2014-02-19

Export SAP Text object to MySQL

Extracting text objects from SAP with RFC_READ_TEXT.
First start transaction SE75


Press display for a list of objects:

Lets pretend we are interested in text object VBBK. Scroll down to VBBK and double click on it.

Now we get a list of text ids for VBBK
Lets say we are interested in Shipping marks to be printed.

Oki we have all info we need. Lets test it out.

We fire up SE37 (test RFC function RFC_READ_TEXT)




and we have a result.

Now we transcribe this into ITL
Now we give this schedule a spin.

And here we have the result table TEXT_LINES in MySQL.

2014-02-18

The new processors and pop up ads

I just checked what impact the new Data Warehouse processors have had. I compared  the ETL-jobs we run in the Data Warehouse the week before and after the processor replacement. Duration (in wall clock time) dropped by 10 to 50 percent. It came as a surprise, I didn’t expect such a dramatic improvement. The jobs that thrives the best from the new processors are the jobs who spread out the work on parallel threads, that was no surprise though, since we increased the total server cores from 8 to 32 (including hyper-threading). The improvement is dramatic. When you need better performance, prop up the hardware before you start to optimize software :))
     
I just found out ads are popping up in my blog posts when I mention Intel processors in the heading. This is nothing I have asked for, but I do not mind as long as the ads are in line with my views on the world and my posts. I’m grateful for my ‘free’ blog and I realize someone has to pay in the end. As you can see I’m still happy.

2014-02-11

The Data Warehouse's new Intel E5 V2 Processors

In a previous post I wrote about problems with the new infrastructure in the Data Warehouse, I had simply miscalculated the need for processor power. The original Intel XEON E5-2609 props were too weak. The virtual server that suffered the most was the ETL server, as you saw in the previous post the cpu consumption was high, even though we gave the ETL serve access to all four cores in the original prop the cpu consumption was a bit too high for my taste. Now we have replaced the old processor with a XEON E5-2670 v2 and gave the ETL server ten cores or threads. I think you can spot when we replaced the processor.


We could have used a somewhat simpler processor but the price difference was not big enough to consider a downgrade from XEON E5-2670 V2. The next image is the CPU utilization for the physical server hosting the ETL server. The time of replacement is equally evident here. From looking at those pictures you see a quite significant overhead for running the physical server, (I may interpret the figures wrongly).



While we replaced the processor of the physical application server, we decide to replace the processor for the database server as well. We choose a simpler six core processor XEON E5-2630 V2, which I think is perfect for the task. You see the effect of the replacement on the next image, it is as clear as the previous images.


This last replacement was not strictly necessary but the extra cost of updating this server was small. We want bios, firmware etc. to be the same version, the actual replacement was done in less than 30 minutes. But we struggled with the bios and firmware upgrade. I recommend Dell to invest in a software refresh, we actually struggled quite a lot before we had the bios and firmware updated. Otherwise these servers are great.


But what does these servers do?

For you who have missed it you can look at one day’s activity here, the video is boring I know, I been told I miss the ‘15 seconds’ generation completely. I suspect I miss everyone, but still it is a day’s night activity of the data warehouse.


p.s.

The pictures above are from Mathias Kettner's  check-MK built on top of Nagios. Really neat.

2014-02-09

PHP 5.6, SAPRFC & SAPNWRFC


I just compiled PHP 5.6 alpha1 and the SAP connectors SAPRFC and SAPNWRFC with no problems at all. Thank you:

In production we soon will upgrade to PHP 5.5.9 .

I will play around with the 5.6 bundled PHPDBG debugger. I didn’t know there was such a thing. This will actually be exciting. I’m not used to work with debuggers, it’s kind of weird since a debugger is such a nice tool.