[Orca-dev] RE: [Orca-users] How to get ORCA to use comma as decimalpoint
Jon A. Tankersley
jon.tankersley at eds.com
Wed Feb 2 12:23:33 PST 2005
We don't use the winallator patch at all. We preprocess the Perfmon data to
clean it up somewhat and until last month we had no problems, but Patric
from Canada had the same problem - worse problem actually as this email
thread will illustrate. Thanks Patrick for the help in making it a bit more
robust.
There is a fairly simple fix with some perl regular expressions
s/([0-9]+),([0-9]+)/\1.\2/g; # for European comma as decimals
s/"//g; # clean up lines eliminate "
s/, ,/,0,/g; # clean up lines eliminate , , with ,0,
s/ /_/g; # clean up lines eliminate ' ' with '_'
s/->/_/g; # clean up lines eliminate -> with '_'
s/\d\;//g; # clean up lines eliminate [0-9];
s/\;_/_/g; # clean up lines eliminate ;_ with _
==================================
< Saw your post on orca-dev
<
< We are looking at the same setup as you have, could you spare a copy of
perfmon2orca.pl
< so we can see how you handled the conversion? How is your interaction
with orca doing?
< Cheers,
< Patrick
==================================
>This is the starting template we've used. It has been modified some since
then. The biggest problem is how we
> keyed off a specific string to find headings. It seems that MS, in their
infinite wisdom, or to just make things difficult,
> decided to change the format slightly with various release of their OS.
Then you have the vendor strings for things like
> the network devices. Orca doesn't like "Compaq Fast Ethernet MultiPort
asdfjlasd asdljasd asdf asdf a asdf asdf asdf
> Nic #1" kind of stuff so we strip a lot of those to something short like
NIC 1.
==================================
>Any luck with what I sent you?
==================================
< Actually no,
<
< Funny thing, I was fiddling around with it when u sent your email
<
< Any idea what might be wrong?
==================================
miscellaneous email and a data file sent
==================================
> Hmmm... I don't think the script speaks French :-)
> Yikes.... comma as decimal too (at least that's what
"9,0653728165969102e-006" looks like....
> That will require some logic changes. :-(
>
> I'll have to think it over. Have anything with a little more data to it?
> I've noticed that date isn't set in the Perl script anywhere.... I'm not
sure why (someone may have been 'hacking' on my
> code).
>
> The biggest problem, as the README says, is dealing with all the curves
that Microsoft throws at you. You basically
> have to examine the data and see what's in there that might bite you. The
French isn't much of a problem (though the
> string substitutions that are going on would not necessarily work). The
internationalization of the numbers... that's a bit
> different.
>
> Out of curiosity, is the comma as decimal typical for Canada or is that an
artifact of the French language setting?
==================================
< Hi jon,
<
< Seems like Windows 2000 and the french language setting likes to use
commas as decimal .. there is no way around it.
<
< Here is a file with a bit more data
<
< Patrick
==================================
> Try this version.
>
> You'll have to deal with the French in the heading.
> Basically the first major section of the script trims out the mostly
useless information (Intel...Ethernet)
> I'm not sure what all of the French means in here, I can read some of it
(I learned Latin), but I don't know all of the
> nuances and idioms (CPU queue length is Longueur de la file du
processeur?)
>
> I'd fix it to trim out things like physique, des, d', etc. as those are
harder to have Orca match.
>
> The European comma as decimal (it wasn't really just French) is fixed, I
think.
==================================
> did the new script do any better?
==================================
< Hi jon,
< I`m using orca to graph the output, this is the data file.. I'm not
getting any output tho.
< It might just be beacause I don't have enough data..
< Patrick
timestamp locltime ~PDH-CSV_4.0~_~Est~~300~
Disque_physique~_Total~_%_Temps_du_disque
Disque_physique~_Total~_%_Temps_écriture_du_disque
Disque_physique~_Total~_%_Temps_lecture_du_disque
Disque_physique~_Total~_Moy._disque_s/écriture
Fichier_d'échange~_H:~_Pourcentage_d'utilisation
Fichier_d'échange~_Total~_Pourcentage_d'utilisation
Interface_réseau~Intel_8255x-based_Integrated_Fast_Ethernet~_Paquets_Unicast
_envoyés/s
Interface_réseau~Intel_8255x-based_Integrated_Fast_Ethernet~_Total_des_octet
s/sec Mémoire_Kilo-octets_disponibles Mémoire_Pages/s
Processeur~_Total~_%_Temps_d'interruption
Processeur~_Total~_%_Temps_Privilégié Processeur~_Total~_%_Temps_processeur
Processeur~0~_%_Temps_d'interruption Processeur~0~_%_Temps_Privilégié
Processeur~0~_%_Temps_processeur Serveur_Total_des_octets/sec
Système_Changements_de_contexte/s Système_Longueur_de_la_file_du_processeur
1106245860 13:31:26.875 01/20/2005_13:31:26.875 1.6423614386274416e-006
1.3859131649934928e-006 2.5644827363394855e-007 0.0013267905003489133
1.226806640625 0.69163929332386365 0.30538883121597643 2659.6939627814986
534424 0.098825049419603114 2.2488927020561716e-006 4.2323592057332202e-006
99.995187385670619 2.2488927020561716e-006 4.2323592057332202e-006
99.995187385670619 3.5139778698793456 226.00364076811505 3 1106246160
13:36:26.879 01/20/2005_13:36:26.879 0.031266266458455996
0.031266266458455996 0 0.00035263124181878999 1.2135823567708335
0.68470348011363635 1.3800679506406748 2971.8663262883379 535316
0.020000984791893838 0.052082666675199896 0.27082986671103942
0.42835785035284513 0.052082666675199896 0.27082986671103942
0.42835785035284513 0 348.99051663882494 6 1106246460 13:41:26.898
01/20/2005_13:41:26.898 0.0075995069135934177 0.0075995069135934177 0
0.00015724209987967553 1.2125651041666665 0.68331631747159094
1.5799362604478024 2722.340172314 535768 0.0033331988617042244
0.057287949595345125 0.36455967924310534 0.62103143832948904
0.057287949595345125 0.36455967924310534 0.62103143832948904
6.676397319993562 331.66995273387886 4 1106246760 13:46:26.902
01/20/2005_13:46:26.902 0.0032666248538685367 0.0032666248538685367 0
0.00017192717304338371 1.2125651041666665 0.68331631747159094
0.89001051489635552 2828.5500841493517 535844 0.0033333727149676235
0.046874400007679902 0.078124000012799844 0.079403983629011687
0.046874400007679902 0.078124000012799844 0.079403983629011687 0
252.07631145128164 5 1106247060 13:51:26.906 01/20/2005_13:51:26.906
0.002799964160458746 0.002799964160458746 0 0.00015848962779263319
1.20849609375 0.68137428977272729 1.0133452326886838 2594.9504715873545
535784 0.0033333724759496176 0.052082666675199896 0.083332266680319816
0.10023705029909014 0.052082666675199896 0.083332266680319816
0.10023705029909014 6.676745069327084 251.91629149741638 3 1106247360
13:56:26.926 01/20/2005_13:56:26.926 0.0047996885770063696
0.0047996885770063696 0 0.00016363811601753853 1.2074788411458335
0.68109685724431823 0.86996487131115852 2800.766906618388 535744
0.0066663974813115593 0.03645596792431053 0.057287949595345125
0.068983924047072431 0.03645596792431053 0.057287949595345125
0.068983924047072431 0 252.1131531469812 3 1106247660 14:01:26.945
01/20/2005_14:01:26.945 0.0029664741899553255 0.0029664741899553255 0
0.0001648150708995034 1.2054443359375 0.6805419921875 0.93329560132313705
2583.9422010146941 535604 0.003333198576154061 0.041663963342069177
0.072911935848621059 0.095023901135860012 0.041663963342069177
0.072911935848621059 0.095023901135860012 6.6763967480365842
290.83490856374641 5 1106247960 14:06:26.965 01/20/2005_14:06:26.965
0.0046996950649854036 0.0046996950649854036 0 0.00015494326056143272
1.2054443359375 0.6805419921875 0.99662651625989107 2862.6980057883275
535640 0.0033331990510364249 0.057287949595345125 0.12499189002620754
0.16272784156672326 0.057287949595345125 0.12499189002620754
0.16272784156672326 0 299.91125101510443 3 1106248260 14:11:26.984
01/20/2005_14:11:26.984 0.0031331300433236025 0.0031331300433236025 0
0.00017091049789339654 1.2054443359375 0.6805419921875 0.86663171049901566
2544.3040404674216 535600 0.0033331988865346754 0.03645596792431053
0.057287949595345125 0.068983924047072431 0.03645596792431053
0.057287949595345125 0.068983924047072431 6.6763973697289547
249.01662241523255 3 1106248560 14:16:27.003 01/20/2005_14:16:27.003
0.0029331430192816705 0.0029331430192816705 0 0.00016296298365667519
1.2054443359375 0.6805419921875 0.95329483538911008 2828.2124518810806
535564 0.0033331987251367483 0.046871958759827831 0.093743917519655662
0.095023901135860012 0.046871958759827831 0.093743917519655662
0.095023901135860012 0 250.20322910366488 3 1106248860 14:21:27.007
01/20/2005_14:21:27.007 0.0030666274138357692 0.0030666274138357692 0
0.00017037133262798817 1.2054443359375 0.6805419921875 0.91667740613071069
2606.6438718389736 535512 0.0033333723859298573 0.062499200010239869
0.098957066682879791 0.11065358363413491 0.062499200010239869
0.098957066682879791 0.11065358363413491 6.6767448890175043
249.54292355548097 3 1106249160 14:26:27.011 01/20/2005_14:26:27.011
0.75839029260425461 0.65092500149331423 0.10746529111094044
0.0028466470364755178 1.1983235677083335 0.67665793678977271
1.2133475405691461 2989.8450084634933 535120 0.97667810271087852
0.052082666675199896 0.16666453336063963 0.1939858503144487
0.052082666675199896 0.16666453336063963 0.1939858503144487 0
267.43646477984225 3 1106249460 14:31:27.031 01/20/2005_14:31:27.031
0.0028664806779343595 0.0028664806779343595 0 0.00015925880917101869
1.1983235677083335 0.67665793678977271 0.87329810501929594
2631.2005256389007 535088 0.0033331988741194499 0.052079954177586478
0.10415990835517296 0.10543989197138171 0.052079954177586478
0.10415990835517296 0.10543989197138171 6.6763973448612584 252.5698114875272
4
==================================
> The data looks 'good', so it may be the Orca config. Can you send that?
> As I said that will be the tricky part, the Orca.cfg file will need to be
written to match the names in the 'heading' line
> (timestamp).
==================================
large config file passes hands
==================================
> Yep... It is a config problem. That is a UNIX config.
> Try this one. You may need to edit it again to fix the specific French
'accented e'.
> You should get at least one graph out of this though.
> If the titles are too wide, the script will need to be edit to strip more
out of the names (like the long Intel....Ethernet)
> string.
==================================
> Any luck?
==================================
=========
miscellaneous email about find_files
=========
==================================
> I guess you figured out the name problem.
> The 'messages' about bareword you get a lot (with the right level of
debugging in the orca command). That's because of
> the way Blair wrote the perl code. The only ones that will not generate
the message are the ones trying to pattern match
> using Perl regular expressions, or at least that's what I've seen when I
looked into it.
> Did any PNG's get created (look in the html directory)?
> The signal INT could be a different issue. We don't run Orca as a
daemon/server. We run it 'orca -o whatever.cfg' every
> time we update the files - there is a memory leak in the code somewhere
that I've not been able to properly run down,
> so we just run it with -o.
> This works well for us because we don't try to keep the rrd/graphs up to
date beyond an hourly interval on some or a
> daily interval on others.
> The messages are all from the plot command structures, it is using the
'string' defined in that to pattern match the
> 'heading' line (timestamp line) of the perfmon/percol file.
> There are >20 plots defined in that config I sent you. I added a few to
the bottom trying to get the wording properly for
> your heading line. You could delete most of them and limit the messages
output.
==================================
< Sadly, no pngs.. Maybe not enough data?
==================================
> Typo on my part... Find in the Perfmon.cfg file the string test and make
it tets.
> Change the rrd entry to be something like rrds instead of .
>
> It only found the one metric, so the spelling is off in the Perfmon file
somewhat (that accented e, etc.)
>
> Here is what I get:
>
> hostname % ls -lR
.:
total 154
drwxrwsr-x 3 testuser testgroup 1536 Jan 21 14:22 html/
drwxrwsr-x 2 testuser testgroup 512 Jan 21 14:19 nt/
-rw-rw-r-- 1 testuser testgroup 1027 Jan 21 14:22 orca.state
-rw-rw-r-- 1 testuser testgroup 13930 Jan 21 14:22 Perfmon.cfg
drwxrwsr-x 3 testuser testgroup 512 Jan 21 14:22 rrd/
./html:
total 214
-rw-rw-r-- 1 testuser testgroup 5774 Jan 21 14:22 index.html
drwxr-sr-x 2 testuser testgroup 1024 Jan 21 14:22 nt/
-rw-rw-r-- 1 testuser testgroup 2252 Jan 21 14:22 orca_logo.gif
-rw-rw-r-- 1 testuser testgroup 6908 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-all.html
-rw-rw-r-- 1 testuser testgroup 5795 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-daily.html
-rw-rw-r-- 1 testuser testgroup 5800 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-hourly.html
-rw-rw-r-- 1 testuser testgroup 5805 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-monthly.html
-rw-rw-r-- 1 testuser testgroup 5815 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-quarterly.html
-rw-rw-r-- 1 testuser testgroup 5800 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-weekly.html
-rw-rw-r-- 1 testuser testgroup 5800 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-yearly.html
-rw-rw-r-- 1 testuser testgroup 6433 Jan 21 14:22
perfmon_nt-all.html
-rw-rw-r-- 1 testuser testgroup 5311 Jan 21 14:22
perfmon_nt-daily.html
-rw-rw-r-- 1 testuser testgroup 5316 Jan 21 14:22
perfmon_nt-hourly.html
-rw-rw-r-- 1 testuser testgroup 5321 Jan 21 14:22
perfmon_nt-monthly.html
-rw-rw-r-- 1 testuser testgroup 5331 Jan 21 14:22
perfmon_nt-quarterly.html
-rw-rw-r-- 1 testuser testgroup 5316 Jan 21 14:22
perfmon_nt-weekly.html
-rw-rw-r-- 1 testuser testgroup 5316 Jan 21 14:22
perfmon_nt-yearly.html
-rw-rw-r-- 1 testuser testgroup 5781 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec.html
-rw-rw-r-- 1 testuser testgroup 2439 Jan 21 14:22
rothschild_image_logo.png
-rw-rw-r-- 1 testuser testgroup 1761 Jan 21 14:22 rrdtool_logo.gif
./html/nt:
total 60
-rw-rw-r-- 1 testuser testgroup 3567 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-daily.png
-rw-rw-r-- 1 testuser testgroup 39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-daily.png.meta
-rw-rw-r-- 1 testuser testgroup 3981 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-hourly.png
-rw-rw-r-- 1 testuser testgroup 39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-hourly.png.meta
-rw-rw-r-- 1 testuser testgroup 3560 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-monthly.png
-rw-rw-r-- 1 testuser testgroup 39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-monthly.png.meta
-rw-rw-r-- 1 testuser testgroup 3577 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-quarterly.png
-rw-rw-r-- 1 testuser testgroup 39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-quarterly.png.meta
-rw-rw-r-- 1 testuser testgroup 3564 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-weekly.png
-rw-rw-r-- 1 testuser testgroup 39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-weekly.png.meta
-rw-rw-r-- 1 testuser testgroup 3691 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-yearly.png
-rw-rw-r-- 1 testuser testgroup 39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-yearly.png.meta
./nt:
total 12
-rwxrwxr-- 1 testuser testgroup 5795 Jan 21 14:18
perfmon-2005-01-20*
./rrd:
total 2
drwxr-sr-x 2 testuser testgroup 512 Jan 21 14:22 perfmon_nt/
./rrd/perfmon_nt:
total 74
-rw-rw-r-- 1 testuser testgroup 37828 Jan 21 14:22
gauge_Serveur_Total_des_octets_per_sec.rrd
==================================
< works for 1 of them ... indeed the é causes some problems ... maybe
remplace the é with e in the perfmon2orca.pl ?
==================================
> You basically have two options, either of which should work (unless Perl
is picky) You can have perfmon2percol change
> é to e and use the e in the Perfmon.cfg Or You can edit the Perfmon.cfg to
have the é in the text and let the pattern
> match find things.
> It depends on what you want to do. The presentation of the reports, if it
is to be in French would be better served by
> fixing the Perfmon.cfg file. You have to either wildcard the missing
information (using Perl regular expressions) or match
> it exactly in the plot data lines. The rest of the plot stuff you can edit
as you basically see fit.
> One thing to note the hrule is new to Orca, your copy may or may not have
it (it basically puts a horizontal line across
> the graph at the value specified - handy for percentage graphs - rrdtool
already had it, Blair didn't originally include it in
> Orca, but he accepted some patches for it).
> Title and legend lines are all your own words. The only 'strangeness' you
should see is the subsitution on those lines
> Title - %g - system name from the appropriate find_files pattern match
Legend - $1 - matches the first (...) expression in
> the data record. $2 would be the second expression.
==================================
< Thanks for the help, basically I will have to replace é by e and è by e as
well .. Fixing the perfmon file gives screwed
< html files names (notice the square char)
==================================
Jon A. Tankersley
EDS - ITO-SD/US Capacity and Performance
MS 401
4000 North Mingo Road
Tulsa, Ok 74116
( Phone:+1-918-939-4820 (8-639-4820)
+ mailto:jon.tankersley at eds.com
_____
From: orca-users-bounces+jon.tankersley=eds.com at orcaware.com
[mailto:orca-users-bounces+jon.tankersley=eds.com at orcaware.com] On Behalf Of
mian at vip.cybercity.dk
Sent: Wednesday, February 02, 2005 2:02 AM
To: orca-users at orcaware.com; orca-dev at orcaware.com
Subject: [Orca-users] How to get ORCA to use comma as decimalpoint
Hello All
I have just installed the ORCA snapshot r411 and patched with the winallator
patch.
My problem is that our Windows machines perfmon is using a comma(,) as
decimalpoint and therefore I can't get ORCA to load the data.
I can somebody tell me where I should make the substistution comma(,) to
point(.).
I have tried to look at the Sourcefile.pm and figure it out, without luck.
Idea's/suggestions will greatly appreciated
Regards
Michael
--
Cybercity Webhosting (http://www.cybercity.dk)
_______________________________________________
Orca-users mailing list
Orca-users at orcaware.com
http://www.orcaware.com/mailman/listinfo/orca-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: /pipermail/orca-dev/attachments/20050202/ef5ad1fa/attachment.htm
More information about the Orca-dev
mailing list