[Orca-users] How to get ORCA to use comma as decimalpoint

Jon A. Tankersley jon.tankersley at eds.com
Wed Feb 2 12:23:33 PST 2005


We don't use the winallator patch at all.  We preprocess the Perfmon data to
clean it up somewhat and until last month we had no problems, but Patric
from Canada had the same problem - worse problem actually as this email
thread will illustrate.  Thanks Patrick for the help in making it a bit more
robust.
 
There is a fairly simple fix with some perl regular expressions
    s/([0-9]+),([0-9]+)/\1.\2/g;        # for European comma as decimals
    s/"//g;             # clean up lines eliminate "
    s/, ,/,0,/g;        # clean up lines eliminate , , with ,0,
    s/ /_/g;            # clean up lines eliminate ' ' with '_'
    s/->/_/g;           # clean up lines eliminate -> with '_'
    s/\d\;//g;          # clean up lines eliminate [0-9];
    s/\;_/_/g;          # clean up lines eliminate ;_ with _

==================================
< Saw your post on orca-dev
<
< We are looking at the same setup as you have, could you spare a copy of
perfmon2orca.pl
< so we can see how you handled the conversion?  How is your interaction
with orca doing?

< Cheers,
< Patrick
==================================
>This is the starting template we've used.  It has been modified some since
then.  The biggest problem is how we
> keyed off a specific string to find headings.  It seems that MS, in their
infinite wisdom, or to just make things difficult,
> decided to change the format slightly with various release of their OS.
Then you have the vendor strings for things like
> the network devices.  Orca doesn't like "Compaq Fast Ethernet MultiPort
asdfjlasd asdljasd asdf asdf a asdf asdf asdf
> Nic #1" kind of stuff so we strip a lot of those to something short like
NIC 1.
==================================
>Any luck with what I sent you?
==================================
< Actually no,
<
< Funny thing, I was fiddling around with it when u sent your email
<
< Any idea what might be wrong?
==================================
miscellaneous email and a data file sent
==================================
> Hmmm... I don't think the script speaks French :-)
> Yikes.... comma as decimal too (at least that's what
"9,0653728165969102e-006" looks like....
> That will require some logic changes.  :-(
>
> I'll have to think it over.  Have anything with a little more data to it?
> I've noticed that date isn't set in the Perl script anywhere.... I'm not
sure why (someone may have been 'hacking' on my
> code).
>
> The biggest problem, as the README says, is dealing with all the curves
that Microsoft throws at you.  You basically 
> have to examine the data and see what's in there that might bite you.  The
French isn't much of a problem (though the
> string substitutions that are going on would not necessarily work).  The
internationalization of the numbers... that's a bit
> different.
>
> Out of curiosity, is the comma as decimal typical for Canada or is that an
artifact of the French language setting?
==================================
< Hi jon,
<
< Seems like Windows 2000 and the french language setting likes to use
commas as decimal .. there is no way around it.
<
< Here is a file with a bit more data
<
< Patrick
==================================
> Try this version.
>
> You'll have to deal with the French in the heading.
> Basically the first major section of the script trims out the mostly
useless information (Intel...Ethernet)
> I'm not sure what all of the French means in here, I can read some of it
(I learned Latin), but I don't know all of the
> nuances and idioms (CPU queue length is Longueur de la file du
processeur?)
>
> I'd fix it to trim out things like physique, des, d', etc.  as those are
harder to have Orca match.
>
> The European comma as decimal (it wasn't really just French) is fixed, I
think.
==================================
> did the new script do any better?
==================================
< Hi jon, 

< I`m using orca to graph the output, this is the data file.. I'm not
getting any output tho. 

< It might just be beacause I don't have enough data.. 

< Patrick 

timestamp locltime ~PDH-CSV_4.0~_~Est~~300~
Disque_physique~_Total~_%_Temps_du_disque

Disque_physique~_Total~_%_Temps_écriture_du_disque

Disque_physique~_Total~_%_Temps_lecture_du_disque

Disque_physique~_Total~_Moy._disque_s/écriture

Fichier_d'échange~_H:~_Pourcentage_d'utilisation

Fichier_d'échange~_Total~_Pourcentage_d'utilisation

Interface_réseau~Intel_8255x-based_Integrated_Fast_Ethernet~_Paquets_Unicast

_envoyés/s

Interface_réseau~Intel_8255x-based_Integrated_Fast_Ethernet~_Total_des_octet

s/sec Mémoire_Kilo-octets_disponibles Mémoire_Pages/s
Processeur~_Total~_%_Temps_d'interruption

Processeur~_Total~_%_Temps_Privilégié Processeur~_Total~_%_Temps_processeur

Processeur~0~_%_Temps_d'interruption Processeur~0~_%_Temps_Privilégié
Processeur~0~_%_Temps_processeur Serveur_Total_des_octets/sec
Système_Changements_de_contexte/s Système_Longueur_de_la_file_du_processeur

1106245860 13:31:26.875 01/20/2005_13:31:26.875 1.6423614386274416e-006

1.3859131649934928e-006 2.5644827363394855e-007 0.0013267905003489133

1.226806640625 0.69163929332386365 0.30538883121597643 2659.6939627814986

534424 0.098825049419603114 2.2488927020561716e-006 4.2323592057332202e-006

99.995187385670619 2.2488927020561716e-006 4.2323592057332202e-006

99.995187385670619 3.5139778698793456 226.00364076811505 3 1106246160

13:36:26.879 01/20/2005_13:36:26.879 0.031266266458455996

0.031266266458455996 0 0.00035263124181878999 1.2135823567708335

0.68470348011363635 1.3800679506406748 2971.8663262883379 535316

0.020000984791893838 0.052082666675199896 0.27082986671103942

0.42835785035284513 0.052082666675199896 0.27082986671103942

0.42835785035284513 0 348.99051663882494 6 1106246460 13:41:26.898

01/20/2005_13:41:26.898 0.0075995069135934177 0.0075995069135934177 0

0.00015724209987967553 1.2125651041666665 0.68331631747159094

1.5799362604478024 2722.340172314 535768 0.0033331988617042244

0.057287949595345125 0.36455967924310534 0.62103143832948904

0.057287949595345125 0.36455967924310534 0.62103143832948904

6.676397319993562 331.66995273387886 4 1106246760 13:46:26.902

01/20/2005_13:46:26.902 0.0032666248538685367 0.0032666248538685367 0

0.00017192717304338371 1.2125651041666665 0.68331631747159094

0.89001051489635552 2828.5500841493517 535844 0.0033333727149676235

0.046874400007679902 0.078124000012799844 0.079403983629011687

0.046874400007679902 0.078124000012799844 0.079403983629011687 0

252.07631145128164 5 1106247060 13:51:26.906 01/20/2005_13:51:26.906

0.002799964160458746 0.002799964160458746 0 0.00015848962779263319

1.20849609375 0.68137428977272729 1.0133452326886838 2594.9504715873545

535784 0.0033333724759496176 0.052082666675199896 0.083332266680319816

0.10023705029909014 0.052082666675199896 0.083332266680319816

0.10023705029909014 6.676745069327084 251.91629149741638 3 1106247360

13:56:26.926 01/20/2005_13:56:26.926 0.0047996885770063696

0.0047996885770063696 0 0.00016363811601753853 1.2074788411458335

0.68109685724431823 0.86996487131115852 2800.766906618388 535744

0.0066663974813115593 0.03645596792431053 0.057287949595345125

0.068983924047072431 0.03645596792431053 0.057287949595345125

0.068983924047072431 0 252.1131531469812 3 1106247660 14:01:26.945

01/20/2005_14:01:26.945 0.0029664741899553255 0.0029664741899553255 0

0.0001648150708995034 1.2054443359375 0.6805419921875 0.93329560132313705

2583.9422010146941 535604 0.003333198576154061 0.041663963342069177

0.072911935848621059 0.095023901135860012 0.041663963342069177

0.072911935848621059 0.095023901135860012 6.6763967480365842

290.83490856374641 5 1106247960 14:06:26.965 01/20/2005_14:06:26.965

0.0046996950649854036 0.0046996950649854036 0 0.00015494326056143272

1.2054443359375 0.6805419921875 0.99662651625989107 2862.6980057883275
535640 0.0033331990510364249 0.057287949595345125 0.12499189002620754

0.16272784156672326 0.057287949595345125 0.12499189002620754

0.16272784156672326 0 299.91125101510443 3 1106248260 14:11:26.984

01/20/2005_14:11:26.984 0.0031331300433236025 0.0031331300433236025 0

0.00017091049789339654 1.2054443359375 0.6805419921875 0.86663171049901566

2544.3040404674216 535600 0.0033331988865346754 0.03645596792431053

0.057287949595345125 0.068983924047072431 0.03645596792431053

0.057287949595345125 0.068983924047072431 6.6763973697289547

249.01662241523255 3 1106248560 14:16:27.003 01/20/2005_14:16:27.003

0.0029331430192816705 0.0029331430192816705 0 0.00016296298365667519

1.2054443359375 0.6805419921875 0.95329483538911008 2828.2124518810806

535564 0.0033331987251367483 0.046871958759827831 0.093743917519655662

0.095023901135860012 0.046871958759827831 0.093743917519655662

0.095023901135860012 0 250.20322910366488 3 1106248860 14:21:27.007

01/20/2005_14:21:27.007 0.0030666274138357692 0.0030666274138357692 0

0.00017037133262798817 1.2054443359375 0.6805419921875 0.91667740613071069

2606.6438718389736 535512 0.0033333723859298573 0.062499200010239869

0.098957066682879791 0.11065358363413491 0.062499200010239869

0.098957066682879791 0.11065358363413491 6.6767448890175043

249.54292355548097 3 1106249160 14:26:27.011 01/20/2005_14:26:27.011

0.75839029260425461 0.65092500149331423 0.10746529111094044

0.0028466470364755178 1.1983235677083335 0.67665793678977271

1.2133475405691461 2989.8450084634933 535120 0.97667810271087852

0.052082666675199896 0.16666453336063963 0.1939858503144487

0.052082666675199896 0.16666453336063963 0.1939858503144487 0

267.43646477984225 3 1106249460 14:31:27.031 01/20/2005_14:31:27.031

0.0028664806779343595 0.0028664806779343595 0 0.00015925880917101869

1.1983235677083335 0.67665793678977271 0.87329810501929594

2631.2005256389007 535088 0.0033331988741194499 0.052079954177586478

0.10415990835517296 0.10543989197138171 0.052079954177586478

0.10415990835517296 0.10543989197138171 6.6763973448612584 252.5698114875272

4

==================================
> The data looks 'good', so it may be the Orca config. Can you send that?

> As I said that will be the tricky part, the Orca.cfg file will need to be
written to match the names in the 'heading' line

>  (timestamp).

==================================
large config file passes hands
==================================
> Yep... It is a config problem. That is a UNIX config.

> Try this one. You may need to edit it again to fix the specific French
'accented e'.

> You should get at least one graph out of this though.

> If the titles are too wide, the script will need to be edit to strip more
out of the names (like the long Intel....Ethernet)

> string.

==================================
> Any luck?

==================================
=========
miscellaneous email about find_files
=========
==================================
> I guess you figured out the name problem.

> The 'messages' about bareword you get a lot (with the right level of
debugging in the orca command). That's because of

> the way Blair wrote the perl code. The only ones that will not generate
the message are the ones trying to pattern match

> using Perl regular expressions, or at least that's what I've seen when I
looked into it.

> Did any PNG's get created (look in the html directory)?

> The signal INT could be a different issue. We don't run Orca as a
daemon/server. We run it 'orca -o whatever.cfg' every

>  time we update the files - there is a memory leak in the code somewhere
that I've not been able to properly run down,

> so we just run it with -o.

> This works well for us because we don't try to keep the rrd/graphs up to
date beyond an hourly interval on some or a

>  daily interval on others.

> The messages are all from the plot command structures, it is using the
'string' defined in that to pattern match the

> 'heading' line (timestamp line) of the perfmon/percol file.

> There are >20 plots defined in that config I sent you. I added a few to
the bottom trying to get the wording properly for

> your heading line. You could delete most of them and limit the messages
output.

==================================
< Sadly, no pngs.. Maybe not enough data? 

==================================
> Typo on my part... Find in the Perfmon.cfg file the string test and make
it tets.
> Change the rrd entry to be something like rrds instead of .
>
> It only found the one metric, so the spelling is off in the Perfmon file
somewhat (that accented e, etc.)
>
> Here is what I get:
>
> hostname % ls -lR
.:
total 154
drwxrwsr-x   3 testuser testgroup         1536 Jan 21 14:22 html/
drwxrwsr-x   2 testuser testgroup          512 Jan 21 14:19 nt/
-rw-rw-r--   1 testuser testgroup         1027 Jan 21 14:22 orca.state
-rw-rw-r--   1 testuser testgroup        13930 Jan 21 14:22 Perfmon.cfg
drwxrwsr-x   3 testuser testgroup          512 Jan 21 14:22 rrd/
 
./html:
total 214
-rw-rw-r--   1 testuser testgroup         5774 Jan 21 14:22 index.html
drwxr-sr-x   2 testuser testgroup         1024 Jan 21 14:22 nt/
-rw-rw-r--   1 testuser testgroup         2252 Jan 21 14:22 orca_logo.gif
-rw-rw-r--   1 testuser testgroup         6908 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-all.html
-rw-rw-r--   1 testuser testgroup         5795 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-daily.html
-rw-rw-r--   1 testuser testgroup         5800 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-hourly.html
-rw-rw-r--   1 testuser testgroup         5805 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-monthly.html
-rw-rw-r--   1 testuser testgroup         5815 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-quarterly.html
-rw-rw-r--   1 testuser testgroup         5800 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-weekly.html
-rw-rw-r--   1 testuser testgroup         5800 Jan 21 14:22
perfmon_gauge_Serveur_Total_des_octets_per_sec-yearly.html
-rw-rw-r--   1 testuser testgroup         6433 Jan 21 14:22
perfmon_nt-all.html
-rw-rw-r--   1 testuser testgroup         5311 Jan 21 14:22
perfmon_nt-daily.html
-rw-rw-r--   1 testuser testgroup         5316 Jan 21 14:22
perfmon_nt-hourly.html
-rw-rw-r--   1 testuser testgroup         5321 Jan 21 14:22
perfmon_nt-monthly.html
-rw-rw-r--   1 testuser testgroup         5331 Jan 21 14:22
perfmon_nt-quarterly.html
-rw-rw-r--   1 testuser testgroup         5316 Jan 21 14:22
perfmon_nt-weekly.html
-rw-rw-r--   1 testuser testgroup         5316 Jan 21 14:22
perfmon_nt-yearly.html
-rw-rw-r--   1 testuser testgroup         5781 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec.html
-rw-rw-r--   1 testuser testgroup         2439 Jan 21 14:22
rothschild_image_logo.png
-rw-rw-r--   1 testuser testgroup         1761 Jan 21 14:22 rrdtool_logo.gif
 
./html/nt:
total 60
-rw-rw-r--   1 testuser testgroup         3567 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-daily.png
-rw-rw-r--   1 testuser testgroup           39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-daily.png.meta
-rw-rw-r--   1 testuser testgroup         3981 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-hourly.png
-rw-rw-r--   1 testuser testgroup           39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-hourly.png.meta
-rw-rw-r--   1 testuser testgroup         3560 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-monthly.png
-rw-rw-r--   1 testuser testgroup           39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-monthly.png.meta
-rw-rw-r--   1 testuser testgroup         3577 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-quarterly.png
-rw-rw-r--   1 testuser testgroup           39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-quarterly.png.meta
-rw-rw-r--   1 testuser testgroup         3564 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-weekly.png
-rw-rw-r--   1 testuser testgroup           39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-weekly.png.meta
-rw-rw-r--   1 testuser testgroup         3691 Jan 20 13:31
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-yearly.png
-rw-rw-r--   1 testuser testgroup           39 Jan 21 14:22
perfmon_nt_gauge_Serveur_Total_des_octets_per_sec-yearly.png.meta
 
./nt:
total 12
-rwxrwxr--   1 testuser testgroup         5795 Jan 21 14:18
perfmon-2005-01-20*
 
./rrd:
total 2
drwxr-sr-x   2 testuser testgroup          512 Jan 21 14:22 perfmon_nt/
 
./rrd/perfmon_nt:
total 74
-rw-rw-r--   1 testuser testgroup        37828 Jan 21 14:22
gauge_Serveur_Total_des_octets_per_sec.rrd
 
==================================
< works for 1 of them ... indeed the é causes some problems ... maybe
remplace the é with e in the perfmon2orca.pl ?

==================================
> You basically have two options, either of which should work (unless Perl
is picky) You can have perfmon2percol change

> é to e and use the e in the Perfmon.cfg Or You can edit the Perfmon.cfg to
have the é in the text and let the pattern

> match find things.

> It depends on what you want to do. The presentation of the reports, if it
is to be in French would be better served by

>  fixing the Perfmon.cfg file. You have to either wildcard the missing
information (using Perl regular expressions) or match

> it exactly in the plot data lines. The rest of the plot stuff you can edit
as you basically see fit.

> One thing to note the hrule is new to Orca, your copy may or may not have
it (it basically puts a horizontal line across

> the graph at the value specified - handy for percentage graphs - rrdtool
already had it, Blair didn't originally include it in

> Orca, but he accepted some patches for it).

> Title and legend lines are all your own words. The only 'strangeness' you
should see is the subsitution on those lines

> Title - %g - system name from the appropriate find_files pattern match
Legend - $1 - matches the first (...) expression in

> the data record. $2 would be the second expression.

==================================
< Thanks for the help, basically I will have to replace é by e and è by e as
well .. Fixing the perfmon file gives screwed

< html files names (notice the square char)

==================================

Jon A. Tankersley 
EDS - ITO-SD/US Capacity and Performance 
MS 401 
4000 North Mingo Road 
Tulsa, Ok 74116 
  
( Phone:+1-918-939-4820 (8-639-4820) 
+ mailto:jon.tankersley at eds.com 

 


  _____  

From: orca-users-bounces+jon.tankersley=eds.com at orcaware.com
[mailto:orca-users-bounces+jon.tankersley=eds.com at orcaware.com] On Behalf Of
mian at vip.cybercity.dk
Sent: Wednesday, February 02, 2005 2:02 AM
To: orca-users at orcaware.com; orca-dev at orcaware.com
Subject: [Orca-users] How to get ORCA to use comma as decimalpoint



Hello All 

I have just installed the ORCA snapshot r411 and patched with the winallator

patch. 

My problem is that our Windows machines perfmon is using a comma(,) as 
decimalpoint and therefore I can't get ORCA to load the data. 

I can somebody tell me where I should make the substistution comma(,) to 
point(.). 

I have tried to look at the Sourcefile.pm and figure it out, without luck. 

Idea's/suggestions will greatly appreciated 

Regards 
Michael 

-- 
Cybercity Webhosting (http://www.cybercity.dk) 

_______________________________________________ 
Orca-users mailing list 
Orca-users at orcaware.com 
http://www.orcaware.com/mailman/listinfo/orca-users 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: </pipermail/orca-users/attachments/20050202/ef5ad1fa/attachment.html>


More information about the Orca-users mailing list