[Orca-dev] Re: Is unzipping the percol files during every run necessary

[Jones, Chris]

Sounds like it's worth a try........ I'm working on a couple of other approaches currently but will add this to my list for testing :-)

Cheers,
Chris.

-----Original Message-----
From: Blair Zajac [mailto:blair at orcaware.com]
Sent: 15 February 2003 02:06
To: kim.taylor at pncbank.com
Cc: orca-dev at orcaware.com
Subject: Re: [Orca-dev] Re: Is unzipping the percol files during every
run necessary


kim.taylor at pncbank.com wrote:
> 
> On Friday, February 14, 2003, Chris Jones wrote:
> 
> >I have a problem with the time it's currently taking to process
> >collected data..........
> 
> >Surely we could speed things up by moving the old percol files into an
> archive directory after each invocation (-o -v).
> >Is this possible?? Do we really need to unzip everything each time or
> should the RRD files contain the relevant
> >historical data and thus only need updating with newly collected
> information?
> 
> I've been thinking hard about the same problem, having about 3 years of
> data from upwards of 40 systems.
> 
> It seems at end of day, all of a FILE is already loaded into RRD with the
> exception of the lag time in the loop (~20min in my case.)
> The only value of processing any FILE.gz then is to pick up the last few
> entries missed as the original FILE was close and compressed.
> 
> What if the compression were simply delayed long enough to have thoe
> original FILE processed?
> Something like setting COMPRESSOR="slowgzip.sh" in the
> /etc/init.d/orcallator startup script might do it where:
> 
> -- slowgzip.sh --
> (sleep 3600; gzip -9 $1) &
> 
> Then remove all compression extentions (*.gz and what not) from
> orcallator.cfg and trust your data collector to have FILE available and
> processed before it "disapears".
> 

That's a good idea.  It may take more than an hour for Orca to read
the data if there are a large number of source files being read, so
3600 could be increased.

Let me know how it works.

Best,
Blair

-- 
Blair Zajac <blair at orcaware.com>
Plots of your system's performance - http://www.orcaware.com/orca/
_______________________________________________
Orca-dev mailing list
Orca-dev at orcaware.com
http://www.orcaware.com/mailman/listinfo/orca-dev

This message is for the named person's use only. It may contain sensitive and private proprietary or legally privileged information. No confidentiality or privilege is waived or lost by any mistransmission. If you are not the intended recipient, please immediately delete it and all copies of it from your system, destroy any hard copies of it and notify the sender. You must not, directly or indirectly, use, disclose, distribute, print, or copy any part of this message if you are not the intended recipient. CREDIT SUISSE GROUP and each legal entity in the CREDIT SUISSE FIRST BOSTON or CREDIT SUISSE ASSET MANAGEMENT business units of CREDIT SUISSE FIRST BOSTON reserve the right to monitor all e-mail communications through its networks. Any views expressed in this message are those of the individual sender, except where the message states otherwise and the sender is authorized to state them to be the views of any such entity.
Unless otherwise stated, any pricing information given in this message is indicative  only, is subject to change and does not constitute an offer to deal at any price quoted. Any reference to the terms of executed transactions should be treated as  preliminary only and subject to our formal written confirmation.