[Orca-users] Re: Updating Orca graphs at longer intervals

[pearcec at commnav.com]

How can we get this process to run faster?  It is way to slow for the
5 machines to take 3+ minutes.  I will be happy to try and generate
some code to speed up the process.

Christian

--- In orca-users at y..., Blair Zajac <blair at a...> wrote:
> Loading data from the percol-* files and loading them into the RRD
> files is the most time consuming part.  Orca creates a number of
> anonymous subroutines to load the data and then feed it into the
> RRD files.
>
> Regarding the lazy option, Orca will only generate the image (GIF or
> PNG) files if there is new data to plot, so I don't see the need for
> the RRD lazy option.
>
> Having a demand driven image cache would be cool.
>
> Regards,
> Blair
>
> pearcec at c... wrote:
> >
> > I am running into a similiar problem.  I have five machines I am
> > pushing orcallator date from.   I am running with the -o and -r
> > switch.  It is still taking
> >
> > Current running time is 3:04 minutes.
> >
> > real    3m4.583s
> > user    2m51.490s
> > sys     0m4.160s
> >
> > between runs.  When I tell it to run the graphing and the html
> > generation (ie no -r), the impact is minimal.  It seems the data
> > gathering and rrd insertion is time consuming.  Is there a rookie
> > mistake I could be making.
> >
> > As far as making graph generation more efficient, it doesn't look
like
> > you orca makes use of the "lazy" switch that RRDtool provides.  I
> > haven't had a lot of time with the code but it might be easy to
hack
> > it into Orca/ImageFile::_update_graph_options.
> >
> >   if ($opt_use_lazy) {
> >     push(@options, '-z');
> >   }
> >
> > Then add this to orca.
> >   elsif ($arg eq '-o') {
> >     $opt_use_lazy = 1;
> >
> > the Orca/Constats.pm's file needs updating too.  If you guys think
> > this is a good idea, I could hack it together and generate some
> > patches.  I am more concerned with the inputing of data into RRD.
I
> > feel it isn't very fast.  Maybe I should move over to the
developers
> > list.
> >
> > The other options, though I am sure you guys don't want to do
this, is
> > to write a CGI script that will generate the the graphs
dynamically.
> > (IE only when needed) Then store it in a cache for later hits.  I
> > might be able to help with this, the company I work for may allow
me
> > to build it and release it to orca, but it has to help use
accomplish
> > what we are trying to do.  Right now I am convice the data
updating is
> > the problem.
> >
> > --
> > Christian Pearce
> > http://pearcec.fast.net/
> >
> > --- In orca-users at y..., Blair Zajac <blair at a...> wrote:
> > > Hello David,
> > >
> > > Currently there is no way to do what you're looking for except
by
> > > the method you use with -o -r and then -o command line options.
> > >
> > > It wouldn't be too hard, and I would appreciate the patches, to
take
> > > some of the code that implements the find_times parameter, such
as
> > the
> > > time parsing, and use it to regenerate the images after a
specific
> > > time.  If you choose to take on this mission :), I'll send you
the
> > > latest Orca beta version to work with.  I think naming the new
> > > parameter "generate_plot_times" would be a good fit with some
new
> > > parameters in the next Orca release.
> > >
> > > Regards,
> > > Blair
> >
> >                    Yahoo! Groups Sponsor
> > [Click Here to Find Software Faster]
> > Click Here to Find Software Faster
> >
> >
Service.