[Orca-users] RE: Performance issue with RSYNC'ing data and Orca 0.26beta1 - I'm a dork

[Sean O'Neill]

OK, I'm a dork.  I figured it out.  Orca had nothing to do with this.  It was rsync or, more correctly, me.

The problem was the rsync command I was using to push the data from one of my systems over to the Orca server.  I was using (in a korn shell script):

cd /usr/local/var/orca/orcallator/${HOSTNAME}
/usr/local/bin/rsync --delete --recursive . ${RRDSERVER}::${HOSTNAME}-orca

This above rsync command will ALWAYS update the modification timestamp of the orca file on the Orca server.  This causes Orca to re-process these files everytime it loops after its sleep cycle.

The fix is:

cd /usr/local/var/orca/orcallator/${HOSTNAME}
/usr/local/bin/rsync --times --delete --recursive . ${RRDSERVER}::${HOSTNAME}-orca

Note the addition of the --times which.  This preserves the modification time (on the Orca client system) of the files being pushed.  Actually, it enforces it.  If the time stamp is incorrect, it changes it back to what it should be.

My CPU levels are back to what I expect them to be :)

So, rsync works as a very nice method to transfer data as an alternative to NFS.

-----Original Message-----
From: Sean O'Neill [mailto:sean.oneill at appnet.com]
Sent: Tuesday, April 25, 2000 10:20 AM
To: orca-users at onelist.com
Subject: Performance issue with RSYNC'ing data and Orca 0.26beta1


Hey Blair,

I remember a while back (at least I think I remember) you saying something about the atime field of the inode for gzip'd orca data files being used to determine if the gzip file needs to be read by the /usr/local/bin/orca perl script.

Well, if this is what I remember, I have finally noticed this atime field effecting the overall performance of Orca using rsync'd files.  

Do you know where in the Orca perl files that this atime (or whatever is causing the rsync'd gzip files to be gunzip'd everything Orca loops) is used to determine when Orca needs to re-read the gzip'd files is?  I'm hoping to update the code to make it unnecessary for Orca to have to re-read the gzip'd file.

------- 
Sean O'Neill
AppNet, Inc.
sean.oneill at appnet.com
Direct - 301-939-1213
Fax - 301-953-2368


------------------------------------------------------------------------
Now the best and coolest websites come right to you based on your 
unique interests. eTour.com is surfing without searching. 
And, it's FREE!
http://click.egroups.com/1/3013/7/_/804404/_/956863271/
------------------------------------------------------------------------