[Orca-users] Re: Half my rrds are missing

bajones at SKY.NET bajones at SKY.NET
Fri Aug 31 05:32:12 PDT 2001


OK, we'll give it a shot.  thanks!

--- In orca-users at y..., Blair Zajac <blair at o...> wrote:
> It's not obvious what's going on.
>
> Can you upgrade to the latest orca 0.27b1 and see if it still
happens.
>
> Blair
>
> bajones at S... wrote:
> >
> > yes, vanilla.  I tarred the existing orca setup that I had on
another
> > server, untarred it over on these new servers, and then ran the
same
> > configuration.  I've actually done this on a bunch of servers but
> > its just this particular new group that is having these problems.
> > This is the data from one of the percol files -
> >
> > ::::::::::::::
> > percol-2001-08-13
> > ::::::::::::::
> > timestamp locltime DNnsrkcmdit   uptime  usr%  sys%  1runq  5runq
> > 15runq #proc scanrate #proc/s #proc/p5s  smtx smtx/cpu nc
> > pus mntC_/ mntU_/ mntA_/ mntP_/ mntc_/ mntu_/ mnta_/ mntp_/
mntC_/usr
> > mntU_/usr mntA_/usr mntP_/usr mntc_/usr mntu_/usr mnta
> > _/usr mntp_/usr mntC_/opt mntU_/opt mntA_/opt mntP_/opt mntc_/opt
> > mntu_/opt mnta_/opt mntp_/opt mntC_/u02 mntU_/u02 mntA_/u0
> > 2 mntP_/u02 mntc_/u02 mntu_/u02 mnta_/u02 mntp_/u02 mntC_/u01
> > mntU_/u01 mntA_/u01 mntP_/u01 mntc_/u01 mntu_/u01 mnta_/u01 mn
> > tp_/u01 mntC_/home mntU_/home mntA_/home mntP_/home mntc_/home
> > mntu_/home mnta_/home mntp_/home mntC_/var/crash mntU_/var/cr
> > ash mntA_/var/crash mntP_/var/crash mntc_/var/crash
mntu_/var/crash
> > mnta_/var/crash mntp_/var/crash disk_runp_c0t6d0 disk_ru
> > np_c3t1d1 disk_runp_c3t1d0 disk_runp_c0t10d0 disk_runp_c0t11d0
> > disk_runp_c6t1d0 disk_runp_c4t1d1 disk_runp_c4t1d0 disk_peak
> > disk_mean disk_rd/s disk_wr/s disk_rK/s disk_wK/s swap_avail
> > page_rstim   freememK free_pages  hme0Ipkt/s  hme0Opkt/s  hme0I
> > nKB/s  hme0OuKB/s  hme0IErr/s  hme0OErr/s  hme0Coll%  hme0NoCP/s
> > hme0Defr/s  hme1Ipkt/s  hme1Opkt/s  hme1InKB/s  hme1OuKB/s
> >   hme1IErr/s  hme1OErr/s  hme1Coll%  hme1NoCP/s  hme1Defr/s
> > hme2Ipkt/s  hme2Opkt/s  hme2InKB/s  hme2OuKB/s  hme2IErr/s  hme
> > 2OErr/s  hme2Coll%  hme2NoCP/s  hme2Defr/s tcp_Iseg/s tcp_Oseg/s
> > tcp_InKB/s tcp_OuKB/s tcp_Ret% tcp_Dup% tcp_Icn/s tcp_Ocn/s
> > tcp_estb tcp_Rst/s tcp_Atf/s tcp_Ldrp/s tcp_LdQ0/s tcp_HOdp/s
> > nfs_call/s nfs_timo/s nfs_badx/s nfss_calls nfss_bad  v2reads
> > v2writes  v3reads v3writes dnlc_ref/s dnlc_hit% inod_ref/s
inod_hit%
> > inod_stl/s pp_kernel pagesfree pageslock pagesio pages
> > totl
> > 997716601 10:30:01 wwwwwwwgwww  5461758   1.2   0.7   0.02   0.05
> > 0.06   175    0.000   0.825   39.1995    13        3
> >   4 1987399 1164391 763387 60.401 492800   5657 487143  1.148
> > 3009327    483716   2465425    16.402    495360     18330
> > 477030     3.700   2508555    308481   2149903    12.548
> > 412800     16233    396567     3.932 247503872  43925664 201993
> > 576    17.862   6361856        58   6361798     0.001 318219264
> > 46587592 269509656    14.738   8514208     25740   8488468
> >     0.302    2457600     252744    2067082     10.895
> > 552664       1450     551214      0.262         2949092
> >    10         2654173           0.000         1474560
> > 5         1474555           0.000          0.00000
> >     0.00078          0.11846          0.80003
> > 0.78442          0.05939          0.01843          1.65412    
1.654
> >     0.429       0.2       8.3      18.0      61.8    4476793
> > 600    1502947     187868      12.961      12.182
> > 1.136       1.935       0.000       0.000      0.000
> > 0.000       0.000       0.000       0.000       0.000       0.000
> >        0.000       0.000      0.000       0.000       0.000
> > 0.000       0.000       0.000       0.000       0.000
> >   0.000      0.000       0.000       0.000     11.144     12.054
> > 0.444      1.295    0.000    0.000     0.010     0.017
> >       117     0.003     0.000      0.000      0.000      0.000
> > 0.000      0.000      0.000          0        0        0
> >         0        0        0     40.086    96.361      0.000
> > 100.000      0.000     29524    187245    137002       0    50
> > 2824
> >
> > --- In orca-users at y..., Blair Zajac <blair at o...> wrote:
> > > These undefined value errors and internal warnings are not a
good
> > sign.
> > > Can you send a couple of lines from the input percol* files?
> > >
> > > Is the configuration file a vanilla config file?
> > >
> > > bajones at S... wrote:
> > > >
> > > > ok, this is a huge amount of output, I cut most of the error
> > messages
> > > > out at the end because they repeat....
> > > >
> > > > Script started on Thu Aug 30 16:27:54 2001
> > > > $ pwd
> > > > /usr/local/orca
> > > > $ /usr/local/orca/bin/orca -v -v -o
/usr/local/orca/orcallator.cfg
> > > > Orca version 0.26beta1 using RRDs version 1.000131.
> > > > Loading state from
> > > > `/usr/local/orca/var/orca/rrd/orcallator/orca.state'.
> > > > Creating orca.gif.
> > > > Creating rrdtool.gif.
> > > > Finding files and setting up data structures at Thu Aug 30
> > 16:28:17
> > > > 2001.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data #httpds' in plot #4 in `/usr/local/orca/var/orca/orc
> > > > allator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: cannot compile `sub {
> > #httpds }'
> > > > for plot #4 `data #httpds': Missing right bracket at (ev
> > > > al 14) line 2, at end of line
> > > > syntax error at (eval 14) line 2, at EOF
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data #httpds' in plot #5 in `/usr/local/orca/var/orca/orc
> > > > allator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data httpop/s' in plot #6 in `/usr/local/orca/var/orca/or
> > > > callator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data http/p5s' in plot #6 in `/usr/local/orca/var/orca/or
> > > > callator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: cannot compile `sub {
> > httpop/s }'
> > > > for plot #6 `data httpop/s': Bareword "httpop" not allo
> > > > wed while "strict subs" in use at (eval 15) line 1.
> > > > /usr/local/orca/bin/orca: warning: cannot compile `sub {
> > http/p5s }'
> > > > for plot #6 `data http/p5s': Bareword "http" not allowe
> > > > d while "strict subs" in use at (eval 16) line 1.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data %to1KB' in plot #7 in `/usr/local/orca/var/orca/orca
> > > > llator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data %to10KB' in plot #7 in `/usr/local/orca/var/orca/orc
> > > > allator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data %to100KB' in plot #7 in `/usr/local/orca/var/orca/or
> > > > callator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data %to1MB' in plot #7 in `/usr/local/orca/var/orca/orca
> > > > llator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: no substitutions performed
for
> > > > `data %over1MB' in plot #7 in `/usr/local/orca/var/orca/or
> > > > callator/memdb1/percol-2001-08-13'.
> > > > /usr/local/orca/bin/orca: warning: cannot compile `sub { 1024
* 8
> > *
> > > > le1OuKB/s }' for plot #15 `data 1024 * 8 * le1OuKB/s': B
> > > > areword "le1OuKB" not allowed while "strict subs" in use at
(eval
> > 35)
> > > > line 1.
> > > > RSS  VSZ %MEM        TIME     USER   PID COMMAND
> > > > 4784 5552  0.2        0:01   ejones  3796 /bin/perl
> > > > Current running time is 0:01 minutes.
> > > > Loading new data from memdb1.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > Use of uninitialized value at (eval 171) line 3, <FD> chunk 2.
> > > > /usr/local/orca/bin/orca: internal error: expecting RRD name
> > > > `orcallator_memdb1_dnlc_hit%' but no data loaded from
`/usr/loc
> > > > al/orca/var/orca/orcallator/memdb1/percol-2001-08-13' at time
Mon
> > Aug
> > > > 13 10:30:01 2001 (997716601).
> > > > /usr/local/orca/bin/orca: internal error: expecting RRD name
> > > > `orcallator_memdb1_dnlc_ref/s' but no data loaded from
`/usr/lo
> > > > cal/orca/var/orca/orcallator/memdb1/percol-2001-08-13' at time
Mon
> > > > Aug 13 10:30:01 2001 (997716601).
> > > >
> > > > these errors about the rrds not existing were the ones I was
> > > > originally seeing.
> > > >
> > > > --- In orca-users at y..., Blair Zajac <blair at o...> wrote:
> > > > > Can you run orca with the -v -v -o command line options and
send
> > > > them
> > > > > along to see what is going on?
> > > > >
> > > > > Blair
> > > > >
> > > > > bajones at S... wrote:
> > > > > >
> > > > > > --- In orca-users at y..., Blair Zajac <blair at o...> wrote:
> > > > > > > Several questions:
> > > > > > >
> > > > > > > 1) Is orcallator.se running on them?
> > > > > >
> > > > > > Yes
> > > > > >
> > > > > > >
> > > > > > > 2) Is orcallator.se set up to start on system boot?
> > > > > >
> > > > > > Yes
> > > > > >
> > > > > > >
> > > > > > > 3) Are the percol* files that orcallator.se should be
> > > > generating in
> > > > > > >    the proper location?
> > > > > >
> > > > > > yes, they are in the same location on both the server
where
> > > > > > everything is working properly and the servers where they
> > aren't
> > > > > > working.
> > > > > >
> > > > > > >
> > > > > > > 4) What is the latest date for these files for each
server?
> > > > > >
> > > > > > all the percol* files have the current time stamp.
> > > > > >
> > > > > > >
> > > > > > > Best,
> > > > > > > Blair
> > > > > > >
> > > > > > > Elizabeth Jones wrote:
> > > > > > > >
> > > > > > > > Hi - I searched around the archives for this problem
but
> > > > > > > > I can't find this specific problem.  I just installed
orca
> > > > > > > > on a new set of SUN servers that are all running
solaris
> > 8.
> > > > > > > > When I run orca, only about half of the rrd files are
> > > > > > > > generated, so I end up with web pages in which half
the
> > > > > > > > graphs have no data.  The problem appears to be at the
> > > > > > > > percol* file level, which I think means that
orcallator.se
> > > > > > > > isn't collecting this information?  Does anyone have
any
> > > > > > > > pointers on how I can figure out why this data isn't
> > > > > > > > being collected?  some of it is what I would consider
very
> > > > > > > > basic information, such as memory usage.
> > > > > > > >
> > > > > > > > thanks -
> > > > > > > > Elizabeth
> > > >
> > > >                    Yahoo! Groups Sponsor
> > > >                        ADVERTISEMENT
> > > >                [Lose 20 lbs by November 5th]
> > > >
> > > >
> > Service.
> >
> >                    Yahoo! Groups Sponsor
> >                           [Image]
> >
> >
Service.



More information about the Orca-users mailing list