MADIS DR RUN-TIME STATUS for Sat May 15 15:32:02 GMT 2021 on vm-bldr-madis-recovery1a
     INFO Node name: vm-bldr-madis-recovery1a
     PASS METAR processing tbl exists:  128320 May 11 17:10 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
     PASS Station update flag exists:  0 May  3  2019 /usr1/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
     PASS Metar station table exists:  1121683 May  3  2019 /usr1/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
     PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC: 
     PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 13 DECODE (4): 5
     PASS Dcmetr check: CNT-LDAD.raw: 1499
     PASS Load resource check: 60% of the time M15 < 9 Samples: 932 %<60:  100% #10=+ 0 #9 0 #8 0 #7 0
     PASS Open file resource check: < 5000 Max files: 1695 #<1000: 878 #<10000 932
     FAIL Process count check: < 1000 Max Processes: 1004G
     PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 14 #Delayed: 0
     PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely:  129    
     PASS No '0' length Station table files in data: #: 0
     PASS No '0' length Station table files in master: #: 0
     PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
     PASS Shefdecoder check 20210514_1300: #CPYRMA: 6 #NJWXNET: 661 #NERRS: 0
  COMPARE UNIQUE mesonet provider cnt for 20210514_1300: 41
     PASS DR_SendFile2LDM is updating MADIS netcdf common data directories 
  COMPARE DECODE STN TBLS           147  Newest:     7017 May 12 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/OK-MesoStation.txt  Oldest:     8848 Sep 16  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-GANetStation.txt
  COMPARE PRE-DECODE STN TBLS       147  Newest:     7017 May 12 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/OK-MesoStation.txt  Oldest:     8848 Sep 16  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-GANetStation.txt
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20210514_13
-rw-r--r--. 1    331868 May 14 14:45 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20210514_1300
-rw-r--r--. 1    132076 May 14 15:45 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20210514_1300
-rw-r--r--. 1   7628412 May 15 15:31 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20210514_1300
-rwxr-xr-x. 1 287494256 May 15 15:30 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20210514_1300
-rw-r--r--. 1    152828 May 14 14:10 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/mobile/netCDF/20210514_1300
-rw-r--r--. 1    308628 May 15 14:55 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20210514_1300
-rw-r--r--. 1  23648944 May 15 01:58 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20210514_1300
-rw-r--r--. 1   2503084 May 15 15:31 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20210514_1300
-rw-r--r--. 1   7798848 May 14 21:07 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20210514_1300
-rw-r--r--. 1    705156 May 14 17:19 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20210514_1300
-rw-r--r--. 1    322816 May 15 13:31 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20210514_1300
-rw-r--r--. 1     69692 May 15 13:31 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20210514_1300
-rw-r--r--. 1   4472460 May 15 13:31 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20210514_1300
-rw-r--r--. 1 213970908 May 15 13:31 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1   5840636 May 14 17:19 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20210514_1300
-rw-r--r--. 1     98848 May 14 15:20 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/mobile/20210514_1300
-rw-r--r--. 1     72928 May 15 13:31 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20210514_1300
-rw-r--r--. 1   6619232 May 15 13:31 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20210514_1300
-rw-r--r--. 1    151924 May 14 17:18 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20210514_1300
-rw-r--r--. 1    136960 May 15 13:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20210514_1300
-rw-r--r--. 1     69692 May 15 13:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20210514_1300
-rw-r--r--. 1   4069260 May 15 13:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20210514_1300
-rw-r--r--. 1 100920828 May 15 13:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1    101500 May 14 15:19 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/mobile/20210514_1300
-rw-r--r--. 1     72928 May 15 13:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20210514_1300
-rw-r--r--. 1   2956412 May 15 13:24 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20210514_1300
-rw-r--r--. 1    200772 May 14 15:41 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20210514_1300
-rw-r--r--. 1    106468 May 15 13:51 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20210514_1300
-rw-r--r--. 1    157736 May 15 13:51 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20210514_1300
-rw-r--r--. 1   2102796 May 15 13:51 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20210514_1300
-rw-r--r--. 1  67730484 May 15 13:51 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1   2111828 May 14 15:41 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20210514_1300
-rw-r--r--. 1     92660 May 14 15:41 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/mobile/20210514_1300
-rw-r--r--. 1     72928 May 15 13:51 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20210514_1300
-rw-r--r--. 1   7116652 May 15 13:51 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20210514_1300
-rw-r--r--. 1    322324 May 14 17:31 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20210514_1300
-rw-r--r--. 1    126796 May 15 13:40 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20210514_1300
-rw-r--r--. 1    187084 May 15 13:40 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20210514_1300
-rw-r--r--. 1   3474828 May 15 13:40 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20210514_1300
-rw-r--r--. 1  93265572 May 15 13:40 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1   1881980 May 14 15:31 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20210514_1300
-rw-r--r--. 1     35200 May 14 14:29 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/mobile/20210514_1300
-rw-r--r--. 1     72928 May 15 13:40 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20210514_1300
-rw-r--r--. 1   9837832 May 15 13:40 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20210514_1300
-rw-r--r--. 1    225764 May 14 15:51 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20210514_1300
-rw-r--r--. 1    118084 May 15 13:08 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20210514_1300
-rw-r--r--. 1     69692 May 15 13:08 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20210514_1300
-rw-r--r--. 1   3715596 May 15 13:08 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20210514_1300
-rw-r--r--. 1 100740756 May 15 13:08 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1   1606748 May 14 15:51 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20210514_1300
-rw-r--r--. 1     35200 May 14 14:50 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/mobile/20210514_1300
-rw-r--r--. 1    491104 May 15 13:08 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20210514_1300
-rw-r--r--. 1   4810432 May 15 13:08 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20210514_1300
-rw-r--r--. 1    457852 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20210514_1300
-rw-r--r--. 1    188360 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20210514_1300
-rw-r--r--. 1  11364876 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20210514_1300
-rw-r--r--. 1 510977712 May 15 14:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1    491104 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20210514_1300
-rw-r--r--. 1  23813472 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20210514_1300
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20210514_1300
-rw-r--r--. 1   1047092 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20210514_1300
-rw-r--r--. 1    457852 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20210514_1300
-rw-r--r--. 1    188360 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20210514_1300
-rw-r--r--. 1  18838592 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20210514_1300
-rw-r--r--. 1  14636556 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20210514_1300
-rw-r--r--. 1 545678904 May 15 14:18 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20210514_1300
-rw-r--r--. 1  11775692 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20210514_1300
-rw-r--r--. 1    187248 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mobile/20210514_1300
-rw-r--r--. 1    491104 May 15 14:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20210514_1300
-rw-r--r--. 1  23813472 May 15 14:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20210514_1300
-rw-r--r--. 1    457852 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20210514_1300
-rw-r--r--. 1    188360 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20210514_1300
-rw-r--r--. 1  11364876 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20210514_1300
-rw-r--r--. 1 510977712 May 15 14:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20210514_1300
-rw-r--r--. 1    491104 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20210514_1300
-rw-r--r--. 1  23813472 May 15 14:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20210514_1300
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20210514_1200
-rw-r--r--. 1   1186820 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20210514_1200
-rw-r--r--. 1    520288 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20210514_1200
-rw-r--r--. 1    192188 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20210514_1200
-rw-r--r--. 1  18823032 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20210514_1200
-rw-r--r--. 1  19063692 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20210514_1200
-rw-r--r--. 1 561200232 May 15 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20210514_1200
-rw-r--r--. 1  11822540 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20210514_1200
-rw-r--r--. 1    257968 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mobile/20210514_1200
-rw-r--r--. 1    491104 May 15 13:19 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20210514_1200
-rw-r--r--. 1  23733672 May 15 13:21 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20210514_1200
-rw-r--r--. 1    521740 May 15 13:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20210514_1200
-rw-r--r--. 1    192188 May 15 13:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20210514_1200
-rw-r--r--. 1  15887628 May 15 13:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20210514_1200
-rw-r--r--. 1 523978032 May 15 13:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20210514_1200
-rw-r--r--. 1    491104 May 15 13:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20210514_1200
-rw-r--r--. 1  23733672 May 15 13:09 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20210514_1200