MADIS DR RUN-TIME STATUS for Sun May 16 00:32:01 GMT 2021 on vm-bldr-madis-recovery1a
     INFO Node name: vm-bldr-madis-recovery1a
     PASS METAR processing tbl exists:  128320 May 11 17:10 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
     PASS Station update flag exists:  0 May  3  2019 /usr1/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
     PASS Metar station table exists:  1121683 May  3  2019 /usr1/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
     PASS Accept/reject|autorej files exists: AO: 3 IQC: 3 NON-SFC: 
     FAIL Missing persistent processes exists: pqact (1+): 1 ldmd (1+): 13 DECODE (4): 8
     PASS Dcmetr check: CNT-LDAD.raw: 1382
     PASS Load resource check: 60% of the time M15 < 9 Samples: 31 %<60:  100% #10=+ 0 #9 0 #8 0 #7 0
     PASS Open file resource check: < 5000 Max files: 1408 #<1000: 30 #<10000 31
     PASS Process count check: < 1000 Max Processes: 313
     FAIL No entries in file: times.out.21136
     PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely:  0    
     PASS No '0' length Station table files in data: #: 0
     PASS No '0' length Station table files in master: #: 0
     PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
     PASS Shefdecoder check 20210514_2200: #CPYRMA: 3 #NJWXNET: 659 #NERRS: 0
  COMPARE UNIQUE mesonet provider cnt for 20210514_2200: 41
     PASS DR_SendFile2LDM is updating MADIS netcdf common data directories 
  COMPARE DECODE STN TBLS           147  Newest:     7017 May 12 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/OK-MesoStation.txt  Oldest:     8848 Sep 16  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/AWS-GANetStation.txt
  COMPARE PRE-DECODE STN TBLS       147  Newest:     7017 May 12 15:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/OK-MesoStation.txt  Oldest:     8848 Sep 16  2019 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AWS-GANetStation.txt
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20210514_22
-rw-r--r--. 1    340092 May 14 23:45 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20210514_2200
-rw-r--r--. 1    132076 May 15 00:45 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20210514_2200
-rw-r--r--. 1   5868684 May 15 22:01 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20210514_2200
-rwxr-xr-x. 1 287987056 May 16 00:30 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20210514_2200
-rw-r--r--. 1    122040 May 14 23:25 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/mobile/netCDF/20210514_2200
-rw-r--r--. 1    308628 May 15 23:55 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20210514_2200
-rw-r--r--. 1  22155916 May 15 11:00 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20210514_2200
-rw-r--r--. 1   1371884 May 15 22:01 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20210514_2200
-rw-r--r--. 1   4363584 May 15 06:06 /usr1/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20210514_2200
-rw-r--r--. 1    763092 May 15 02:20 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20210514_2200
-rw-r--r--. 1    334432 May 15 22:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20210514_2200
-rw-r--r--. 1     69692 May 15 22:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   4239756 May 15 22:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20210514_2200
-rw-r--r--. 1 214985460 May 15 22:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1   5379476 May 15 02:20 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20210514_2200
-rw-r--r--. 1     91776 May 15 02:20 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/mobile/20210514_2200
-rw-r--r--. 1     72928 May 15 22:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20210514_2200
-rw-r--r--. 1   3270292 May 15 22:27 /usr1/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20210514_2200
-rw-r--r--. 1    136960 May 15 22:22 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20210514_2200
-rw-r--r--. 1     69692 May 15 22:22 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   2206476 May 15 22:22 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20210514_2200
-rw-r--r--. 1 100958160 May 15 22:22 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1     98848 May 15 02:19 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/mobile/20210514_2200
-rw-r--r--. 1     72928 May 15 22:22 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20210514_2200
-rw-r--r--. 1   1645032 May 15 22:22 /usr1/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20210514_2200
-rw-r--r--. 1    201908 May 15 00:46 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20210514_2200
-rw-r--r--. 1    106468 May 15 22:44 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20210514_2200
-rw-r--r--. 1    157736 May 15 22:44 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   1365516 May 15 22:44 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20210514_2200
-rw-r--r--. 1  67798560 May 15 22:44 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1   2113292 May 15 00:46 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20210514_2200
-rw-r--r--. 1     35200 May 14 23:45 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/mobile/20210514_2200
-rw-r--r--. 1     72928 May 15 22:44 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20210514_2200
-rw-r--r--. 1   5036532 May 15 22:44 /usr1/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20210514_2200
-rw-r--r--. 1    326868 May 15 02:33 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20210514_2200
-rw-r--r--. 1    126796 May 15 22:35 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20210514_2200
-rw-r--r--. 1    187084 May 15 22:35 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   3234060 May 15 22:35 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20210514_2200
-rw-r--r--. 1  92527716 May 15 22:35 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1   1823420 May 15 00:34 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20210514_2200
-rw-r--r--. 1     35200 May 14 23:31 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/mobile/20210514_2200
-rw-r--r--. 1     72928 May 15 22:35 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20210514_2200
-rw-r--r--. 1   6190972 May 15 22:35 /usr1/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20210514_2200
-rw-r--r--. 1    238260 May 15 00:59 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20210514_2200
-rw-r--r--. 1    118084 May 15 22:56 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20210514_2200
-rw-r--r--. 1     69692 May 15 22:56 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   3608460 May 15 22:56 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20210514_2200
-rw-r--r--. 1 101362224 May 15 22:56 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1   1491092 May 15 00:59 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20210514_2200
-rw-r--r--. 1     35200 May 14 23:59 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/mobile/20210514_2200
-rw-r--r--. 1    508528 May 15 22:56 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20210514_2200
-rw-r--r--. 1   2379192 May 15 22:56 /usr1/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20210514_2200
-rw-r--r--. 1    469468 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20210514_2200
-rw-r--r--. 1    188360 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   8686476 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20210514_2200
-rw-r--r--. 1 511678236 May 15 23:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1    508528 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20210514_2200
-rw-r--r--. 1  13088352 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20210514_2200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20210514_2200
-rw-r--r--. 1   1053908 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20210514_2200
-rw-r--r--. 1    469468 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20210514_2200
-rw-r--r--. 1    188360 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20210514_2200
-rw-r--r--. 1  18570960 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20210514_2200
-rw-r--r--. 1  11971980 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20210514_2200
-rw-r--r--. 1 546375036 May 15 23:15 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20210514_2200
-rw-r--r--. 1  11194484 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20210514_2200
-rw-r--r--. 1    155424 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mobile/20210514_2200
-rw-r--r--. 1    508528 May 15 23:15 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20210514_2200
-rw-r--r--. 1  13088352 May 15 23:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20210514_2200
-rw-r--r--. 1    469468 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20210514_2200
-rw-r--r--. 1    188360 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20210514_2200
-rw-r--r--. 1   8686476 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20210514_2200
-rw-r--r--. 1 511678236 May 15 23:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20210514_2200
-rw-r--r--. 1    508528 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20210514_2200
-rw-r--r--. 1  13088352 May 15 23:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20210514_2200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20210514_2100
-rw-r--r--. 1   1020964 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20210514_2100
-rw-r--r--. 1    468016 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20210514_2100
-rw-r--r--. 1    188360 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20210514_2100
-rw-r--r--. 1  18357788 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20210514_2100
-rw-r--r--. 1  12330252 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20210514_2100
-rw-r--r--. 1 547369824 May 15 22:15 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20210514_2100
-rw-r--r--. 1  11329172 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20210514_2100
-rw-r--r--. 1    103268 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/mobile/20210514_2100
-rw-r--r--. 1    494008 May 15 22:15 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20210514_2100
-rw-r--r--. 1   4243852 May 15 22:17 /usr1/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20210514_2100
-rw-r--r--. 1    468016 May 15 22:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/crn/20210514_2100
-rw-r--r--. 1    188360 May 15 22:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hcn/20210514_2100
-rw-r--r--. 1   8929548 May 15 22:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/hydro/20210514_2100
-rw-r--r--. 1 513048540 May 15 22:07 /usr1/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20210514_2100
-rw-r--r--. 1    494008 May 15 22:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/nepp/20210514_2100
-rw-r--r--. 1   4243852 May 15 22:08 /usr1/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20210514_2100