MADIS DR RUN-TIME STATUS for Thu Mar 30 04:32:02 GMT 2023 on vm-bldr-madis-ops-recovery1
     INFO Node name: vm-bldr-madis-ops-recovery1
     PASS METAR processing tbl exists:  128320 Mar 28 17:30 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
     PASS Station update flag exists:  0 Feb  1 16:52 /opt/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
     PASS Metar station table exists:  1121683 Feb  1 16:51 /opt/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
     FAIL Missing Accept/reject|autorej files exists: AO: 1 IQC: 1 NON-SFC: 
     PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 5 DECODE (4): 5
     PASS Dcmetr check: CNT-LDAD.raw: 748
     PASS Load resource check: 60% of the time M15 < 9 Samples: 272 %<60:  100% #10=+ 0 #9 0 #8 0 #7 0
     PASS Open file resource check: < 5000 Max files: -1 #<1000: 272 #<10000 272
     PASS Process count check: < 1000 Max Processes: 410
     PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 3 #Delayed: 0
     PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely:  24    
     PASS No '0' length Station table files in data: #: 0
     PASS No '0' length Station table files in master: #: 0
     PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
     PASS Shefdecoder check 20230329_0200: #CPYRMA: 28 #NJWXNET: 636 #NERRS: 0
  COMPARE UNIQUE mesonet provider cnt for 20230329_0200: 28
     PASS DR_SendFile2LDM is updating MADIS netcdf common data directories 
  COMPARE DECODE STN TBLS           137  Newest:   214482 Mar 30 02:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/RAWSStation.txt  Oldest:     2699 Mar 29 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/AFAStation.txt
  COMPARE PRE-DECODE STN TBLS       137  Newest:   214482 Mar 30 02:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/RAWSStation.txt  Oldest:     2699 Mar 29 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AFAStation.txt
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_02
-rw-r-----. 1    316448 Mar 29 05:50 /opt/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20230329_0200
-rw-r-----. 1    141360 Mar 29 04:50 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20230329_0200
-rw-r-----. 1   5281844 Mar 29 13:18 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20230329_0200
-rwxr-x---. 1 168661696 Mar 30 03:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20230329_0200
-rw-r-----. 1    131508 Mar 30 03:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20230329_0200
-rw-r-----. 1  11750900 Mar 29 04:07 /opt/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20230329_0200
-rw-r-----. 1    517184 Mar 29 04:06 /opt/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20230329_0200
-rw-r-----. 1   5343384 Mar 29 03:06 /opt/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20230329_0200
-rw-r--r--. 1   761956 Mar 29 06:13 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20230329_0200
-rw-r--r--. 1   264736 Mar 30 03:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20230329_0200
-rw-r--r--. 1    69692 Mar 30 02:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20230329_0200
-rw-r--r--. 1  4591768 Mar 30 02:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 63343640 Mar 30 03:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1  4941540 Mar 29 06:13 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20230329_0200
-rw-r--r--. 1    72928 Mar 30 02:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  2395152 Mar 30 03:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20230329_0200
-rw-r--r--. 1   153060 Mar 29 06:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20230329_0200
-rw-r--r--. 1   150028 Mar 30 03:19 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20230329_0200
-rw-r--r--. 1    69692 Mar 30 02:18 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20230329_0200
-rw-r--r--. 1  1473408 Mar 30 02:18 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 48440192 Mar 30 03:19 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1  1507364 Mar 29 04:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/metar/20230329_0200
-rw-r--r--. 1    72928 Mar 30 02:18 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  2490912 Mar 30 03:19 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20230329_0200
-rw-r--r--. 1   156468 Mar 29 03:22 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20230329_0200
-rw-r--r--. 1   123892 Mar 30 02:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20230329_0200
-rw-r--r--. 1    69692 Mar 30 02:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20230329_0200
-rw-r--r--. 1  1709392 Mar 30 02:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 70046004 Mar 30 03:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1  2656996 Mar 29 06:22 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20230329_0200
-rw-r--r--. 1    72928 Mar 30 02:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  1889752 Mar 30 03:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20230329_0200
-rw-r--r--. 1   287108 Mar 29 06:25 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20230329_0200
-rw-r--r--. 1   112276 Mar 30 02:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20230329_0200
-rw-r--r--. 1   202396 Mar 30 03:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20230329_0200
-rw-r--r--. 1  2708712 Mar 30 02:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 80047756 Mar 30 03:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1  2281636 Mar 29 04:25 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20230329_0200
-rw-r--r--. 1    72928 Mar 30 02:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  8880232 Mar 30 03:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20230329_0200
-rw-r--r--. 1   248484 Mar 29 06:32 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20230329_0200
-rw-r--r--. 1   123892 Mar 30 03:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20230329_0200
-rw-r--r--. 1    69692 Mar 30 02:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20230329_0200
-rw-r--r--. 1  3037404 Mar 30 02:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 86871340 Mar 30 03:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1  1904804 Mar 29 06:32 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20230329_0200
-rw-r--r--. 1   180376 Mar 30 03:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  4334292 Mar 30 03:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20230329_0200
-rw-r--r--. 1    436072 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_0200
-rw-r--r--. 1    202396 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_0200
-rw-r--r--. 1   7598156 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 300064260 Mar 30 03:06 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1    180376 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  16147352 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_0200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_0200
-rw-r--r--. 1   1617364 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_0200
-rw-r--r--. 1    436072 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_0200
-rw-r--r--. 1    202396 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_0200
-rw-r--r--. 1  18891496 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_0200
-rw-r--r--. 1  11889212 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_0200
-rw-r--r--. 1 492784224 Mar 30 03:11 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_0200
-rw-r--r--. 1  11391844 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_0200
-rw-r--r--. 1    180376 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_0200
-rw-r--r--. 1  16147352 Mar 30 03:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_0200
-rw-r--r--. 1    436072 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_0200
-rw-r--r--. 1    202396 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_0200
-rw-r--r--. 1   7598156 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_0200
-rw-r--r--. 1 300064260 Mar 30 03:06 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_0200
-rw-r--r--. 1    180376 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_0200
-rw-r--r--. 1  16147352 Mar 30 03:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_0200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_0100
-rw-r--r--. 1   1634404 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_0100
-rw-r--r--. 1    436072 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_0100
-rw-r--r--. 1    202396 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_0100
-rw-r--r--. 1  18900832 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_0100
-rw-r--r--. 1  12278104 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_0100
-rw-r--r--. 1 494300576 Mar 30 02:12 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_0100
-rw-r--r--. 1  11325604 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_0100
-rw-r--r--. 1    180376 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_0100
-rw-r--r--. 1  16197892 Mar 30 02:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_0100
-rw-r--r--. 1    436072 Mar 30 02:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_0100
-rw-r--r--. 1    202396 Mar 30 02:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_0100
-rw-r--r--. 1   7953336 Mar 30 02:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_0100
-rw-r--r--. 1 301626896 Mar 30 02:06 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_0100
-rw-r--r--. 1    180376 Mar 30 02:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_0100
-rw-r--r--. 1  16197892 Mar 30 02:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_0100