MADIS DR RUN-TIME STATUS for Thu Mar 30 14:32:02 GMT 2023 on vm-bldr-madis-ops-recovery1
     INFO Node name: vm-bldr-madis-ops-recovery1
     PASS METAR processing tbl exists:  128320 Mar 28 17:30 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/NonFedAWOSStation.tbl
     PASS Station update flag exists:  0 Feb  1 16:52 /opt/ldm/madis/dr/decode/awips/fxa/GO-UPDATE-STATIONS
     PASS Metar station table exists:  1121683 Feb  1 16:51 /opt/ldm/madis/dr/sfc/iqc1/fslparms/lsfc.tbl
     FAIL Missing Accept/reject|autorej files exists: AO: 1 IQC: 1 NON-SFC: 
     PASS Persistent processes exists: pqact (1+): 1 ldmd (1+): 12 DECODE (4): 5
     PASS Dcmetr check: CNT-LDAD.raw: 968
     PASS Load resource check: 60% of the time M15 < 9 Samples: 872 %<60:  100% #10=+ 0 #9 0 #8 0 #7 0
     PASS Open file resource check: < 5000 Max files: -1 #<1000: 872 #<10000 872
     PASS Process count check: < 1000 Max Processes: 410
     PASS AO Throughput test: <20 delayed %Delayed: 0% #Sample: 13 #Delayed: 0
     PASS IQC Throughput test: <30 delayed #Delayed: 0 Competed timely:  124    
     PASS No '0' length Station table files in data: #: 0
     PASS No '0' length Station table files in master: #: 0
     PASS No netcdf-4.1 netCDF lib connection for routerStoreNetCDF:
     PASS Shefdecoder check 20230329_1200: #CPYRMA: 7 #NJWXNET: 1060 #NERRS: 0
  COMPARE UNIQUE mesonet provider cnt for 20230329_1200: 28
     PASS DR_SendFile2LDM is updating MADIS netcdf common data directories 
  COMPARE DECODE STN TBLS           137  Newest:   214482 Mar 30 12:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/RAWSStation.txt  Oldest:     2699 Mar 29 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/AFAStation.txt
  COMPARE PRE-DECODE STN TBLS       137  Newest:   214482 Mar 30 12:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/RAWSStation.txt  Oldest:     2699 Mar 29 15:00 /opt/ldm/madis/dr/decode/data/fxa/LDAD/data/master/AFAStation.txt
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_12
-rw-r-----. 1    185892 Mar 29 14:50 /opt/ldm/madis/dr/decode/data/fxa/LDAD/crn/netCDF/20230329_1200
-rw-r-----. 1    118572 Mar 29 14:50 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hcn/netCDF/20230329_1200
-rw-r-----. 1   8998004 Mar 30 14:16 /opt/ldm/madis/dr/decode/data/fxa/LDAD/hydro/netCDF/20230329_1200
-rwxr-x---. 1 169431696 Mar 30 12:40 /opt/ldm/madis/dr/decode/data/fxa/LDAD/mesonet/netCDF/20230329_1200
-rw-r-----. 1    124128 Mar 30 13:55 /opt/ldm/madis/dr/decode/data/fxa/LDAD/nepp/netCDF/20230329_1200
-rw-r-----. 1  11513584 Mar 29 14:07 /opt/ldm/madis/dr/decode/data/fxa/LDAD/rwis/netCDF/20230329_1200
-rw-r-----. 1   3054684 Mar 30 14:16 /opt/ldm/madis/dr/decode/data/fxa/LDAD/snow/netCDF/20230329_1200
-rw-r-----. 1   5344236 Mar 29 13:21 /opt/ldm/madis/dr/decode/data/fxa/LDAD/urbanet/netCDF/20230329_1200
-rw-r--r--. 1   860788 Mar 29 16:13 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/buoy/20230329_1200
-rw-r--r--. 1   212464 Mar 30 13:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/crn/20230329_1200
-rw-r--r--. 1    69692 Mar 30 12:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  5890884 Mar 30 12:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 63125444 Mar 30 13:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  5574500 Mar 29 16:13 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/metar/20230329_1200
-rw-r--r--. 1    72928 Mar 30 12:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  2405792 Mar 30 13:15 /opt/ldm/madis/dr/sfc/iqc1/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1   154196 Mar 29 13:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/buoy/20230329_1200
-rw-r--r--. 1    97756 Mar 30 13:19 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/crn/20230329_1200
-rw-r--r--. 1    69692 Mar 30 12:18 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  3197536 Mar 30 12:18 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 48402724 Mar 30 13:19 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  1592740 Mar 29 14:17 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/metar/20230329_1200
-rw-r--r--. 1    72928 Mar 30 12:18 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  2501552 Mar 30 13:19 /opt/ldm/madis/dr/sfc/iqc2/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1   157604 Mar 29 13:22 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/buoy/20230329_1200
-rw-r--r--. 1    80332 Mar 30 12:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/crn/20230329_1200
-rw-r--r--. 1    69692 Mar 30 12:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  4857852 Mar 30 12:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 69860868 Mar 30 13:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  2673188 Mar 29 16:22 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/metar/20230329_1200
-rw-r--r--. 1    72928 Mar 30 12:24 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  1895072 Mar 30 13:25 /opt/ldm/madis/dr/sfc/iqc3/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1   295060 Mar 29 16:25 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/buoy/20230329_1200
-rw-r--r--. 1    78880 Mar 30 12:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/crn/20230329_1200
-rw-r--r--. 1   167944 Mar 30 13:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  3500944 Mar 30 12:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 80526024 Mar 30 13:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  2420004 Mar 29 14:25 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/metar/20230329_1200
-rw-r--r--. 1    72928 Mar 30 12:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  8872252 Mar 30 13:28 /opt/ldm/madis/dr/sfc/iqc4/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1   248484 Mar 29 16:32 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/buoy/20230329_1200
-rw-r--r--. 1    97756 Mar 30 13:35 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/crn/20230329_1200
-rw-r--r--. 1    69692 Mar 30 12:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  2453464 Mar 30 12:34 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 88451608 Mar 30 13:35 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  1979876 Mar 29 16:32 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/metar/20230329_1200
-rw-r--r--. 1   167308 Mar 30 13:35 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  4297052 Mar 30 13:35 /opt/ldm/madis/dr/sfc/iqc5/qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    251668 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_1200
-rw-r--r--. 1    167944 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  13054684 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 301448372 Mar 30 13:06 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1    167308 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  16150012 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_1200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_1200
-rw-r--r--. 1    774452 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_1200
-rw-r--r--. 1    251668 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_1200
-rw-r--r--. 1    167944 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_1200
-rw-r--r--. 1  18961516 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_1200
-rw-r--r--. 1  18235496 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_1200
-rw-r--r--. 1 520347448 Mar 30 13:12 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_1200
-rw-r--r--. 1  12204388 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_1200
-rw-r--r--. 1    167308 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_1200
-rw-r--r--. 1  16150012 Mar 30 13:14 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_1200
-rw-r--r--. 1    251668 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_1200
-rw-r--r--. 1    167944 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_1200
-rw-r--r--. 1  13054684 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_1200
-rw-r--r--. 1 301448372 Mar 30 13:06 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_1200
-rw-r--r--. 1    167308 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_1200
-rw-r--r--. 1  16150012 Mar 30 13:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_1200
  COMPARE Compare rough file sizes for same hour on known good system. Hour: 20230329_1100
-rw-r--r--. 1   1667348 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/buoy/20230329_1100
-rw-r--r--. 1    460756 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/crn/20230329_1100
-rw-r--r--. 1    278956 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hcn/20230329_1100
-rw-r--r--. 1  18947512 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hfmetar/20230329_1100
-rw-r--r--. 1  17576908 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/hydro/20230329_1100
-rw-r--r--. 1 493458648 Mar 30 12:11 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/mesonet/20230329_1100
-rw-r--r--. 1  12251492 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/metar/20230329_1100
-rw-r--r--. 1    180376 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/nepp/20230329_1100
-rw-r--r--. 1  16123412 Mar 30 12:13 /opt/ldm/madis/dr/sfc/ao/dr_qcms_data/urbanet/20230329_1100
-rw-r--r--. 1    460756 Mar 30 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/crn/20230329_1100
-rw-r--r--. 1    278956 Mar 30 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hcn/20230329_1100
-rw-r--r--. 1  13146188 Mar 30 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/hydro/20230329_1100
-rw-r--r--. 1 302142632 Mar 30 12:06 /opt/ldm/madis/dr/sfc/ao/qcms_data/mesonet/20230329_1100
-rw-r--r--. 1    180376 Mar 30 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/nepp/20230329_1100
-rw-r--r--. 1  16123412 Mar 30 12:07 /opt/ldm/madis/dr/sfc/ao/qcms_data/urbanet/20230329_1100