Tech Staff Meeting Notes April 5, 2010
The top priority is always repair of down stations.
NM problem stations
ET problem stations
We reviewed the task list at this meeting and afterward to come up with this April 2010 revision. For comparison, here's the old table from February 6, 2009. Note that everyone is still needed to work on essentially all tasks.
We have no news nor highlights.
Holly's NM list:
My list of high priority stations to fix: RDGT, PWLA, HOVM, CTCT, WYBT, and MARM
Down
RDGT
PWLA
HOVM
CTCT.EHE
MPH.LLZ
Sporadic Outages
BACM
BRNM
Interference ? see attached MARM-April2010.docx
MARM.EHN
Muted Amplitude
BETM.EHN
DWDM.EHE
FLPT.EHN
GOBM.EHN
LRAR.EHE
MARM.EHE
MATM.EHN
MLDM.EHE
MTAR.EHN
NBNT.EHN
Isis Oxidation problem
MCAM.EHN
WYBT.EHZ - see attached WYBT-April2010.docx
SJBM.EHN
Gain channel problems
CHRM
MORT
Unusable for v. small events
PLAR
CHRM
Add BRNM, which also knocks out BACM, to the list. It's been having problems for the last week. Looks like an intermittent power problem, most likely a bad SR2.
David fixed RDGT but it went down again a few days later.
Greg found and fixed a problem with the PWLA VCO. Its ready to install after he ships it back to us.
TNMT and MIST were single component failures. Found only some minor corrosion and mold on the connectors and some slightly sprung contacts. The others could be relatively easy if that's that problem.
Richardson, LNXT, and SFTN need new batteries.
MKTA:
Need alternate comm path. Telecom says dsl isn't available (though we once had ISDN).
Mitch met with Bob Woodward and Bob Busby of IRIS about EarthScope. Bob Busby said he might be able to loan us some WildBlue hardware to test. Assuming we can get sufficient bandwidth without violating shared use maxima, this could be a viable option if dsl is unavailable.
LNXT:
Still need to tie generator status alarms into lnxtworm
Now that we have a phone line for the dsl, we can replace the adam6060 with the simpler style phone reset.
The DBB is currently stable and there is a second computer at lnxt on the dsl. Its second ethernet on the 10.156 is currently disabled.
NMAD:
Need alternate comm path. Telecom says dsl isn't available (though we once had ISDN).
AZTN: Upgrade PC and replace XLAK clock
CERI:
Need to gather up a contact list (e.g. everyone's home phone, power companies, etc) and put it on webworm (password protected). Jim has a draft of this that so far has all the node contacts. Mitch suggested that the umdrive seisnet space might be a better place than webworm for it.
The DBB firewall installed and operating. Only specific ip's are allowed through. You need to use the route command to manually add a route. Evertying behind the firewall is the same D ip number but with 10.156.1 instead of 141.225.156. Remaining items include:
SFTN mss100 needs a reset.
For some stations (most frequently SEAR) data feeds get dropped. Scream sits there "connecting" but never connects. The mss100 is fine. A disconnect then connect on scream fixes the problem (or rather fixes the symptom--the problem is unknown). Using reboot_mss_ew didn't help. We still have problems at SEAR even with a new mss100. While we still want to upgrade everything to year 3 hardware, Mitch will seek permission to stream at 50 sps and trigger at 200. Jim will verify that we can actually do that. No response from ANSS management on request to stream at 50 and trigger at 200.
NAIT: Couldn't get the NWS cable modem to cooperate at NAIT (firewall?). Dean was going to ask Comcast about it and maybe get a new modem. Steve will follow up.
CVVA is upgraded but there remains an unresolved issue with the firewall Steve is working with Merritt Reagan NGC to get them resolved.
Al is making a practice run on the strongmo trigger download for data from the 3.4 near Dyersburg on Nov 6. Mitch sent these instructions are archving triggered strongmotion data:
HDBR
Recorders 1, 6, and 7 are repaired, configured, and awaiting installation.
Al reports that of the remaining four, only two are associating.
Resets are not working well and tones are degraded. Likely cause is telemetry between the reset unit on the AZTN roof and the DAS's on the bridge. If its ice, it will self-correct. Otherwise we'll check it when we get time and a lane closure to install the 3 repaired units.
HDAR
Bad CMG5 E/W.
Not getting broadband feed.
HDBT
Replace two bad mss100's.
Bad 100' accelerometer.
Down
CCNC
CMGA
LRVA.EHE
Sporadic Outages
GRBT
TRYN
TVNC
Strange signal
ATTN (see attached)
ATTN_GMG-April2010.docx
Unusabale
GMG- horizontals (see attached)
ATTN_GMG-April2010.docx
Strong Motion stations down
ADSC
CVVA
FPAL is back and is now RT130/T120PA/ES-T.
CPCT has bad timing. Gives "gps obscured" errors. Its a mkII dm24 with the old style gps pod. Jim will check the other, ancient CMG3-ESP/DM24 to see if it works. If it does, he'll send that to John. If it doesn't then its still worth a trip to CPCT to see if the antenna is just knocked over or covered with debris after the last storm. There is no way to correct the data so Mitch decided that no data is better than bad data. Al will comment the CPCT lines in scream2ew until its fixed.
Many of the NC station problems are probably because of insufficient power. John will find out what's needed to increase solar and battery to help make it through the winter storms. The ET stations have the same issues but problems are not as evident because they are, in general, at much lower elevation (less snow).
STAR Node
BHT. Chris reports that it is time to seriously pursue another site as access is even difficult by 4-wheeler. David reports moving it will take all the fun out it, what's the worst that could happen? John said that folks at Cumberland Trail State Park said we can put the station at another spot on Black Mtn. which is just a couple of miles NE of the present location. It is accessible by a paved road. We can pursue that or I can look for something that will put it further NE to get it more equidistant between DYTN and WMTN. Right now it is awfully close to DYTN and BCRT. Mitch likes the idea of splitting the difference between DYTN and WMTN. John will dig out his old notes and starting looking around.
BRBC Node
GFM The NC state park service is purchasing GFM. We already have a couple permissions from them and John initiated the paperwork for the GFM permission.
TRYN: the forest service wants to remove the tower. There will be a new 180' tower and we have permission to be on it. We also have permission to be in the building (rack mount only). Can we convert this station to AC?
James has a very nice SOH website at http://www.ceri.memphis.edu/people/jpdavis/gama/results.html.
All stations up.
STLE, NMKM, and RLAP all need a charger upgrade. They are currently working (and have been for a long time) so this is not necessarily a top priority.
Comm line from maintenance shed to park service office at CCAR is being replaced.
We are approved for the following in approximately the same order as we
hope to complete them:
ASL is sending the 13 Reftek's and 13 Trilliums. ASL ordered cables. No word on accelerometers nor additional 3 refteks.
Note that using other funds, we're also upgrading 3 additional ET stations to digital with episensor and FPAL to the same hardware as the other broadbands.
Mitch hung a chart in the war room to track our progress (we're required to make quarterly progress reports and to meet the proposed schedule).
We need to be very careful to keep AG, ARRA, and CERI hardware separate and be certain that hardware purchased by each project goes only to that project.
All replaced DM24's and CMG40T's are to go to south campus and taken off inventory. This hardware is not to be redeployed anywhere in the CERI seismic network nor FDL.
F-150 required a new engine and differential seal. Cost was about $6500. DES chipped in $2k.
Two CMG6TD's are at guralp depot in Menlo for repair.
Need to review power loads and line balance after adding the new AQMS servers. Review needs to consider addition of new landmark servers, mac server, and seisnet deep waveform buffers. The Earth Science Library (ESL) in 3892 is moving to the main branch and has a liebert. We should consider carving out rack space in that room (though backup power is an issue).
The neic has a new metadata website at https://geohazards.usgs.gov/smds/index.php?message=1. John is finished populating it with info from our stations.
Mitch is working on the mountain of paperwork required to contract help from Dave Ketchum to get initial dataless SEED from INV. It will include a visit to Memphis for training. John will be our INV czar.
Our cell phones have extremely poor performance in outlying areas. They should be replaced.
NKU1 is online.
What to do with the Steiner brain dump DVD's?
Mitch made a seisnet group on umdrive. Go to http://umdrive.memphis.edu/mwithers/seisnet You will need your uuid and password. There are several things on there including John's database. We can put contact info there too when its available. Only people in the seisnet group have access to this area. If you download something for update, don't forget to upload it again so that we all have the same version of the files.
There is now a ceri_seis email group that includes all the seismic networks staff.
Rotational sensor is feeding an earthworm but still has IRIG crosstalk problem to fix. Its fine on an Oscope hooked to the output of the mux and looks fine in LabView. Its bad when viewed with wave_viewer. Need to see what the sac files look like to make sure it isn't just a wave_viewer feature.
Chris continues to hound the supply to try to get Parker's old Suburban onto govdeals.
The pink palace display now includes a heli connection for MPHB. Need to retrieve any remaining hardare (e.g. antenna and reciever on roof).
3890 Power Chris is going to make a diagram for 3890. Good luck son.
3876 Power Chris is going to make a diagram for 3876. Good luck son.
Should we have a trouble ticket system?