Tech Staff Meeting Notes May 23, 2013
The top priority is always repair of down stations.
NM problem stations
ET problem stations
Duty Table updated May 2012 (needs updating)
Dave isn't allowed to eat donuts anymore.
The students have taken over NELE and they're off to an excellent start. Chris will accompany the first install team next week to teach them the details to keep it working for two years. We may also need to punch some holes for them.
Routine Maintenance: Top Priorities for the new year are these 2012 leftovers.
NMAD: 1 ISIS and 0 bb
LNXT: Done
MKTA: 6 ISIS and 1 bb
CLTN needs an earthen berm.
EDIT, NNAR & CHNM: NNAR and CHNM will be redirected to transmit directly to the node instead of through EDIT.
From /gaia/smeagol/dat2/Working/ET/201305/20130524_055500_MAN??
Down
MATM- sporadic
HOVM.EHZ
X501
Unk Problem
CCAR.HNZ -spikes
Mag. 4.0 gain range problems
These stations had problems with the gain channel during the Magnitude 4 Missouri
event on Feb 21, 2012. It isn't clear to me whether they data channels saturated
or whether there was excessive chatter in the gain channel.
See image.
CHRM
DWDM
MATM
FLPT
GNAR needs better insulating berm.
EBZ will require excavating the sensor to trouble shoot the problem. Ancestral myths suggest its 8 feet under. Its also noisy and needs to become 3-c to get s-arrivals. We'll decommission the S-13 and convert it to ungain-ranged isis (so it can stay on the abb and in the automatics).
DBB:
MKTA:
LNXT:
We're using propane too fast. We need to let the level, currently 35%, go down before repairing the leak. Will call Cummins when we're under 10%, probably this fall at current rates.
NMAD:
G and D and the local EMA installed a 25kW generator to power that side of the building. If there's room power-wise would they let us power the rack from it too? We could share the maintenance of the generator. We'd also have to install a transfer switch.
AZTN:
CERI:
Need a PFLR alarm in 218/3904. Currently only get a PFLR when UPS dies. Need to know when Line goes down and when gernator transfers or not.
Generator fuel lift pump, battery & air filter should be replaced. Jim sent a quote to PP for that follow up work but no word yet. Cummins is now on a UM agreement and Jim is working with purchasing to get LNXT generator included.
Twisted pair from Richardson is extremely noisy causing problems with the analog backbone. Richardson is also on the UM 5-year capital improvement plan to be replaced.
Visit to WKNO tower on south campus was good. The building is URM so we want to minimize our footprint inside. There isn't a good telemetry shot to CERI so we'd need to move the ceri node (e.g. mudworm and associated rack, dbb firewall, etc) to the tower. Mitch is checking with ITD about bandwidth.
Jim asked about the feasibility of putting a 100 foot freestanding tower on the CERI campus. Steve spoke with Research Support and P-plant. Past issues with permissions may now be less onerous. We can't put it between houses 1 and 0 because the MLGW right of way to the transformer. Mitch will see about necessary $20-30k. Jim and Steve will look into getting a cost estimate and find out if there is anyplace at CERI that meets code for a tower.
The vlink device servers from B&B work very well and replace the lantronix and routers.
Replace foam rubber plugs at all year 1 stations (need to notch it to accomodate the GPS pods): CBHT.
CVVA. Now has an IP thanks to the VA DMME. John will visit next week. Dave will program a vlink and send it to John.
HDBR
The comm problems for HDBR are a result of cost cutting and a desire to not expand
the footprint on the roof of aztn. We have 7 freewaves on the bridge, transmitting
to 5 freewaves at aztn. This worked well in the lab but doesn't provide sufficient
bandwidth when deployed. Mitch will ask Shahram for $4k to add two more freewaves.
Note from Steve on May 15:
I spent some time looking at the bridge recorders, and wanted update everyone with regards to how things are working. Only two recorders of the seven are completely unreachable, and in both those cases the freewave at the recorder site is reachable. All seven recorders can be power cycled (ie Unit answers to the phone key tone commands) I downloaded a 3min segment of data available at: /gaia/home/sbrewer1/sac/bridge.dat/20130515_151000_MAN Here is a summary of the state of things, arranged by recorder. hdbr-hd1 (pier A) ok waveserver keeping up to date, ssh works fine. hdbr-hd2 (pier B) ok waveserver keeping up to date, ssh works fine. hdbr-hd3 (pier C) unreachable, freewave at site is reachable, power cycle did not help. (bad radio link?) hdbr-hd4 (pier D) ok?, waveserver behind ~2min, ssh doesn't really work. Did password prompt but could not connect. (Bad radio link?) hdbr-hd5 (pier E) no waveserver data, power cycle did not restore, reachable by ssh. Bad configuration? hdbr-hd6 (pier F) ok?, waveserver behind ~2min, ssh doesn't work at all. (bad radio link?) hdbr-hd7 (pier G) ok, came back after power cycle. (Not so good of a radio link?) Looks like most problems could be resolved, if the freewave radio links worked better. The only recorder completely unreachable is hdbr-hd3 (pier C) Is there be a way to add two more freewaves to the AutoZone end, and reconfigure the links without visiting the bridge? thanks, steve.
HDAR
HDBT
LRVA and VHTN are on deck for upgrades with the Basalts from the Depot.
There is a TA station, V52A is installed nearby and a radio link should work to the top of
the Green Top tower. Mitch will contact EarthScope.
STAR Node
Need to replace vandalized windows in the fire tower.
Generator is not functional despite EMA's effort to repair. Consider
additional battery for starworm.
If they get the generator working, a generator on alarm would be useful.
Do we have this at other nodes (e.g. Memphis and LNXT)?
BHT move. Plans are moving forward to move to PMTN.
John suggests that we consider abandoning CMGA and moving it to the TA station TA-X51A. It
has already been installed and a radio link between that location and GMG will work.
BRBC Node
RBNC and CCNC need new radio pairs.
MTTN Node
ASTN: Change to AC power. We have permission and can install anytime.
PIGT has internet issues, needs a site visit.
Have $1500 to by a 1u unit to replace the VM's.
Comms down at STLE.
Do annual maintenance trip prior to current FY end June 30.
One 6TD returned, needs testing. Two others forwarded to England for repair.
The seisnet group on umdrive is at
http://umdrive.memphis.edu/mwithers/seisnet
You will need your uuid and password.
Multi-station image
Down
All stations on BRBC are flatlined. Computer is online and operating normally.
A crew is headed up there to assess storm damage.
Unk Problem
CPCT.HN*
CSTN - gaps
GTTN.EHZ
GPS
AG Network
FDL
NSMP
MISCELLANEOUS