Online Recipes
Here are some recipies, fault-tree, how-to, to get some of the online database routines/services working again
Please Call the DB expert first: 356-2257
- Restore RunLog Browser
- Restore Migration Code
- Restore Online Daemons
Restore Migration Macros
The Migration Macros are monitored here, if they have stopped the page will display values in red.
- Call Database Expert 356-2257
- Log onto onlinux6.starp.bnl.gov - as stardb: Ask Michael, Wayne, Gene, Jerome for password
- check for runaway processes - for example, these are run as crons so a process starts before its previous exectution finishes, the process never ends and they build up
If this is the case kill each of the processes
- cd to dbcron
Restore RunLog Browser
If the Run Log Browser is not Updating...
- make sure all options are selected and deselect "filter bad"
often - people will complain about missing runs and they are just not selected
- Call DB EXPERT: 349-2257
- Check onldb.star.bnl.gov
- log onto node as stardb (password known by Michael, Wayne, Jerome, Gene)
- df -k ( make sure a disk did not fill) - If it did: cd into the appropriate data directory
(i.e. /mysqldata00/Run_7/port_3501/mysql/data) and copy /dev/null into the large log file onldb.starp.bnl.gov.log
`cp /dev/null > onldb.starp.bnl.gov.log`
- make sure back-end runlog DAEMON is running
- execute /online/production/database/Run_7/dbSenders/bin/runWrite.sh status
Running should be returned
- restart deamon - execute /online/production/database/Run_7/dbSenders/bin/runWrite.sh start
Running should be returned
- if Not Running is returned there is a problem with the code or with daq
- contact DAQ expert to check their DB sender system
- refer to the next section below as to debugging/modifying recompiling code
- Make sure Database is running
- mysql -S /tmp/mysql.3501.sock
- To restart db
- cd to /online/production/database/config
- execute `mysql5.production start 3501`
- try to connect
- debug/modify Daemon Code (be careful and log everything you do)
- check log file at /online/production/database/Run_7/dbSenders/run this may point to an obvious problem
- Source code is located in /online/production/database/Run_7/dbSenders/online/Condition/run
- GDB is not Available usless the code is recompiled NOT as a daemon
- COPY Makefile_debug to Makefile (remember to copy Makefile_good back to Makefile when finished)
- setenv DAEMON RunLogSender
- make
- executable is at /online/production/database/Run_7/dbSenders/bin
- gdb RunLog