In order to use this early stage of the database, all that should be required is mariaDB installed, and a handful of python3 packages (numpy, astropy, MySQLdb, scipy and ftplib). Pull this repo into a directory, and then manually run databaseCore.py to setup the initial SQL database and bring database up-to-date. databaseCore.py can then be setup as a cron job to periodically update the SQL databases.
Current pre-requisites:
- MariaDB setup with user 'auscope' (easily changed)
- Python3 with mysqlclient, numpy, astropy and ftplib packages
Example crontab:
# m h dom mon dow command
0 5 * * 1 ~/software/stationFeedbackDB/databaseCore.py master2024.txt auscopeDB
0 7 * * 1 ~/software/stationFeedbackDB/databaseCore.py master2025.txt auscopeDB
0 9 * * 1 ~/software/stationFeedbackDB/updateReports.py auscopeDB
Create or fill the database (hardcoded parameters) with entries processed from the
Database is currently working fine, but reports are broken due to the SQL table name change. Need to fix this, then probably split the reports side off into its own repository.
- requirements.txt, test in a virtual environment
- regarding the pipeline/cron:
- look into looping through past master schedules as required
- i would put the command line args as parameters in a config file...
- use a proper logger