Background information
Re-import full planet data into maps2009.
executing the import
- disable disable_replication_cron and disable_tile_generation_cron in hieradata
- execute initial-imposm-import script using the following command
# change -d value accordingly when performing the import with the most updated values # from https://planet.openstreetmap.org/pbf/ -> latest planet date # this step should take ~13 hours and potentially trigger WAL errors sudo -s screen -DR imposm-initial-import -d 220530 -x webproxy.codfw.wmnet:8080
- Post a log message in IRC #wikimedia-operations !log maintenance: trigger full planet re-import for maps codfw
- monitor the full planet import
- Did the script finished properly?
- Are the logs sufficient?
When the import is done, the data won't be available in production, the data will be in the import schema
- deploy data to the public schema by running:
sudo -u osmupdater imposm-deploy-import
- REINDEX DATABASE gis;
- monitor and check the APIs,
if needed rollback with the following command
sudo -u osmupdater imposm-rollback-import
- check if sql functions and indexes are applied (if not apply them manually)
- re-enable the replication service and check for its health
- re-enable the tile-generation cron and check for its health
- clean-up old data in backup
- Post a log message in IRC #wikimedia-operations !log <your_username>@maps2009 imposm-removebackup-import (T305845)
imposm-removebackup-import
Open questions
- How much SRE intervention will be needed?
Acceptance criteria
- DB is refreshed with most updated data
- perform DC switchover