OSM Tileserver: Difference between revisions

From Wikitech
Content deleted Content added
Line 53: Line 53:
* Get rid of some no longer active wmflabs maintainers from the project
* Get rid of some no longer active wmflabs maintainers from the project
* delete overpass-wiki instance. Made by [[User:Jotpe]], but doesn't seem to be in actual use.
* delete overpass-wiki instance. Made by [[User:Jotpe]], but doesn't seem to be in actual use.
* Make a debian stretch package of mod_tile ???????
* Make a debian stretch package of mod_tile ??????? See: [[APT_repository]]

Revision as of 11:26, 19 December 2018

Historic information about this is on OSM Tileserver/Archive.

This page is for the project to implement an OpenStreetMap TileServer hosted in WMF's production infrastructure which serves the same basic data as OSM themselves (synced from them). This is orthogonal to (or in some other sense, a prerequisite for) other OSM efforts going on in Labs for related overlays and databases. Corrections to the information below are welcome, this is all to the best of my knowledge at this time...

Resources

Technology stack

  • Apache with mod_tile
  • Munin
    • conf:
    • output: /var/www/munin
  • Renderd
    • conf: /etc/renderd.conf
    • output: /data/project/tiles/[tilevariant]
    • Important: make sure fonts for global scripts are installed.
    • Hillshading is not rendered it seems. pre generated tilesĀ ?
    • apt: renderd/trusty
  • Mapnik
    • Version: 2.2.0
    • Styles: /data/project/styles/
    • Lib: /usr/lib/mapnik/2.2/input
    • apt: libmapnik-dev/trusty, libmapnik2.2/trusty, mapnik-utils/trusty, openstreetmap-mapnik-carto-stylesheet-data/trusty, python-mapnik/trusty
  • Database
    • Host: osmdb.eqiad.wmnet
    • User: osm
    • Database: gis
    • Referenced from /data/project/styles/*/*.xml

Questions

  • Can we puppetize thisĀ ?
  • Should we switch from renderd to tirexĀ ?
  • Where does the code for renderd come fromĀ ?
  • Why is maps-tiles2.maps.eqiad.wmflabs not serving httpĀ ?
  • Is there no osm2pqslĀ ??????????
  • The styles are 83MB.. but contain the dbname etc. How to not put that in puppet repo, yet have dbname configurableĀ ?

Decisions

  • Dump munin, since grafana and nagf provide the same info
  • Build a new cluster on hostname maps.wmflabs.org (currently unused), for easy testing
  • Switch to Debian Stretch as best supported
  • Create a repo to maintain all the styles, config files and any non-privileged information
  • Get rid of some no longer active wmflabs maintainers from the project
  • delete overpass-wiki instance. Made by User:Jotpe, but doesn't seem to be in actual use.
  • Make a debian stretch package of mod_tileĀ ??????? See: APT_repository