Wiki Replicas are MySQL/MariaDB databases that replicate near-realtime from the production MediaWiki databases of Wikimedia Foundation wikis. The database tables are sanitized for public use.

Access to the Wiki Replicas is automatically granted to all users of Toolforge. See Help:Toolforge/Database to learn how to access the Wiki Replicas.

ToolsDB is a service that allows a Tool shared user to create and maintain a Tool specific database.

See Help:Toolforge/Database#User databases for help on ToolsDB.

ToolsDB is acessible on the following addresses:

It used to run on labsdb1005 and got migrated into a Cloud VPS VM called clouddb1001 in the clouddb-services project (more details about the migration are available in phab:T208754​phab:T193264​).

You can verify the service status and the availability report in Icinga. Active checks are carried out by Toolschecker upon request by Icinga.

The Wikilabels Postgres database, used by ORES, is on a replicated VM cluster: clouddb-wikilabels-01 is the primary with clouddb-wikilabels-02 as the usual replica.

Wikimedia Dumps offers a range of data downloads including full text dumps, and other datasets. More documentation about dumps can be found at Data dumps.

Shared Storage is offered via NFS. It includes shared directories offered to VPS and ToolForge users. Currently offered shares are described at Help:Shared storage. Wikimedia Dumps are also offered via the Shared Storage services, but treated as a Data Service because of their wide use.

The Toolforge environment is set up for access by default, and other Cloud VPS projects can access some resources by requesting access to listed shares by filing a task on Phabricator under the Data-Services and VPS-Projects projects.

The "Cloud Elastic" servers are a replica of the CirrusSearch Elasticsearch indices made available to Wikimedia Cloud Services applications (both Cloud VPS and Toolforge). Applications can use the full power of the elasticsearch search API's to query the search indices in ways that CirrusSearch does not expose directly on the wikis themselves. See Help:CirrusSearch elasticsearch replicas for more details.

These servers are not generally accessible from the internet at large, rather they are only accessible through applications running inside Wikimedia Cloud Services.

Quarry is a graphical web interface that allows users to query the Wiki Replicas with SQL. Quarry is extensively used by analysts, researchers, and people of all experience levels to easily access the databases. See m:Research:Quarry for help.

Quarry requires a Wikimedia SUL account to login.

PAWS is a Jupyter notebooks installation hosted by Wikimedia Cloud Services that hosts Python notebooks and a terminal accessible through a web browser. You can access Wiki Replicas, ToolsDB and Dumps with PAWS.

PAWS requires a Wikimedia SUL account to login.

Wikimedia Cloud Services provides a clone of the OSM (OpenStreetMap) database for usage inside Toolforge and Cloud VPS. See Help:Toolforge/Database#Connecting to OSM via the official CLI PostgreSQL and Openstreetmap Databases for more information.

Wikitech

Content is available under CC BY-SA 3.0 unless otherwise noted.