wikitech.wikimedia.org
Wikitech
Help:Toolforge/Elasticsearch
< Help:Toolforge
Overview
This page contains information about local Elasticsearch services in Toolforge. For information about the replica of the Wikimedia CirrusSearch Elasticsearch indices available from Toolforge and Cloud VPS instances, see Help:CirrusSearch elasticsearch replicas.
About Elasticsearch
Elasticsearch is a full-text search system built on Apache Lucene. It can be used to index and search data stored as JSON documents.
Elasticsearch is the technology used to power Wikimedia's CirrusSearch system.
Elasticsearch for Toolforge
An Elasticsearch version 7 cluster for all tools is available at http://elasticsearch.svc.tools.eqiad1.wikimedia.cloud​, on the non-standard port 80.
This Elasticsearch cluster is a shared resource. All documents indexed in it can be read by anonymous users from within Toolforge. Write access is needed to create new indexes, and a password is needed to store or update documents.
Read-only access
The Elasticsearch servers allow anyone to read any of the indexes that it contains. This access is limited to other hosts in the Toolforge project (e.g. the OGE job grid, Kubernetes containers, and the bastion servers).
The Elasticsearch service is available on port 80 at http://elasticsearch.svc.tools.eqiad1.wikimedia.cloud
Note: The default Elasticsearch port (9200) is not used.
Write access
Elasticsearch does not offer multi-tenant access control in its open source version.
PUT, POST, or DELETE requests sent to the Elasticsearch servers require HTTP Basic Authentication using a username and password specific to each tool.
Requests for write access can be made by filing this Phabricator task.
When credentials have been created they will be placed in /data/project/$TOOL/.elasticsearch.ini​. Access requests are currently processed manually and may take a few days to be fulfilled.

Communication and support
We communicate and provide support through several primary channels. Please reach out with questions and to join the conversation.
Communicate with us
ConnectBest for
Phabricator Workboard#Cloud-ServicesTask tracking and bug reporting
IRC Channel#wikimedia-cloud​connect
Telegram bridge
mattermost bridge
General discussion and support
Mailing Listcloud@Information about ongoing initiatives, general discussion and support
Announcement emailscloud-announce@Information about critical changes (all messages mirrored to cloud@)
News wiki pageNewsInformation about major near-term plans
Cloud Services BlogClouds & UnicornsLearning more details about some of our work
Wikimedia Technical Blogtechblog.wikimedia.orgNews and stories from the Wikimedia technical movement
Last edited on 25 September 2020, at 21:42
Wikitech
Content is available under CC BY-SA 3.0 unless otherwise noted.
Privacy policy
Terms of Use
Desktop
 Home Random Log in  Settings  Donate  About Wikitech  Disclaimers
WatchEdit