Help:CirrusSearch elasticsearch replicas: Difference between revisions
Revision as of 12:38, 17 May 2019 (view source)
Ebernhardson (talk | contribs)
(Created page with "Cloud Elastic is a replica of the CirrusSearch elasticsearch indices made available to WMF cloud applications. Applications can use the full powe...")
 
Revision as of 12:39, 17 May 2019 (view source)
Ebernhardson (talk | contribs)
Newer edit →
Line 26:Line 26:


All wikis have two indices, of the format <code>&lt;dbname&gt;_content</code> and <code>&lt;dbname&gt;_general</code>. The content index contains all of the content namespaces of the wiki, the general index contains everything else. So for example on wikipedia's articles are found in the content index, and talk pages are found in the general index. Querying both indices can be done by providing only the wiki db name.All wikis have two indices, of the format <code>&lt;dbname&gt;_content</code> and <code>&lt;dbname&gt;_general</code>. The content index contains all of the content namespaces of the wiki, the general index contains everything else. So for example on wikipedia's articles are found in the content index, and talk pages are found in the general index. Querying both indices can be done by providing only the wiki db name.

=== Schema ===

See [[mw:Extension:CirrusSearch/Schema]].


=== Example Use Cases ====== Example Use Cases ===
Revision as of 12:39, 17 May 2019
Cloud Elastic is a replica of the CirrusSearch elasticsearch indices made available to WMF cloud applications. Applications can use the full power of the elasticsearch search API's to query the search indices in ways that CirrusSearch doesn't expose directly on the wiki's themselves.
Contents
1Accessing
2Indices Available
3Schema
4Example Use Cases
4.1Query all wikis
Accessing
There are actually three clusters, named chi, psi and omega. chi contains approximately the 200 largest wikis. psi and omega contain equal splits of the remaining smaller wikis.
NameURL
chihttps://cloudelastic1001.wikimedia.org:8243/
psihttps://cloudelastic1001.wikimedia.org:8643/
omegahttps://cloudelastic1001.wikimedia.org:8443/
Clusters can be accessed through each other using the elasticsearch cross cluster search syntax. For example labswiki, which lives on the omega cluster, can be queried through the chi cluster with:
curl -XGET https://cloudelastic1001.wikimedia.org:8243/omega:labswiki/_search?q=example
Indices Available
All wikis have two indices, of the format <dbname>_content and <dbname>_general​. The content index contains all of the content namespaces of the wiki, the general index contains everything else. So for example on wikipedia's articles are found in the content index, and talk pages are found in the general index. Querying both indices can be done by providing only the wiki db name.
Schema
See mw:Extension:CirrusSearch/Schema​.
Example Use Cases
Query all wikis
curl -XGET https://cloudelastic1001.wikimedia.org:8243/*,*:*/_search?q=example
Search
This page was last edited on 17 May 2019, at 12:39.
Text is available under the Creative Commons Attribution-ShareAlike License; additional terms may apply. See Terms of Use for details.
Privacy policy
About Wikitech
Disclaimers
Code of Conduct
Mobile view
Developers
Statistics
Cookie statement

Create accountLog in
Help pageDiscussion
ReadView sourceView history
Visit the main pageMain pageRecent changesServer admin log: ProdAdmin log: RelEngIncident statusDeploymentsSRE Team HelpCloud VPS portalToolforge portalRequest VPS projectAdmin log: Cloud VPSWhat links hereRelated changesSpecial pagesPermanent linkPage informationCite this pageCreate a bookDownload as PDFPrintable version