Analytics Engineering
(Redirected from Analytics)
The Wikimedia Foundation's Analytics Engineering team is part of the Technology department.
The Analytics Engineering Team's primary responsibility is to "empower and support data informed decision making across the Foundation and the Community".
We make Wikimedia related data available for querying and analysis to both WMF and the different Wiki communities and stakeholders.
We develop infrastructure so all our users, both within the Foundation and within the different communities, can access data in a self-service fashion that is consistent with the values of the movement.
We keep all our documentation here on Wikitech. See also this FAQ.
About us - Analytics/Team
Contact
If you have questions about our work or the infrastructure we provide, you can contact us in two ways:
Work organization
The analytics team uses Phabricator to track its projects.
Prioritization
Datasets
Systems
We maintain various systems to allow querying of our datasets in different fashion.
System name and linkTypeAccessibility
ArchivaRepository for Java archivesPrivate
AQS - Analytics Query Service
REST API for analytics dataPublic
Clients (stat100X)Analytics client nodes to access Hadoop and various servicesPrivate
Cluster (Hadoop, Gobblin, Hive, Oozie, Spark...)HadoopPrivate
DashikiFramework for building dashboardsPublic
DruidData storage engine optimized for exploratory analyticsPrivate
EventLoggingAd-hoc streaming pipelinePrivate
EventStreamsMediawiki events streamsPublic
HueWeb interface for Hive, Oozie, and other Cluster servicesPrivate
KafkaData transport and streaming systemPrivate
MariaDBData storage for MediaWiki replicas and EventLoggingPrivate
Matomo (formerly known as Piwik)Small-scale web analytics platformPrivate
ReportUpdaterJob SchedulerPrivate
SupersetWeb interface for data visualization and explorationPrivate
JupyterHosted notebooks for data analysisPrivate
TurniloWeb interface for exploring data stored in DruidPrivate
Wikistats (1 and 2)Community Dashboard with high-level metricsPublic
The list of scheduled manual maintenance tasks are documented here.
Try it out! Analytics/Tutorials
We'd rather have you having fun with our data :)
Please check the link above for something that might help you, and let us know if you don't find what you're after.
Table of Content
Go to the Analytics/TOC page to have a list of all pages we have under Analytics.
Last edited on 11 August 2021, at 21:46
Wikitech
Content is available under CC BY-SA 3.0 unless otherwise noted.
Privacy policy
Terms of Use
Desktop
 Home Random Log in  Settings  Donate  About Wikitech  Disclaimers
WatchEdit