Page MenuHomePhabricator

Service-deployment-requestsTag
ActivePublic

Details

Description

When developers or engineers have developed a new service and would like to see it in production, they should file a request in this project in order to provide MediaWiki-Engineering and SRE teams with the requested information and kick off the process of putting the service in production.

In order to automated the process as much as possible and avoid needless back and forth requesting for information the following is requested:

  • A clear description of what this service does. Preferably a link to a wiki page that clearly states what the service is for.
  • A desired timeline for the introduction of the service into production.
  • At point person. That is the person responsible for this service. They run deployments etc. Could very well be the service owner
  • Used technologies. The language and framework used to implement the service primarily. Do note that there is a conscious effort to avoid too many environments and/or difficult to maintain ones due to maintainability concerns.
  • A link to a simplified proposed architecture diagram (possibly in the same wiki page as the description). The diagram should have:
    • Request flow from:
      1. The browser(end-user) to mediawiki (if any)
      2. The mediawiki (or relevant extension) to the service (if any)
      3. The browser to the service (if any)
      4. The service to any other WMF service (if any)
      5. The service to any external entity e.g. translation APIs, web sites that could be used as citation etc. (if any)
    • Jobs that might need to run via jobrunners (if any)
    • Data store dependencies (if any)
    • Anything else architecturally significant not covered by the above

No intermediate HTTP caching layers should be inserted for simplicity's sake, but if HTTP caching is off the essence it should be noted. Lower level caching layers like memcached/redis should be added. It is highly preferable that the service should continue working if those are unavailable but in case this is impossible it should be clearly noted.

A prepopulated ticket can be created by the following link: Service Request

Recent Activity

Wed, Apr 17

WDoranWMF edited projects for T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production, added: Data Products (Data Products Sprint 12); removed Data Products (Data Products Sprint 11).
Wed, Apr 17, 3:17 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE

Mon, Apr 15

Scott_French added a comment to T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.

@WDoranWMF and @SGupta-WMF, thank you both for the followup.

Mon, Apr 15, 5:54 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
SGupta-WMF updated subscribers of T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.

@WDoranWMF Yep , it makes sense . I confirmed with @mforns that API paths and we agreed on metrics/commons-analytics . Regarding the prefix , all the AQS services use /api/rest_v1/metrics , we could use that from consistency perspective . But still will like @VirginiaPoundstone to confirm .
Also , we are developing CIM AQS services in gitlab . Would that make any significant difference? Should we raise a ticket for CI of the same?

Mon, Apr 15, 5:07 AM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE

Tue, Apr 9

WDoranWMF added a comment to T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.

> The idea would be to get your service up and running as early as possible so you can iterate, but accessible only internally.
Thanks, @SGupta-WMF and @Milimetric are currently working on completion of the first endpoint MR. We're hoping to have that in by tomorrow. With that the service itself will be functional, however, we will still lack data.

Tue, Apr 9, 12:46 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE

Mon, Apr 8

Scott_French added a comment to T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.

Does this binary need to implement some of the endpoints, or just the frame of the service?

Mon, Apr 8, 7:01 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
mforns updated the task description for T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
Mon, Apr 8, 5:29 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
mforns added a comment to T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
  • When do you anticipate having a minimal binary that successfully builds? (to unblock build pipeline setup)

Does this binary need to implement some of the endpoints, or just the frame of the service?

Mon, Apr 8, 2:06 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE

Fri, Apr 5

Eevans triaged T343855: AQS 2.0 differentially private pageviews deploy API as Medium priority.
Fri, Apr 5, 8:44 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE
Eevans changed the status of T343855: AQS 2.0 differentially private pageviews deploy API from Open to Stalled.
Fri, Apr 5, 8:44 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE
VirginiaPoundstone moved T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production from Sprint Backlog to In Process on the Data Products (Data Products Sprint 11) board.
Fri, Apr 5, 4:07 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE

Thu, Apr 4

Scott_French claimed T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
Thu, Apr 4, 4:23 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
Scott_French added a comment to T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.

Additionally, two timeline questions:

  • When do you anticipate having a minimal binary that successfully builds? (to unblock build pipeline setup)
  • When do you anticipate having the service ready to launch publicly? (to unblock final steps that would make it publicly reachable)
Thu, Apr 4, 4:07 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
hnowlan added a comment to T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.

What external paths should we be routing to what internal paths for this service?

Thu, Apr 4, 3:33 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
hnowlan updated the task description for T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
Thu, Apr 4, 1:50 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
hnowlan updated the task description for T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
Thu, Apr 4, 1:44 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
WDoranWMF updated the task description for T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
Thu, Apr 4, 1:06 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
WDoranWMF triaged T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production as High priority.
Thu, Apr 4, 1:06 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE
WDoranWMF created T361835: Commons Impact Metrics AQS 2.0 Deployment to Staging and Production.
Thu, Apr 4, 1:05 PM · Data Products (Data Products Sprint 12), serviceops, Service-deployment-requests, SRE

Feb 1 2024

gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 995005 merged by Clément Goubert:

[operations/puppet@production] ipoid: Fix probe definition

https://gerrit.wikimedia.org/r/995005

Feb 1 2024, 12:56 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
kostajh closed T325147: New Service Request 'iPoid' as Resolved.

Closing this; future work can tag iPoid-Service.

Feb 1 2024, 12:18 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
kostajh closed T305727: Improve service and extension documentation and related configuration guidelines, a subtask of T325147: New Service Request 'iPoid', as Resolved.
Feb 1 2024, 12:16 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a project to T325147: New Service Request 'iPoid': Patch-For-Review.
Feb 1 2024, 12:15 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 995005 had a related patch set uploaded (by Clément Goubert; author: Clément Goubert):

[operations/puppet@production] ipoid: Fix probe definition

https://gerrit.wikimedia.org/r/995005

Feb 1 2024, 12:15 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests

Jan 11 2024

Maintenance_bot removed a project from T325147: New Service Request 'iPoid': Patch-For-Review.
Jan 11 2024, 3:31 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
Stashbot added a comment to T325147: New Service Request 'iPoid'.

Mentioned in SAL (#wikimedia-operations) [2024-01-11T14:51:11Z] <reedy@deploy2002> Synchronized wmf-config/: T325147 (duration: 06m 43s)

Jan 11 2024, 2:51 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 988482 merged by jenkins-bot:

[operations/mediawiki-config@master] ProductionServices: Add entry for ipoid

https://gerrit.wikimedia.org/r/988482

Jan 11 2024, 2:38 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 989829 merged by Effie Mouzeli:

[operations/puppet@production] services_proxy: Add ipoid to the service mesh (fix)

https://gerrit.wikimedia.org/r/989829

Jan 11 2024, 1:46 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 989829 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] services_proxy: Add ipoid to the service mesh (fix)

https://gerrit.wikimedia.org/r/989829

Jan 11 2024, 1:43 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 928487 merged by Effie Mouzeli:

[operations/puppet@production] service.yaml: add iPoid to the service catalogue

https://gerrit.wikimedia.org/r/928487

Jan 11 2024, 10:07 AM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 988453 merged by Effie Mouzeli:

[operations/puppet@production] Add ipoid to the service mesh

https://gerrit.wikimedia.org/r/988453

Jan 11 2024, 9:50 AM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests

Jan 8 2024

gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 988482 had a related patch set uploaded (by Kosta Harlan; author: Kosta Harlan):

[operations/mediawiki-config@master] ProductionServices: Add entry for ipoid

https://gerrit.wikimedia.org/r/988482

Jan 8 2024, 12:57 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
gerritbot added a comment to T325147: New Service Request 'iPoid'.

Change 988453 had a related patch set uploaded (by Kamila Součková; author: Kamila Součková):

[operations/puppet@production] Add ipoid to the service mesh

https://gerrit.wikimedia.org/r/988453

Jan 8 2024, 11:02 AM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
Aklapper edited Description on Service-deployment-requests.
Jan 8 2024, 9:43 AM

Nov 29 2023

calbon moved T329971: New Service Deployment Request: NNLB-200 for machine translation from Watching to 2023-2024 Q3 Done on the Machine-Learning-Team board.
Nov 29 2023, 2:20 PM · Language-Team (Language-2023-July-September), MinT, SRE, serviceops, Service-deployment-requests, Machine-Learning-Team

Nov 13 2023

Htriedman added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

Any updates on this?

Nov 13 2023, 8:11 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE

Nov 10 2023

kostajh closed T336165: Create Wikitech page documenting the iPoid service, a subtask of T325147: New Service Request 'iPoid', as Resolved.
Nov 10 2023, 10:08 AM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests

Nov 8 2023

Marostegui closed T305114: Set up MariaDB for iPoid, a subtask of T325147: New Service Request 'iPoid', as Resolved.
Nov 8 2023, 2:39 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests
jijiki reopened T305114: Set up MariaDB for iPoid, a subtask of T325147: New Service Request 'iPoid', as Open.
Nov 8 2023, 10:57 AM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests

Nov 6 2023

Jdforrester-WMF closed T297314: New Service Request: function-orchestrator and function-evaluator (for Wikifunctions launch) as Resolved.
Nov 6 2023, 8:56 PM · Abstract Wikipedia team, serviceops, Service-deployment-requests, Services, SRE

Nov 1 2023

Tchanders moved T325147: New Service Request 'iPoid' from In Progress to Backlog on the iPoid-Service board.
Nov 1 2023, 6:57 PM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests

Oct 27 2023

Tchanders added a project to T325147: New Service Request 'iPoid': Trust and Safety Product Sprint.
Oct 27 2023, 10:41 AM · Patch-For-Review, Trust and Safety Product Sprint, iPoid-Service, serviceops, Service-deployment-requests

Oct 19 2023

Htriedman added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

Hi @VirginiaPoundstone! Thanks for the detailed questions! I'll try to answer them one by one :)

Oct 19 2023, 8:43 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE

Oct 13 2023

VirginiaPoundstone updated subscribers of T343855: AQS 2.0 differentially private pageviews deploy API.

Had a quick chat with @JAllemandou to think through some open questions we need to answer across teams.

Oct 13 2023, 5:45 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE

Oct 4 2023

Htriedman added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

@Eevans In that case, I'll change the data model to drop it! Will update this thread when it's done.

Oct 4 2023, 10:06 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE
Eevans added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

@Eevans Understood! I'll make that change to the schema soon.

As far as returning a single DPPageviews vs. an array wrapped in DPPageviewsResponse: I was waiting on changing that until we discussed/decided unequivocally that only one response was necessary. Do you all think it makes sense to re-implement the ability to return all page_ids for a given (project, country, year, month, day) tuple if page_id is not included?

Oct 4 2023, 7:59 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE
Htriedman added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

@Eevans Understood! I'll make that change to the schema soon.

Oct 4 2023, 7:52 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE
Eevans added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

Speaking here only with respect to the data model:

Oct 4 2023, 7:05 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE

Oct 3 2023

Htriedman added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

Hi all! I've made updates to the codebase to better comply with @Eevans' feedback, resulting in a greatly simplified interface. I've listed the following design changes below:

Oct 3 2023, 11:50 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE

Sep 27 2023

Nikerabbit moved T329971: New Service Deployment Request: NNLB-200 for machine translation from Needs QA to Done on the Language-Team (Language-2023-July-September) board.
Sep 27 2023, 7:17 AM · Language-Team (Language-2023-July-September), MinT, SRE, serviceops, Service-deployment-requests, Machine-Learning-Team

Sep 22 2023

Eevans added a comment to T343855: AQS 2.0 differentially private pageviews deploy API.

It feels wrong to me to be willing to return all page views on a date: the result set would be enormous and wouldn't be API convenient.

Sep 22 2023, 2:10 PM · Cassandra, serviceops, AQS2.0, Service-deployment-requests, Services, SRE