Deployments

Deployments
	Jump to current event Deployment calendar Long-term calendar; 1.42 Roadmap; Train overview; Archive; ; Blocking tasks (Current task); How to monitor errors; Holding the train; 🚨 Emergencies; How to deploy code Heterogeneous deployment; Train deploys; ; Backport windows How to deploy backports; ; Backport vs Train vs Special Window Train vs Backport; Special Windows; Backport windows; ;

Release Engineering and SRE request that you follow the COVID-19 deployment recommendations.

Subscribe in Google Calendar via wikimedia.org_rudis09ii2mm5fk4hgdjeh1u64@group.calendar.google.com.
This may not include one-off windows. If there are differences, then the wiki page is canonical and correct.

This page tracks upcoming deployments of software to the Wikimedia Foundation servers.

Cadence: MediaWiki follows a weekly deploy cadence known as the Deployment Train, except for backports. For other services, teams decide their own schedule.
Schedule: Generally use Backport windows instead of scheduling new windows. But, long running tasks and others things covered by Inclusion criteria do require their own windows. When creating windows, schedule more time than you think you need, to account for issues that might slow you down. One hour is best for most things.
Times are pinned to San Francisco, and thus the UTC time changes in March and November due to the DST.
To add or remove your name from the list, or to schedule a new recurring deploy window, send a patchset to mediawiki/tools/release's deployments-calendar.json file. Add thcipriani as a reviewer.
If you need help, contact Release Engineering on IRC at #wikimedia-releng ^connect; and ping Tyler (thcipriani).
Communicating: Deployments of new or major features should be announced on the Wikimedia blog, Tech News, and/or global MassMessage to relevant communities. Changes that are likely to affect cache behaviour, add new cookies, or utilize new database tables, should be announced on the ops mailing list first.
Something went wrong? See Incident response. Is there a user-impacting problem? Communicate in the #wikimedia-operations ^connect IRC channel. If there is a Phabricator task, ensure #Wikimedia-Incident is tagged, and consider setting the Unbreak Now priority.
For information about the current status of the versions deployed to the various wikis, see https://versions.toolforge.org/
The deployment commands helper can assist with which commands to run, including how to revert your changeː https://deploy-commands.toolforge.org/

Week of March 14

Sunday, March 13

08:00–08:00 UTC #
00:00–00:00 PST

No deploys all day! See Deployments/Emergencies if things are broken.
Deployer
Changes	No Deploys

Monday, March 14

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Adam (awight), Martin (Urbanecm), Taavi (taavi)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Zabe (zabe) [config] 769750 (deploy commands) wikitech: migrate wmf* to wmg* Gergő (tgr) [config] 770496 (deploy commands) Stop using huwiki 500k milestone logo [config, no-op] 770497 (deploy commands) Delete huwiki 500k milestone logo files Requesting Developer (irc-nickname) Gerrit link to backport or config change

15:30–16:00 UTC #
08:30–09:00 PDT

Wikimedia Portals Update
Deployer	Jan Drewniak (jan_drewniak)
Changes	Weekly window for the portals page: https://www.wikipedia.org/

17:00–17:30 UTC #
10:00–10:30 PDT

Wikidata Query Service weekly deploy
Deployer	Ryan (ryankemper)
Changes	...

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Martin (Urbanecm)
Changes	4nn1l2 (nn1l2) [config] 770523 (deploy commands) liwiktionary: Change timezone to CET/CEST Erik B (ebernhardson) [wmf.25] 770056 (deploy commands) cirrus: Cut saneitizer reindexing rate in half Requesting Developer (irc-nickname) Gerrit link to backport or config change

21:00–23:00 UTC #
14:00–16:00 PDT

Weekly Security deployment window
Deployer	Sam (Reedy), Scott (sbassett)
Changes	Held deployment window for Security-team related deploys.

01:00–02:00 UTC #
(Mon) 18:00–19:00 PDT

Automatic branching of MediaWiki, extensions, skins, and vendor – see Heterogeneous_deployment/Train_deploys
Deployer	N/A
Changes	Branch `wmf/1.38.0-wmf.26`

02:00–02:30 UTC #
(Mon) 19:00–19:30 PDT

Manual branching of MediaWiki, extensions, skins, and vendor for REL1_38 – see T302909
Deployer	James_F
Changes	Branch `REL1_38`

Tuesday, March 15

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Adam (awight), Martin (Urbanecm), Taavi (taavi)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	WMDE-Fisch Done [wmf.25] 770057 (deploy commands) TemplateWizard: Fix copy-paste mistake in template search widget Requesting Developer (irc-nickname) Gerrit link to backport or config change

16:00–17:00 UTC #
09:00–10:00 PDT

Puppet request window (Max 6 patches)
Deployer	JBond (jbond), Reuven (rzl)
Changes	Zabe (zabe) 770102 (deploy commands) wikitech_private: stop writing to wmf* constants Requesting Developer (irc-nickname) Gerrit link to Puppet change

17:00–18:00 UTC #
10:00–11:00 PDT

Toolhub
Deployer	bd808
Changes	Deploy latest Toolhub build

18:00–20:00 UTC #
11:00–13:00 PDT

MediaWiki train - Utc-7 Version

Deployer

Jeena (jeena), Ahmon (dancy)

Changes

1.38 schedule

group0	1.38.0-wmf.25->1.38.0-wmf.26
group1	1.38.0-wmf.25
group2	1.38.0-wmf.25

group0 to 1.38.0-wmf.26
Blockers: task T300202

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Martin (Urbanecm)
Changes	Kosta Harlan (kostajh) [config] 771011 (deploy commands) GrowthExperiments: Add another entry to GECampaignPatterns Requesting Developer (irc-nickname)h Gerrit link to backport or config change

Wednesday, March 16

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Adam (awight), Martin (Urbanecm), Taavi (taavi)
Changes	Kartik Mistry (kart_) [config] 770882 (deploy commands) Disable ContentTranslation for non-extended confirmed users on viwiki [testwiki] Create tables: cx_significant_edits and cx_section_translation (T302371) Requesting Developer (irc-nickname) Gerrit link to backport or config change

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Adam W. (awight) Done [config] 771331 (deploy commands) Deploy template features to enwiki Requesting Developer (irc-nickname) Gerrit link to backport or config change

18:00–19:00 UTC #
11:00–12:00 PDT

Train log triage with CPT
Deployer	Jeena (jeena), Ahmon (dancy) + CPT
Changes	See Heterogeneous_deployment/Train_deploys#Breakage

18:00–20:00 UTC #
11:00–13:00 PDT

MediaWiki train - Utc-7 Version

Deployer

Jeena (jeena), Ahmon (dancy)

Changes

1.38 schedule

group0	1.38.0-wmf.26
group1	1.38.0-wmf.25->1.38.0-wmf.26
group2	1.38.0-wmf.25

group1 to 1.38.0-wmf.26
Blockers: task T300202

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Martin (Urbanecm)
Changes	Zabe (zabe) [config] 768254 (deploy commands) Migrate wmfDatacenter(s) to wmgDatacenter(s) Clare Ming (cjming) [wmf.25] 771449 (deploy commands) Add script to update vector skin preferences Clare Ming (cjming) [wmf.26] 771390 (deploy commands) Add insert option for update skin preferences script Kosta Harlan (kostajh) [config] 771451 (deploy commands) GrowthExperiments: Set GEWelcomeSurveyShowMailingListQuestion Requesting Developer (irc-nickname) Gerrit link to backport or config change

00:00–01:00 UTC #
(Wed) 17:00–18:00 PDT

Phabricator update
Deployer	Mukunda (twentyafterfour)
Changes	HOLD: Window to update phabricator.wikimedia.org

Thursday, March 17

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport and config training Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Ariel (apergos)
Changes	Training to do backport and config deployment. To sign up for deployment training use the Deployment Training Request phabricator milestone Requesting Developer (irc-nickname) Gerrit link to backport or config change

10:00–11:00 UTC #
03:00–04:00 PDT

Services – Citoid / Zotero
Deployer	Marielle (mvolz)
Changes	See Citoid

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

16:00–17:00 UTC #
09:00–10:00 PDT

Puppet request window (Max 6 patches)
Deployer	JBond (jbond), Reuven (rzl)
Changes	Requesting Developer (irc-nickname) Gerrit link to Puppet change

18:00–20:00 UTC #
11:00–13:00 PDT

MediaWiki train - Utc-7 Version

Deployer

Jeena (jeena), Ahmon (dancy)

Changes

1.38 schedule

group0	1.38.0-wmf.26
group1	1.38.0-wmf.26
group2	1.38.0-wmf.25->1.38.0-wmf.26

group2 to 1.38.0-wmf.26
Blockers: task T300202

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport and config training Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Brennen (brennen)
Changes	Training to do backport and config deployment. To sign up for deployment training use the Deployment Training Request phabricator milestone Requesting Developer (irc-nickname) Gerrit link to backport or config change

Friday, March 18

07:00–07:00 UTC #
00:00–00:00 PDT

No deploys all day! See Deployments/Emergencies if things are broken.
Deployer
Changes	No Deploys

Saturday, March 19

07:00–07:00 UTC #
00:00–00:00 PDT

No deploys all day! See Deployments/Emergencies if things are broken.
Deployer
Changes	No Deploys

Week of March 21

Sunday, March 20

07:00–07:00 UTC #
00:00–00:00 PDT

No deploys all day! See Deployments/Emergencies if things are broken.
Deployer
Changes	No Deploys

02:00–03:00 UTC #
(Sun) 19:00–20:00 PDT

Automatic 🚂🧪Trainsperiment Week branching of MediaWiki, extensions, skins, and vendor – see Heterogeneous_deployment/Train_deploys
Deployer	N/A
Changes	Branch `wmf/1.39.0-wmf.1`

Monday, March 21

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Adam (awight), Martin (Urbanecm), Taavi (taavi)
Changes	Kartik Mistry (kart_) [x1] Create new tables: cx_significant_edits and cx_section_translation (T302371) Requesting Developer (irc-nickname) Gerrit link to backport or config change

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

08:00–10:00 UTC #
01:00–03:00 PDT

🚂🧪Trainsperiment Week Deploy

Deployer

Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)

Changes

1.39 schedule

group0	1.38.0-wmf.26->1.39.0-wmf.1
group1	1.38.0-wmf.26->1.39.0-wmf.1
group2	1.39.0-wmf.1

group0 to 1.39.0-wmf.1, group1 to 1.39.0-wmf.1
Blockers: task T300203

12:00–13:00 UTC #
05:00–06:00 PDT

Automatic 🚂🧪Trainsperiment Week branching of MediaWiki, extensions, skins, and vendor – see Heterogeneous_deployment/Train_deploys
Deployer	N/A
Changes	Branch `wmf/1.39.0-wmf.2`

15:30–16:00 UTC #
08:30–09:00 PDT

Wikimedia Portals Update
Deployer	Jan Drewniak (jan_drewniak)
Changes	Weekly window for the portals page: https://www.wikipedia.org/

17:00–17:30 UTC #
10:00–10:30 PDT

Wikidata Query Service weekly deploy
Deployer	Ryan (ryankemper)
Changes	...

18:00–20:00 UTC #
11:00–13:00 PDT

🚂🧪Trainsperiment Week Deploy

Deployer

Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)

Changes

1.39 schedule

group0	1.39.0-wmf.1
group1	1.39.0-wmf.1
group2	1.38.0-wmf.26->1.39.0-wmf.1

group2 to 1.39.0-wmf.1

group0	1.39.0-wmf.1->1.39.0-wmf.2
group1	1.39.0-wmf.1->1.39.0-wmf.2
group2	1.39.0-wmf.1->1.39.0-wmf.2

group0 to 1.39.0-wmf.2
group1 to 1.39.0-wmf.2
group2 to 1.39.0-wmf.2
Blockers: task T300203

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

21:00–23:00 UTC #
14:00–16:00 PDT

Weekly Security deployment window
Deployer	Sam (Reedy), Scott (sbassett)
Changes	Held deployment window for Security-team related deploys.

02:00–03:00 UTC #
(Mon) 19:00–20:00 PDT

Automatic 🚂🧪Trainsperiment Week branching of MediaWiki, extensions, skins, and vendor – see Heterogeneous_deployment/Train_deploys
Deployer	N/A
Changes	Branch `wmf/1.39.0-wmf.3`

Tuesday, March 22

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Adam (awight), Martin (Urbanecm), Taavi (taavi)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

08:00–10:00 UTC #
01:00–03:00 PDT

🚂🧪Trainsperiment Week Deploy

Deployer

Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)

Changes

1.39 schedule

group0	1.39.0-wmf.2->1.39.0-wmf.3
group1	1.39.0-wmf.2->1.39.0-wmf.3
group2	1.39.0-wmf.2->1.39.0-wmf.3

group0 to 1.39.0-wmf.3
group1 to 1.39.0-wmf.3
group2 to 1.39.0-wmf.3
Blockers: task T300203

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

16:00–17:00 UTC #
09:00–10:00 PDT

Puppet request window (Max 6 patches)
Deployer	JBond (jbond), Reuven (rzl)
Changes	Requesting Developer (irc-nickname) Gerrit link to Puppet change

18:00–20:00 UTC #
11:00–13:00 PDT

🚂🧪Trainsperiment Week Deploy
Deployer	Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)
Changes	1.39 schedule Cathcup window (if needed) Blockers: task T300203

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

02:00–03:00 UTC #
(Tue) 19:00–20:00 PDT

Automatic 🚂🧪Trainsperiment Week branching of MediaWiki, extensions, skins, and vendor – see Heterogeneous_deployment/Train_deploys
Deployer	N/A
Changes	Branch `wmf/1.39.0-wmf.4`

Wednesday, March 23

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Adam (awight), Martin (Urbanecm), Taavi (taavi)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

08:00–10:00 UTC #
01:00–03:00 PDT

🚂🧪Trainsperiment Week Deploy
Deployer	Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)
Changes	1.39 schedule Catchup window (if needed) Blockers: task T300203

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

18:00–20:00 UTC #
11:00–13:00 PDT

🚂🧪Trainsperiment Week Deploy

Deployer

Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)

Changes

1.39 schedule

group0	1.39.0-wmf.3->1.39.0-wmf.4
group1	1.39.0-wmf.3->1.39.0-wmf.4
group2	1.39.0-wmf.4

group0 to 1.39.0-wmf.4
group1 to 1.39.0-wmf.4
group2 to 1.39.0-wmf.4
Blockers: task T300203

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

00:00–01:00 UTC #
(Wed) 17:00–18:00 PDT

Phabricator update
Deployer	Mukunda (twentyafterfour)
Changes	HOLD: Window to update phabricator.wikimedia.org

Thursday, March 24

07:00–08:00 UTC #
00:00–01:00 PDT

UTC morning backport and config training Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Amir (Amir1), Ariel (apergos)
Changes	Training to do backport and config deployment. To sign up for deployment training use the Deployment Training Request phabricator milestone Requesting Developer (irc-nickname) Gerrit link to backport or config change

08:00–10:00 UTC #
01:00–03:00 PDT

🚂🧪Trainsperiment Week Deploy
Deployer	Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)
Changes	1.39 schedule Catchup window (if needed) Blockers: task T300203

10:00–11:00 UTC #
03:00–04:00 PDT

Services – Citoid / Zotero
Deployer	Marielle (mvolz)
Changes	See Citoid

13:00–14:00 UTC #
06:00–07:00 PDT

UTC afternoon backport window Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Roan (RoanKattouw), Lucas (Lucas_WMDE), Martin (Urbanecm)
Changes	Requesting Developer (irc-nickname) Gerrit link to backport or config change

16:00–17:00 UTC #
09:00–10:00 PDT

Puppet request window (Max 6 patches)
Deployer	JBond (jbond), Reuven (rzl)
Changes	Requesting Developer (irc-nickname) Gerrit link to Puppet change

18:00–20:00 UTC #
11:00–13:00 PDT

🚂🧪Trainsperiment Week Deploy
Deployer	Ahmon (dancy), Antoine (hashar), Brennen (brennen), Dan (dduvall), Jeena (jeena), Jaime (jnuche)
Changes	1.39 schedule Blockers: task T300203

20:00–21:00 UTC #
13:00–14:00 PDT

UTC late backport and config training Your patch may or may not be deployed at the sole discretion of the deployer (Max 6 patches)
Deployer	Brennen (brennen)
Changes	Training to do backport and config deployment. To sign up for deployment training use the Deployment Training Request phabricator milestone Requesting Developer (irc-nickname) Gerrit link to backport or config change

Friday, March 25

07:00–07:00 UTC #
00:00–00:00 PDT

No deploys all day! See Deployments/Emergencies if things are broken.
Deployer
Changes	No Deploys

Saturday, March 26

07:00–07:00 UTC #
00:00–00:00 PDT

No deploys all day! See Deployments/Emergencies if things are broken.
Deployer
Changes	No Deploys