Page MenuHomePhabricator

Deploy Wikimedia DNS: DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) public resolver
Open, MediumPublic

Description

This task tracks the deployment of Wikimedia DNS, a caching, recursive DNS-over-HTTPS and DNS-over-TLS resolver service.

It is currently an experiment and its use is discouraged until things are stable. If you still plan on using it, your help with the testing is appreciated, but please note that things may break and features may be deprecated at any time as we work towards finalizing this project.

Documentation for this project will be updated on the Wikitech page.

Details

SubjectRepoBranchLines +/-
operations/puppetproduction+2 -2
integration/configmaster+1 -1
integration/configmaster+7 -1
operations/homer/publicmaster+1 -0
operations/homer/publicmaster+1 -0
operations/homer/publicmaster+2 -0
operations/homer/publicmaster+1 -0
operations/puppetproduction+3 -1
operations/homer/publicmaster+1 -0
operations/puppetproduction+1 -0
operations/puppetproduction+5 -3
operations/puppetproduction+1 -0
operations/dnsmaster+38 -1
operations/puppetproduction+7 -2
operations/puppetproduction+1 -1
operations/puppetproduction+5 -0
operations/puppetproduction+12 -0
operations/puppetproduction+1 -1
operations/puppetproduction+6 -0
operations/puppetproduction+33 -0
operations/puppetproduction+1 -1
operations/puppetproduction+12 -0
operations/puppetproduction+8 -8
operations/puppetproduction+9 -0
operations/puppetproduction+13 -2
operations/puppetproduction+2 -2
operations/puppetproduction+31 -5
operations/puppetproduction+2 -0
operations/puppetproduction+6 -4
operations/puppetproduction+1 -0
operations/puppetproduction+2 -2
operations/puppetproduction+80 -32
operations/puppetproduction+10 -5
operations/puppetproduction+6 -0
operations/puppetproduction+16 -5
operations/puppetproduction+6 -6
operations/puppetproduction+2 -2
operations/puppetproduction+26 -0
operations/puppetproduction+7 -1
operations/puppetproduction+3 -0
operations/puppetproduction+61 -18
operations/puppetproduction+2 -2
operations/puppetproduction+8 -0
operations/puppetproduction+6 -0
operations/puppetproduction+2 -0
operations/puppetproduction+20 -21
operations/puppetproduction+36 -15
operations/puppetproduction+6 -2
operations/puppetproduction+3 -3
operations/puppetproduction+60 -15
operations/puppetproduction+18 -4
operations/puppetproduction+15 -4
operations/puppetproduction+7 -0
operations/puppetproduction+9 -1
operations/puppetproduction+23 -5
operations/puppetproduction+5 -0
operations/puppetproduction+55 -1
operations/puppetproduction+7 -0
operations/puppetproduction+1 -0
operations/puppetproduction+15 -1
Show related patches Customize query in gerrit

Related Objects

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Mentioned in SAL (#wikimedia-operations) [2021-02-01T17:10:07Z] <sukhe> upload dnsdist_1.5.1-3wm1 to apt.wm.o (buster) - T252132

Change 660868 had a related patch set uploaded (by Ssingh; owner: Ssingh):
[operations/puppet@production] wikidough: update description for role

https://gerrit.wikimedia.org/r/660868

Change 660868 merged by Ssingh:
[operations/puppet@production] wikidough: update description for role

https://gerrit.wikimedia.org/r/660868

Change 685030 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] wikidough: add nrpe::monitor_service

https://gerrit.wikimedia.org/r/685030

Change 685571 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] aptrepo: add a component for knot-dnsutils

https://gerrit.wikimedia.org/r/685571

Change 685800 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] P:wikidough: Add tcp connect checks for DoH and DTLS

https://gerrit.wikimedia.org/r/685800

Change 685030 abandoned by Ssingh:

[operations/puppet@production] wikidough: add nrpe::monitor_service

Reason:

https://gerrit.wikimedia.org/r/c/operations/puppet/ /685800/

https://gerrit.wikimedia.org/r/685030

Change 685823 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] nagios_common: add check_tcp_ssl

https://gerrit.wikimedia.org/r/685823

Change 685823 merged by Ssingh:

[operations/puppet@production] nagios_common: add check_tcp_ssl

https://gerrit.wikimedia.org/r/685823

Change 686534 had a related patch set uploaded (by Jbond; author: John Bond):

[operations/puppet@production] O:nagios_common: drop -c/-w they are not what i thought

https://gerrit.wikimedia.org/r/686534

Change 686534 merged by Jbond:

[operations/puppet@production] O:nagios_common: drop -c/-w they are not what i thought

https://gerrit.wikimedia.org/r/686534

Change 685800 merged by Ssingh:

[operations/puppet@production] P:wikidough: Add TCP connect check for DoH and DoT

https://gerrit.wikimedia.org/r/685800

Change 686622 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] nagios_common: add check_https_url_custom_ip

https://gerrit.wikimedia.org/r/686622

Change 686625 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] wikidough: use check_https_url_custom_ip for DoH check

https://gerrit.wikimedia.org/r/686625

Change 686622 merged by Ssingh:

[operations/puppet@production] nagios_common: add check_https_url_custom_ip

https://gerrit.wikimedia.org/r/686622

Change 686625 merged by Ssingh:

[operations/puppet@production] wikidough: use check_https_url_custom_ip for DoH check

https://gerrit.wikimedia.org/r/686625

Change 688336 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] wikidough: lookup domain and IP from hiera

https://gerrit.wikimedia.org/r/688336

Change 688336 merged by Ssingh:

[operations/puppet@production] wikidough: lookup domain and IP from hiera

https://gerrit.wikimedia.org/r/688336

Change 692625 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/dns@master] Add zone for wikimedia-dns.org (Wikidough)

https://gerrit.wikimedia.org/r/692625

With the current automation and logic in the generation script, adding just the IP would create this file, that is far from ideal:

diff --git a/org-global b/org-global
new file mode 100644
index 0000000..84245bb
--- /dev/null
+++ b/org-global
@@ -0,0 +1 @@
+wikimedia-dns                            1H IN A 185.71.138.138

It's far from ideal because it could be included in a single place and ofc as soon as we would have another first level domani (example.org) its IPs would endup in the same file, making it not INCLUD-able in the places we'd need.

I also need to check why it's not creating the reverse zone but that's another problem.

In light of this, to unblock @ssingh I'd suggest to go the manual way for now and dig a bit more on how we can map this into our workflow.

@BBlack @ayounsi @cmooney: do you have any thoughts?

I've updated https://netbox.wikimedia.org/ipam/ip-addresses/8539/ to set the DNS as manual for now so that it doesn't gets auto-generated.

Change 692625 merged by Ssingh:

[operations/dns@master] Add zone for wikimedia-dns.org (Wikidough)

https://gerrit.wikimedia.org/r/692625

Change 685571 abandoned by Ssingh:

[operations/puppet@production] aptrepo: add a component for knot-dnsutils

Reason:

this change is no longer required

https://gerrit.wikimedia.org/r/685571

Change 693210 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] acme_chief: add certificates for wikimedia-dns.org

https://gerrit.wikimedia.org/r/693210

Change 693210 merged by Ssingh:

[operations/puppet@production] acme_chief: add certificates for wikimedia-dns.org

https://gerrit.wikimedia.org/r/693210

Change 697942 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] acme_chief: authorize doh300* hosts for Wikidough

https://gerrit.wikimedia.org/r/697942

Change 697942 merged by Ssingh:

[operations/puppet@production] acme_chief: authorize doh300* hosts for Wikidough

https://gerrit.wikimedia.org/r/697942

Change 698162 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] Add doh5001 to BGP anycast in eqsin

https://gerrit.wikimedia.org/r/698162

Change 698162 merged by jenkins-bot:

[operations/homer/public@master] Add doh5001 to BGP anycast in eqsin

https://gerrit.wikimedia.org/r/698162

Change 698206 had a related patch set uploaded (by Ayounsi; author: Ayounsi):

[operations/puppet@production] Add 185.71.138.0/24 to network::external

https://gerrit.wikimedia.org/r/698206

Change 698206 merged by Ayounsi:

[operations/puppet@production] Add 185.71.138.0/24 to network::external and diffscan

https://gerrit.wikimedia.org/r/698206

Mentioned in SAL (#wikimedia-operations) [2021-06-09T06:25:59Z] <XioNoX> Add 185.71.138.0/24 to network::external and diffscan - T252132

Change 698971 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] Add doh4001 to BGP anycast in eqsin

https://gerrit.wikimedia.org/r/698971

Change 698971 merged by jenkins-bot:

[operations/homer/public@master] Add doh4001 to BGP anycast in ulsfo

https://gerrit.wikimedia.org/r/698971

Change 699217 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] Add doh1001 and doh1002 to BGP anycast in eqiad

https://gerrit.wikimedia.org/r/699217

Change 699217 merged by jenkins-bot:

[operations/homer/public@master] Add doh1001 and doh1002 to BGP anycast in eqiad

https://gerrit.wikimedia.org/r/699217

Change 710358 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] Add doh5002 to BGP anycast in eqsin

https://gerrit.wikimedia.org/r/710358

Change 710358 merged by jenkins-bot:

[operations/homer/public@master] Add doh5002 to BGP anycast in eqsin

https://gerrit.wikimedia.org/r/710358

Change 712400 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/homer/public@master] Add doh4002 to BGP anycast in ulsfo

https://gerrit.wikimedia.org/r/712400

Change 712400 merged by jenkins-bot:

[operations/homer/public@master] Add doh4002 to BGP anycast in ulsfo

https://gerrit.wikimedia.org/r/712400

Mentioned in SAL (#wikimedia-operations) [2021-08-13T18:43:23Z] <bblack> reprepro: uploaded gdnsd-3.8.0-1~wmf1 to buster-wikimedia - T252132

Change 712990 had a related patch set uploaded (by BBlack; author: BBlack):

[integration/config@master] operations-dnslint: create version 0.0.12

https://gerrit.wikimedia.org/r/712990

Change 712991 had a related patch set uploaded (by BBlack; author: BBlack):

[integration/config@master] operations-dnslist: bump to 0.0.12

https://gerrit.wikimedia.org/r/712991

Change 712990 merged by jenkins-bot:

[integration/config@master] operations-dnslint: create version 0.0.12

https://gerrit.wikimedia.org/r/712990

Change 712991 merged by jenkins-bot:

[integration/config@master] operations-dnslint: bump to 0.0.12

https://gerrit.wikimedia.org/r/712991

Change 725036 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] wikidough: switch to LE's alternative chain

https://gerrit.wikimedia.org/r/725036

Change 725036 merged by Ssingh:

[operations/puppet@production] wikidough: switch to LE's alternative chain

https://gerrit.wikimedia.org/r/725036

Mentioned in SAL (#wikimedia-operations) [2022-01-11T19:30:10Z] <sukhe> upload pdns-recursor_4.6.0-1wm1 to apt.wm.o (buster) - T252132

ssingh renamed this task from Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) public resolver to Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) public resolver.May 17 2022, 2:40 PM
ssingh updated the task description. (Show Details)
Johan closed subtask Restricted Task as Resolved.Mar 14 2023, 12:27 PM
Johan reopened subtask Restricted Task as Open.
ssingh renamed this task from Deploy Wikidough: Experimental DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) public resolver to Deploy Wikidough: DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) public resolver.Mar 14 2023, 7:01 PM

@ssingh: Removing task assignee as this open task has been assigned for more than two years - See the email sent to task assignee on Feburary 22nd, 2023.
Please assign this task to yourself again if you still realistically [plan to] work on this task - it would be welcome! :)
If this task has been resolved in the meantime, or should not be worked on by anybody ("declined"), please update its task status via "Add Action… 🡒 Change Status".
Also see https://www.mediawiki.org/wiki/Bug_management/Assignee_cleanup for tips how to best manage your individual work in Phabricator. Thanks!

ssingh renamed this task from Deploy Wikidough: DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) public resolver to Deploy Wikimedia DNS: DNS-over-HTTPS (DoH) and DNS-over-TLS (DoT) public resolver.May 31 2023, 3:19 PM
ssingh updated the task description. (Show Details)

https://meta.wikimedia.org/wiki/Wikimedia_DNS is a detailed introduction of the project, including an FAQ.