Page MenuHomePhabricator

Cloud-VPS (Project-requests)Milestone
ActivePublic

Details

Description

Requests for creating or deleting Cloud-VPS projects. See openstack-browser for a list of existing projects and their members. For quota changes see Cloud-VPS (Quota-requests)

Before you request a project

  1. Confirm you cannot run your code/bot/thing on Toolforge. You can request access to Toolforge by following the instructions on wikitech. With Toolforge, the underlying infrastructure will be taken care of for you, and you can focus on writing your tool / bot / researchy-thing.
  1. Only request a VPS project if you need root on the VM for a specific purpose (or need testing VMs for MediaWiki changes, etc). Remember that if you have root you have responsibilities too! :)

Maintainer responsibilities

Each Cloud VPS project must have one or more active maintainer. Maintainers must have an active Phabricator account, must subscribe to the cloud-announce mailing list, and must respond to tasks, emails, and requests for action on the part of WMCS staff and admins.

In addition, maintainers of VMs in Cloud VPS projects must provide basic maintenance on their servers: puppet needs to be kept in working order, upgrades will need to be applied periodically, and VMs will need to be periodically deleted and recreated with updated OS images.

If a project is not actively maintained, or WMCS staff are unable to contact maintainers for a long period of time, that project will be shut down and ultimately deleted along with all associated configuration and data.

Project scope

Cloud VPS projects should be scoped based around concrete products or software projects, rather than the team working on them. The three main problems that we (the Cloud Services team) have seen in the past with team ownership/scope for Cloud VPS projects are:

  • Team gets disbanded/reorganized but its project needs to live on due to hosting of important VMs
  • Difficulty establishing who is the primary point of contact for a given VM when trying to reclaim quota or fix a broken instance
  • Tendency to close membership/participation to only team members rather than inviting participation by other volunteers

There are things that can be done to mitigate these problems, but the easiest thing to do is to create more targeted projects that are scoped to a product/project rather than a team. This can become a burden in other ways if a common group of developers is active on a large number of such projects, so we are willing to be flexible if good cause can be shown for project consolidation.

For more guidance, see https://wikitech.wikimedia.org/wiki/Help:Cloud_VPS_project

Requesting a new project

To request a new project, create a task using this link, and fill out the requested information by <replacing the instructions>

Process

Requests are processed by the Cloud Services team during the Cloud Services team meeting every Wednesday (8:00 PST) that the meeting is held. This schedule may be effected by holidays, conferences, or other unavailability. Requests can be granted when approved by a quorum of at least two WMCS team members.

Once approved (typically noted with a "+1" or "approved" comment on the task), creation of the project in OpenStack will be handled by a member of the Cloud VPS admin team. This will typically happen within 1-2 days, but may take longer due to availability of computing resources or higher priority administration tasks.

See also

Recent Activity

Wed, Apr 10

JJMC89 moved T345755: Request creation of copypatrol VPS project from Backlog to Done on the CopyPatrol board.
Wed, Apr 10, 4:37 PM · Community-Tech, CopyPatrol, Cloud-VPS (Project-requests)

Thu, Apr 4

bvibber added a comment to T361730: Reassign cloud VPS project "media-streaming" to bvibber.

Thanks. Confirmed I'm into the admin interface on new account and can take it from here. :D

Thu, Apr 4, 9:12 PM · User-bd808, Cloud-VPS (Project-requests)

Wed, Apr 3

bd808 moved T361730: Reassign cloud VPS project "media-streaming" to bvibber from Inbox to Approved on the Cloud-VPS (Project-requests) board.
Wed, Apr 3, 7:59 PM · User-bd808, Cloud-VPS (Project-requests)
bd808 closed T361730: Reassign cloud VPS project "media-streaming" to bvibber as Resolved.

{{Done}} I left your legacy account as a member of the project. Please feel free to remove it if there is no longer any need for it to be there.

Wed, Apr 3, 7:59 PM · User-bd808, Cloud-VPS (Project-requests)
bvibber created T361730: Reassign cloud VPS project "media-streaming" to bvibber.
Wed, Apr 3, 6:07 PM · User-bd808, Cloud-VPS (Project-requests)

Tue, Apr 2

fgiunchedi added a comment to T361566: Request creation of o11y VPS project to replace monitoring.

Just a note that we now have https://wikitech.wikimedia.org/wiki/Help:Using_a_web_proxy_to_reach_Cloud_VPS_servers_from_the_internet#wmcloud.org_zone_delegations - depending on your use case could that replace the floating IP?

Thank you, to clarify what I need is *.o11y.wmcloud.org (HTTPS only) to be answered by an instance/backend. If the generic proxy can do also zone delegation then I'm all for it! Last I checked this wasn't possible, hence the floating IP, though things might have changed

That's indeed supported too, I clarified the docs.

Tue, Apr 2, 1:52 PM · Cloud-VPS (Project-requests)
taavi added a comment to T361566: Request creation of o11y VPS project to replace monitoring.

Just a note that we now have https://wikitech.wikimedia.org/wiki/Help:Using_a_web_proxy_to_reach_Cloud_VPS_servers_from_the_internet#wmcloud.org_zone_delegations - depending on your use case could that replace the floating IP?

Thank you, to clarify what I need is *.o11y.wmcloud.org (HTTPS only) to be answered by an instance/backend. If the generic proxy can do also zone delegation then I'm all for it! Last I checked this wasn't possible, hence the floating IP, though things might have changed

Tue, Apr 2, 1:21 PM · Cloud-VPS (Project-requests)
fgiunchedi added a comment to T361566: Request creation of o11y VPS project to replace monitoring.

Thank you folks for the quick action on this! Appreciate it

Tue, Apr 2, 1:17 PM · Cloud-VPS (Project-requests)
rook closed T361566: Request creation of o11y VPS project to replace monitoring as Resolved.
Tue, Apr 2, 12:25 PM · Cloud-VPS (Project-requests)
taavi added a comment to T361566: Request creation of o11y VPS project to replace monitoring.

Floating IPs: 1

Just a note that we now have https://wikitech.wikimedia.org/wiki/Help:Using_a_web_proxy_to_reach_Cloud_VPS_servers_from_the_internet#wmcloud.org_zone_delegations - depending on your use case could that replace the floating IP?

Tue, Apr 2, 12:09 PM · Cloud-VPS (Project-requests)
dcaro added a comment to T361566: Request creation of o11y VPS project to replace monitoring.

+1, please make sure report back when the migration is done so we can free the resources (and whenever possible avoid having two fully used projects in parallel) thanks!

Tue, Apr 2, 12:04 PM · Cloud-VPS (Project-requests)
aborrero added a comment to T361566: Request creation of o11y VPS project to replace monitoring.

LGTM. +1.

Tue, Apr 2, 12:03 PM · Cloud-VPS (Project-requests)
fgiunchedi created T361566: Request creation of o11y VPS project to replace monitoring.
Tue, Apr 2, 9:22 AM · Cloud-VPS (Project-requests)

Mar 14 2024

taavi closed T360091: Request creation of pixel VPS project as Resolved.
Mar 14 2024, 5:42 PM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)
taavi claimed T360091: Request creation of pixel VPS project.
Mar 14 2024, 5:37 PM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)
taavi moved T360091: Request creation of pixel VPS project from Inbox to Approved on the Cloud-VPS (Project-requests) board.
Mar 14 2024, 5:37 PM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)
Andrew added a comment to T360091: Request creation of pixel VPS project.

+1 sounds good

Mar 14 2024, 2:19 PM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)
Peter added a project to T360091: Request creation of pixel VPS project: Web Team Visual Regression Framework.
Mar 14 2024, 8:23 AM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)
Peter created T360091: Request creation of pixel VPS project.
Mar 14 2024, 8:19 AM · Web Team Visual Regression Framework, Quality-and-Test-Engineering-Team, Cloud-VPS (Project-requests)

Mar 6 2024

kostajh added a comment to T359298: Request creation of ipoid-opensearch VPS project.

Should there be an option like g3.cores8.ram16.disk80 for 80GB? I see g3.cores8.ram16.disk20 for 20GB of disk space.

See https://wikitech.wikimedia.org/wiki/Help:Adding_disk_space_to_Cloud_VPS_instances for how disk beyond the 20GB base image is handled these days. Rather than having a number of flavors with varying disk allocations, we now make almost all of the flavors 20GB and encourage use of volumes to create storage that can be attached to any instance in the project as needed. This helps keep the flavors list more manageable and also makes migrating data from one instance to another simpler, encouraging "cattle, not pets" thinking about instance lifecycles.

Mar 6 2024, 8:07 PM · Cloud-VPS (Project-requests)
bd808 added a comment to T359298: Request creation of ipoid-opensearch VPS project.

Should there be an option like g3.cores8.ram16.disk80 for 80GB? I see g3.cores8.ram16.disk20 for 20GB of disk space.

See https://wikitech.wikimedia.org/wiki/Help:Adding_disk_space_to_Cloud_VPS_instances for how disk beyond the 20GB base image is handled these days. Rather than having a number of flavors with varying disk allocations, we now make almost all of the flavors 20GB and encourage use of volumes to create storage that can be attached to any instance in the project as needed. This helps keep the flavors list more manageable and also makes migrating data from one instance to another simpler, encouraging "cattle, not pets" thinking about instance lifecycles.

Mar 6 2024, 7:27 PM · Cloud-VPS (Project-requests)
kostajh added a comment to T359298: Request creation of ipoid-opensearch VPS project.

@kostajh project created, I've added you as a member. The default quotas are 8 cores, 16 GB or ram and 80 GB of disk space. Let us know if you need more.

Mar 6 2024, 5:54 PM · Cloud-VPS (Project-requests)
kostajh added a comment to T359298: Request creation of ipoid-opensearch VPS project.

@fnegri thanks!

Mar 6 2024, 5:35 PM · Cloud-VPS (Project-requests)
fnegri closed T359298: Request creation of ipoid-opensearch VPS project as Resolved.

@kostajh project created, I've added you as a member. The default quotas are 8 cores, 16 GB or ram and 80 GB of disk space. Let us know if you need more.

Mar 6 2024, 5:10 PM · Cloud-VPS (Project-requests)
Stashbot added a comment to T359298: Request creation of ipoid-opensearch VPS project.

Mentioned in SAL (#wikimedia-cloud-feed) [2024-03-06T17:05:56Z] <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'kharlan' in role 'member' (T359298)

Mar 6 2024, 5:06 PM · Cloud-VPS (Project-requests)
Stashbot added a comment to T359298: Request creation of ipoid-opensearch VPS project.

Mentioned in SAL (#wikimedia-cloud-feed) [2024-03-06T17:05:50Z] <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'kharlan' in role 'member' (T359298)

Mar 6 2024, 5:06 PM · Cloud-VPS (Project-requests)
fnegri claimed T359298: Request creation of ipoid-opensearch VPS project.
Mar 6 2024, 4:51 PM · Cloud-VPS (Project-requests)
dcaro added a comment to T359298: Request creation of ipoid-opensearch VPS project.

+1

Mar 6 2024, 4:30 PM · Cloud-VPS (Project-requests)
kostajh created T359298: Request creation of ipoid-opensearch VPS project.
Mar 6 2024, 10:14 AM · Cloud-VPS (Project-requests)

Mar 5 2024

bd808 added a parent task for T354192: Request creation of OpenVAS VPS project: T356830: Floating IP request for project Openvas.
Mar 5 2024, 11:12 PM · Cloud-VPS (Project-requests)
0xDeadbeef added a comment to T358427: Request creation of discordbots VPS project.

Thank you!

Mar 5 2024, 3:08 AM · cloud-services-team, Cloud-VPS (Project-requests)

Mar 4 2024

fnegri closed T358427: Request creation of discordbots VPS project as Resolved.

The new project discordbots was created, and I added @0xDeadbeef and @Legoktm has members. The default quotas should be more than what you need so I haven't touched those.

Mar 4 2024, 3:00 PM · cloud-services-team, Cloud-VPS (Project-requests)
Stashbot added a comment to T358337: Request creation of logger-discord-bot VPS project.

Mentioned in SAL (#wikimedia-cloud) [2024-03-04T14:56:32Z] <dhinus> delete project "loggerdiscordbot" in favor of new project "discordbots" T358337,T358427

Mar 4 2024, 2:57 PM · Cloud-VPS (Project-requests)
Stashbot added a comment to T358427: Request creation of discordbots VPS project.

Mentioned in SAL (#wikimedia-cloud) [2024-03-04T14:56:32Z] <dhinus> delete project "loggerdiscordbot" in favor of new project "discordbots" T358337,T358427

Mar 4 2024, 2:56 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri moved T358427: Request creation of discordbots VPS project from Inbox to Approved on the Cloud-VPS (Project-requests) board.
Mar 4 2024, 2:17 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri moved T358427: Request creation of discordbots VPS project from Inbox to Clinic Duty on the cloud-services-team board.
Mar 4 2024, 2:17 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri renamed T358427: Request creation of discordbots VPS project from Request creation of wikiauthbot-ng VPS project to Request creation of discordbots VPS project.
Mar 4 2024, 2:16 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri added a project to T358427: Request creation of discordbots VPS project: cloud-services-team.
Mar 4 2024, 2:16 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri updated the task description for T358427: Request creation of discordbots VPS project.
Mar 4 2024, 2:15 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri updated the task description for T358427: Request creation of discordbots VPS project.
Mar 4 2024, 2:15 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri added a comment to T358427: Request creation of discordbots VPS project.

I think renaming a project is complicated, I will create a new project discordbots and delete the existing loggerdiscordbot project. Once the new project is created, you'll be able to select it from the project dropdown in Horizon, manage the Trove database under "Database->Instances", and the VM for Redis under "Compute->Instances".

Mar 4 2024, 2:13 PM · cloud-services-team, Cloud-VPS (Project-requests)
0xDeadbeef added a comment to T358427: Request creation of discordbots VPS project.

Bundling would actually be nice. It would probably help with the bus factor since Legoktm (or any future collaborators) can access both if things happen. We can rename it to something like discordbots if possible, but I have not gotten into accessing the trove project yet so I'm unfamiliar with the technicalities behind it. Let me know if there's anything I can do! And thanks.

Mar 4 2024, 12:58 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri added a comment to T358427: Request creation of discordbots VPS project.

Best bet is probably for the project to run its own redis and make some kind of periodic backup dump

Mar 4 2024, 12:53 PM · cloud-services-team, Cloud-VPS (Project-requests)
Andrew added a comment to T358427: Request creation of discordbots VPS project.

@0xDeadbeef unfortunately we don't currently support Redis as a database type in Trove. @Andrew do you think it's something we could enable?

Mar 4 2024, 4:03 AM · cloud-services-team, Cloud-VPS (Project-requests)

Mar 2 2024

0xDeadbeef added a comment to T358427: Request creation of discordbots VPS project.

Per https://github.com/wikimedia/operations-puppet/blob/ee02ed8031f246dd4f309bb7e83eeb9a8f285f51/modules/profile/manifests/toolforge/redis_sentinel.pp#L79-L80 and https://redis.io/docs/reference/eviction/#eviction-policies, it looks like the Redis for Toolforge instance will start deleting old keys once the maxmemory limit is reached. This is usually fine if applications don't want to use redis as a reliable persistent storage (its advertised as a useful cache service), but it would be a bad thing for this specific tool.

Mar 2 2024, 5:38 AM · cloud-services-team, Cloud-VPS (Project-requests)

Mar 1 2024

fnegri updated subscribers of T358427: Request creation of discordbots VPS project.

@0xDeadbeef unfortunately we don't currently support Redis as a database type in Trove. @Andrew do you think it's something we could enable?

Mar 1 2024, 5:35 PM · cloud-services-team, Cloud-VPS (Project-requests)
fnegri closed T358023: Request creation of mdwiki-offline VPS project as Resolved.

Dashes in the project name are discouraged.

Mar 1 2024, 5:21 PM · cloud-services-team, Wikimedia-Medicine, Cloud-VPS (Project-requests)
Stashbot added a comment to T358337: Request creation of logger-discord-bot VPS project.

Mentioned in SAL (#wikimedia-cloud-feed) [2024-03-01T17:19:19Z] <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'dbeef' in role 'member' (T358337)

Mar 1 2024, 5:19 PM · Cloud-VPS (Project-requests)
Stashbot added a comment to T358337: Request creation of logger-discord-bot VPS project.

Mentioned in SAL (#wikimedia-cloud-feed) [2024-03-01T17:19:14Z] <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'dbeef' in role 'member' (T358337)

Mar 1 2024, 5:19 PM · Cloud-VPS (Project-requests)
Stashbot added a comment to T358023: Request creation of mdwiki-offline VPS project.

Mentioned in SAL (#wikimedia-cloud-feed) [2024-03-01T17:19:07Z] <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'timmoody' in role 'member' (T358023)

Mar 1 2024, 5:19 PM · cloud-services-team, Wikimedia-Medicine, Cloud-VPS (Project-requests)