Page MenuHomePhabricator
Projects Release-Engineering-Team

Release-Engineering-TeamGroup
ActivePublic
Watch Project

Milestones
View All

Subprojects
View All

Members (19)

Watchers (4)

Details

Description

Responsibilities

The WMF Release Engineering Team's mission is to enable confident code deployment with feedback loops to inform optimal delivery to production.

https://www.mediawiki.org/wiki/Wikimedia_Release_Engineering_Team

Our Workboards

Milestones

Milestones with emojis

🧟 – An ended sprint with remaining tasks
🔥 – Current active sprint

Software/tooling projects

Here are the projects and components we care about:

Our ACL (Access Control List) project: acl*releng

Team Skill Matrix

Looking for someone to help you on a specific thing? Have a look at the Release Engineering skill matrix.

Deployments

Release-Engineering-Team is responsible for the weekly MediaWiki "Train Deployments," scheduling of code deployments, deployment tooling, etc. Some helpful links below:

Team image: CC-By-SA-4.0 Diego Delso

Recent Activity
View All

Yesterday

Anoop renamed T381940: Requesting GitLab account activation for Amutha2002 from Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] to Requesting GitLab account activation for Amutha2002.
Wed, Dec 11, 8:24 AM · GitLab (Account Approval), Release-Engineering-Team
Amutha2002 added a comment to T381940: Requesting GitLab account activation for Amutha2002.

Requesting GitLab account activation for Amutha2002 ,I am begineer in this wiki developers.I t help me to wkimedia Hackathon.

Wed, Dec 11, 6:09 AM · GitLab (Account Approval), Release-Engineering-Team
Amutha2002 created T381940: Requesting GitLab account activation for Amutha2002.
Wed, Dec 11, 5:48 AM · GitLab (Account Approval), Release-Engineering-Team

Mon, Dec 9

gerritbot added a comment to T381728: Use PHP 8.3 in MediaWiki-Docker.

Change #1101594 had a related patch set uploaded (by Daimona Eaytoy; author: Daimona Eaytoy):

[mediawiki/core@master] docker: Switch to Debian Bookworm and PHP 8.3

https://gerrit.wikimedia.org/r/1101594

Mon, Dec 9, 9:59 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
CodeReviewBot added a project to T381728: Use PHP 8.3 in MediaWiki-Docker: Patch-For-Review.

daimona opened https://gitlab.wikimedia.org/repos/releng/dev-images/-/merge_requests/69

Mon, Dec 9, 9:54 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
Daimona claimed T381728: Use PHP 8.3 in MediaWiki-Docker.
Mon, Dec 9, 7:13 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
Daimona added a parent task for T381728: Use PHP 8.3 in MediaWiki-Docker: T360995: Migrate Wikimedia production from PHP 8.1 to PHP 8.3.
Mon, Dec 9, 4:40 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker
affandymurad created T381774: Requesting GitLab account activation for affandymurad.
Mon, Dec 9, 2:47 PM · GitLab (Account Approval), Release-Engineering-Team
CodeReviewBot added a project to T381473: Generate a dumps-enabled mediawiki image: Patch-For-Review.

oblivian opened https://gitlab.wikimedia.org/repos/releng/release/-/merge_requests/138

Mon, Dec 9, 2:38 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe added a comment to T381473: Generate a dumps-enabled mediawiki image.

I have started looking into it hypothesizing we might want to create a new derivative image for dumps specifically, but then I realized we're just adding about 150 MB in this layer, so it might make sense to actually add the tools needed for dumps to our "debug" image, in order to reduce the amount of time it will take to build images during the release process.

Mon, Dec 9, 10:20 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops

Sat, Dec 7

Daimona created T381728: Use PHP 8.3 in MediaWiki-Docker.
Sat, Dec 7, 11:03 PM · Patch-For-Review, Release-Engineering-Team, dev-images, MediaWiki-Docker

Fri, Dec 6

BTullis added a comment to T381473: Generate a dumps-enabled mediawiki image.
In T381473#10382532, @Joe wrote:
In T381473#10380690, @BTullis wrote:

Would it be a big problem to have the git command in the final image?
Could you see any other benefits to getting the dumps code with rsync from a deployment host, rather than as a git checkout from gerrit? Thanks.

It's not a big problem, but in general we tend to only add to images what's strictly needed. Is there any other reason why having git in the image would be useful?

Fri, Dec 6, 10:54 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops

Thu, Dec 5

Aklapper closed T381531: Requesting GitLab account activation for ranjithraj as Resolved.

The GitLab account does not show "Pending approval" on (admin-only) https://gitlab.wikimedia.org/admin/users?sort=created_desc so I assume this has been somehow already sorted out ?

Thu, Dec 5, 12:47 PM · GitLab (Account Approval), Release-Engineering-Team
Joe added a comment to T381473: Generate a dumps-enabled mediawiki image.
In T381473#10380690, @BTullis wrote:

Would it be a big problem to have the git command in the final image?
Could you see any other benefits to getting the dumps code with rsync from a deployment host, rather than as a git checkout from gerrit? Thanks.

Thu, Dec 5, 9:04 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe added a comment to T381473: Generate a dumps-enabled mediawiki image.

The reason to do what I said is that's how we currently build up the mediawiki code, I'm aware there are other ways to do it but I wanted to maintain consistency with the rest of the process :)

Thu, Dec 5, 9:02 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops

Wed, Dec 4

Ranjithraj created T381531: Requesting GitLab account activation for ranjithraj.
Wed, Dec 4, 8:34 PM · GitLab (Account Approval), Release-Engineering-Team
hashar added a comment to T381473: Generate a dumps-enabled mediawiki image.

You can retrieve a tarball directly from Gerrit using eg:

Wed, Dec 4, 6:47 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
BTullis added a comment to T381473: Generate a dumps-enabled mediawiki image.

Thanks for creating this ticket.

Wed, Dec 4, 5:43 PM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
Joe renamed T352650: Migrate current-generation dumps to run on kubernetes from Migrate current-generation dumps to run from our containerized images to Migrate current-generation dumps to run on kubernetes.
Wed, Dec 4, 10:28 AM · Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, serviceops
Joe created T381473: Generate a dumps-enabled mediawiki image.
Wed, Dec 4, 9:57 AM · Patch-For-Review, Data-Platform-SRE, Epic, Data Products, MW-on-K8s, Dumps-Generation, Release-Engineering-Team, Data-Platform, serviceops
hashar closed T374717: Speed up git clone operation in wmf-quibble job as Resolved.

A build of wmf-quibble-core-vendor-mysql-php74 from this morning show the zuul clone took 34.393 seconds

TOTAL: 142.69199999999995
mediawiki/extensions/WikiEditor 7.649
mediawiki/extensions/CirrusSearch 7.645
mediawiki/extensions/CheckUser 7.156
mediawiki/extensions/Translate 6.735
mediawiki/extensions/Babel 5.763
mediawiki/extensions/CodeEditor 5.474
mediawiki/extensions/ConfirmEdit 5.366
mediawiki/extensions/ContentTranslation 5.072
mediawiki/extensions/Disambiguator 4.565
mediawiki/extensions/Echo 4.258
mediawiki/vendor 3.683
mediawiki/extensions/Wikibase 3.384
mediawiki/extensions/TimedMediaHandler 3.353
mediawiki/extensions/Math 3.236
mediawiki/extensions/PageTriage 2.989
mediawiki/extensions/ProofreadPage 2.579
mediawiki/extensions/CiteThisPage 2.417
mediawiki/extensions/VisualEditor 2.322
mediawiki/extensions/UniversalLanguageSelector 2.238
mediawiki/extensions/WikiLove 2.087
mediawiki/extensions/GrowthExperiments 1.925
mediawiki/extensions/WikimediaMessages 1.807
mediawiki/extensions/Gadgets 1.713
mediawiki/extensions/Interwiki 1.699
mediawiki/extensions/BetaFeatures 1.646
mediawiki/extensions/WikibaseMediaInfo 1.644
mediawiki/extensions/Kartographer 1.633
mediawiki/extensions/AntiSpoof 1.633
mediawiki/skins/MinervaNeue 1.565
mediawiki/extensions/Elastica 1.55
mediawiki/extensions/AbuseFilter 1.52
mediawiki/extensions/FileImporter 1.507
mediawiki/extensions/Thanks 1.502
mediawiki/extensions/MobileFrontend 1.407
mediawiki/extensions/Cite 1.398
mediawiki/extensions/ParserFunctions 1.34
mediawiki/extensions/IPInfo 1.309
mediawiki/skins/Vector 1.275
mediawiki/extensions/Graph 1.223
mediawiki/extensions/InputBox 1.168
mediawiki/extensions/CommunityConfiguration 1.138
mediawiki/extensions/SpamBlacklist 1.127
mediawiki/extensions/JsonConfig 1.123
mediawiki/extensions/WikibaseCirrusSearch 1.116
mediawiki/extensions/GlobalPreferences 1.114
mediawiki/extensions/SiteMatrix 1.113
mediawiki/extensions/GuidedTour 1.106
mediawiki/extensions/ImageMap 1.093
mediawiki/extensions/MobileApp 1.049
mediawiki/extensions/EventBus 1.032
mediawiki/extensions/GeoData 1.009
mediawiki/extensions/EventStreamConfig 0.982
mediawiki/extensions/PdfHandler 0.969
mediawiki/extensions/cldr 0.952
mediawiki/extensions/PageViewInfo 0.944
mediawiki/extensions/MediaModeration 0.918
mediawiki/extensions/SandboxLink 0.911
mediawiki/extensions/GlobalCssJs 0.898
mediawiki/extensions/Scribunto 0.892
mediawiki/extensions/Poem 0.881
mediawiki/extensions/TemplateData 0.865
mediawiki/extensions/PageImages 0.861
mediawiki/extensions/NavigationTiming 0.797
mediawiki/extensions/EventLogging 0.695
mediawiki/extensions/CommunityConfigurationExample 0.672
Wed, Dec 4, 9:10 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

Tue, Dec 3

sbassett closed T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly) as Resolved.
Tue, Dec 3, 7:01 PM · Security-Team, Release-Engineering-Team
sbassett added a comment to T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).
In T381431#10377256, @taavi wrote:

you should be able to self-serve this here: https://gitlab.wikimedia.org/groups/repos/security/-/group_members

Tue, Dec 3, 7:00 PM · Security-Team, Release-Engineering-Team
taavi added a comment to T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).

you should be able to self-serve this here: https://gitlab.wikimedia.org/groups/repos/security/-/group_members

Tue, Dec 3, 6:58 PM · Security-Team, Release-Engineering-Team
sbassett renamed T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly) from Grant Access to JLy (Jimmy Lee) to /repos/security under gitlab.wikimedia.org to Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).
Tue, Dec 3, 6:57 PM · Security-Team, Release-Engineering-Team
sbassett added a parent task for T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly): T380014: Onboard Jimmy Ly to the Security Team.
Tue, Dec 3, 6:56 PM · Security-Team, Release-Engineering-Team
sbassett created T381431: Grant Access to /repos/security under gitlab.wikimedia.org for JLy (Jimmy Ly).
Tue, Dec 3, 6:55 PM · Security-Team, Release-Engineering-Team
Maintenance_bot removed a project from T374717: Speed up git clone operation in wmf-quibble job: Patch-For-Review.
Tue, Dec 3, 5:30 PM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
gerritbot added a comment to T374717: Speed up git clone operation in wmf-quibble job.

Change #1099657 merged by Dzahn:

[operations/puppet@production] ci: add WikimediaMessages to git cache

https://gerrit.wikimedia.org/r/1099657

Tue, Dec 3, 5:10 PM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
hashar reopened T303828: Delete wmf branches from Gerrit repositories, a subtask of T374717: Speed up git clone operation in wmf-quibble job, as Open.
Tue, Dec 3, 7:34 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

Mon, Dec 2

Maintenance_bot removed a project from T378769: scap / puppet dependency issue on reimaged phabricator hosts: Patch-For-Review.
Mon, Dec 2, 6:31 PM · Release-Engineering-Team, collaboration-services, Scap
gerritbot added a comment to T378769: scap / puppet dependency issue on reimaged phabricator hosts.

Change #1098933 merged by Dzahn:

[operations/puppet@production] scap target: ensure scap is installed on host before it is required

https://gerrit.wikimedia.org/r/1098933

Mon, Dec 2, 5:54 PM · Release-Engineering-Team, collaboration-services, Scap
Clement_Goubert updated subscribers of T380958: httpb fails upon deployment of 1.44.0-wmf.5.
In T381250#10370809, @Ladsgroup wrote:

Now erroring with:

11:13:16 Check 'check_testservers_baremetal-1_of_1' failed: Sending to 4 hosts...
https://boardgovcom.wikimedia.org/wiki/Main_Page (/srv/deployment/httpbb-tests/appserver/test_remnant.yaml:43)
  mwdebug2002.codfw.wmnet
    Status code: expected 200, got 503.
    Body: expected to contain 'Board Governance Committee', got '<!DOCTYPE html>\n<html lang="en">\n<meta charset="ut'... (1953 characters total).
===
FAIL: 131 requests sent to each of 4 hosts. 1 request with failed assertions.
Mon, Dec 2, 12:31 PM · Deployments, serviceops, Wikimedia-production-error, Release-Engineering-Team
kostajh added a comment to T374717: Speed up git clone operation in wmf-quibble job.
In T374717#10370843, @hashar wrote:

After having cherry picked the Puppet patch on the integration project, I gave it a try on integration-agent-docker-1040.integration.eqiad1.wikimedia.cloud:

$ sudo docker run -v /srv/git:/srv/git -v "$(pwd)"/src:/src \
    --rm -it docker-registry.wikimedia.org/releng/quibble-buster-php74:1.11.0 \
    -c /bin/true mediawiki/extensions/WikimediaMessages \
    --git-parallel=1 2>&1|ts -s '%H:%M:%.s'
..
00:00:10.559435 INFO:zuul.Cloner:Creating repo mediawiki/extensions/WikimediaMessages from cache /srv/git/mediawiki/extensions/WikimediaMessages.git
00:00:11.003473 INFO:zuul.Cloner:Updating origin remote in repo mediawiki/extensions/WikimediaMessages to https://gerrit.wikimedia.org/r/mediawiki/extensions/WikimediaMessages
00:00:11.785612 INFO:zuul.Cloner:Falling back to branch master
00:00:11.853725 INFO:zuul.Cloner:Prepared mediawiki/extensions/WikimediaMessages repo with branch master at commit 57a8067e12484e5ba12d109362f3c33a1e5ee0da

Cloning WikimediaMessages went from ~ 13 seconds to half a second :-]

Mon, Dec 2, 12:08 PM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
hashar added a comment to T374717: Speed up git clone operation in wmf-quibble job.

After having cherry picked the Puppet patch on the integration project, I gave it a try on integration-agent-docker-1040.integration.eqiad1.wikimedia.cloud:

$ sudo docker run -v /srv/git:/srv/git -v "$(pwd)"/src:/src \
    --rm -it docker-registry.wikimedia.org/releng/quibble-buster-php74:1.11.0 \
    -c /bin/true mediawiki/extensions/WikimediaMessages \
    --git-parallel=1 2>&1|ts -s '%H:%M:%.s'
..
00:00:10.559435 INFO:zuul.Cloner:Creating repo mediawiki/extensions/WikimediaMessages from cache /srv/git/mediawiki/extensions/WikimediaMessages.git
00:00:11.003473 INFO:zuul.Cloner:Updating origin remote in repo mediawiki/extensions/WikimediaMessages to https://gerrit.wikimedia.org/r/mediawiki/extensions/WikimediaMessages
00:00:11.785612 INFO:zuul.Cloner:Falling back to branch master
00:00:11.853725 INFO:zuul.Cloner:Prepared mediawiki/extensions/WikimediaMessages repo with branch master at commit 57a8067e12484e5ba12d109362f3c33a1e5ee0da
Mon, Dec 2, 11:21 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
gerritbot added a project to T374717: Speed up git clone operation in wmf-quibble job: Patch-For-Review.
Mon, Dec 2, 10:46 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
gerritbot added a comment to T374717: Speed up git clone operation in wmf-quibble job.

Change #1099657 had a related patch set uploaded (by Hashar; author: Hashar):

[operations/puppet@production] ci: add WikimediaMessages to git cache

https://gerrit.wikimedia.org/r/1099657

Mon, Dec 2, 10:46 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
Clement_Goubert merged task T381252: legalteam wiki reliably returns 500s into T381250: Uncaught MediaWiki\Config\ConfigException: Translate: Message group subscriptions (TranslateEnableMessageGroupSubscription) are enabled but Echo extension is not installed.
Mon, Dec 2, 10:42 AM · serviceops, Release-Engineering-Team
Ladsgroup merged task T381252: legalteam wiki reliably returns 500s into T381250: Uncaught MediaWiki\Config\ConfigException: Translate: Message group subscriptions (TranslateEnableMessageGroupSubscription) are enabled but Echo extension is not installed.
Mon, Dec 2, 10:42 AM · serviceops, Release-Engineering-Team
Ladsgroup created T381252: legalteam wiki reliably returns 500s .
Mon, Dec 2, 10:41 AM · serviceops, Release-Engineering-Team
hashar added a comment to T374717: Speed up git clone operation in wmf-quibble job.

For mediawiki/extensions/WikimediaMessages taking 13.395, that is when resolving the deltas. It is ~ 50MB, I will add it to the list of mirrored repositories.

Mon, Dec 2, 10:38 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
karapayneWMDE moved T372618: Create a daily job running core + extension PHPUnit tests serially from Wikidata.org Slice to Epics & Stalled on the Wikidata Dev Team board.
Mon, Dec 2, 9:28 AM · Wikidata Dev Team (Epics & Stalled), Patch-For-Review, Wikidata, wmde-wikidata-tech, MediaWiki-Platform-Team (Radar), Release-Engineering-Team, Developer Productivity, MediaWiki-Core-Tests
karapayneWMDE moved T372618: Create a daily job running core + extension PHPUnit tests serially from Incoming to Stalled on the Wikidata Dev Team (Epics & Stalled) board.
Mon, Dec 2, 9:21 AM · Wikidata Dev Team (Epics & Stalled), Patch-For-Review, Wikidata, wmde-wikidata-tech, MediaWiki-Platform-Team (Radar), Release-Engineering-Team, Developer Productivity, MediaWiki-Core-Tests
hashar updated the task description for T374717: Speed up git clone operation in wmf-quibble job.
Mon, Dec 2, 9:14 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure
hashar merged task T380991: Various CI jobs failing with: Could not resolve host: gerrit.wikimedia.org (2024-11-27) into T374830: Various CI jobs running in the integration Cloud VPS project failing due to transient DNS lookup failures, often for our own hosts such as gerrit.wikimedia.org.
Mon, Dec 2, 8:55 AM · ci-test-error (WMF-deployed Build Failure), cloud-services-team, Cloud-VPS, Continuous-Integration-Infrastructure, Release-Engineering-Team

Sun, Dec 1

Pppery closed T381208: Requesting GitLab account activation for King ChristLike1 as Resolved.

https://gitlab.wikimedia.org/kingchristlike1 is now approved.

Sun, Dec 1, 3:06 AM · GitLab (Account Approval), Release-Engineering-Team

Sat, Nov 30

RhinosF1 added a comment to T381208: Requesting GitLab account activation for King ChristLike1.

@KingChristLike: just to check, have you lost access to your KingChristLike account? I assume that's yours.

Sat, Nov 30, 8:00 PM · GitLab (Account Approval), Release-Engineering-Team
RhinosF1 renamed T381208: Requesting GitLab account activation for King ChristLike1 from Requesting GitLab account activation for [YOUR DEVELOPER ACCOUNT USERNAME HERE] to Requesting GitLab account activation for King ChristLike1.
Sat, Nov 30, 7:57 PM · GitLab (Account Approval), Release-Engineering-Team
KingChristLike updated the task description for T381208: Requesting GitLab account activation for King ChristLike1.
Sat, Nov 30, 6:54 PM · GitLab (Account Approval), Release-Engineering-Team
KingChristLike created T381208: Requesting GitLab account activation for King ChristLike1.
Sat, Nov 30, 6:50 PM · GitLab (Account Approval), Release-Engineering-Team
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits