Import 15.7 Planning issue

Planning call meeting recording

Team

~11353826

• 3 BE
• 1 FE
• 1 SET
• 1 shared SEC

Capacity / OOO

• Andrey: 2022-11-30 - 2022-12-17 (3 weeks)
• Rodrigo: 2-3 days out
• George: 2022-11-28 - 2022-12-02 (1 week)
• Testing session: ~2 days for the full team

Team	Weight
backend (excl. SoftServe)	~22
frontend (excl. SoftServe)	9
SoftServeImport	~20

GitLab Migration team bug searching session mentioned below, if planned for 2 days would take 3 weight point for Import internal part of the team and 2 weight points for SoftServe part of the team, see comment.

Anticipated % split for features/bugs/maintenance

This is excluding the work that SoftServe is contributing

• 40% features (weight)
• 30% bugs (weight)
• 30% maintenance (weight)

Boards

• Import Current Milestone Board
• Refinement Board
• Import Security Board

High level Objectives

• Finish GitHub importer
• Improve reliability of the GitLab Migration

Objectives

GitLab Migration

When FF for bulk_import_project is fully rolled out and feature enabled by default (see timeline) we will announce open beta release. This means the feature is not Production ready, but we need to ensure that migrating projects with GitLab Migration does not negatively impact customer data OR put them in a worse place.

In next milestones we want to continue working on GL Migration, focusing on project migration:

• team bug searching session - https://gitlab.com/gitlab-org/manage/import/discussions/-/issues/30+
• fix bugs and make further reliability and efficiency improvements
• make better testing set up - e.g. 2 instances with same users existing in both instances, instance with SAML - and ability to automate this - E2E testing setup for importers (gitlab-org/gitlab#382166 - closed)
• further look out for customer feedback

We can observe numbers on our improved SiSense dashboard.

Product prioritized typefeature list

FF for bulk_import_project rollout issue.

1. Any %15.6 carryover
   1. Not started
      • item
   2. At risk of slipping
      • 5️⃣ Update all import-related group selection dropd... (gitlab-org/gitlab#375958 - closed) frontend
      • 5️⃣ Cancel GitHub project imports - frontend (gitlab-org/gitlab#247325 - closed) frontend
      • 5️⃣ GitHub Importer: API for bulk import of persona... (gitlab-org/gitlab#371099 - closed)
2. New feature work
   • Usability
     • 2️⃣ Add personal access token verification before G... (gitlab-org/gitlab#375057 - closed)
     • 1️⃣ Add missed points in GitHub import progress det... (gitlab-org/gitlab#379105 - closed) not Deliverable
   • GitHub importer
     • 5️⃣ Run model validations when importing from GitHub (gitlab-org/gitlab#373256 - closed)
     • 3️⃣ GitHub importer: give feedback to the user on g... (gitlab-org/gitlab#376283 - closed)

Engineering prioritized typemaintenance list (@wortschi )

1. Any %15.6 carryover
   1. Not started
   • item
   2. At risk of slipping
   • 3️⃣ Update GitLab Migration to use /metadata endpoi... (gitlab-org/gitlab#366319 - closed)
   • 3️⃣ Require `schemes:` kwarg for Gitlab::URLBlocker... (gitlab-org/gitlab#372317 - closed)
   • 2️⃣ Prune ProjectExportJob records (gitlab-org/gitlab#351253 - closed)
2. New maintenance work
   • GitLab Migration
     • 3️⃣ POC: GitLab Migration - export and import relat... (gitlab-org/gitlab#382121 - closed)
     • 3️⃣ GitLab Migration - export relations compressed ... (gitlab-org/gitlab#379216)
     • 2️⃣ GitLab Migration - mark entity as failed when e... (gitlab-org/gitlab#378441 - closed)
     • 2️⃣ GitLab Migration validate entities path in the ... (gitlab-org/gitlab#378435 - closed) not Deliverable
     • 1️⃣ Remove google code as an import source. (gitlab-org/gitlab#379715 - closed) not Deliverable
   • GitHub importer:
     • 2️⃣ Gitlab::GithubImport::ImportPullRequestWorker: ... (gitlab-org/gitlab#378324 - closed)
     • 2️⃣ Gitlab::GithubImport:ImportPullRequestMergedByW... (gitlab-org/gitlab#378326 - closed)
     • 2️⃣ Gitlab::GithubImport::ImportPullRequestReviewWo... (gitlab-org/gitlab#381295 - closed)
   • Security
     • 3️⃣ Investigate if/how Import TLS use follows/recom... (gitlab-org/gitlab#350818)
   • Other
     • 2️⃣ Create and use import_bot in BareRepositoryImport (gitlab-org/gitlab#379107 - closed)
   • Quality:
     • E2E testing setup for importers (gitlab-org/gitlab#382166 - closed)

Prioritized typebug list

1. Any %15.6 carryover
   1. Not started
   • item
   2. At risk of slipping
   • 5️⃣ Gitlab Migration gets stuck in the importing st... (gitlab-org/gitlab#375588 - closed)
2. New bugs
   • Security
     • item
   • Infradev
     • item
   • UX debt
     • 3️⃣ GitLab Migration UI hangs when updating namespa... (gitlab-org/gitlab#350984 - closed) frontend
     • 3️⃣ Update the dropdown component on Group import page (gitlab-org/gitlab#321190 - closed) frontend
   • GitLab Migration
     • 3️⃣ [GitLab Migration] Exported relations fail to d... (gitlab-org/gitlab#383056 - closed)
     • 3️⃣ GitLab Migration - Incorrect user mapped to pro... (gitlab-org/gitlab#381596 - closed)
   • GH Importer
     • 2️⃣ Missing some labeled events for project importe... (gitlab-org/gitlab#375766 - closed)
     • 2️⃣ Cancellation of github repo import forwards to ... (gitlab-org/gitlab#345743 - closed)
     • 1️⃣ GitHub import doesn't associate user even user ... (gitlab-org/gitlab#296604 - closed)
     • 3️⃣ GitHub API (Octokit) search query can grow too ... (gitlab-org/gitlab#332123 - closed)
     • 3️⃣ Mirrored project with LFS files returns Object ... (gitlab-org/gitlab#217925 - closed)

Release Post Items

Status	Issue	Release Post MR
will be done next milestone	Feature flag rollout - bulk_import_projects (gitlab-org/gitlab#339941 - closed)	Migrating GitLab projects by direct transfer Beta (gitlab-com/www-gitlab-com!114711 - merged)
will be done next milestone	GitHub Importer: API for bulk import of persona... (gitlab-org/gitlab#371099 - closed)	GitHub Importer: API for bulk import of persona... (gitlab-com/www-gitlab-com!112869 - merged)
✅	Cancel GitHub project imports - frontend (gitlab-org/gitlab#247325 - closed)	Cancel GitHub project import (gitlab-com/www-gitlab-com!112812 - merged)

Completed Bugs (check off when added to 15.7 bug release post)

• [ ]

Completed UI improvements (check off when added to 15.7 UI improvements release post)

• [ ]

Progress on quarterly OKRs

• Migrate 1 dropdown to Pajamas ✅
  • Replace user_select in app/assets/javascripts/p... (gitlab-org/gitlab#369993 - closed) has been shipped in %15.5
• Reduce number of S2 bugs by 50% (starting at 9 issues) ✅
  • In total, we resolved/closed 6 out of 9 issues and have reached our OKR 🎉
• 90% of the GitLab migrations pass successfully ✅
  • We implemented tracking in gitlab-org/gitlab#341506 (closed) and are currently monitoring the metrics
  • Group migrations: In October, 92% of the migrations to .com and 93% (1,2% timeout, 5,6% failure) of the migrations on self-managed finished successfully.
  • Project migrations: In October, 99% of the migrations to .com and 90% (0,4% timeout, 9,5% failure) of the migrations on self-managed finished successfully.
  • Dashboard link
• Achieve at least equal usage of GitLab migration compared to file-based import/export
  • Group migrations: We have more group migrations done via GitLab migration than import/export
  • Project migrations are still lacking behind

TODO

• Schedule the planning call. Nov, 9th @ 11:30 CET
• Write milestone objectives.
• Review the roadmap with the team.
• Review milestone objectives with the team.
• Discuss capacity (OOO plans).
• Team planning to highlight/guess issues that can be delivered in 15.6, label Deliverable and set milestone to 15.6.
• Publish the planning call video: Unfiltered
• Clone the planning issue for the next milestone and link to this one.

< Previous | Next >