Commit 5a5a9d52 authored by Andy Hohenner's avatar Andy Hohenner
Browse files

Remove stale Test Platform team references from test-coverage page

parent 0254a3db
Loading
Loading
Loading
Loading
+4 −17
Changes for content/handbook/engineering/testing/test-coverage.md: 4 added lines, 17 removed lines.
Original line number Diff line number Diff line
---
title: "Test Coverage"
description: "The Test Platform Department has coverage to support testing particular scenarios."
description: "An overview of GitLab's test coverage for specific testing scenarios, including offline environments, upgrade paths, and performance environments."
---

### Offline environments / Airgapped GitLab QA scenario

The Test Platform Department has a GitLab QA scenario that supports [offline environment / air-gapped](https://docs.gitlab.com/ee/user/application_security/offline_deployments/) testing.
A [GitLab QA](https://gitlab.com/gitlab-org/gitlab-qa) scenario supports [offline environment / air-gapped](https://docs.gitlab.com/ee/user/application_security/offline_deployments/) testing.
The [scenario](https://gitlab.com/gitlab-org/gitlab-qa/-/blob/master/lib/gitlab/qa/scenario/test/instance/airgapped.rb) `Test::Instance::Airgapped` is part of [GitLab QA](https://gitlab.com/gitlab-org/gitlab-qa/-/blob/master/docs/what_tests_can_be_run.md#testinstanceairgapped)
test scenarios. The suite runs against a test environment including [Gitaly Cluster](https://docs.gitlab.com/ee/administration/gitaly/) which have been configured using `iptables` to drop traffic other than specific ports which allow our test access to the test instances.

@@ -32,7 +32,7 @@ Instructions for working with secure scanners can be found in the [Offline envir

The goal of GitLab Upgrades test coverage is to ensure that a customer following the [upgrade path](https://docs.gitlab.com/ee/update/index.html#upgrade-paths) will be successful.

To achieve the best coverage, Test Platform follows the [Test Pyramid approach](https://docs.gitlab.com/ee/development/testing_guide/testing_levels.html)
To achieve the best coverage, GitLab follows the [Test Pyramid approach](https://docs.gitlab.com/ee/development/testing_guide/testing_levels.html)
by shifting left to unit tests without build environments in merge requests
and going up to system level testing with actual environments being built:

@@ -83,14 +83,6 @@ Additionally, a [`Test::Omnibus::UpdateToNext`](https://gitlab.com/gitlab-org/gi
     [Patch](https://gitlab.com/gitlab-org/release-tools/-/blob/4bb7fc754df6d32c372f3683dfada93525a31a29/lib/tasks/security.rake#L415)
     release pipelines to test upgrades from the current latest released version to the upcoming version.

#### Performance environments nightly upgrades

Framework and Performance Enablement teams support test performance environments listed on [Reference Architecture](https://docs.gitlab.com/ee/administration/reference_architectures/#how-to-interpret-the-results) page.
These environments are built with GitLab Environment Toolkit and are upgraded daily or weekly depending on environment to the latest
nightly image.

Detailed process is described on [Performance and Scalability](https://docs.gitlab.com/ee/administration/reference_architectures/#how-to-interpret-the-results) page.

#### Upgrade Tester

| Upgrade path scenarios               | Example                                                                                                                                          |
@@ -102,9 +94,4 @@ Detailed process is described on [Performance and Scalability](https://docs.gitl
Focused on building and testing different upgrade paths using the [Reference Architectures](https://docs.gitlab.com/ee/administration/reference_architectures/), the Upgrade Tester pipelines build and upgrade environments starting at a specified version and ending at either the latest nightly package or a specific version. For each upgrade the path used to upgrade differs depending on the start and end versions used. For example, when starting with version 16.0.0 the upgrade path would be
`16.0.0, 16.1.6, 16.3.7, 16.7.7, nightly`.

More information can be found within the [Upgrade Tester project](https://gitlab.com/gitlab-org/quality/upgrade-tester) about the schedule and Reference Architecture types that are used for testing. Test results are reported to `#qa-upgrade-results` channel in Slack and monitored by Self-Managed Platform team.

#### Work in progress

Test Platform team is working on improving GitLab upgrades coverage and this effort is
tracked in [epic#12458](https://gitlab.com/groups/gitlab-org/-/epics/12458).
More information can be found within the [Upgrade Tester project](https://gitlab.com/gitlab-org/quality/upgrade-tester) about the schedule and Reference Architecture types that are used for testing.