Skip to content
Snippets Groups Projects

2023-10-09 Test session report | staging-sanity

    • Closed Issue created by Ghost User @ghost1

    Session summary

    • Deploy version: 16.5.202310090605-3efa0b327b5.63c8b799c9f
    • Deploy environment: gstg-cny
    • Pipeline: staging 2392441
    • Total 166 tests
    • Passed 148 tests
    • Failed 14 tests
    • 4 other tests (usually skipped)

    Failed jobs

    Manage

    • Total 2 tests
    • Passed 2 tests
    • Failed 0 tests
    • 0 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Manage basic user login user logs in using basic credentials and logs out 11455574 passed -
    Manage Project access tokens can be created and revoked via the UI 11455594 passed -

    Plan

    • Total 55 tests
    • Passed 55 tests
    • Failed 0 tests
    • 0 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Plan Issues list successfully exports issues list as CSV 11455578 passed -
    Plan Contribution Analytics tests contributions 11455578 passed -
    Plan Group milestone creates a group milestone 11455578 passed -
    Plan issue suggestions shows issue suggestions when creating a new issue 11455578 passed -
    Plan for group insights page behaves like default insights page displays issues and merge requests dashboards 11455575 passed -
    Plan for project insights page behaves like default insights page displays issues and merge requests dashboards 11455575 passed -
    Plan Related issues relates and unrelates one issue to/from another 11455575 passed -
    Plan Epics Management creates a confidential epic 11455575 passed -
    Plan Epics Management creates an epic 11455575 passed -
    Plan Epics Management Resources created via API adds/removes issue to/from epic using quick actions 11455575 passed -
    Plan Epics Management Resources created via API Visit epic first closes and reopens an epic 11455575 passed -
    Plan Epics Management Resources created via API Visit epic first comments on epic 11455575 passed -
    Plan Epics Management Resources created via API Visit epic first adds/removes issue to/from epic 11455575 passed -
    Plan filter issue comments activities filters comments and activities in an issue 11455586 passed -
    Plan Group issue boards creates a group issue board via the GUI 11455586 passed -
    Plan Custom email customizes email with additional text 11455586 quarantine passed -
    Plan Read-only board configuration shows board configuration to user without edit permission 11455586 passed -
    Plan Project level issues analytics behaves like issues analytics page displays a graph 11455594 passed -
    Plan Group level issues analytics behaves like issues analytics page displays a graph 11455594 passed -
    Plan Multiple assignees per issue shows the first five assignees and a +n more link in the issue page 11455594 passed -
    Plan Multiple assignees per issue shows the first three assignees and a +n sign in the issues list 11455594 passed -
    Plan check xss occurence in @mentions in issues mentions a user in a comment 11455594 passed -
    Plan Issues weight visualization shows the set weight in the issue page, in the milestone page, and in the issues list page 11455580 passed -
    Plan Epics roadmap presents epic on roadmap 11455580 passed -
    Plan Issue comments comments on an issue and edits the comment 11455580 passed -
    Plan Burndown chart shows burndown chart on milestone page 11455592 passed -
    Plan promote issue to epic promotes issue to epic 11455592 passed -
    Plan Custom issue templates creates an issue via custom template 11455588 passed -
    Plan Testing project wiki file upload by creating a formatted page with an image uploaded 11455588 quarantine passed -
    Plan Configure issue board by label shows only issues that match the configured label 11455588 passed -
    Plan Project milestone creates a project milestone 11455581 passed -
    Plan Sum of issues weights on issue board shows the sum of issues weights in the board list's header 11455581 passed -
    Plan Project issue boards Label issue board shows the just created board with a "Testing" (label) list, and an issue on it 11455581 passed -
    Plan Project issue boards Milestone issue board shows the just created board with a "1.0" (milestone) list, and an issue on it 11455581 passed -
    Plan Project issue boards Assignee issue board shows the just created board with an assignee list, and an issue on it 11455581 passed -
    Plan Merge Request Analytics shows merge request analytics chart and stats 11455581 passed -
    Plan Group issue boards shows multiple group boards in the boards dropdown menu 11455590 passed -
    Plan collapse comments in issue discussions collapses and expands reply for comments in an issue 11455590 passed -
    Plan Milestones Group milestone behaves like when assigned to new issue is assigned 11455590 passed -
    Plan Milestones Group milestone behaves like when assigned to existing issue is assigned 11455590 passed -
    Plan Milestones Project milestone behaves like when assigned to new issue is assigned 11455590 passed -
    Plan Milestones Project milestone behaves like when assigned to existing issue is assigned 11455590 passed -
    Plan Issue board focus mode focuses on issue board 11455590 passed -
    Plan Epics milestone dates API updates epic dates when adding another issue 11455590 passed -
    Plan Epics milestone dates API updates epic dates when removing issue 11455590 passed -
    Plan Epics milestone dates API updates epic dates when deleting milestones 11455590 passed -
    Plan Multiple assignees per issue shows four assignees in the issues list 11455583 passed -
    Plan Configurable issue board renames the issue board 11455583 passed -
    Plan Default issue templates uses default template when creating an issue 11455583 passed -
    Plan Value stream analytics without pre-existing dashboard with custom template behaves like value stream analytics shows vsa dashboard 11455583 passed -
    Plan Value stream analytics without pre-existing dashboard with default template behaves like value stream analytics shows vsa dashboard 11455583 passed -
    Plan Issue creation closes an issue 11455572 passed -
    Plan Issue creation creates an issue 11455572 passed -
    Plan Issue creation when using attachments in comments comments on an issue with an attachment 11455572 passed -
    Plan mention mentions another user in an issue 11455572 passed -

    Create

    • Total 48 tests
    • Passed 38 tests
    • Failed 9 tests
    • 1 other tests (usually skipped)
    Test Job Status Action
    Create Git push over HTTP pushes to a project using a specific Praefect repository storage 11455574 failed
    • failure issue exists or was created
    Create Git push over HTTP user pushes code to the repository 11455574 failed
    • failure issue exists or was created
    Create Git push over HTTP user using a personal access token pushes code to the repository 11455574 failed
    • failure issue exists or was created
    Create SSH key support pushes code to the repository via SSH 11455574 failed
    • failure issue exists or was created
    Create Git push to canary Gitaly node over HTTP pushes to a project using a canary specific Gitaly repository storage 11455574 failed
    • failure issue exists or was created
    Create Cherry picking from a merge request creates a merge request 11455578 failed
    • failure issue exists or was created
    Create Reverting a commit creates a merge request 11455580 failed
    • failure issue exists or was created
    Create new merge request from the event notification after a push via the API creates a merge request 11455581 failed
    Create new merge request from the event notification after a push via the git CLI creates a merge request 11455581 failed
    Passed tests:
    Test Job Status Action
    Create Create a new merge request creates a basic merge request 11455574 passed -
    Create SSH keys support user can add an SSH key 11455574 passed -
    Create SSH keys support after adding an ssh key can delete an ssh key 11455574 passed -
    Create SSH key support pushes multiple branches and tags together 11455574 passed -
    Create Cherry picking a commit creates a merge request 11455575 passed -
    Create File management user creates a file via the Web 11455575 passed -
    Create Multiple file snippet behaves like copying snippet file contents copies a multi-file project_snippet to a comment and verifies them 11455586 passed -
    Create Multiple file snippet behaves like copying snippet file contents copies a multi-file personal_snippet to a comment and verifies them 11455586 passed -
    Create Download merge request patch and diff views the merge request plain diff 11455586 passed -
    Create Download merge request patch and diff views the merge request patches 11455586 passed -
    Create Multiple file snippet creates a personal snippet with multiple files 11455586 passed -
    Create Merge request push options sets labels 11455594 passed -
    Create Merge request push options when labels are set already removes them on subsequent push 11455594 passed -
    Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing project_snippet to make it single-file 11455580 passed -
    Create Multiple file snippet behaves like deleting file from snippet deletes second file from an existing personal_snippet to make it single-file 11455580 passed -
    Create Merge request custom templates creates a merge request via custom template 11455580 passed -
    Create Multiple file snippet creates a project snippet with multiple files 11455592 passed -
    Create Commit data user views raw commit diff 11455592 passed -
    Create Commit data user views raw email patch 11455592 passed -
    Create Protected branch support when developers and maintainers are not allowed to push to a protected branch user without push rights fails to push 11455588 passed -
    Create Protected branch support when developers and maintainers are allowed to push to a protected branch user with push rights successfully pushes 11455588 passed -
    Create Merge request push options sets a target branch 11455588 passed -
    Create Merge request suggestions applies a single suggestion with a custom message 11455588 passed -
    Create Batch comments in merge request user submits a diff review 11455588 passed -
    Create Batch comments in merge request user submits a non-diff review 11455588 passed -
    Create Merge request push options sets title and description 11455581 passed -
    Create Default merge request templates uses default template when creating a merge request 11455581 passed -
    Create Repository tags when protected behaves like unsuccessful tag creation cannot be created by an unauthorized developer_user 11455581 passed -
    Create Repository tags when protected behaves like successful tag creation can be created by maintainer_user 11455581 passed -
    Create Repository tags when not protected behaves like successful tag creation can be created by maintainer_user 11455581 passed -
    Create Repository tags when not protected behaves like successful tag creation can be created by developer_user 11455581 passed -
    Create Merge request push options removes the source branch 11455590 passed -
    Create Merge request squashing user squashes commits while merging 11455590 passed -
    Create Merge request batch suggestions applies multiple suggestions 11455583 passed -
    Create Sharing snippets when the snippet is changed to private does not display Embed/Share dropdown 11455583 passed -
    Create Sharing snippets when the snippet is public can be shared with not signed-in users 11455583 passed -
    Create File management user edits a file via the Web 11455583 passed -
    Create Personal snippet creation user creates a personal snippet 11455572 passed -
    Other tests:
    Test Job Status Action
    Create Approval rules allows multiple approval rules with users and groups 11455580 quarantine pending -

    Verify

    • Total 8 tests
    • Passed 6 tests
    • Failed 2 tests
    • 0 other tests (usually skipped)
    Test Job Status Action
    Verify Pipelines for merged results and merge trains creates a pipeline with merged results 11455578 failed
    Verify Pipelines for merged results and merge trains merges via a merge train 11455578 failed
    Passed tests:
    Test Job Status Action
    Verify Include local config file paths with wildcard runs the pipeline with composed config 11455594 passed -
    Verify Parent-child pipelines independent relationship parent pipelines passes if child passes 11455580 passed -
    Verify Parent-child pipelines independent relationship parent pipeline passes even if child fails 11455580 passed -
    Verify Run pipeline with web only rule can trigger pipeline 11455581 passed -
    Verify Parent-child pipelines dependent relationship parent pipeline fails if child fails 11455590 passed -
    Verify Parent-child pipelines dependent relationship parent pipelines passes if child passes 11455590 passed -

    Package

    • Total 1 tests
    • Passed 1 tests
    • Failed 0 tests
    • 0 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Package SaaS Container Registry pulls an image from an existing repository 11455572 passed -

    Monitor

    • Total 4 tests
    • Passed 4 tests
    • Failed 0 tests
    • 0 other tests (usually skipped)
    Passed tests:
    Test Job Status Action
    Monitor Alert settings when using Prometheus integration behaves like sends test alert creates new alert 11455574 passed -
    Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert creates new alert 11455574 passed -
    Monitor Alert settings when using HTTP endpoint integration behaves like sends test alert using authorization key creates new alert 11455572 passed -
    Monitor Alert settings when using Prometheus integration behaves like sends test alert using authorization key creates new alert 11455572 passed -

    Govern

    • Total 25 tests
    • Passed 22 tests
    • Failed 2 tests
    • 1 other tests (usually skipped)
    Test Job Status Action
    Govern Project for add project behaves like audit event logs audit events for UI operations 11455586 failed
    • failure issue exists or was created
    Govern Group for add user, change access level, remove user behaves like audit event logs audit events for UI operations 11455580 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Govern Scan result policy requires approval when a pipeline report has findings matching the scan result policy 11455578 quarantine passed -
    Govern Project for project archive and unarchive behaves like audit event logs audit events for UI operations 11455586 passed -
    Govern Project for add deploy key behaves like audit event logs audit events for UI operations 11455586 passed -
    Govern Project for add user access as guest behaves like audit event logs audit events for UI operations 11455586 passed -
    Govern Project for change visibility behaves like audit event logs audit events for UI operations 11455586 passed -
    Govern Security Reports in a Merge Request Widget displays vulnerabilities in merge request widget 11455586 passed -
    Govern Project vulnerability report validates "fix a vulnerability" workflow 11455594 passed -
    Govern project vulnerability report can successfully bulk change status to confirmed in vulnerability report 11455594 passed -
    Govern project vulnerability report can bulk dismiss vulnerabilities as false positive in vulnerability report 11455594 passed -
    Govern project vulnerability report can successfully change status of a vulnerability in vulnerability details page 11455594 passed -
    Govern Group for add and remove project access behaves like audit event logs audit events for UI operations 11455580 passed -
    Govern Group for update group name behaves like audit event logs audit events for UI operations 11455580 passed -
    Govern Group for add group behaves like audit event logs audit events for UI operations 11455580 passed -
    Govern Vulnerability management in a merge request can dismiss a security finding with reason from pipeline security tab 11455592 passed -
    Govern Group for enable and disable membership lock behaves like audit event logs audit events for UI operations 11455592 passed -
    Govern Group for enable and disable allow user request access behaves like audit event logs audit events for UI operations 11455592 passed -
    Govern Group for disable and Enable LFS behaves like audit event logs audit events for UI operations 11455592 passed -
    Govern Group for change project creation level behaves like audit event logs audit events for UI operations 11455592 passed -
    Govern Security Dashboard in a Project shows vulnerability details 11455583 passed -
    Govern Security Dashboard in a Project creates an issue from vulnerability details 11455583 passed -
    Govern Policies List page can navigate to Policy Editor page 11455572 passed -
    Govern Policies List page can load Policies page and view the policies list 11455572 passed -
    Other tests:
    Test Job Status Action
    Govern MR security widget checks that dismissed vulnerabilities do not show up 11455580 quarantine pending -

    Data_stores

    • Total 22 tests
    • Passed 20 tests
    • Failed 1 tests
    • 1 other tests (usually skipped)
    Test Job Status Action
    Data Stores Project transfer user transfers a project between groups 11455586 failed
    • failure issue exists or was created
    Passed tests:
    Test Job Status Action
    Data Stores Users API GET /users/:username with a valid username 11455578 passed -
    Data Stores Users API GET /users/:username with an invalid username 11455578 passed -
    Data Stores Users API GET /users 11455578 passed -
    Data Stores User with terminated parent group membership can not edit the project files 11455575 passed -
    Data Stores Project activity with git push creates an event in the activity page 11455594 passed -
    Data Stores User when added to parent group is allowed to push code to sub-group project via the CLI 11455594 passed -
    Data Stores User when added to parent group is allowed to create a file in sub-group project via the API 11455594 passed -
    Data Stores User when added to sub-group is not allowed to commit to parent group project via the API 11455594 passed -
    Data Stores User when added to sub-group is not allowed to push code to parent group project via the CLI 11455594 passed -
    Data Stores Project Member adds a project member 11455592 passed -
    Data Stores Project badge creates project badge 11455592 passed -
    Data Stores Check for broken images when a new user logs in behaves like loads all images is expected to have loaded all images 11455592 passed -
    Data Stores Check for broken images when a new admin logs in behaves like loads all images is expected to have loaded all images 11455592 passed -
    Data Stores Invite group with a personal namespace project behaves like invites group to project grants group and members correct access level 11455588 passed -
    Data Stores Invite group with a group project behaves like invites group to project grants group and members correct access level 11455588 passed -
    Data Stores Project owner permissions for group projects behaves like adds user as maintainer has maintainer role without owner permissions 11455583 passed -
    Data Stores Project owner permissions for group projects behaves like adds user as owner has owner role and permissions 11455583 passed -
    Data Stores Project owner permissions for personal projects behaves like adds user as owner has owner role and permissions 11455583 passed -
    Data Stores Project owner permissions for personal projects behaves like adds user as maintainer has maintainer role without owner permissions 11455583 passed -
    Data Stores Project in group behaves like successful project creation creates a new project 11455572 passed -
    Other tests:
    Test Job Status Action
    Data Stores Project in personal namespace behaves like successful project creation creates a new project 11455572 quarantine pending -

    Unknown

    • Total 1 tests
    • Passed 0 tests
    • Failed 0 tests
    • 1 other tests (usually skipped)
    Other tests:
    Test Job Status Action
    Framework sanity Version check is the specified version 11455572 pending -

    Link to Grafana dashboard for run-type of staging-sanity

    Designs

      Child items ...

      2. Activity

      Please register or sign in to reply