We have retry and cancel support in the offloading sink. In order
test those, we have to mock a bucket that can simulate delay and error.

In this commit, we add a mock bucket. The bucket is based on fileblob
bucket but intercept its response with cuostizable delay and error.
With such simulation, we can write test cases to examine the
offloading sink's behavior under long delay and frequent error.

The offloading storage is a cloud object store where we can save
our offloaded object to. As part of repository offloading,
interacting with the offloading storage is required for operations
such as downloading, uploading, deleting, and listing.

This commit introduces an new sink implementation to serve as an
abstraction where we can interact with the offloading storage.

localrepo: Exercise `CloneBundle()` fsck configuration in test

See merge request !7579



Merged-by: James Liu <jliu@gitlab.com>
Approved-by: Emily Chui <echui@gitlab.com>
Approved-by: James Liu <jliu@gitlab.com>
Co-authored-by: Justin Tobler <jtobler@gitlab.com>

Starting in Git version 2.46.0, executing git-clone(1) on a bundle
performs fsck checks when `transfer.fsckObjects` is enabled. Prior to
this, this configuration was always ignored and fsck checks were not
run. Unfortunately, fsck message severity configuration is ignored by
Git only for bundle clones.

This issue is resolved in Git version 2.48.0, but until this gets rolled
out to GitLab, disable `transfer.fsckObjects` so bundles containing fsck
errors can continue to be cloned. This matches behavior prior to Git
version 2.46.0.

In Git versions prior to 2.46.0, performing git-clone(1) on a bundle
did not perform fsck checks even when `transfer.fsckObjects` was
enabled. Add a test case exercising an fsck error being caught when
cloning from a bundle.

[ci skip]

[ci skip]

[ci skip]

repository: Fix flaky `TestGetConfig`

See merge request !7577



Merged-by: James Liu <jliu@gitlab.com>
Approved-by: James Liu <jliu@gitlab.com>
Co-authored-by: Justin Tobler <jtobler@gitlab.com>

In 810ed5cf (git: Wire up Git v2.48 execution environment, 2025-01-14),
the `TestGetConfig` test was modified to support Git version 2.48. Using
a feature flag to guard to select the expected output doesn't work if
the bundled Git version get overwritten as done in the nightly CI
pipelines.

Fix this by checking the actual version of Git being used during test
execution.

Add the `IsGitVersionLessThan()` function to compare the Git version in
use compared to a specified version.

template: Add note to announce Git rollouts

See merge request !7574



Merged-by: Eric Ju <eju@gitlab.com>
Approved-by: Eric Ju <eju@gitlab.com>
Co-authored-by: Justin Tobler <jtobler@gitlab.com>

Updating Git versions in Gitaly can have widespread impacts. Add note in
the Git version rollout issue template to announce the change.

go-toolchain: Downgrade gitaly-init-cgroups version

See merge request !7569



Merged-by: Olivier Campeau <ocampeau@gitlab.com>
Approved-by: Sami Hiltunen <shiltunen@gitlab.com>
Approved-by: Eric Ju <eju@gitlab.com>

The gitaly-init-cgroups tool has an inconsistent
'toolchain' version in the go.mod file. All other
tools are on 1.22.6, but this one was on 1.22.8.

This MR downgrades the 'toolchain' version of this
tool to 1.22.6, so it is consistent with all other
tools and binaries of the project.

This change is also motivated by the fact that having
different go.mod files with inconsistent `toolchain'
versions across the same project can cause some version
conflicts when people uses IDE, which prevents building
and debugging.

backup: Confirm recovered log entries are being applied

See merge request !7555



Merged-by: Mustafa Bayar <mbayar@gitlab.com>
Approved-by: Divya Rani <drani@gitlab.com>
Approved-by: Mustafa Bayar <mbayar@gitlab.com>
Reviewed-by: Quang-Minh Nguyen <qmnguyen@gitlab.com>
Reviewed-by: Divya Rani <drani@gitlab.com>
Co-authored-by: Quang-Minh Nguyen <qmnguyen@gitlab.com>

Roll docs linting Docker image forward

See merge request !7567



Merged-by: Emily Chui <echui@gitlab.com>
Approved-by: Emily Chui <echui@gitlab.com>
Approved-by: Nao Hashizume <nhashizume@gitlab.com>
Co-authored-by: Evan Read <eread@gitlab.com>

Add nodejs back to .tool-versions

See merge request !7570



Merged-by: Stan Hu <stanhu@gmail.com>
Approved-by: Toon Claes <toon@gitlab.com>
Approved-by: Olivier Campeau <ocampeau@gitlab.com>

markdownlint-cli2 needs nodejs (npm specifically). Omitting
nodejs caused the GDK CI jobs to fail in
gitlab!178256.

ci: Extend nightly testing for reftables and SHA256

See merge request !7562



Merged-by: Emily Chui <echui@gitlab.com>
Approved-by: Emily Chui <echui@gitlab.com>
Co-authored-by: Justin Tobler <jtobler@gitlab.com>

Upgrade markdownlint-cli2 to 0.17.1

See merge request !7565



Merged-by: Emily Chui <echui@gitlab.com>
Approved-by: Emily Chui <echui@gitlab.com>
Co-authored-by: Evan Read <eread@gitlab.com>
Co-authored-by: Nao Hashizume <nhashizume@gitlab.com>

go: Update module github.com/git-lfs/git-lfs/v3 to v3.6.1

See merge request !7559



Merged-by: James Liu <jliu@gitlab.com>
Approved-by: James Liu <jliu@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

Remove cc:@andrashorvath from Production Training.md

See merge request !7563



Merged-by: John Cai <jcai@gitlab.com>
Approved-by: John Cai <jcai@gitlab.com>
Co-authored-by: Andras Horvath <ahorvath@gitlab.com>

Makefile: Build and install Git v2.48.0

See merge request !7560



Merged-by: Patrick Steinhardt <psteinhardt@gitlab.com>
Approved-by: James Liu <jliu@gitlab.com>
Approved-by: Karthik Nayak <knayak@gitlab.com>
Reviewed-by: Patrick Steinhardt <psteinhardt@gitlab.com>
Reviewed-by: James Liu <jliu@gitlab.com>
Co-authored-by: Justin Tobler <jtobler@gitlab.com>

Embed raftpb to Gitaly for direct use

See merge request !7561



Merged-by: Divya Rani <drani@gitlab.com>
Approved-by: Divya Rani <drani@gitlab.com>
Reviewed-by: Quang-Minh Nguyen <qmnguyen@gitlab.com>
Reviewed-by: James Liu <jliu@gitlab.com>
Reviewed-by: Divya Rani <drani@gitlab.com>
Co-authored-by: Quang-Minh Nguyen <qmnguyen@gitlab.com>

tools/govulncheck: Update module golang.org/x/vuln to v1.1.4

See merge request !7558



Merged-by: Quang-Minh Nguyen <qmnguyen@gitlab.com>
Approved-by: Quang-Minh Nguyen <qmnguyen@gitlab.com>
Approved-by: Ahmad Sherif <ahmad@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

This commit updates the protoc-gen-go tool to newer version. This tool
is used to compile *.proto files to corresponding Go code. The changelog
has nothing interesting.

This commit is drafted manually because the renovation bot could not
upgrade this dependency.

This commit revises Raft-related protobufs stored in cluster.proto:
- Remove RaftMessageType, RaftConfStateV1, and RaftHardStateV1 . We can
  now use the upstream raftpb.
- Merge ReferencedLogData and PackedLogData into one single LogData.
- Rename RaftMessageV1 to InternalRaftRequest.
- Create RaftService and corresponding request/response object.
- Move cluster_id, authority_name, and partition_id to RaftService.

Nightly CI pipelines perform additional jobs that perform Gitaly testing
with Git versions built from master and next. Extend testing with these
Git versions to also test with reftables and SHA256 repositories
configured.

The Gitaly Go test suite can be exercised through make by setting
`GITALY_TEST_WITH_SHA256=YesPlease` or the `TEST_WITH_SHA256` variable.
Add the `test-with-sha256` target as another option to perform testing
with this configuration. This is in line with other existing testing
`test-with-*` targets.

Introduce the Git v2.48 execution environment behind the `GitV248`
feature flag. When the flag is enabled, Git v2.48.0 is used instead of
Git v2.47.0.

In Git v2.48 the order of config entries after repository initialization
has changed. Update the `TestGetConfig` test to handle the new expected
order.

Now that Git version 2.48.1 is released, update the Gitaly Makefile to
begin building and install the new Git version.

With the release of Git v2.48, the order of Git config entries written
by git-init(1) and git-clone(1) has changed slightly. While the
difference is only in the order of config entries, transaction votes
rely on the content of files in the repository. Any difference results
in a different votes.

The `TestCreateRepositoryFromBundle_transactional` test validates that
transaction vote generation for the `CreateRepositoryFromBundle` RPC
works are expected. The expected vote is determined from a repository
used to create the bundle which was created with git-init(1). The actual
vote is determined from a repository created from this bundle via
git-clone(1). Due to the recent Git change, the configs no longer
exactly match which will result in test failure when using Git v2.48.

Adapt the test to avoid these config differences by just using the
actual config in the computed transction vote hash.

Edit Team Member Onboarding.md

See merge request !7548



Merged-by: John Cai <jcai@gitlab.com>
Approved-by: John Cai <jcai@gitlab.com>
Co-authored-by: Andras Horvath <ahorvath@gitlab.com>