Skip to content

Fix bug with Wiki pages encoding

What does this MR do?

When we retrieve wiki pages from Gitaly they all have a binary encoding. Then we try to decode them to the proper encoding using CharlockHolmes. Sometimes this process brings false negatives, and strings that are indeed UTF8 encoded, results in binary encoded ones.

Also, before this MR, the content of the pages was converted to the matching encoding. But, when the wiki project has a web hook attached, the content is stored into Sidekiq. Because Sidekiq only accepts UTF8 encoding, this process may raise an error.

Why was this MR needed?

To resolve some errors with the wiki page content encoding.

Does this MR meet the acceptance criteria?

What are the relevant issue numbers?

Closes #49512 (closed)

Merge request reports