[Engine] Metascraper - service integration front#5392

Ticket(s) / Related Merge Requests

Issue

• Issue card: front#5392 (closed)

MRs / for approval

• Metascraper repo: https://gitlab.com/minds/developers/metascraper-server/
• Minds Repo: minds!204 (diffs)
• Front front!1956 (merged)
• Helm: helm-charts!83 (merged)

Summary of Changes

Replacing iframely rich-embed with our own self-hosted service powered by Metascraper, Browserless and Puppeteer.

Testing Considerations

Test rich embeds for various URLs and contrast results with production.

Should use iframely when feat flag is off.

Deployment Considerations

• Many different repositories (above) to merge.
• Terraform needs building out still. minds/infrastructure/minds-terraform#64 (closed)
• Helm charts are working for sandbox deployments - HPA is not configured if desired at this moment helm-charts!83 (merged)
• Recommend Canary initially to gather feedback.

Regression Scope

• Rich embeds
• Composer upload

Platform Affected (web, mobile, etc)

Web / Engine / Mobile / CI / Metascraper Server / Helm / Local

Developer Testing Completed

Unit tests where appropriate and possible.

Manual.

Screenshots / Screen Recording

https://streamable.com/8ey47l

Does this impact

• Localization
• Dark/light mode
• Guest mode

Definition of Done Checklist

• The Acceptance Criteria has been met
• Code is tested: Testing includes unit/spec, E2E/automated and manual testing
• Merge requests description has been filled out