[se-5392] Setup OpenSearch and Fluent-Bit dashboards
Description
This PR sets up OpenSearch and Fluent-Bit integration for Grove.
By default all logs generated by Kubernetes containers will be forwarded to Fluent-Bit and can be viewed from the OpenSearch dashboard.
For now, the OpenSearch dashboard isn't exposed to the internet due to the complexity of achieving it. This will be tackled in a different ticket (SE-5432).
Supporting information
Testing instructions
- Run the terraform scripts.
- Forward the port for the OpenSearch dashboard:
./kubectl --namespace monitoring port-forward --address 0.0.0.0 deployments/opensearch-dashboard-opensearch-dashboards 8001:5601
- You can then access the dashboards from http://localhost:8001 and login with
admin:admin
- Visit http://localhost:8001/app/discover and add an Index Pattern for
fluent-bit
. - The logs will start streaming in (you might need to navigate back to the Discover page to see them).
Edited by Keith Grootboom