Stackdriver Exporter: errors in Prometheus when scraping the sd-exporter target

We see a lot of errors in the Prometheus logs with the following two messages:

  • Error on ingesting out-of-order samples
  • Error on ingesting samples with different value but same timestamp

In both cases, the target being scraped is http://sd-exporter-01-inf-gprd.c.gitlab-production.internal:9255/metrics?collect=logging.googleapis.com