Skip to content

Use query field when reading from BQ

Hongtao Yang requested to merge hyang/use-query-when-reading-from-bq into main

What does this merge request do and why?

We've created sample dataset (BQ views) that are updated according to the latest daily runs. However, our existing read from bq function doesn't support views: #201 (comment 1831945824)

The solution is to use the query field instead of table. The query field allow us to read from both tables and views.

How to set up and validate locally

Numbered steps to set up and validate the change are strongly suggested.

Merge request checklist

  • I've ran the affected pipeline(s) to validate that nothing is broken.
  • Tests added for new functionality. If not, please raise an issue to follow up.
  • Documentation added/updated, if needed.
Edited by Hongtao Yang

Merge request reports