Commit dd7a297f authored by Jon Tavernier's avatar Jon Tavernier

tidy up readme

parent 4d13ef84
......@@ -26,12 +26,7 @@ I have used Apache Airflow. Google offers Apache Airflow as-a-service via its C
- reference: https://cloud.google.com/sdk/gcloud/reference/beta/composer/environments/update
1. How are Airflow variables set?
- The Airflow Web UI is accessible so variables can be set there.
- Also via gcloud:
```bash
gcloud composer environments run jon-airflow-poc \
--location us-central1 variables -- \
--set 'DAG_GIT_VERSION' 'BlAH'
```
- See example below for setting via `gcloud` cli.
1. What functionality is beta vs released?
- Need to look into...
1. What GCP components are created?
......@@ -90,7 +85,10 @@ gcloud beta composer environments update jon-airflow-poc \
# Local Development
1. Does Google provide a Docker Image already to launch their flavor of Airflow locally?
1. How to launch Apache Airflow (aka Cloud Composer)?
- Can a local instance be created that's "close enough" to Cloud Composer? The idea here is to enable local development for fast iterations over code.
1. How to launch Apache Beam (aka GCP Dataflow)?
1. How to launch Apache Spark (aka GCP Dataproc)?
1. What utils exist within Cloud Composer?
- Example: The `bq` cli is available so that's something I would want to build into my locally running Airflow instance.
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment