Skip to content

whats-new-2025.md

Latest commit

 

History

History
49 lines (37 loc) · 1.59 KB

whats-new-2025.md

File metadata and controls

49 lines (37 loc) · 1.59 KB
Raw

What's new — 2025 update

Note

Published August 20, 2025. For the current update, see What's new — 2026.

BigQuery demos

  1. SQL transform examples
  2. Exported billing data example
  3. Information schema examples

Composer demos

  1. DAG check scripts (python and bash)
  2. DAG that shows different Airflow strategies for BigQuery exports
  3. DAG that shows executing a query and exporting the results

Dataflow demos

  1. Simple demo pipeline that illustrates read, write, branch, Map, FlatMap and Filter
  2. Simple demo pipeline that illustrates Create, GroupByKey, CombineGlobally, CombinePerKey, and CoGroupByKey

Dataproc demos

  1. Autoscaling cluster demo to go with manual scaling demo

DLP-demo

  1. Revised app and source code for demoing DLP abilities

Do it nows

  1. Fixes to the Do It Now instructions and code

Security

  1. Assets for creating and applying a custom constraint
  2. A python script that illustrates multiple ways of authenticating

Terraform

  1. Bash script that exports a project resources as Terraform HCL

Utilities

  1. Source code for a silly web service that generates Costco shopping lists and returns them in JSON payloads

Works in Progress

  • Finishing Dataform demo
  • Finishing Dataplex demo
  • Finishing custom log-sink -> pub/sub -> cloud function -> interesting action demo

Note

Since publication: the Dataform demo moved to its own repository (jwdavis/dataform-demo), and the Dataplex work continued with the lineage tools added in 2026. The log-sink demo is still open.