Google iconGoogleAug 31, 2026 ~1 min source read

From weeks to minutes: The new agentic era of data pipelines

Data pipelines are the backbone of the modern enterprise, yet a barrier to entry exists for orchestrating them, making this critical capability unavailable to many data professionals. Following our announcements at Google Cloud NEXT '26, where we introduced the Orchestration Pipelines framework, we are fundamentally changing this dynamic.

From weeks to minutes: The new agentic era of data pipelines
Read original More from Google

Share this story

Send the public story page.

Useful takeaways from this story.

Data pipelines are the backbone of the modern enterprise, yet a barrier to entry exists for orchestrating them, making this critical capability unavailable to many data professionals.

First, it provides a dedicated Data Engineering tab for comprehensive pipeline management.

Following our announcements at Google Cloud NEXT '26, where we introduced the Orchestration Pipelines framework, we are fundamentally changing this dynamic.

Building the complete brief

The page is ready to read now. The fuller skim-friendly version will appear here automatically.

The useful part

Data pipelines are the backbone of the modern enterprise, yet a barrier to entry exists for orchestrating them, making this critical capability unavailable to many data professionals. Following our announcements at Google Cloud NEXT '26, where we introduced the Orchestration Pipelines framework, we are fundamentally changing this dynamic. First, it provides a dedicated Data Engineering tab for comprehensive pipeline management.

How it works

  • To bring this powerful framework directly to practitioners, we offer the Data Agent Kit — a unified, freely available, and open-source collection of data engineering and data science tools that integrate...
  • Pipelines framework into your workflow in two distinct ways.
  • Second, it includes a specialized agentic skill designed to author, deploy, and troubleshoot production-grade Apache Airflow® DAGs using natural language.

Keep reading in the app

Open the app view to save this story, compare related coverage, and continue from the same source.

Open in app