Basin, Basin Pipelines, Basin Catalog, Basin SQL now generally available
Cloudflare's end-to-end analytics platform Basin is now generally available, combining data collection and querying capabilities. Basin includes Pipelines for event ingestion from Workers and Logpush, Catalog for managing Apache Iceberg tables, and SQL for serverless distributed querying without compute management.
Basin, formerly the Cloudflare Data Platform, is now generally available. Basin brings an end-to-end analytics platform to the Developer Platform, enabling you to collect data from a variety of sources, such as apps, infrastructure, devices, and other Cloudflare services, then query it to answer analytical questions.
Basin Pipelines
Basin Pipelines, formerly Cloudflare Pipelines, ingests events from Workers, HTTP endpoints, and Cloudflare Logpush. It transforms events with SQL and ingests them into Iceberg tables or files on R2. With Basin Pipelines you can:
- Ingest application and device events through HTTP endpoints or Workers bindings.
- Filter and reshape Cloudflare logs before storing them as Iceberg tables, Parquet, or JSON.
- Catch schema mismatches with typed bindings and investigate dropped events in the dashboard.
Basin Catalog
Basin Catalog, formerly R2 Data Catalog, manages and automatically maintains Apache Iceberg tables ↗︎ to keep them fast, cost-efficient, and accessible to any compatible query engine. With Basin Catalog you can:
- Connect DuckDB, Spark, Snowflake, or PyIceberg to the same tables.
- Maintain growing tables with compaction, snapshot expiration, and manifest optimization.
- Share analytical data across tools and clouds without paying egress fees.
Basin SQL
Basin SQL, formerly R2 SQL, is a serverless, distributed SQL engine for querying large Apache Iceberg tables in Basin Catalog without managing or scaling compute. With Basin SQL you can:
- Summarize and rank data with standard and approximate aggregates, grouping sets, and window functions.
- Combine and inspect datasets with joins, subqueries, common table expressions, set operations, schema discovery, and
EXPLAIN. - Transform strings, timestamps, JSON, and complex values with more than 190 functions.
Get started
To get started with creating an end-to-end data pipeline, run:
npmyarnpnpmnpx wrangler basin pipelines setupyarn wrangler basin pipelines setuppnpm wrangler basin pipelines setupOr get started by referring to the Basin getting started guide.
Note
Existing Cloudflare Pipelines, R2 Data Catalog, and R2 SQL resources and configurations will continue to work and will be deprecated over time.
Source: original entry ↗
More from Cloudflare
Follow Cloudflare to get its new changes in your feed and email digest.
Cloudflare API MCP server now serves Cloudflare skills
The Cloudflare API MCP server now integrates with the Skills over MCP extension, allowing MCP clients to discover and access Cloudflare skills. Users can add the MCP server endpoint to compatible MCP clients to access these skills.
WAF failed detections field now available in Rules
A new cf.appsec.request.failed_detections field lets you control how rules handle requests when security detections fail. This array of detection IDs covers content scanning, WAF attack scoring, attack signatures, leaked credentials, and AI-based PII/prompt injection/custom topic detection failures, and works across custom rules, rate limiting rules, and request header transform rules.
Markdown for Agents: More efficient in-process streaming conversion
Markdown for Agents now uses an in-process streaming engine at the edge to convert HTML, reducing overhead and memory use. The conversion limit increased from 2 MiB to 6 MiB, and token count headers are no longer generated.