A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...

Today, at its annual Data + AI Summit, Databricks announced that it is open-sourcing its core declarative ETL framework as Apache Spark Declarative Pipelines, making it available to the entire Apache ...

SAN FRANCISCO, June 11, 2025 /PRNewswire/ -- Data + AI Summit --Databricks, the Data and AI company, today announced it is open-sourcing the company's core declarative ETL framework as Apache Spark™ ...

Who needs rewrites? This metadata-powered architecture fuses AI and ETL so smoothly, it turns pipelines into self-evolving engines of insight. In the fast-evolving landscape of enterprise data ...

Databricks Inc. today announced the general availability of Delta Live Tables, which it claims is the first extract/transfer/load or ETL framework to use a declarative approach to building data ...

Databricks has made a name for itself as one of the most popular commercial services around the Apache Spark data analytics platform (which, not coincidentally, was started by the founders of ...

The name of Databricks' annual conference has gone from "Spark Summit" to "Spark + AI Summit" and now to "Data + AI Summit." The evolution of the event name tracks Databricks' own transition from the ...

The no-code ETL tool works by combining a generative AI assistant for pipeline creation and Unity Catalog for governance. Databricks showcased a new no-code data management tool, powered by a ...

Jenkins provides two different syntaxes for pipelines. When DevOps engineers write a Jenkins pipeline, they can choose between declarative and scripted. The differences between the two are both subtle ...