Skip to main content
SnowflakeETL

Snowflake Data Loading

Simplify Snowflake data loading with Starlake's declarative YAML: schema validation, SCD2 strategies, and automated orchestration.

· 7 min read
DatabricksDuckDB

Introducing Starlake.ai

Meet Starlake.ai, the declarative data pipeline platform that simplifies ingestion, transformation, orchestration, and governance.

· 2 min read
Data EngineeringAnalytics

Incremental models, the easy way.

Build incremental data models without state management using Starlake's declarative approach and Airflow catchup mechanism.

· 3 min read
Unit TestDatabricks

How to unit test your data pipelines

Learn how to unit test SQL data pipelines locally with DuckDB using Starlake, reducing costs and catching bugs before deployment.

· 6 min read
PolarsSpark

Polars versus Spark

Compare Polars and Spark for data engineering tasks including file loading, SQL transforms, and single-node performance benchmarks.

· 6 min read
SparkBigQuery

Column and Row Level Security in BigQuery

Implement row-level and column-level security in BigQuery using native features and Starlake's declarative YAML configuration.

· 4 min read