Data Engineering

Data Engineering

Pipeline SLA calculators, data quality validators, schema evolution reference tools, streaming latency budgets, and data engineering utilities that run entirely in your browser.

๐Ÿ”’ Browser-only โ€” no data sent โšก Zero account required ๐Ÿ“ฆ 13 free tools
reliability
Data Pipeline SLA Calculatorโ†’
Calculate pipeline SLA feasibility from upstream completion, processing time, and consumer deadlines.
quality
Data Quality Score Calculatorโ†’
Calculate composite data quality score from completeness, validity, uniqueness, and timeliness.
schemas
Schema Evolution Referenceโ†’
Reference guide to schema evolution โ€” Avro, Protobuf, backward/forward compatibility.
streaming
Streaming Latency Budget Calculatorโ†’
Calculate end-to-end streaming pipeline latency from ingest through processing to sink.
storage
Data Partitioning Strategy Referenceโ†’
Reference guide to data partitioning โ€” time partitioning, hive-style, clustering, and small file problem.
architecture
ETL vs ELT Referenceโ†’
Reference guide to ETL vs ELT architectures โ€” dbt, reverse ETL, and transformation strategy.
reliability
Data Freshness SLO Calculatorโ†’
Calculate data freshness SLO compliance and budget remaining from pipeline lag.
cost
Data Warehouse Cost Calculatorโ†’
Estimate monthly data warehouse costs across BigQuery, Snowflake, and Redshift.
schemas
Event Schema Validatorโ†’
Validate event payload JSON against data engineering best practices โ€” event_id, occurred_at, schema_version.
governance
Data Lineage Referenceโ†’
Reference guide to data lineage โ€” column-level lineage, dbt DAG, OpenLineage, and data catalogs.
ingestion
CDC Referenceโ†’
Reference guide to Change Data Capture โ€” Debezium, Postgres logical replication, and replication lag.
governance
Data Contract Referenceโ†’
Reference guide to data contracts โ€” schema, freshness SLOs, ODCS standard, and producer responsibility.
cost
Dataflow Worker Sizing Calculatorโ†’
Size a stream-processing worker pool from events per second, average processing time, concurrency per worker, and hea...