Sdf

SDF is a next-generation build system for data infrastructure that compiles all data contracts, queries, and policies at once to build code-level, time-level, and access-level dependencies.

Key features:

• Scalability: SDF is the first scalable build system for data infrastructure.
• Local execution: SDF enables local execution of SQL development with intelligent workflows and data governance packed into 60MB of Rust-based magic.
• Data governance: SDF enables precise column-level lineage analysis that generates a full-featured data catalog out of the box.
• Easy to use: SDF is a powerful and easy-to-use data development platform that enables organizations at any scale to fully leverage their data while respecting all relevant policies and protections.
• Cloud-based: SDF runs its soon-to-be open-source engine in the cloud to take your deployments from a single command to an automatically scheduled workflow with policies enforced in real-time.

Use cases:

• Build code-level, time-level, and access-level dependencies for data infrastructure.
• Compile data contracts, queries, and policies at once to streamline SQL development.
• Generate a full-featured data catalog out of the box with precise column-level lineage analysis.
• Enable organizations at any scale to fully leverage their data while respecting all relevant policies and protections.
• Schedule workflows with policies enforced in real-time.