Skip to main content

Documentation

Learn OptimaFlo

Guides and tutorials to help you go from raw data to clean dashboards; whether you're connecting your first source or deploying in your own cloud.

Popular Guides

The fastest way to get productive with the platform.

Deploy BYOC on GCP

Step-by-step walkthrough: enable APIs, grant IAM roles, and deploy via the dashboard.

15 min read

Deploy BYOC on AWS

Step-by-step walkthrough: connect your AWS account with a cross-account IAM role, then deploy via the dashboard.

15 min read

Build Your First Pipeline

Connect a data source, transform with SQL, and schedule an Airflow DAG in under five minutes.

5 min read

Layered Data Architecture 101

Understand Bronze, Silver, and Gold layers and how OptimaFlo automates the flow between them.

8 min read

Using AI

Describe transformations in plain English.

6 min read

Browse by Topic

Everything from first setup to production deployment.

Getting Started
Create your first pipeline in under five minutes. Covers account setup, workspace creation, and core concepts.
  • Create your first pipeline
  • Workspace & project setup
  • Core concepts: Ingestion, Cleaning, Aggregation
  • Connecting your first data source
Platform Architecture
Understand the 8-layer architecture, layered data architecture data flow, and how DuckDB and BigQuery auto-scale under the hood, with Sail (coming soon) for the largest workloads.
  • Layered Data Architecture overview
  • Engine selection: DuckDB vs BigQuery vs Sail (coming soon)
  • Apache Iceberg & Polaris catalog
  • Data lifecycle & time-travel
Connectors & Sources
Connect to GCS, BigQuery, REST APIs, and more. Schema inference and one-click OAuth included.
  • GCS file connector
  • REST API connector
  • BigQuery connector
  • Adding new data sources
Pipeline Builder
Drag-and-drop pipeline canvas, SQL node configuration, and scheduling with Airflow.
  • Visual canvas walkthrough
  • Node types & configuration
  • SQL generation & copilot
  • Scheduling & backfills
Catalogs
Every table across Raw, Clean, and Ready in one browser. Schema history, access grants, and freshness health.
  • Tables, search & bulk delete
  • Collections
  • Schema change timeline & alerts
  • Access levels & freshness health
AI Agents
Your AI data team: Manager, Ingestion Engineer, Data Engineer, Analytics Engineer, Analyst, BI Developer, and Quality Engineer. One workflow.
  • Manager: end-to-end orchestration
  • Ingestion Engineer & Data Engineer
  • Analytics Engineer & Analyst
  • BI Developer & Quality Engineer
GCP
BYOC Deployment
Deploy OptimaFlo in your own cloud. Terraform-managed infrastructure with full data residency. Your data lives in your account, never ours.
  • GCP setup guide
  • Required APIs & IAM roles
  • Terraform infrastructure
  • Architecture & security model
AWS
BYOC Deployment
Deploy OptimaFlo in your own AWS account. Cross-account IAM role via CloudFormation, Terraform-managed infrastructure. Your data lives in your account, never ours.
  • AWS setup guide
  • Cross-account IAM role & CloudFormation
  • Terraform infrastructure
  • Architecture & security model
BI & Dashboards
Semantic layer, chart types, KPI tiles, dashboard creation, and embedding for stakeholder access.
  • Creating dashboards
  • Chart types & configuration
  • Semantic layer & metrics
  • Sharing & embedding
Scale
Ontology Map
A live map of your workspace: sources, tables, pipelines, metrics, dashboards, and business objects, built automatically from what you create.
  • Reading the map: node and edge kinds
  • Search, legend, and unconnected nodes
  • Why a node has no connections
  • Impact warnings and asking the Manager
Glossary
Define your business terms once for the whole workspace, and link them to the real tables and columns that calculate them.
  • Definitions, synonyms & categories
  • Linking a term to real tables & columns
  • Search & filter
  • CSV import
Data Quality
Quality scoring across five dimensions, schema enforcement, validation rules, and self-healing SQL across your pipeline.
  • Quality scores explained
  • Automated profiling
  • Validation rules
  • Self-healing SQL & schema enforcement

Built on Open Standards

OptimaFlo is built on Apache Iceberg, Apache Airflow, and Apache Polaris. No proprietary formats, no data lock-in. Your data stays yours, and these docs show you exactly how it all fits together.

Ready to build?

Go from raw data to dashboards in minutes.

Get StartedContact

Now in early beta. Standard is $50,000/yr. Deployed in your cloud, and your tables stay in your account.