Flowbase is a by delaware developed accelerator for ETL processes. It helps organizations process data across different layers of their data platform in a uniform and efficient manner. Flowbase automates the non-value adding technical support activities so that data engineers can focus on adding value via business logic.
With Flowbase, data engineers can combine data transformations (business logic) and data assets (resulting table or file) into a single data pipeline (= Directed Acyclic Graph containing the full ETL process). Flowbase provides all functionality to orchestrate and govern this data pipeline. Flowbase is delivered as a versioned Python package with an up-to-date documentation website.
Most important features are:
- Built-in logging and monitoring dashboards in Power BI
- Lineage driven orchestration approach (DAG) with a skipping functionality
- Straightforward CI/CD flow, managed by a well structured configuration file and Azure Devops pipelines
- Maintenance (ZORDER)
- Error handling
- Built-in (and customizable) data quality screenings
- Performance optimizations
Projects < 50 mandays development
Projects between 50 mandays and 200 mandays
Projects > 200 mandays development