Cost effective data pipelines code repository
-
Updated
Sep 9, 2023 - Jupyter Notebook
#
data-pipeline-building
Here are 5 public repositories matching this topic...
FabricEngineer is a comprehensive Python package designed specifically for Microsoft Fabric developers to streamline data transformation workflows and automate complex ETL processes. This package provides enterprise-grade solutions for building robust data pipelines with minimal boilerplate code.
pyspark python-package microsoft-fabric data-pipeline-building microsoft-fabric-data-engineer data-pipeline-automation
-
Updated
Aug 27, 2025 - Jupyter Notebook
Our startup, Mela, aims to simplify cryptocurrency trading for everyone and provide reliable investment sources while mitigating risks. We aim to design and build a reliable, large-scale trading data pipeline that can run various backtests and store useful artifacts in a robust data warehouse.
apache technical-analysis backtesting-trading-strategies structured-streaming backtesting workflow-orchestration financial-prediction data-pipeline-building databricks-tools enterprise-grade-data-engineering
-
Updated
Jun 28, 2024 - Jupyter Notebook
This project demonstrates the development of a complete end-to-end data pipeline in the cloud using the Microsoft Azure ecosystem to ingest, transform, store, and visualize COVID-19 related data.
python azure power-bi data-visualization cloud-computing azure-data-factory etl-pipeline data-engineering-pipeline azure-synapse-analytics data-pipeline-building data-lake-gen2
-
Updated
Jun 4, 2025 - Python
A minimal ETL (Extract, Transform, Load) pipeline written in Rust for fetching and processing block data from the Solana blockchain.
-
Updated
Oct 23, 2025 - Rust
Improve this page
Add a description, image, and links to the data-pipeline-building topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-pipeline-building topic, visit your repo's landing page and select "manage topics."