I will setup a modern data stack leveraging dbt, metabase, postgresql and airbyte
Developing Resilient, Reliable and Robust Data and AI Pipelines
About this Gig
Picture the following situations:
- A mature company with little to no digital infrastructure automatically consolidating and transforming data and no expertise to either implement or run one
- A start-up seeking to capitalize on its existing data but with little to no budget to do so with commercial solutions
- A rainy day with little or nothing to do aside from learning how to build a self-contained data stack
I propose to leverage several solutions which remain open-source and, when combined, can create a data stack satisfying minimal requirements:
- Task orchestration - Airflow
- Data integration - Airbyte
- Data warehousing - PostgreSQL
- Data transformation - DBT
Can be launched locally or remotely provided the instance satisfies the following requirements:
Cores: 2
RAM: 4GB (recommended minimum RAM for the latest version of Airflow)
Memory: 12GB minimum (without accounting for downloaded data with Airbyte)
Docker (https://docs.docker.com/engine/install/ubuntu/) and Docker Compose (https://docs.docker.com/compose/install/) installed
Python: (not including 3.9, for compatibility with DBT)
Ubuntu: >=18.04
The rest of the installation process is done either in a local terminal/Webserver
Technology:
Amazon Redshift
•
BigQuery
•
Python
•
SQL
•
NoSQL
My Portfolio
Other Data Engineering Services I Offer
6 reviews for this Gig
| (3) | ||
| (2) | ||
| (1) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
C 
cemkocabasa

Turkey
I have what I wanted to have. But the level of involvement I imagined was far less. I had to send the same Json file 3-4 times for him to see it. Also he was hesitant to troubleshoot saying it wasn't part of the agreement. Which imo doesn't make sense because I was asking him to troubleshoot so I can...
$100-$200
Price
3 weeks
Duration
Helpful?S shane_provost

United States
Quality of work was very good, and the documentation was pretty comprehensive. What was delivered was what I needed and will add a ton of value to my service!
$100-$200
Price
10 days
Duration
Helpful?B 
brandonsings

United States
A really knowledgable and responsive seller who went above and beyond my expectations. Not only did he deliver quickly, he also helped teach me a few things along the way. Thanks so much!
$200-$400
Price
2 weeks
Duration
Helpful?L lonzin3

United Kingdom
Wow, what an incredible experience working with Grivine! I was in a tough spot with my company's data, and they came to the rescue. He successfully set up data integration using Airbyte for us, and it has been a game-changer. Our data flows seamlessly, and we're finally making informed decisions.
Up to $50
Price
2 days
Duration
Helpful?L local_toast

Germany
Getting an ELT stack up and running required far more work and effort from my side than expected, but Grivine did everything he could to help at every hurdle. I now have a repeatable deployment process, which is exactly what I wanted. Thanks! 👍
$100-$200
Price
7 days
Duration
Helpful?
6 reviews for this Gig
| (3) | ||
| (2) | ||
| (1) | ||
| (0) | ||
| (0) |
Rating Breakdown
- Seller communication level
- Quality of delivery
- Value of delivery
Sort By
C 
cemkocabasa

Turkey
I have what I wanted to have. But the level of involvement I imagined was far less. I had to send the same Json file 3-4 times for him to see it. Also he was hesitant to troubleshoot saying it wasn't part of the agreement. Which imo doesn't make sense because I was asking him to troubleshoot so I can...
$100-$200
Price
3 weeks
Duration
Helpful?S shane_provost

United States
Quality of work was very good, and the documentation was pretty comprehensive. What was delivered was what I needed and will add a ton of value to my service!
$100-$200
Price
10 days
Duration
Helpful?B 
brandonsings

United States
A really knowledgable and responsive seller who went above and beyond my expectations. Not only did he deliver quickly, he also helped teach me a few things along the way. Thanks so much!
$200-$400
Price
2 weeks
Duration
Helpful?L lonzin3

United Kingdom
Wow, what an incredible experience working with Grivine! I was in a tough spot with my company's data, and they came to the rescue. He successfully set up data integration using Airbyte for us, and it has been a game-changer. Our data flows seamlessly, and we're finally making informed decisions.
Up to $50
Price
2 days
Duration
Helpful?L local_toast

Germany
Getting an ELT stack up and running required far more work and effort from my side than expected, but Grivine did everything he could to help at every hurdle. I now have a repeatable deployment process, which is exactly what I wanted. Thanks! 👍
$100-$200
Price
7 days
Duration
Helpful?

