I will setup a modern data stack leveraging dbt, metabase, postgresql and airbyte

4.3
4.3

Kenya

I speak English

56 orders completed

Developing Resilient, Reliable and Robust Data and AI Pipelines

I specialize in turning messy business data into reliable pipelines, cloud warehouses, analytics-ready datasets, and ML-ready data systems. I help startups and growing businesses design, build, and a...
About this Gig

Picture the following situations:

  • A mature company with little to no digital infrastructure automatically consolidating and transforming data and no expertise to either implement or run one
  • A start-up seeking to capitalize on its existing data but with little to no budget to do so with commercial solutions
  • A rainy day with little or nothing to do aside from learning how to build a self-contained data stack


I propose to leverage several solutions which remain open-source and, when combined, can create a data stack satisfying minimal requirements:

  • Task orchestration - Airflow
  • Data integration - Airbyte
  • Data warehousing - PostgreSQL
  • Data transformation - DBT


Can be launched locally or remotely provided the instance satisfies the following requirements:

Cores: 2

RAM: 4GB (recommended minimum RAM for the latest version of Airflow)

Memory: 12GB minimum (without accounting for downloaded data with Airbyte)

Docker (https://docs.docker.com/engine/install/ubuntu/) and Docker Compose (https://docs.docker.com/compose/install/) installed

Python: (not including 3.9, for compatibility with DBT)

Ubuntu: >=18.04

The rest of the installation process is done either in a local terminal/Webserver

Expertise:

Data extraction

Data manipulation

Data validation

ETL

Technology:

Amazon Redshift

BigQuery

Python

SQL

NoSQL

My Portfolio

Other Data Engineering Services I Offer

Reviews

6 reviews for this Gig
4.3

(3)
(2)
(1)
(0)
(0)
Rating Breakdown
  • Seller communication level
    4.5
  • Quality of delivery
    3.7
  • Value of delivery
    4
Sort By
Most relevant
  • C
    image-docs

    cemkocabasa

    TR

    Turkey

    3

    I have what I wanted to have. But the level of involvement I imagined was far less. I had to send the same Json file 3-4 times for him to see it. Also he was hesitant to troubleshoot saying it wasn't part of the agreement. Which imo doesn't make sense because I was asking him to troubleshoot so I can...

    $100-$200

    Price

    3 weeks

    Duration

    Helpful?
    Yes
    No
  • S

    shane_provost

    US

    United States

    4

    Quality of work was very good, and the documentation was pretty comprehensive. What was delivered was what I needed and will add a ton of value to my service!

    $100-$200

    Price

    10 days

    Duration

    Helpful?
    Yes
    No
  • B
    image-docs

    brandonsings

    US

    United States

    4.7

    A really knowledgable and responsive seller who went above and beyond my expectations. Not only did he deliver quickly, he also helped teach me a few things along the way. Thanks so much!

    $200-$400

    Price

    2 weeks

    Duration

    Helpful?
    Yes
    No
  • L

    lonzin3

    GB

    United Kingdom

    5

    Wow, what an incredible experience working with Grivine! I was in a tough spot with my company's data, and they came to the rescue. He successfully set up data integration using Airbyte for us, and it has been a game-changer. Our data flows seamlessly, and we're finally making informed decisions.

    Up to $50

    Price

    2 days

    Duration

    Helpful?
    Yes
    No
  • L

    local_toast

    DE

    Germany

    4.3

    Getting an ELT stack up and running required far more work and effort from my side than expected, but Grivine did everything he could to help at every hurdle. I now have a repeatable deployment process, which is exactly what I wanted. Thanks! 👍

    $100-$200

    Price

    7 days

    Duration

    Helpful?
    Yes
    No
Reviews

6 reviews for this Gig
4.3

(3)
(2)
(1)
(0)
(0)
Rating Breakdown
  • Seller communication level
    4.5
  • Quality of delivery
    3.7
  • Value of delivery
    4
Sort By
Most relevant
  • C
    image-docs

    cemkocabasa

    TR

    Turkey

    3

    I have what I wanted to have. But the level of involvement I imagined was far less. I had to send the same Json file 3-4 times for him to see it. Also he was hesitant to troubleshoot saying it wasn't part of the agreement. Which imo doesn't make sense because I was asking him to troubleshoot so I can...

    $100-$200

    Price

    3 weeks

    Duration

    Helpful?
    Yes
    No
  • S

    shane_provost

    US

    United States

    4

    Quality of work was very good, and the documentation was pretty comprehensive. What was delivered was what I needed and will add a ton of value to my service!

    $100-$200

    Price

    10 days

    Duration

    Helpful?
    Yes
    No
  • B
    image-docs

    brandonsings

    US

    United States

    4.7

    A really knowledgable and responsive seller who went above and beyond my expectations. Not only did he deliver quickly, he also helped teach me a few things along the way. Thanks so much!

    $200-$400

    Price

    2 weeks

    Duration

    Helpful?
    Yes
    No
  • L

    lonzin3

    GB

    United Kingdom

    5

    Wow, what an incredible experience working with Grivine! I was in a tough spot with my company's data, and they came to the rescue. He successfully set up data integration using Airbyte for us, and it has been a game-changer. Our data flows seamlessly, and we're finally making informed decisions.

    Up to $50

    Price

    2 days

    Duration

    Helpful?
    Yes
    No
  • L

    local_toast

    DE

    Germany

    4.3

    Getting an ELT stack up and running required far more work and effort from my side than expected, but Grivine did everything he could to help at every hurdle. I now have a repeatable deployment process, which is exactly what I wanted. Thanks! 👍

    $100-$200

    Price

    7 days

    Duration

    Helpful?
    Yes
    No