I will build an open source kubernetes based data and ml platform

India

I speak Hindi, English

21 orders completed

I'm a Data, ML and DevOps Engineer. My work revolves around Solution Architecture, Dev, and building Data & ML Platforms, Data Engineering, Model Serving, and to provide Data Architecture & Governance...
About this Gig

Many organizations are burdened by the cost of Snowflake, Redshift and Databricks environments. These platforms are good but they cost a lot compared to the benefits they bring along. To solve this issue, I have been helping organizations to build and maintain their own Data and ML Platform with end-to-end CICD which is negligible in cost and completely cloud agnostic. Doesn't matter if you're on AWS, GCP or Azure, with the help of Kubernetes we can maintain a fully functional platform that can help serve production data pipelines and models. I will use established technologies from Apache Software Foundation, Linux & AI Foundation and CNCF to build a cost-effective, efficient, easy-to-use platform which is highly adjustable and flexible in use. Your developers can add more features to it as per their needs and won't be dependent on a vendor to help support them. It won't be a black box that you don't understand. You can simply use Spark or DBT to build your pipelines and schedule them via Airflow and monitor it via Grafana, while all this running on your own cloud and Kubernetes. I have been doing this for past 5 yrs and already completed deployments in 4 big MNCs

Expertise:

Big data

ETL

Transformation

SQL

Other

Technology:

Apache Hadoop

Apache Kafka

Apache Spark

Python

Other