I will help big data assignments and tasks

I am an experienced data engineer. I have deep experience in building data platforms and building services to expose data in various formats.

My main expertise is around: Big Data :

Core Hadoop, Hive, Spark , HBase, Elasticsearch, Ranger, Atlas, HDInsight, Ambari, Kafka AWS Solution: AWS Lambda, EMR, Kinesis, API Gateway, Cognito, Dynamo DB, RDS Azure Solution: Event Hub, CosmosDB, HDInsight, Data Factory API: Flask Deployment: Ansible, Docker

The tools and technologies i am very familiar with

1. Apache Hadoop
2. Apache Spark
3. Apache Kafka for data streaming
4. Apache Flink for stream processing
5. Elasticsearch for data indexing
6. MongoDB for NoSQL data storage
7. Apache Cassandra for distributed databases
8. Apache Hive for data warehousing
9. Apache Pig for data analysis
10. Apache Beam for data processing
11. TensorFlow for machine learning with big data
12. PySpark for Python-based big data processing
13. Apache NiFi for data flow management
14. Presto for distributed SQL querying
15. Apache Sqoop for data import/export
16. Apache Airflow for workflow management
17. Grafana for data visualization
18. Tableau for interactive data analytics
19. Jupyter Notebook for data exploration
20. Zeppelin for interactive data analysis