Address2+ years of relevant experience with AWS Cloud on data integration with Databricks,Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
Strong real-life experience in Python development especially in pySpark in the AWS Cloud environment.
Design, develop, test, deploy, maintain and improve data integration pipeline.
Experience in Python and common python libraries.
Strong analytical experience with the database in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc.
Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
