Address
Form of work Roles and Responsibilities:
We are seeking an experienced Data Engineer to join our team. The ideal candidate will have 5 to 8 years of experience in Data Engineering and a strong background in building data pipelines, data warehousing, and data management solutions. In this role, you will work closely with data scientists, analysts, and other stakeholders to design, build, and maintain scalable and robust data infrastructure. Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services - DynamoDB, RedShift, Kinesis, Lambda, S3,Glue.
Hands on experience utilizing AWS Management Tools (CloudWatch, CloudTrail) to proactively monitor large and complex deployments.
Experience in analyzing, re-architecting, and re-platforming on-premise data warehouses to data platforms on AWS.
Excellent in Advanced SQL end to end development and Optimization of existing processes
Ability to understand complex python queries and update existing code according to business requirement.
Table Partition mechanism, Types of Partitions, column store index
Maintenance and optimization of existing processes
Requirement gathering and feasibility analysis, design, develop from scratch and deliver
Experience in designing data warehouse/data mart.
Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements
Experience in deploying data pipelines using automated CI/CD approach.
Experience in writing production ready code in Python and test, participate in code reviews to maintain and improve code quality, stability, and supportability.
Ability to write modularized reusable code components.
Proficient in identifying data issues and anomalies during analysis.
Leading the client calls to flag off any delays, blockers, escalations and collate all the requirements
External Skills And Expertise
Must have Skills:
Python
Data Migration
Data Warehousing
AWS
SQL
