Lead Data Engineer

Anko is the global capability centre for Kmart Group Australia, fuelling growth aspirations of iconic Australian retail brands Kmart, Target and Anko. Based in Bangalore, India, we strive to accelerate retail innovation by building competitive capabilities in Technology, Data Sciences and Business Services that enable our brands to deliver delightful experiences to our in-store and online customers.Primary Purpose of RoleØ Design, develop, and maintain robust, scalable and sustainable data product and build & optimizing data pipeline and infrastructure.Ø Excellent problem-solving and communication skillsØ Proven experience in designing and implementing large-scale data solutions, including data pipelines and ETL processes.Ø In-depth knowledge of data warehousing concepts and data modeling techniques.Ø Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.Ø Identify and implement data quality monitoring and validation proce...

Anko is the global capability centre for Kmart Group Australia, fuelling growth aspirations of iconic Australian retail brands Kmart, Target and Anko. Based in Bangalore, India, we strive to accelerate retail innovation by building competitive capabilities in Technology, Data Sciences and Business Services that enable our brands to deliver delightful experiences to our in-store and online customers.Primary Purpose of RoleØ Design, develop, and maintain robust, scalable and sustainable data product and build & optimizing data pipeline and infrastructure.Ø Excellent problem-solving and communication skillsØ Proven experience in designing and implementing large-scale data solutions, including data pipelines and ETL processes.Ø In-depth knowledge of data warehousing concepts and data modeling techniques.Ø Collaborate with stakeholders to understand their data requirements and translate them into technical solutions.Ø Identify and implement data quality monitoring and validation processes to ensure data integrity.Ø W ork closely with data scientists and analysts to support their data needs and enable advanced analytics and machine learning initiatives.Ø Provide technical leadership and mentorship to junior Data Engineers, guiding them in best practices and fostering their professional growth.Ø Contribute to the development of the organization's data strategy, including evaluating new technologies, tools, and framewor ks to enhance the Data Engineering ecosystem.Ø Implement data quality frameworks and ensure data governance best practices, including data lineage, data documentation, and data security.Required Qualification Level: Bachelor Degree (Undergrad)
Qualification Field: Any engineering discipline
Preferred Qualification Level: Masters
Qualification Field: Computer Science or ITTechnical Skills required:AWS-S3, IAM, API Gateway. EKS, EC2. EMR, Lambda, Cloudformation, etcSQL - Snowflake or other Cloud Data warehouse solutions, Oracle, MS SQL Server Python, Java, ScalaKafka, Kafka Streams, KSQLDB, Kafka Connect preferably Confluent KafkaDocker, Kubernetes, Jenkins, AirflowPower BITraits / Abilities:
Ø Troubleshoot and resolve data-related issues, performance bottlenecks, and scalability challenges.Ø Excellent analytical abilitiesØ Solid understanding of DevOps principles and experience with infrastructure automation using tools like Terraform or CloudFor mation.Ø Excellent problem-solving, communication, and collaboration skills.Ø Hands-on experience with cloud platforms, such as AW S or Azure, and related services (e.g., EC2, S3, Snowflake, Data Lake, etc.).Ø Understandings of data warehousing concepts and best practicesØ W ork closely with stakeholders to understand business requirements and translate them into data solution designs.Ø Strong understanding of data architecture principles, data modeling techniques, and data integration patterns.Work ExperienceØ 7- 10 years to total IT experience preferably in field of Data EngineeringØ 5+ years’ experience with AW S services including Lambda,IAM,API gatewayØ 4+ years’ experience in creating and deploying dockor containers on kudernestesØ 4+ years’ experience in supporting development teams on Kubernetes best practices, troubleshooting, and performance optimization.Ø 4+ years’ experience with CI/CD pipelines toll such as Jenkins and Github ActionsØ 4+ years’ experience with Snowflake data warehousing and data lake soluti onsØ Strong programming skill in Python, Java or ScalaØ 4+ years of experience in scripting and automation using languages such as Bash, Python, or GoØ 4+ years of experience with infrastructure-as-code tools such as Terraform, Ansible, or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).Ø Knowledge of Agile methodologies and software development lifecycle processes