Job Title:Data Engineer
Location: Xiaomi India Technology Pvt Ltd, Bangalore, India
Job Description:
Xiaomi India is seeking a highly skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure to support our rapidly growing business needs. The ideal candidate will have expertise in Apache Iceberg, Apache Hive, Apache Hadoop, SparkSQL, YARN, HDFS, MySQL, Data Modeling, Data Warehousing, Spark Architecture, and SQL Query Optimization. Experience with Apache Flink, PySpark, Automated Data Quality testing & Data Migration is considered a plus. Also, it's mandatory to know any one cloud stack (AWS or Azure) for Data Engineering to Create Data Jobs and Workflows and Scheduler it later for Automation
Responsibilities:
- Design, implement, and maintain scalable and reliable data pipelines using Apache Iceberg, Apache Hive, Apache Hadoop, SparkSQL, YARN, and HDFS.
- Develop efficient data models and data warehousing solutions to support business analytics and reporting requirements.
- Optimize SQL queries and performance tuning to ensure optimal data retrieval and processing.
- Collaborate with Engineering Manager & understand the data requirements coming from cross-functional teams/Business Teams to deliver effective solutions.
- Implement best practices for data governance, data quality, and data security.
- Develop and maintain documentation for data processes, data flows, and data infrastructure.
- Stay updated with emerging technologies and trends in the Data Engineering domain.
- Mentor junior team members and contribute to a culture of continuous learning and improvement.
Requirements:
- Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree preferred.
- 3+ years of experience working as a Data Engineer or a similar role.
- Strong proficiency in Apache Iceberg, Apache Hive, Apache Hadoop, SparkSQL, YARN, HDFS, MySQL, Data Modeling, and Data Warehousing.
- Expertise in Spark Architecture and SQL query optimization.
- Experience with Apache Flink, and Automated Data Quality testing is a plus.
- It's mandatory to know any one cloud stack (AWS or Azure) for Data Engineering to Create Data Jobs and Workflows and Scheduler later for Automation
- Excellent Problem-Solving Skills and attention to detail.
- Strong communication and collaboration skills.
- Ability to thrive in a fast-paced and dynamic environment.
Job ID
30995Job Type
Full-timeLocation
BengaluruExperience
1 - 2 YearsBusiness Unit
ITOrganization
Xiaomi IndiaPosted
March 15th 2024Posted By
Sudipto Kanti Ghosh