Address
Form of workOverview :We are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining the infrastructure required to manage and process large and complex data sets. Collaborating closely with data scientists and business stakeholders, you will translate their needs into technical solutions that drive business outcomes. Your responsibilities will include building robust data pipelines, troubleshooting data-related issues, and ensuring the reliability, accuracy, and security of our data infrastructure.Responsibilities :Design and develop scalable data pipelines using Pyspark or Scala and Python.Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions.Implement DevOps processes using Jenkins/Bitbucket/AzureDevOps for seamless deployment and integration.Experience working with catalogs like Hive Metastore or Apache Atlas or Utility Catalog.Troubleshoot and resolve data-related issues to ensure data reliability and accuracy.Utilize Databricks to manage and orchestrate data workflows effectively.Experience in Hadoop ecosystem on-prem (Cloudera) with SQL in Hadoop ecosystem will be advantageous.Monitor and enhance data infrastructure to meet evolving business needs.Stay updated with the latest industry trends and best practices to contribute to our Data Engineering strategy.Qualifications (Must-have skills) :Bachelor's degree in Computer Science, Information Technology, or a related field.Proven experience as a Data Engineer with a focus on Python, SQL, PySpark, and Databricks.Strong proficiency in Python and SQL, with the ability to write efficient code.Familiarity with Databricks and related certifications will be preferred.Solid understanding of data modeling, ETL processes, and data warehousing.Excellent problem-solving skills and attention to detail.Effective communication and collaboration skills.Ability to work independently and as part of a team.A passion for data and a desire to continuously improve data infrastructure.Benefits :Startup Environment - Join a dynamic and impactful startup setting with a small team of 50 young professionals.Growth Opportunities - Rapidly advance your career and expand your skills within our close-knit team.Direct Impact - Your contributions shape the company's success and future growth.Fun and Social Activities - Engage in regular team-building activities and events.Transparency and Communication - Experience a culture of transparency and open communication.Entrepreneurial Spirit - Develop an entrepreneurial mindset and gain firsthand experience in building a company.Company Culture - Join a supportive team environment that celebrates achievements.Vacation and Holidays - Enjoy generous vacation policies and holiday allowances.Competitive Compensation - We offer a highly competitive salary to attract top talent in the industry. (ref:hirist.tech)
