Big Data Engineer

We are seeking a skilled Big Data Engineer with 3+ years of experience to join our dynamic team. The ideal candidate will have expertise in Python, SQL, Hadoop, Hive, and Airflow, and a strong background in working with large datasets.As a Big Data Engineer, you will be responsible for designing, developing, and maintaining our Big Data infrastructure to ensure optimal performance and scalability.Key Responsibilities:Designing and implementing Big Data solutions using Hadoop, Hive, and other relevant technologiesDeveloping data pipelines and ETL processes to extract, transform, and load data from various sourcesOptimizing and tuning Big Data systems for performance and efficiencyCollaborating with data scientists and analysts to understand data requirements and deliver actionable insightsMonitoring and troubleshooting data processing jobs to ensure data quality and reliabilityStaying up-to-date with the latest trends and technologies in Big Data and analyticsSkills and Qualifications:Bachelor's degree in Computer Science, Engineering, or a related field3+ years of experience in Big Data Engineering rolesProficiency in Python and SQL for data manipulation and analysisHands-on experience with Hadoop ecosystem tools such as HDFS, MapReduce, and SparkStrong knowledge of Hive for data warehousing and querying large datasetsExperience with workflow management tools like Airflow for orchestrating data pipelinesFamiliarity with cloud platforms such as AWS or Azure is a plusExcellent problem-solving skills and attention to detailStrong communication and teamwork abilities