AddressJob Description :
We are seeking a highly skilled and motivated experienced Data Architect to join our dynamic team with expertise in Scala, Kafka, Spark, Big Data, and Batch Processing.
As a Data Architect, you will play a crucial role in designing, implementing, and maintaining the Data Architecture that supports our organization's data-driven initiatives. Your expertise in Scala, Spark, and Kafka will be essential in building scalable and efficient data processing solutions.
Key Responsibilities :
Data Architecture Design :
- Collaborate with cross-functional teams to understand business requirements and translate them into scalable and efficient Data Architecture solutions.
- Design end-to-end data pipelines and architectures that support data integration, processing, and analytics.
Scala, Spark, and Kafka Expertise :
- Utilize your strong proficiency in Scala programming language to develop robust and scalable data processing applications.
- Design and implement Spark-based solutions for large-scale data processing and analytics.
- Implement and optimize Kafka for real-time data streaming and event-driven architectures.
Data Modeling :
- Develop and maintain conceptual, logical, and physical data models to ensure data consistency, integrity, and availability.
- Design data structures that support both operational and analytical requirements.
Data Governance and Security :
- Establish and enforce data governance policies to ensure the quality, accuracy, and security of data.
- Implement security measures to protect sensitive data and comply with relevant regulations.
Collaboration and Communication :
- Work closely with data engineers, analysts, and other stakeholders to understand data requirements and provide guidance on best practices.
- Communicate complex technical concepts to non-technical stakeholders in a clear and understandable manner.
Performance Optimization :
- Identify and implement optimizations to improve the performance and efficiency of data processing pipelines.
- Troubleshoot and resolve issues related to data processing and integration.
Qualifications :
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience as a Data Architect with a focus on Scala, Spark, and Kafka.
- Strong proficiency in Scala programming language.
- In-depth knowledge of Apache Spark for large-scale data processing.
- Experience in designing and implementing Kafka-based data streaming solutions.
- Understanding of data governance principles and security best practices.
- Excellent communication and collaboration skills.
Preferred Skills :
- Certification in Scala, Spark, or Kafka.
- Experience with cloud-based data platforms (e.g., AWS, Azure, GCP).
- Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
- Familiarity with machine learning and advanced analytics
