Senior Data Engineer

Job Description:
GENERAL JOB DESCRIPTION:
Data Engineer to join our team will be primarily responsible for the development of PowerBI dashboards and data pipelines in the Azure cloud environment. As a Data Engineer, he/she will play a critical role in transforming raw data into actionable insights, enabling informed decision-making across the organization. The successful candidate will collaborate closely with data analysts, business stakeholders, and other team members to design, develop, and maintain scalable data solutions.
DUTIES & RESPONSIBILITIES:
Essential Functions of the Job:
Design, develop, and maintain PowerBI dashboards to visualize complex data sets and key performance indicators.
Develop and optimize data pipelines using Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics for efficient data ingestion, transformation, and storage.
Collaborate with business stakeholders to understand data requirements and translate them into technical specifications for data pipelines and dashboards.
Ensure data quality and integrity by implementing data validation, cleansing, and enrichment processes within data pipelines.
Perform data profiling, analysis, and troubleshooting to identify and resolve data issues and performance bottlenecks.
Implement security measures and best practices to safeguard sensitive data within PowerBI dashboards and Azure cloud solutions.
Monitor and optimize the performance of PowerBI dashboards and data pipelines to meet business SLAs and performance requirements.
Stay current with industry trends and emerging technologies related to PowerBI, Azure cloud services, and Data Engineering best practices.
Provide technical guidance and mentorship to junior team members on PowerBI development and Azure cloud technologies.
Analytical and Decision-Making Responsibilities:
Analyse business requirements and design technical solutions that meet those requirements while aligning with TASMU Platform capabilities and architecture.
Evaluate technical feasibility of data driven solutions and identify technical risks and mitigation strategies.
Analyse market trends and customer feedback to identify opportunities for product or service enhancements.
Conduct competitive analysis and stay up-to-date with industry trends to identify new features or services that could be implemented.
Assess potential impact of implemented technical solutions on existing IT infrastructure, security, and data governance.
Identify and prioritize technical requirements for TASMU services based on customer needs, feasibility, and technical impact.
Make recommendations on technical solutions to account managers and business development managers based on technical feasibility and alignment with market standards.
SKILLS & ABILITIES:
Required Skills and Abilities:
Bachelor's degree in Computer Science, Information Technology, or related field; Master's degree preferred.
Proven experience in developing PowerBI dashboards and reports with a strong understanding of data visualization best practices.
Extensive hands-on experience with Microsoft Azure cloud services, particularly Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
Proficiency in SQL and experience with database technologies such as SQL Server, Azure SQL Database, or similar.
Strong programming skills in languages such as Python, R, or C# for data manipulation and transformation tasks.
Experience with data modelling techniques and concepts, including star schema, snowflake schema, and dimensional modelling.
Familiarity with data warehousing concepts and methodologies.
Excellent problem-solving skills with the ability to analyze complex data sets and identify actionable insights.
Strong communication and collaboration skills with the ability to work effectively in cross-functional teams.
Proactive attitude towards learning new technologies and adapting to evolving business requirements.
Preferred Qualifications:
Certification in Microsoft Azure (e.g., Microsoft Certified: Azure Data Engineer Associate).
Experience with DevOps practices and tools for continuous integration and deployment (CI/CD) in Azure.
Knowledge of machine learning concepts and tools for predictive analytics and data-driven decision-making.
Experience with Agile development methodologies such as Scrum or Kanban.