Address
Form of workPurpose:
The Senior Team Leader – Data Engineering and Support role has a dual focus, covering direct team leadership for the Elanco IT DataOps Data Engineering team located at IAC and the Enterprise Data Platforms and Data Products Support team through that team’s leader, which will report to this role. As part of the Data Engineering team, this individual is accountable for the delivery of data foundations, pipelines, and products supporting our enterprise data objectives. As part of the Enterprise Data Platforms and Data Products Support team, this individual is accountable for the operational support of the services covering key data platforms, such as Azure Databricks, Azure Synapse Analytics, Azure Data Lake, and the Enterprise Data Products, such as Workforce, Material, Customer and Consumer. Leadership responsibilities will include providing direct HR line support for ~4 people at IAC and indirect support for a further ~7. This includes alignment on annual and quarterly goal
...Purpose:
The Senior Team Leader – Data Engineering and Support role has a dual focus, covering direct team leadership for the Elanco IT DataOps Data Engineering team located at IAC and the Enterprise Data Platforms and Data Products Support team through that team’s leader, which will report to this role. As part of the Data Engineering team, this individual is accountable for the delivery of data foundations, pipelines, and products supporting our enterprise data objectives. As part of the Enterprise Data Platforms and Data Products Support team, this individual is accountable for the operational support of the services covering key data platforms, such as Azure Databricks, Azure Synapse Analytics, Azure Data Lake, and the Enterprise Data Products, such as Workforce, Material, Customer and Consumer. Leadership responsibilities will include providing direct HR line support for ~4 people at IAC and indirect support for a further ~7. This includes alignment on annual and quarterly goals, completing the performance management cycle in alignment with Elanco processes, and providing coaching, feedback, and career planning to enable a well engaged and high performing team. Other administrative responsibilities include input into the annual business plan cycle, enabling strong partnerships with third party organizations supporting our teams, and working across DataOps leadership to continue to build and mature our capabilities as an organization.
This position will also be focused on maturing Data Engineering capabilities and developing data pipelines and products for Elanco. The role requires sound understanding of animal health data from different domains – R&D, Sales & Marketing, Commercial, Regulatory and Supply Chain, and proven learning agility and ability to translate complex business problems and challenges into tangible data pipelines and data products of high value. The ideal candidate would be responsible for end-to-end development, delivery, and support highly performant, scalable (small- to big- data), robust and secure Azure cloud data pipelines enabling AI/ML/Deep-Learning, Advanced Analytics, Enterprise Collaboration, Micro-services, IoT and Server-less Compute.
Role & Responsibilities
Leadership – Supervisory Responsibilities (70%)
Leadership
· Partner with Engineering Community (Solution Ops, Tech Ops) Leadership to establish and scale engineering forum within Elanco.
· Partner with DataOps Leadership to establish and scale DataOps Engineering and Data Platform/Product Support as growing teams within Elanco.
· Collaborate within and across teams to define, embed and scale the DataOps engineering processes for delivering data products and pipelines to enable the business initiatives in Elanco.
· Partner with future Data Ops Delivery Leads for demand shaping, prioritization, and alignment.
· Guide the Data Platforms/Products Support Lead in staffing their team, setting priorities and objectives.
Role & Responsibilities
Leadership – Supervisory Responsibilities (70%)
Leadership
· Partner with Engineering Community (Solution Ops, Tech Ops) Leadership to establish and scale engineering forum within Elanco.
· Partner with DataOps Leadership to establish and scale DataOps Engineering and Data Platform/Product Support as growing teams within Elanco.
· Collaborate within and across teams to define, embed and scale the DataOps engineering processes for delivering data products and pipelines to enable the business initiatives in Elanco.
· Partner with future Data Ops Delivery Leads for demand shaping, prioritization, and alignment.
· Guide the Data Platforms/Products Support Lead in staffing their team, setting priorities and objectives.
· Identify and position new methodologies, techniques and concepts that drive data product delivery and operational efficiencies, including automation, etc.
· Establish a culture of operational excellence, with a focus on continuous improvement.
· Enable and foster strong working relationships with third party service providers for both development and support of data solutions.
· Own the establishment of required capabilities and skills, anticipate future needs, staff to needs, and continuously work to develop people and the organization.
· Recruit, develop, engage, and retain a diverse, high-performing team.
Coach the engineering and support staff to maximize everyone's contribution and to help them achieve their full potential.
Engage with the broader leadership at IAC, both to support the evolution of this organization within Elanco and to ensure that DataOps is represented appropriately in any organization-wide initiatives.
Mentor individuals across IT roles in IAC
· Demonstrate ownership in understanding Elanco’s strategic direction as it relates to your team and individual goals.
Data Engineering (30%)
· Provide Data Engineering subject matter expertise and hands-on development for data- capture, ingestion, curation, and pipeline development to deliver cloud optimized data solutions.
· Understand business requirements and design, deliver, and lead team in the building of reliable, efficient, scalable, and quality data pipelines.
· Work on complex data and analytics-centric problems to enable proof of concepts and build learnings into future production solutions.
· Provide expert data PaaS, IaaS, or SaaS consultancy on a range of topics, such as cloud storage; big data platform services; server-less architectures; SQL DB; NoSQL databases and secure, automated data pipelines.
· Develop and evolve new or existing Data Engineering methods and procedures to create alternative, agile solutions to moderately complex problems.
· Stay abreast with new and emerging Data Engineering technologies, tools, methodologies, and patterns on major public clouds, especially Azure and GCP.
· Ensure that the team delivers quality solutions in alignment with our enterprise Elanco quality policies and procedures.
· Work collaboratively and use sound judgment in developing robust solutions while seeking guidance on complex problems.
Basic Qualifications (Must have)
· Bachelors or higher degree in Computer Science or a related discipline.
· At least 8 years of data pipeline and data product design, development, delivery experience and deploying ETL/ELT solutions, ideally on Cloud Platforms (Azure/GCP preferred)
· At least 1 year of team leadership/team supervisory experience
Minimum of 5 years of hands-on experience in programming languages, Cloud and Big Data technologies such as Powershell, C#, Java, Python, Scala, SQL, ADLS/Blob, Hadoop, Spark/SparkSQL, Hive, and streaming technologies like Kafka, EventHub etc.
Good to Have Skills:
· Hands-on experience in implementing data migration and data processing using Azure services: Windows/Linux virtual machines, Docker Container and Kubernetes Cluster Management, AutoScaling, Azure Functions, Server-less Architecture, ARM Templates, Logic Apps and Data Factory, Azure network security group, Key management service, etc.
· Knowledge of Spark Framework 3.x version
· Experience working with Developer tools such as Visual Studio, GitLabs, Jenkins, etc.
· Familiarity with metadata management tools, techniques, and technologies such as Data Catalog & API Management
· DevOps on an Azure platform.
· Experience in Azure Machine Learning Services.
Great-to-Have Skills
· Azure Certifications – particularly with data platforms/services
Multi-cloud experience is a plus, especially GCP
