ABOUT US
SG Analytics, a Great Place to Work (GPTW) certified company, is one of the leading research and analytics firms to offer datacentric research and contextual analytics services to companies across BFSI, Media & Entertainment, Technology & Healthcare sectors including Fortune 500 companies. With a presence in the US, the UK, Switzerland, and India (Pune, Hyderabad, Bangalore), SG Analytics has been consistently meeting and exceeding customer expectations by its knowledge-based ecosystem and impact-oriented solution.
Company size: 900+ employees.
Headquarters: Pune
Founded: 2007
Specialties: ESG Consulting, Equity & Fixed Income Research, Corporate Finance & Valuation, Market Research, Market Intelligence, Data Engineering, Data Governance & Management, Data Science, AI/ML, Customer Analytics, Marketing Analytics, Sales Analytics, Competitive Intelligence, Intelligent Automation, RPA, Quality Engineering, and Business Consulting
Description:
The objective of the Data Engineer is to build data products that collect, process and transform data from various sources and integrate to implement visualization
Responsibilities:
- Work with the Data providers and Data Architect to identify the critical data elements and come up with the Data Model for DW/Data Lake, Big data; Work with Logical data models, and different types of hierarchies in Azure.
- Data processing from different sources using ETL tools mainly using Azure components and integrate into DW/Data Lake. Perform cleansing, normalizing and aggregation as required.
- Implement optimized pipeline solutions and automation of workflows.
- Consideration of security, privacy and regulatory compliance measures to ensure data confidentiality and integrity.
Skills:
- 6-8 Years of experience in Data modeling, Data processing and data visualization.
- Good knowledge in Azure Data Factory (ADF), Azure Storage, Azure Synapse, ADLS, Functions, Logic Apps, Azure Analysis Service.
- Good knowledge in multiple flavors of Data Stores like Azure Synapse, distributed, row-based like Postgres, SQL managed Instance.
- Should have practical knowledge on AZURE SSIS integration run time.
- Should have hands-on expertise in creating external tables and designing distributed tables in AZURE SQL DW
- Microsoft Azure Certification in AZ104, DP-200/ DP-201 is a big plus.
- Knowledge of Agile methodologies and experience in the SDLC process, which includes analysis, design, development and testing.