Job description
Job Description As Data Engineer, you’ll be responsible for creating and optimizing data and data pipeline for Machine learning projects, writing PySpark code for ETL operation on source data, data wrangling, perform data profiling & aggregation for preparing model ready data. • The Data Engineer will support our designers, data analysts and data scientists on different project initiatives and will ensure optimal project delivery. • You must be self-directed and comfortable supporting the development requirements which includes creation of an ML framework, component and creation of data pipeline in PySpark, Hive, MLiB for end to end (E2E) product lifecycle roadmaps. • You will also act as a Data Enabler for ML use cases as well as any tasks that involve generation of insights. • The individual would need to gain a good data understanding of all the source systems so as to support any downstream Use-Case/MI/Reporting requirements. • Experience of Banking/financial industries • Good understanding of Data Pipeline building on Pyspark & Hadoop echo system • Good understanding of various statistical analysis techniques • Understanding of MI, Machine learning technologies and solution • Relational and NoSQL databases. Primary Skills Data Science, Machine Learning, ML, Data Analytics, AIML, Predictive Analytics, AI, Forecasting, Prediction, Generative AI, Secondary Skills Hadoop
Address
Pune, Maharashtra
