Address
Form of workJob Description :Kogta Financial Ltd is seeking an experienced and highly skilled ETL & Data Warehouse Developer with expertise in utilizing AWS services to join our dynamic team. As a key member of our Data Engineering team, you will be responsible for designing, developing, and optimizing ETL processes and data warehousing solutions on the AWS platform. The ideal candidate should have a solid background in ETL development, data modeling, and a deep understanding of AWS services and hands-on experience in crafting complex SQL queries and optimizing data workflows.Responsibilities :1. ETL Development :- Design, develop, and implement robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed.- Ensure the efficient extraction, transformation, and loading of data from diverse sources into our data warehouse.2. Data Warehousing :- Design and maintain data warehouse solutions on AWS, with a focus on scalability, performance, and reliability.- Implement and optimize data models for efficient storage and retrieval in AWS Redshift.3. AWS Service Utilization :- Leverage AWS services such as S3, Lambda, Glue, Redshift, and others to build end-to-end data solutions.- Stay abreast of AWS developments and recommend the adoption of new services to enhance our data architecture.4. SQL Expertise :- Craft complex SQL queries to support data analysis, reporting, and business intelligence requirements.- Optimize SQL code for performance and efficiency, and troubleshoot any issues related to data retrieval.5. Performance Optimization :- Optimize ETL workflows and data warehouse queries to ensure optimal performance.- Identify and resolve bottlenecks in data processing and storage.6. Data Integration :- Collaborate with cross-functional teams to integrate data from various sources into the data warehouse.- Work closely with business stakeholders to understand data requirements.7. Security and Compliance :- Implement and maintain security measures to protect data integrity and ensure compliance with industry standards and regulations.- Collaborate with the security and compliance teams to implement best practices.8. Documentation :- Document ETL processes, data models, and system configurations for future reference.- Ensure comprehensive documentation of the developed solutions for knowledge transfer.Requirements :- Bachelor's degree in Computer Science, Information Technology, or a related field.- Proven experience as an ETL & Data Warehouse Developer with a focus on AWS services and SQL expertise.- Strong proficiency in SQL, stored procedures, and views.- In-depth understanding of AWS services related to data processing and storage.- Experience with data modeling and designing efficient data warehouses.- Familiarity with best practices in data security, compliance, and governance.- Strong problem-solving and analytical skills.- Excellent communication and collaboration skills.- Certification in AWS or relevant technologies. (ref:hirist.tech)
