Job Description
Job Title: Data Engineer – DBT
Chennai | Hyderabad | Bangalore
Who we are
Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose is to provide certainty to shape a better tomorrow.
Our team of 4000+ technologists and consultants are based in the US, Canada, the UK, India, Singapore and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. Many of our team leaders rank in Top 10 and 40 Under 40 lists, exemplifying our dedication to innovation and excellence.
We are a Great Place to Work-Certified™ (2022-24), recognized by analyst firms such as Forrester, Gartner, HFS, Everest, ISG and others. We have been ranked among the ‘Best’ and ‘Fastest Growing’ analytics firms lists by Inc., Financial Times, Economic Times and Analytics India Magazine.
Curious about the role? What your typical day would look like?
As a Data Engineer, you will have the opportunity to independently develop data pipelines, focus on code modularization, implement data quality checks and logic, as well as conduct unit testing. Additionally, you will be responsible for reviewing and troubleshooting data pipeline code written by the team. On a typical day, you might
- Engage with clients and gathering technical requirements for select components or modules of the overall solution being developed with minimal guidance from leads.
- Demonstrate exceptional problem-solving and analytical skills.
- Collaborate with cross-functional teams to ensure data accuracy, completeness, and consistency.
- Take the lead on various project aspects with minimal guidance from project leads.
- Design data models and review or troubleshoot data model components developed by the team.
- Perform all data governance tasks outlined in the solution design document with limited guidance from leads/SMEs.
- Quickly adapt to new situations and exhibit forward-thinking.
- Implement ingest, transform, store, and analyze components on the project's cloud platform with limited guidance from leads/SMEs.
- Maintain quality control standards and adhere to acceptable coding and organizing practices
Job Requirement
What do we expect? Skills that we’d love!
- Possess over 4 years of comprehensive experience with a strong grasp of database and data warehousing concepts.
- Demonstrated proficiency in DBT (both Cloud and CLI), with a minimum of 1 year of hands-on experience.
- Hands-on experience of at least 1 year in Apache Airflow development and Python scripting.
- Sound understanding of data modeling concepts.
- Extensive knowledge of SQL, capable of writing SQL queries proficiently, including CTEs.
- Experience in working with data pipelines for ingesting raw data into Cloud Data Warehouses (e.g., Snowflake, Redshift, BigQuery), cleansing the data, and transforming it to the required state.
- Proficient in data profiling and data validation techniques.
- Skilled in developing and implementing data transformation logic using DBT (Data Build Tool).
- Hands-on experience in creating DBT models, materialization, macros, snapshots, Jinja templating, and creating or modifying YAML files.
- Proficient in creating DBT Cloud jobs.
- Experienced in building Airflow DBT connections and DAG creation to schedule DBT Cloud jobs.
- Familiarity with integrating GitHub or any other version control tool with DBT and Airflow.
- Knowledgeable in Shell or PowerShell scripting.
You are important to us, let’s stay connected!
Every individual comes with a different set of skills and qualities so even if you don’t tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow.
We are an equal-opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire.
Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.