C2C jobs requirements
Role: Data Engineer (Snowflake, AWS)
Location: Fort Mill, SC / ONSITE
Duration: Long Term Project
Experience: 10+
Job Role and Responsibilities:
Responsible for designing developing and maintaining scalable data pipelines and ETL processes using AWS Glue This role involves working closely with data engineers analysts and other IT professionals to ensure data is efficiently integrated transformed and made available for business use
2 DBT Experience with DBT Data Build Tool for modeling data and creating data transformation pipelines is a plus
3 AWS services Airflow The candidate should have handson experience with AWS services particularly Apache Airflow for orchestrating complex data workflows and pipelines
4 AWS services Lambda Proficiency in AWS Lambda for serverless computing and eventdriven architecture is essential for this role
5 AWS services Glue The candidate should be wellversed in AWS Glue for ETL Extract Transform Load processes and data integration
6 Fivetran HVR Working knowledge and handson experience on Fivetran HVR
7 Python Strong programming skills in Python are required for developing data pipelines data transformations and automation tasks
Responsibilities:
Design develop and maintain data pipelines and ETL processes using Snowflake AWS services Python and DBT
Collaborate with data scientists and analysts to understand data requirements and implement solutions
Optimize data workflows for performance scalability and reliability
Troubleshoot and resolve datarelated issues in a timely manner
Stay updated on the latest technologies and best practices in data engineering
Design and implement scalable ETL solutions using AWS Glue
Collaborate with data engineers and analysts to understand data requirements
Develop and manage data extraction transformation and loading processes
Optimize and improve existing data pipelines and ETL workflows
Ensure data quality and integrity during the transformation process
Monitor and troubleshoot issues with ETL jobs
Maintain detailed documentation of data workflows and processes
Stay updated with the latest AWS services and tools
Qualifications:
Bachelors degree in Computer Science Engineering or related field
Proven experience in data engineering roles with a focus on Snowflake AWS services Python and DBT
Strong analytical and problemsolving skills
Excellent communication and teamwork abilities
Technical certifications are a plus
Bachelors degree in Computer Science Information Technology or a related field
3 years of experience working with AWS Glue and other AWS data services
Proven experience in designing and maintaining ETL processes
Strong knowledge of SQL and database management
Familiarity with data warehousing concepts and tools
Experience with Python or other scripting languages
Excellent problemsolving and analytical skills
Strong communication and teamwork abilities
To apply for this job email your details to shahid.m@wonese.com