C2C requirements
Role: Sr Data Engineer
Location: Remote
Rate: $50/hr on C2C
We need to share senior profiles (10+ years) with expertise in Apache Spark, Python, AWS, etc. (see JD for details).
Client will interview shortlisted candidates and may assign a 1–3 day test task.
Job Responsibilities:
The Primary focus for this Senior Engineering position will be to support SAS transition priorities, create and/or convert existing SAS code to Spark.
Optimize Spark jobs performance and resource usage, identifying and addressing bottlenecks and inefficiencies in backend systems
Design, develop, and maintain high-quality backend software components and services, ensuring functionality, performance, and scalability
Research and build proof of concepts in the data space
Write clean, well-structured, and maintainable code, adhering to established coding standards and best practices
Perform thorough code reviews, providing constructive feedback to peers and identifying potential risks or areas for improvement
Debug and resolve defects, proactively identifying and addressing potential issues before they impact users.
Create and maintain comprehensive technical documentation
Actively participate in Agile ceremonies, such as stand-ups, sprint planning, and retrospectives, ensuring effective communication and collaboration across the team
Assist in the estimation, prioritization, and planning of development tasks, ensuring projects are delivered on time and within budget
Continuously evaluate and recommend new data frame related technologies, frameworks, and tools, helping to drive innovation and keep the team up-to-date with industry trends
Engage in ongoing professional development to stay current with industry best practices, and share knowledge and insights with the team as appropriate
Assist in the implementation and maintenance of security, compliance, and governance policies within the AWS environment to ensure adherence to industry standards and regulatory requirements.
Qualifications
Strong experience with Apache Spark and Python
Bachelor’s degree in Computer Science, Computer Engineering or related field
At least 10 years of experience in software development
AWS Experience (S3, EC2, Glue, Lambda, etc)
Strong understanding of software design patterns, data structures, and algorithms
Experience with Agile development methodologies
Ability to work independently as well as in a team
Strong problem-solving and analytical skills
Strong verbal and written communication skills
Related experience in analytic programming, data extraction, querying databases/data warehouses and data analysis.
DataBricks & R experience is highly preferred
Professional DataBricks/Apache Spark Certification(s) are highly preferred
To apply for this job email your details to rajm@simplisoftwaresolutions.com