Contract C2C
Role- Big Data Scala Developer
Location- 100% Remote
Must Have Skills
Zio
Cat Effects
Scala
Experian is seeking a skilled Software Engineer to work on a Scala-based data processing platform. The role involves designing, developing, and maintaining scalable distributed systems that process large volumes of data across cloud environments. The ideal candidate should have strong hands-on experience in Scala application development, functional programming, distributed computing, and large-scale data processing.
The candidate should be comfortable working with modern Scala libraries such as Cats, cats-effect, FS2, and preferably ZIO. Strong SQL expertise in the context of large data operations is essential, along with experience in Google Dataflow, BigQuery, PostgreSQL, AWS/GCP services, and distributed messaging systems.
Responsibilities
Design and develop scalable Scala-based backend services and data processing applications
Build and maintain distributed systems for large-scale data ingestion and processing
Work with functional programming libraries such as Cats, cats-effect, FS2, and related Scala ecosystem tools
Integrate cloud services across AWS and GCP environments
Develop and optimize SQL queries for large-scale data operations
Work with BigQuery, Dataflow, PostgreSQL, and distributed messaging systems such as Pub/Sub
Implement asynchronous and concurrent processing solutions
Write clean, maintainable, testable, and well-documented code
Troubleshoot issues in distributed cloud-based environments
Collaborate with cross-functional engineering teams using Git-based workflows
Qualifications
3+ years of professional software engineering experience
Strong proficiency in Scala and sbt
Hands-on experience with Cats, cats-effect (especially cats-effect 2), and functional programming concepts
Exposure to ZIO is a plus
Strong SQL and PostgreSQL experience, especially with large data operations
Experience with JSON serialization/deserialization tools such as Circe
Experience with Google BigQuery and Dataflow
Familiarity with AWS/GCP services including IAM, STS, AssumeRole, WebIdentity, S3, and related SDKs
Experience with asynchronous/concurrent programming and distributed systems
Familiarity with Pub/Sub or similar distributed messaging systems
Experience with unit, component, and integration testing
Knowledge of Kubernetes, workflow orchestration, or Finagle is preferred
Strong problem-solving and debugging skills
Bachelor’s degree in Computer Science or equivalent practical experience
To apply for this job email your details to Adarsh@empowerprofessionals.com