AWS Databricks Engineer C2C contract role Raritan, NJ

Role – AWS Databricks Engineer  (AWS Databricks not Azure Databricks)

Location – Raritan, NJ

Contract

Role Summary:

We are looking for an experienced AWS Databricks Platform Administrator with 5 plus years of experience in cloud Databricks on AWS. This role is responsible for managing securing automating and optimizing the Databricks Platform and governance needs. The ideal candidate should have hands on experience in AWS Infrastructure IAM Unity Catalog Support

JD:

Administer and manage Databricks workspaces in AWS environments
Configure Implement and maintain manage secure Unity access to data stored in Amazon S3 using IAM roles instance profiles and trust policy
Define and enforce Catalog including catalogs schemas tables storage credentials and external locations
Monitor cluster performance cluster policies access controls and workspace standards to ensure security and compliance
Automate platform provisioning usage trends and platform health and drive cost optimization through autoscaling tag
Troubleshoot and configuration using Infrastructure as Code tools such as Terraform production issues related to clusters permissions storage access networking and job failures
Support Collaborate with data engineering security cloud infrastructure and support teams to ensure platform reliability and release management upgrades new feature enablement and platform best practices adoption
Create and maintain operational documentation SOPs and runbooks for platform administration
 

Required Skills and Qualifications

5-7 years of overall IT experience with strong hands-on experience in Databricks administration on AWS
Good understanding of AWS services including IAM S3 EC2 VPC CloudWatch and related security controls
Handson experience with Unity Catalog and enterprise data governance practices
Strong knowledge of Databricks cluster management workspace administration job
Monitoring and access management
Experience in Infrastructure as Code using Terraform and scripting using Python Shell or Bash Knowledge of CICD release management and environment migration processes for platform changes