AWS Databricks Platform Administrator Job at Neshent Technologies, Raritan, NJ

N0lrOWw3MG1WMnRMdWZ1WWJiQXd1WHdBVHc9PQ==
  • Neshent Technologies
  • Raritan, NJ

Job Description

Job Summary

We are seeking a Senior Databricks Platform Engineer with strong hands-on experience in administering, securing, optimizing, and supporting Databricks environments on AWS. The role focuses on platform reliability, security, governance, automation, cost optimization, and production support for enterprise data platforms.

Key Responsibilities
  • Administer Databricks workspaces, Unity Catalog, clusters, SQL warehouses, jobs, secrets, and access controls.
  • Manage AWS integrations, including S3, IAM, VPC, KMS, PrivateLink, CloudWatch, and CloudTrail.
  • Implement security, identity management, data governance, and access control policies.
  • Automate platform provisioning and operations using Terraform, Python, Databricks CLI/SDK, and CI/CD pipelines.
  • Monitor platform performance, troubleshoot production issues, manage incidents, and ensure SLA compliance.
  • Optimize Databricks and AWS resource utilization and costs.
  • Manage platform upgrades, disaster recovery, compliance, and operational documentation.
  • Collaborate with cloud, security, and data engineering teams and provide technical guidance.
Required Qualifications
  • 9+ years of overall IT experience, with at least 5 years of hands-on Databricks administration experience.
  • Strong knowledge of Databricks on AWS, Unity Catalog, Delta Lake, Apache Spark, clusters, jobs, and SQL warehouses.
  • Hands-on experience with AWS services, including S3, IAM, VPC, KMS, PrivateLink, CloudWatch, and CloudTrail.
  • Experience with Terraform, Python, shell scripting, REST APIs, Databricks CLI/SDK, and CI/CD.
  • Strong understanding of cloud security, networking, monitoring, performance tuning, FinOps, and production support.
  • Bachelor's degree in Computer Science, IT, Engineering, or equivalent relevant experience.

Job Tags

Contract work

Similar Jobs

Alpaca Health

Prior Authorization Manager Job at Alpaca Health

 ...and based in the United States Role: Prior Authorizations Manager Responsibilities: Work with our Prior Authorizations vendor...  ...across the intake workflow Develop processes and training materials for offshore team members to resolve day-to-day prior authorization... 

Orion Consortium

Telecommunications Equipment Installer and Repairer - Pipeline Job at Orion Consortium

 ...requirements. Applications are being accepted in advance to identify qualified candidates for potential openings.* Description Install, set-up, rearrange, or remove switching, distribution, routing, and dialing equipment used in central offices or headend. Service... 

Consilium, LLC

Clinical Neuropsychologist Job at Consilium, LLC

Neuro-Psychology Opportunity | Ages 12+ | MF ScheduleThis is a mission-driven, multidisciplinary setting where your expertise will directly shape outcomes for a highly vulnerable population.Schedule : MondayFriday, 8:00 AM5:00 PMPopulation : Ages 12+Clinical Focus...

A.N. Publishing

International Editor (Internship) Job at A.N. Publishing

 ...Foreign Policy , Global Policy , International Affairs, and Semafor ? Well, take the...  ...reading further, this is a virtual, unpaid internship role that can also be used for class...  ...Experience/ability to oversee the development of intentional social and political news... 

Vanderbilt University

Lab Teaching Assistant Biological Sciences Job at Vanderbilt University

 ...Staff is part of the Department of Biological Sciences at Vanderbilt University and is responsible for assisting in the education of students in multiple major disciplines...  ...safe laboratory practices. Involved in information management (grades creation and maintenance...