Databricks Administration

Responsibilities

Key Responsibilities:

• Administer and maintain Databricks workspaces, clusters, and compute policies to ensure high availability and performance.
• Configure and manage user access, roles, permissions, and workspace governance aligned to security best practices.
• Monitor platform health, job reliability, cluster utilization, and troubleshoot failures across notebooks, jobs, and connectivity.
• Implement cost optimization practices such as cluster sizing, auto-scaling, scheduling, and usage reporting.
• Support integrations with cloud services and storage, ensuring stable connectivity and secure data access patterns.
• Create and maintain operational documentation, runbooks, and standard procedures for recurring administration tasks.
• Partner with engineering and data teams to onboard workloads, enforce standards, and improve platform usability.
• Assist with incident response, root-cause analysis, and continuous improvements to reduce operational risk.

Additional Responsibilities

Minimum Qualifications:

• Bachelor’s degree or equivalent in Engineering, Computer Science, MCA, MSc, or related discipline.
• 3–5 years of experience in platform administration/support with hands-on Databricks Administration.
• Working experience with cloud platforms and core cloud concepts (networking, IAM, storage, compute).
• Experience managing access controls, policies, and operational governance in a shared environment.
• Strong troubleshooting skills with the ability to analyze logs/metrics and resolve platform issues effectively.

Preferred Qualifications:

• Experience operating Databricks on major cloud platforms with an understanding of cloud-native security and governance.
• Exposure to automation for administrative tasks and environment standardization to improve reliability and speed.
• Proven ability to drive performance tuning and cost optimization for compute workloads in cloud environments.
• Experience supporting multiple teams, prioritizing requests, and communicating clearly with technical and non-technical stakeholders.
• Familiarity with monitoring/alerting practices and building operational dashboards for platform visibility.

Good to have skills:

Terraform, CI/CD, Python scripting, Monitoring & Alerting (Grafana/Prometheus/CloudWatch), Identity & Access Management (IAM)

Technical and Professional Requirements

• Primary skills:Technology->Data Engineering->Databricks

Preferred Skills

• Databricks

Educational Requirements

MCA,MSc,MTech,Bachelor of Engineering,BTech