Azure Databricks Admin

Job Description

Job Description:
Job Title: Azure Databricks Admin

Location: Remote

Mode of Hiring – Contract

The perfect candidate must have a mix of Azure Administration skills and Databricks setup/configuration/integration skills.

The resource must have strong understanding of Databricks architecture, needs to be strong in Azure Databricks administration (key area).

Job Description

Summary:

The Enterprise Cloud Team is looking for a Senior Cloud Engineer with hands-on Microsoft Azure cloud engineering experience and required Databricks infrastructure, performance, hands-on. The ideal candidate has experience working in hybrid (cloud & on-prem) environments, and multi-cloud if possible, building and maintaining cloud group and subscription hierarchies, building and securing cloud-based infrastructure, supporting application runtime environments, architecting solutions and comfortable collaborating and communicating with engineers at all levels of the datacenter stack to implement complicated architectures and designs, while being hands-on as needed. The ideal candidate must be a quick learner of our infrastructure/environment, proactive in taking on tasks and not afraid to assume ownership of the tasks, end-to-end. The candidate must be a “do-er” not a follower and must be willing to provide commentary and opinion on just about any cloud-related topic.

Skills

Responsibilities:

· Manage Databricks infrastructure and collaborate with various teams to ensure it integrates seamlessly with all components including network, security, messaging, and remote access. (REQUIRED)

· Troubleshoot and resolve Databricks environment performance issues, connectivity issues, security issues. (REQUIRED)

· Experience in setting up “Admin Group” and give user admin privileges, adding them to admins group using Admin Console, Groups API 2.0, SCIM API 2.0 or using SCIM-enabled identity provider. (REQUIRED)

· Work with Application and Solution Architects, Software Engineers & Infrastructure Engineers to solve technical and operational challenges, drive efficiency and provide critical support for business impacting issues

· Act as a point of escalation regarding Azure and AWS situations for the Cloud Support Team

· Support multiple systems or applications of high complexity, ensuring control, integrity and accessibility

· Act as the technical liaison between operational and development teams, providing critical operational insight to upcoming implementations and strategies, including validation of ongoing solutions supportability

· Stay well-informed of failures and complications related to our cloud offerings

· Be responsible for debugging technical issues inside a complex stack involving virtualization, containers, micro-services, etc.

· Collaborate with engineering teams to enable their applications to migrate to and run on Cloud infrastructure.

· Work with automation team to maintain Automation scripts / tools created to support monitoring and automation of operational support

· Manage and Support cloud environments in accordance with company security guidelines.

· Strong implementation and support of APIs to troubleshoot RESTful services and integration of them with consumers

· Extensive experience with open-source technology, software development and system engineering.

· Employ exceptional problem-solving skills, with the ability to see and solve issues before they snowball into problems.

· Educate teams on the implementation of new cloud-based initiatives, providing associated training as required.

· Lead and develop best practices and runbooks for use by operations and escalations teams

· Stay current with industry trends, contributing to recommendations as needed to help the company excel.

Qualifications:

Bachelor’s Degree in Computer Science or Engineering; Master’s degree a plus.
Certification as an Azure Solutions Architect, Cloud Security Certification, and/or OpenStack
8+ years of experience in Azure cloud computing and design.
Experience with popular solutions from the leading cloud vendors, primarily Microsoft Azure, as well as Amazon Web Services (AWS)
Experience implementing and supporting micro-service and server-less design concepts and patterns
Proven design, planning and implementation experience with all infrastructure components including Storage, Network and Compute technologies