Home

IMMEDIATE INTERVIEW AND OFFER= Databricks Support Engineer = Remote (local to Chicago preferred)- need local candidate from ILLINOIS at Chicago, Illinois, USA
Email: [email protected]
http://bit.ly/4ey8w48
https://jobs.nvoids.com/job_details.jsp?id=2080569&uid=

|
From:

GAURAV,

SIBITALENT

[email protected]

Reply to:   [email protected]

Hi,
Hope you are doing well,
IMMEDIATE INTERVIEW AND OFFER= Databricks Support Engineer = Remote (local to Chicago preferred)- need local candidate from ILLINOIS 
Please find the Job details below and kindly revert if youre interested in learning more about this job.

Job Title: Databricks Support Engineer 
Location: Remote (local to Chicago preferred)-need local candidate from ILLINOIS 
Onboarding Requirements: Background check, Drug screen, COVID vaccination (if applicable)

Position Overview:
We are seeking a Databricks Support Engineer to provide critical support for the day-to-day operations of Databricks jobs, pipelines, and machine learning operations. This position requires expertise in Databricks engineering, troubleshooting Python/SQL code, and optimizing data pipelines. The ideal candidate will have experience working with Databricks, BigQuery, and ML pipelines, and be comfortable with troubleshooting and supporting machine learning jobs and clusters.
Key Responsibilities:
Mandatory Skills and Responsibilities:
    Machine Learning Pipeline & Job Troubleshooting:
o    Investigate failed or stuck Databricks jobs and debug errors in job execution, including Python exceptions and Spark-related issues.
o    Troubleshoot SQL queries and Python scripts within Databricks notebooks or jobs.
o    Optimize and ensure performance, scalability, and reliability of Databricks pipelines.
    Day-to-Day Databricks Operations Support & Performance Tuning:
o    Monitor health and performance of Databricks jobs, clusters, and pipelines.
o    Diagnose and resolve issues related to job performance, failures, resource constraints, and bottlenecks.
o    Provide support to data scientists, engineers, and other users with Databricks workspace configurations and job setups.
o    Monitor and analyze performance using tools like Spark UI, Ganglia, and Databricks Metrics.
    System & Data Integrations:
o    Support integration of Databricks with other data systems (e.g., BigQuery), ensuring smooth data flow between platforms.
o    Configure and troubleshoot job scheduling systems to ensure jobs are triggered as expected.
Nice to Have:
    MLflow: Understanding of Databricks MLflow for machine learning operations.
    Databricks Cluster Management (Admin Duties):
o    Manage Databricks clusters, including creation, scaling, and termination.
o    Define and enforce cluster policies to optimize resource usage and control costs.
o    Optimize cluster configurations for performance and cost efficiency.
Collaboration and Documentation:
    Collaborate with data engineers, data scientists, and ML teams to ensure Databricks environments meet their needs.
    Maintain clear documentation on Databricks cluster management, job setup, pipeline troubleshooting, and incident resolution.
Requirements:
    Strong experience with Databricks engineering, Python, and SQL troubleshooting.
    Experience in supporting and optimizing Databricks jobs and pipelines.
    Familiarity with Databricks clusters, job scheduling, and data integrations (e.g., BigQuery).
    Basic knowledge of Databricks administration, including cluster management and policies.
    MLflow knowledge is a plus.
    Strong problem-solving skills and ability to debug issues across Databricks environments.
    Excellent communication skills for collaborating with cross-functional teams.
Preferred Skills:
    Familiarity with BigQuery and machine learning pipelines.
    Experience with Azure or cloud-based environments.
Additional Information:
    This is a 100% remote position, but candidates should be local to Chicago for potential on-site requirements or collaboration.
    The role is expected to start immediately and is projected for 3 months, with potential for extension.
    ISS Friendly and VSD Friendly.
If you're passionate about optimizing data pipelines and working with cutting-edge technologies in a collaborative environment, we would love to hear from you!

Thanks & Regards:

GAURAV VISHWAKARMA

IT Recruiter (

Sibitalent Corp

)

Office

  101 E. Park Blvd,Suite 600, Plano, TX75074

Website

:

www.sibitalent.com I

Phone

:

936-297-2002

E-Mail

:

[email protected]

linkedin.com/in/gaurav-vishwakarma-758b58265

Keywords: machine learning user interface information technology Texas
IMMEDIATE INTERVIEW AND OFFER= Databricks Support Engineer = Remote (local to Chicago preferred)- need local candidate from ILLINOIS
[email protected]
http://bit.ly/4ey8w48
https://jobs.nvoids.com/job_details.jsp?id=2080569&uid=
[email protected]
View All
02:20 AM 15-Jan-25


To remove this job post send "job_kill 2080569" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]


Time Taken: 0

Location: ,