IMMEDIATE INTERVIEW AND OFFER= Databricks Support Engineer = Remote (local to Chicago preferred)- need local candidate from ILLINOIS at Chicago, Illinois, USA |
Email: [email protected] |
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2080569&uid= | From: GAURAV, SIBITALENT [email protected] Reply to: [email protected] Hi, Hope you are doing well, IMMEDIATE INTERVIEW AND OFFER= Databricks Support Engineer = Remote (local to Chicago preferred)- need local candidate from ILLINOIS Please find the Job details below and kindly revert if youre interested in learning more about this job. Job Title: Databricks Support Engineer Location: Remote (local to Chicago preferred)-need local candidate from ILLINOIS Onboarding Requirements: Background check, Drug screen, COVID vaccination (if applicable) Position Overview: We are seeking a Databricks Support Engineer to provide critical support for the day-to-day operations of Databricks jobs, pipelines, and machine learning operations. This position requires expertise in Databricks engineering, troubleshooting Python/SQL code, and optimizing data pipelines. The ideal candidate will have experience working with Databricks, BigQuery, and ML pipelines, and be comfortable with troubleshooting and supporting machine learning jobs and clusters. Key Responsibilities: Mandatory Skills and Responsibilities: Machine Learning Pipeline & Job Troubleshooting: o Investigate failed or stuck Databricks jobs and debug errors in job execution, including Python exceptions and Spark-related issues. o Troubleshoot SQL queries and Python scripts within Databricks notebooks or jobs. o Optimize and ensure performance, scalability, and reliability of Databricks pipelines. Day-to-Day Databricks Operations Support & Performance Tuning: o Monitor health and performance of Databricks jobs, clusters, and pipelines. o Diagnose and resolve issues related to job performance, failures, resource constraints, and bottlenecks. o Provide support to data scientists, engineers, and other users with Databricks workspace configurations and job setups. o Monitor and analyze performance using tools like Spark UI, Ganglia, and Databricks Metrics. System & Data Integrations: o Support integration of Databricks with other data systems (e.g., BigQuery), ensuring smooth data flow between platforms. o Configure and troubleshoot job scheduling systems to ensure jobs are triggered as expected. Nice to Have: MLflow: Understanding of Databricks MLflow for machine learning operations. Databricks Cluster Management (Admin Duties): o Manage Databricks clusters, including creation, scaling, and termination. o Define and enforce cluster policies to optimize resource usage and control costs. o Optimize cluster configurations for performance and cost efficiency. Collaboration and Documentation: Collaborate with data engineers, data scientists, and ML teams to ensure Databricks environments meet their needs. Maintain clear documentation on Databricks cluster management, job setup, pipeline troubleshooting, and incident resolution. Requirements: Strong experience with Databricks engineering, Python, and SQL troubleshooting. Experience in supporting and optimizing Databricks jobs and pipelines. Familiarity with Databricks clusters, job scheduling, and data integrations (e.g., BigQuery). Basic knowledge of Databricks administration, including cluster management and policies. MLflow knowledge is a plus. Strong problem-solving skills and ability to debug issues across Databricks environments. Excellent communication skills for collaborating with cross-functional teams. Preferred Skills: Familiarity with BigQuery and machine learning pipelines. Experience with Azure or cloud-based environments. Additional Information: This is a 100% remote position, but candidates should be local to Chicago for potential on-site requirements or collaboration. The role is expected to start immediately and is projected for 3 months, with potential for extension. ISS Friendly and VSD Friendly. If you're passionate about optimizing data pipelines and working with cutting-edge technologies in a collaborative environment, we would love to hear from you! Thanks & Regards: GAURAV VISHWAKARMA IT Recruiter ( Sibitalent Corp ) Office 101 E. Park Blvd,Suite 600, Plano, TX75074 Website : www.sibitalent.com I Phone : 936-297-2002 : [email protected] linkedin.com/in/gaurav-vishwakarma-758b58265 Keywords: machine learning user interface information technology Texas IMMEDIATE INTERVIEW AND OFFER= Databricks Support Engineer = Remote (local to Chicago preferred)- need local candidate from ILLINOIS [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2080569&uid= |
[email protected] View All |
02:20 AM 15-Jan-25 |