| Hybrid :: Databricks Lead opening in Houston, TX at Houston, Texas, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2275874&uid= From: Shaheen Rukhsar, SUS Infotech [email protected] Reply to: [email protected] Hi, Job Title :: Databricks Lead Location :: (Hybrid) Duration: 12 Months Role Overview: Key Responsibilities: Lead the design and deployment of scalable data pipelines, ETL/ELT workflows, and real-time data streaming solutions in Databricks. Develop and automate ETL/ELT pipelines to process structured and unstructured data from multiple sources. Work with SQL, Python, Scala, and Spark to implement advanced data transformations. Integrate Databricks with cloud platforms (AWS, Azure, GCP), data warehouses (Snowflake, BigQuery, Redshift), and BI tools (Tableau, Power BI). Implement real-time data streaming using Kafka, Spark Streaming, and Delta Live Tables. Define and enforce best practices for data lineage, metadata management, and quality assurance. Implement role-based access control (RBAC) and identity management for secure data access. Work with a team of data engineers, architects, and analysts in Databricks development. Collaborate with business stakeholders, data scientists, and DevOps teams to align data solutions with business objectives. Provide technical guidance, hands-on development, and architecture recommendations. Basic Qualifications: 6+ years of experience in big data engineering, cloud data platforms, and analytics. 3+ years of hands-on experience with Databricks, Apache Spark, Delta Lake, and cloud platforms (AWS, Azure, or GCP). Strong expertise in Python, Scala, SQL, and Spark for data transformations. Experience with ETL/ELT pipelines, data ingestion, and real-time processing. Proficiency in data lake architectures, Delta Lake, and Lakehouse principles. Hands-on experience with cloud-native services like AWS Glue, Azure Data Factory, Google Dataflow. Excellent problem-solving, communication, and stakeholder management skills. Preferred Qualifications: Databricks Certification (Databricks Certified Data Engineer Associate/Professional) (Highly Preferred) Experience with Terraform, Kubernetes, and CI/CD pipelines for Databricks automation Familiarity with BI tools like Tableau, Power BI, Looker What We Offer: Competitive salary with the industrys best incentive structure. Opportunity to lead and drive cloud-based data transformation initiatives. Working hours from 9:00 AM CST to 5:00 PM CST. Career growth and development opportunities within a leading IT services and staffing company. Regards, Shaheen Rukhsar Sr. Resource Manager SUS InfoTech Inc. E : [email protected] Keywords: continuous integration continuous deployment access management business intelligence information technology Hybrid :: Databricks Lead opening in Houston, TX [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2275874&uid= |
| [email protected] View All |
| 07:02 PM 21-Mar-25 |