| Azure DataBricks Engineer at Remote, Remote, USA |
| Email: [email protected] |
|
https://jobs.nvoids.com/job_details.jsp?id=2338883&uid= From: Ansh Malhotra, Tek Inspiratiopns LLC [email protected] Reply to: [email protected] Job Description - Azure DataBricks Engineer Need Candidates LinkedIn Need recent clients experience in the healthcare industry or working with healthcare data. About the Role We are seeking an Azure Databricks Engineer with some architecture experience. This is a hands-on postion with Azure Databricks. This is an exciting opportunity to design and implement cutting-edge data solutions that power innovative products and breakthroughs in the healthcare industry. As a Data Engineer, you will play a pivotal role in shaping scalable, high-performance data architecturesthat support critical business and analytics needs. Key Responsibilities Architect, develop, and implement scalable and efficient data solutions to support business intelligence, advanced analytics, and machine learning initiatives. Design and optimize data pipelines and workflows using Azure Databricks, Delta Lake, and other Azure services. Lead the design of data models and schemas for structured, semi-structured, and unstructured data. Collaborate with data engineers, data scientists, and business stakeholders to define data requirements and deliver data solutions aligned with business objectives. Develop strategies for seamless data integration across multiple systems, including on-premise and cloud environments. Implement data governance best practices, including security, privacy, lineage, and compliance (e.g., HIPAA for healthcare data). Optimize data storage and processing costs while ensuring high availability and performance. Evaluate emerging technologies and tools to improve the organizations data ecosystem. Troubleshoot and resolve technical issues related to data infrastructure and pipelines. Qualifications Education: Bachelors degree in Computer Science, Information Technology, or a related field (Masters degree preferred). Experience: 8+ years of experience in data engineering, 2+ years of architecture experience 3+ years of hands-on experience with Azure Databricks, including building and optimizing Spark-based data pipelines. Deep understanding of Azure ecosystem, including: Azure Data Lake, Azure Data Factory, Azure Synapse, Azure SQL Proficiency in Python, SQL, and Scala (preferred) Strong knowledge of data modeling techniques, database design, and schema creation Experience with Delta Lake and data lakehouse architecture Familiarity with streaming frameworks such as Apache Kafka or Structured Streaming Hands-on experience with Git, CI/CD pipelines, and monitoring tools Strong understanding of data governance frameworks, security, and compliance standards (e.g., HIPAA, GDPR) Ability to work in an agile environment and collaborate with cross-functional teams. Previous experience in the healthcare industry or working with healthcare data. Familiarity with data visualization tools like Power BI, Tableau, or similar. Azure Data Engineering certification or related certifications. Keywords: continuous integration continuous deployment business intelligence Azure DataBricks Engineer [email protected] https://jobs.nvoids.com/job_details.jsp?id=2338883&uid= |
| [email protected] View All |
| 07:51 AM 12-Apr-25 |