| MLOps Azure Engineer Remote at Providence, Rhode Island, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2188338&uid= From: Asim Ahamed, Intellicept [email protected] Reply to: [email protected] Sr. Technical Lead Remote Azure Senior Data Lead with Azure Data Factory (ADF),Azure Databricks,SQL,Oracle PL/SQL,Python Data_MLOps Engineer Job Location Providence, RI Remote ok (Yes / No) Yes Job Summary The Senior Technical Lead will be responsible for leading the technical aspects of projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and maintaining data pipelines and ETL processes while ensuring high performance and scalability of data solutions. (1.) Key Responsibilities 1. Lead the end-to-end technical implementation of data projects using azure data factory, azure databricks, sql, oracle pl/sql, and python. 2. Design and develop efficient and reliable etl processes for large datasets. 3. Collaborate with cross functional teams to understand business requirements and translate them into technical solutions. 4. Optimize data workflows, troubleshoot issues, and ensure data quality and integrity. 5. Implement best practices for data security, governance, and compliance. 6. Provide technical guidance, mentoring, and support to junior team members. 7. Stay uptodate with the latest trends and technologies in data engineering and analytics. Skill Requirements 1. Proficiency in azure data factory (adf) and azure databricks for data integration and processing. 2. Strong skills in writing complex sql queries for data manipulation and analysis. 3. Experience with oracle pl/sql for database development and management. 4. Proficient in python programming language for automation and scripting tasks. 5. Solid understanding of data warehousing concepts, etl processes, and data modeling. 6. Ability to work in a fast paced environment and manage multiple priorities effectively. 7. Excellent problem-solving skills and attention to detail. 8. Strong communication and interpersonal skills for effective collaboration with team members and stakeholders. Certifications: Relevant certifications in Azure Data Factory, Azure Databricks, SQL, Oracle, or Python would be a plus. Experience 11-15 Years Skill (Primary) Data Fabric-Azure-Azure Data Factory (ADF) Project Duration 6+ Months JD Experience within the Azure ecosystem, including Azure AI Search, Azure Storage Blob, Azure Postgres, with expertise in leveraging these tools for data processing, storage, and analytics tasks. Proficiency in data preprocessing and cleaning large datasets efficiently using Azure Tools, Python, and other data manipulation tools. Strong background in Data Science/MLOps, with hands-on experience in DevOps, CI/CD, Azure Cloud computing, and model monitoring. Expertise in healthcare data standards, such as HIPAA and FHIR, with a deep understanding of sensitive data handling and data masking techniques to protect PII and PHI. Experience with chunking techniques and working with vectors and vector databases like Pinecone. Ability to design, develop, and maintain scalable data pipelines for processing and transforming large volumes of structured and unstructured data, ensuring performance and scalability. Implement best practices for data storage, retrieval, and access control to maintain data integrity, security, and compliance with regulatory requirements. Implement efficient data processing workflows to support the training and evaluation of solutions using large language models (LLMs), ensuring that models are reliable, scalable, and performant. Proactively identify and resolve data quality issues, pipeline failures, or resource contention to minimize disruption to systems. Experience with large language model frameworks, such as Langchain, and the ability to integrate them into data pipelines for natural language processing tasks. Familiarity with Snowflake for data management and analytics, with the ability to work within the Snowflake ecosystem to support data processes. Knowledge of cloud computing principles and hands-on experience with deploying, scaling, and monitoring AI solutions on platforms like Azure, AWS, and Snowflake. Ability to communicate complex technical concepts effectively to both technical and non-technical stakeholders and collaborate with cross-functional teams. Analytical mindset with attention to detail, coupled with the ability to solve complex problems efficiently and effectively. Experience with ML model deployment, including testing, validation, and integration of machine learning models into production systems. Automation of ML workflows through CI/CD pipelines, enabling smooth model training, testing, validation, and deployment. Monitoring and logging of AI/ML systems post-deployment to ensure consistent reliability, scalability, and performance. Collaboration with data scientists and engineering teams to facilitate model retraining, fine-tuning, and updating. Familiarity with containerization technologies, like Docker and Kubernetes, for deploying and scaling machine learning models in production environments. Ability to implement model governance practices to ensure compliance and auditability of AI/ML systems. Understanding of model explainability and the use of tools and techniques to provide transparent insights into model behavior. Must Have: Minimum of 10 years experience as a data engineer Hands-on experience with Azure Cloud eco-system. Hands-on experience using Python for data manipulation. Deep understanding of vectors and vector databases. Hands-on experience scaling POC to production. Hands-on experience using tools such as Document Intelligence, Snowflake, function app. Azure AI Search Experience working with PII/PHI Hands-on experience working with unstructured data. Keywords: continuous integration continuous deployment artificial intelligence machine learning procedural language Rhode Island MLOps Azure Engineer Remote [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2188338&uid= |
| [email protected] View All |
| 10:17 PM 19-Feb-25 |