| Urgent role || - Big Data Engineer with Azure || Remote at Remote, Remote, USA |
| Email: prashantp@vbeyond.com |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1171487&uid= From: Prashant Pal, Vbeyond Corporation prashantp@vbeyond.com Reply to: prashantp@vbeyond.com Hello , Greetings! Please share the profile only with LinkedIn url and Visa Status. This is Prashant from VBeyond Corp. We are a global recruitment company. One of our clients is looking for - Big Data Engineer with Azure , Remote. Job Description: - Job- Big Data Engineer Location- Remote Duration: - Long Term (12+ months) Description: Need - 8+ years of exp. Major Responsibilities/Activities Build a highly functional and efficient Big Data platform that brings together data from disparate sources and allow client to design and run complex algorithms providing insights to Healthcare business operations. Build ETL Data Pipelines in Azure Cloud using Azure ADF and Databricks using Py Spark and Scala. Migrate ETL Data pipelines from On Prem Hadoop Cluster to Azure Cloud. Build Data Ingestion Pipelines in Azure to pull data from SQL Server. Perform Automated and Regression Testing. Partner with internal business, product, and technical teams to analyze complex requirements and deliver solutions. Participate in development, automation, and maintenance of application code to ensure consistency, quality, reliability, scalability, and system performance. Deliver data and software solutions working on Agile delivery teams Requirements: Bachelors degree in computer science or a related discipline 6+ years of data engineering in an enterprise environment 6+ years of experience writing production code in Python, Py Spark or Scala Strong knowledge of Azure platform. Should have worked in Azure ADF, Deployed ADF and Databricks code to production and be able to troubleshoot production issues. Experience with SQL. Experience with Big Data technologies in Azure such as Spark, Hive, Sqoop, Databricks or any other equivalent components. Experience working with git and CI/CD tools Proven background in Distributed Computing, ETL development, and large-scale data processing Travel: None. Preferred Skills: Healthcare experience preferred Proficiency in SQL and query optimization Proficiency in Linux and Bash scripting Experience with Azure ADF, Azure Databricks, Terraform templates, ADF Automated pipelines. Experience migrating applications from an On Prem Hadoop to Cloud. Experience with SQL Server. Knowledge and passion for software development including software architecture, functional and non-functional aspects. Any background in ETL tools such as Ab-Initio, Data Stage Thanks Prashant https://www.linkedin.com/in/prashantpbh/ Keywords: continuous integration continuous deployment http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1171487&uid= |
| prashantp@vbeyond.com View All |
| 10:49 PM 29-Feb-24 |