| Required Data Engineer for Remote at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=497604&uid= From: Arun, KPG [email protected] Reply to: [email protected] Hello, Please share updated resume to [email protected] Role Data Engineer Location Remote Duration 3 months+ Interview - Video Need everything whatever is required. Essential Job Duties and Responsibilities: Primary Skillset: Design and implement efficient and scalable data pipelines for ETL processes, integrating diverse data sources into Snowflake data warehouse. Proficient in Python and Spark SQL for data manipulation, transformation, and quality assurance. Develop and optimize data processing algorithms to handle large-scale datasets efficiently. Build and maintain ETL processes in Snowflake, ensuring data integrity and quality throughout the workflow. Design, configure, and manage Airflow workflows to schedule and monitor data engineering tasks. Additional Skillset: Identify and implement performance improvements in data pipelines and ETL processes. Implement and enforce data governance best practices to ensure data privacy, security, and compliance Create and maintain comprehensive documentation of data engineering processes, pipelines, and workflows. Collaborate effectively with cross-functional teams, including data scientists and analysts, to understand their data needs and support data-related initiatives. Required Skills and Responsibilities Bachelor's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer with a strong focus on data pipeline development and ETL processes. Proficiency in Python and Spark SQL for data manipulation and transformation. Hands-on experience with Snowflake ETL processes and data integration. Familiarity with job orchestration tools, specifically Airflow Solid understanding of data warehousing concepts and database design principles Strong analytical and problem-solving skills with a keen attention to detail Excellent communication and interpersonal skills, able to work effectively in a collaborative team environment Preferred Qualifications Experience with cloud platforms like AWS, Azure Knowledge of big data technologies such as Hadoop, Spark, or Kafka. Critical thinking and problem-solving skills o Familiarity with data modeling and database optimization techniques. Good organizational skills including attention to detail and multi-tasking skills Keywords: http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=497604&uid= |
| [email protected] View All |
| 10:54 PM 08-Aug-23 |