| Spark Developer Remote 10+ years ofexperience Visa: USC GC at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1075547&uid= From: bhumika, Adifice Technologies [email protected] Reply to: [email protected] Title: Spark Developer Location: 100% Remote Visa: USC & GC C2C Duration: 6+ months Looking for candidates with 10+ years of experience Responsibilities: Design, implement, and maintain scalable data pipeline solutions using Spark, Python, AWS Glue, and Snowflake Develop and deploy high-performance ETL processes using Spark and Python to ingest data from various sources and load it into Snowflake. Write efficient, maintainable, and scalable data transformation code using Spark, Python, and SQL Collaborate with team members to develop, test, and maintain data pipeline solutions. Optimize data processing performance through tuning, caching, partitioning, and indexing techniques! Monitor and troubleshoot issues related to data pipelines, ensuring data quality and integrity. Develop and maintain documentation on data pipeline architecture, processes, data flows, and data dictionary. Required Skills: Solid experience with Spark is required. Strong expertise in Python is required. Expertise in AWS cloud platform is required. Knowledge of data pipeline concepts and best practices Experience with AWS Glue and Snowflake is highly desirable. Proficient in SQL and database concepts, with the ability to optimize queries and data processing performance. Strong problem-solving and analytical skills Excellent communication and collaboration skills, with the ability to work effectively in a team environment. Nice-to-Have Skills: Experience with other cloud platforms, such as Azure or Google Cloud Knowledge of Java/Scala is a plus. Keywords: information technology green card http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1075547&uid= |
| [email protected] View All |
| 09:49 PM 01-Feb-24 |