| Opening for Spark or Scala Developer - Remote to start at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=608032&uid= From: meenakshi bisht, kpg99 [email protected] Reply to: [email protected] Title: Spark/Scala Developer Location: Onsite in Morris Plains, NJ/ Remote to start Duration: 6 months Work Eligibility: GC/USC Key Technology: Spark, Scala Job Responsibilities: Developing and implementing scalable data processing solutions using Apache Spark. Experience in both batch and real-time data processing Strong background in technologies such as Databricks, Snowflake, Kafka, SQL and Unix. Work closely with our data engineering and data science teams to design and optimize data pipelines and ensure efficient and reliable data processing. Skills and Experience Required: Required: At least 4 years of experience in Designing, developing, and maintaining data processing solutions using Apache Spark (Scala). Experience working in both on-prim Hadoop cluster as well as Databricks environment. Strong understanding of Functional programming and RESTful APIs Implementing both batch and real-time data processing frameworks. Collaborating with data engineering and data science teams to understand data requirements and design optimal data pipelines. Writing efficient Spark jobs and optimizing Spark code for performance and scalability. Working with Kafka for real-time data streaming and integration. Developing and optimizing SQL queries for data extraction, transformation, and loading. Produce unit tests for Spark transformations and helper methods Ensuring data quality and integrity throughout the data processing pipelines. Monitoring and troubleshooting data processing issues, and implementing necessary fixes. Collaborating with cross-functional teams to integrate Spark solutions with other systems and technologies. Keeping up-to-date with the latest advancements in Spark and big data technologies. Regards, Meenakshi Bisht Technical Recruiter D: 609-357-5502 E: [email protected] Note:: We are going through prime vendor. Keywords: green card New Jersey http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=608032&uid= |
| [email protected] View All |
| 11:30 PM 06-Sep-23 |