| PySpark & Databricks Developer in Dearborn, MI (Hybrid Onsite) at Dearborn, Michigan, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2149072&uid= From: Ranjeet Kumar, Source Infotech Inc [email protected] Reply to: [email protected] Hi, Title: PySpark/Databricks Developer Location: Dearborn, MI (Hybrid Onsite) Duration: 6+ months contract IV: Phone and Video Visa: No H1b/CPT Looking for an onsite Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually. - Design and development of data ingestion pipelines (Databricks background preferred). - Performance tune and optimize the databricks jobs - Evaluated new features and refractors existing code - Mentor junior developers and makes sure all patterns are documented - Perform data migration and conversion activities. - Develop and integrate software applications using suitable development methodologies and standards, applying standard architectural patterns, taking into account critical performance characteristics and security measures. - Collaborate with Business Analysts, Architects and Senior Developers to establish the physical application framework (e.g. libraries, modules, execution environments). - Perform end to end automation of ETL process for various datasets that are being ingested into the big data platform. * Maintain and support the application. * Must be willing to flex work hours accordingly to support application launches and manage production outages if necessary * Ensures to understand the requirements thoroughly and in detail and identify gaps in requirements * Ensures that detailed unit testing is done, handles negative scenarios and document the same * Work with QA and automation team. * Works on best practices and documenting the process * code merges and releases (Bitbucket) * Works with architect and manager on designs and best practices * Good data analysis skills Must be a team player. Must have following SCALA SQL Spark/Spark Streaming Big Data Tool Set Linux Python/PySpark Kafka * Experience collaborating with dev team, project managers, and engineers. * Excellent communication and teamwork skills I would appreciate your valuable reply. Have a nice day. Thanks and regards Ranjeet kumar , IT-Technical Recruiter Source Infotech Inc P.O. Box 577, EDISON, NJ 08818-0577 Web:www.sourceinfotech Id: [email protected] Keywords: quality analyst information technology Idaho Michigan New Jersey PySpark & Databricks Developer in Dearborn, MI (Hybrid Onsite) [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2149072&uid= |
| [email protected] View All |
| 03:42 AM 06-Feb-25 |