| Requirement for Certified Data Engineer in Madison, WI at Madison, Wisconsin, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=596982&uid= I need local candidate for this, from Madison, WI Avinsh Nagar| Senior Technical Recruiter Direct: (732) 820-2121 Phone: (732) 707-2535 EXT 2032 Disclaimer: This is not meant to be an unsolicited email, so if you dont want to receive any emails from me and QSP Infotech, you can click on -> . Do not hesitate to contact me back for any questions . From: Avinsh Nagar <[email protected]> Sent: Friday, September 1, 2023 10:45 AM To: Avinsh Nagar <[email protected]> Subject: Requirement for Certified Data Engineer in Madison, WI Job Description Role: Certified Data Engineer Location: Madison, WI - Hybrid - locals only Duration: 9 months Visa: No H1/CPT/OPT Interview: Phone/Skype Certified Cloud Engineer Years of experience: 15-20+ Job Description: We are seeking a highly skilled Data Engineer to join our dynamic team. In this role, you will collaborate closely with our data engineering and development teams to design, develop, test, and maintain robust and scalable ELT/ETL pipelines. Your work will involve using SQL scripts, Redshift stored procedures, and various AWS tools and services to ensure top-quality outcomes. You will architect, implement, and manage end-to-end data pipelines, emphasizing data accuracy, reliability, quality, performance, and timeliness. Key Responsibilities: Collaborate with cross-functional teams to translate business requirements into effective data solutions. Design and implement ETL processes, including CDC and SCD logics, to integrate data seamlessly from diverse source systems. Provide expertise in Redshift database optimization, performance tuning, and query optimization. Design and implement efficient orchestration workflows using Airflow. Integrate Redshift with AWS services such as AWS DMS, AWS Glue, AWS Lambda, Amazon S3, and more to build end-to-end data pipelines. Perform data profiling and analysis to troubleshoot data-related challenges and develop solutions. Proactively identify opportunities to automate tasks and create reusable frameworks. Work closely with the version control team to maintain a well-organized and documented code repository using Git. Provide technical guidance and mentorship to fellow developers, sharing best practices and optimizing Redshift-based data solutions. Required Skills: Bachelors or masters degree in computer science, Information Technology, or a related field. 15 20+ years of hands-on experience designing, developing, and maintaining data pipelines and ETL processes on AWS Redshift, including data lakes and data warehouses. Proficiency in SQL programming and Redshift stored procedures. Hands-on experience with AWS services like AWS DMS, Amazon S3, AWS Glue, Redshift, and Airflow. Strong understanding of ETL best practices, data integration, data modeling, and data transformation. Experience with complex ETL scenarios, including CDC and SCD logics . Demonstrated expertise in AWS DMS for seamless data ingestion. Proficiency in Python programming for Airflow DAG development. Familiarity with converting Oracle scripts and Stored Procedures to Redshift equivalents. Knowledge of version control systems, particularly Git. Ability to identify and resolve performance bottlenecks and fine-tune Redshift queries. Strong coding and problem-solving skills with attention to data quality and accuracy. Effective communication of technical concepts to non-technical stakeholders. Proven track record of delivering high-quality data solutions within deadlines. Experience working with large-scale, high-volume data environments. AWS certifications related to data engineering or databases. Avinsh Nagar| Senior Technical Recruiter Disclaimer: This is not meant to be an unsolicited email, so if you dont want to receive any emails from me and QSP Infotech, you can click on -> . Do not hesitate to contact me back for any questions . -- Keywords: access management sthree information technology Wisconsin http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=596982&uid= |
| [email protected] View All |
| 08:32 PM 01-Sep-23 |