AWS Cloud Architect (Contract) at Remote, Remote, USA |
Email: [email protected] |
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=867496&uid= From: roshini, s3 infinity [email protected] Reply to: [email protected] Data Architecture Design: Design and implement scalable, high-performance data architectures on AWS, utilizing services such as Amazon S3, Amazon Redshift, Amazon RDS, and more. Collaborate with data stakeholders to understand data requirements and translate them into effective data solutions ETL Development: Develop and maintain ETL (Extract, Transform, Load) processes to ingest, cleanse, and transform data in EMR and Glue from various sources into usable formats for analytics and reporting Optimize ETL workflows for performance and efficiency. Must have Hands On Programming Experience in Spark and Scala Data Modeling: Create and manage data models that support business reporting and analytics needs Ensure data quality and consistency by implementing data validation and data cleansing routines. Data Security and Compliance: Implement data security best practices and ensure compliance with relevant regulations (e.g., GDPR, HIPAA) and company policies Monitor and audit data access and usage to maintain data integrity and confidentiality. Monitoring and Optimization: Monitor data pipelines and infrastructure for performance, availability and reliability. Identify and resolve data-related issues and bottlenecks promptly. Continuously optimize data processing and storage for cost-effectiveness. Documentation and Collaboration: Document data engineering processes, workflows, and best practices Collaborate with cross-functional teams, including data scientists and analysts, to understand their data needs and provide data solutions. Other Expertise: Experience in designing CICD pipelines using AWS Code Commit and Code Pipeline. Experience in ingesting stream data from Kafka. Experience in working with Apache Hudi and Iceberg tables. Experience in working and understanding of Cloudera Platform Keywords: sthree http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=867496&uid= |
[email protected] View All |
10:18 PM 17-Nov-23 |