| Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=257013&uid= From: Kiran Bhatt, Largeton INC. [email protected] Reply to: [email protected] Title: - Data Engineer Duration: -6 Months Location: - HYBRID AZ. Visa: - All but no H1B/OPT/CPT Experience in USA should be 6-7 Years. As a Data Engineer, you will be responsible for developing, optimizing, and maintaining the ETL data pipeline. This involves working with infrastructure built in AWS, including Spark EMR, S3, and Dynamo DB. This role will help build statistical tools, develop unit and stress tests, and create automation surrounding the orchestration of the ETL data pipeline. Responsibilities: 25% - Build infrastructure and automation for the extraction, preparation, and loading of data from various sources 25% - Create unit and stress test components to monitor technical performance and ensure identified issues are resolved 10% - Build and maintain data-backed tools to give data insight and capture key metrics 20% - Automate and integrate new components into the data pipeline. 10% - Use best practices for data governance, data quality, data cleansing, and other ETL-related activities. 10% - Maintain technical documentation Requirements: 3+ years of development experience in data engineering 3+ years professional experience working in big data ecosystems, preference for Spark 1+ years of professional experience working with dataflow management tools, such as Airflow 1+ years experience working with Pentaho (or equivalent tools such as Talend, DataStage, and Informatica)2Hands-on scripting experience with Python, Scala, and/or scripting Preference for development experience in highly scalable, distributed systems and cluster architectures (e.g. AWS, Azure, Google Cloud, etc) Familiarity with complex NoSQL databases (e.g. DynamoDB, Cassandra, Elasticsearch, etc) Prior experience working with large data sets (>1M+ records) B.S. preferred in Computer Science, Information Systems, or related fields (foreign education equivalent accepted) Thanks & Regards Kiran Bhatt|Technical Recruiter Email:[email protected] | Direct : +1 (571)-463-9088 LARGETON INC | 13800 Coppermine Rd, Herndon, VA 20171 Keywords: sthree database http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=257013&uid= |
| [email protected] View All |
| 05:22 PM 09-Jan-23 |