| Apply Now-Data Engineer-Remote at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2258193&uid= Only H4EAD/L2 Hi All, Hope you doing good ! Pleasure mailing you. Please go through the below requirement and let me know if you are comfortable for the position. Please send me your updated resume along with the best hourly rate, work authorization status and availability. An early response is really appreciated. Title : Data Engineer Remote Mandatory : Python, Pyspark and SQL JD Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL. Work with structured and unstructured data to build scalable data solutions. Write efficient and scalable PySpark scripts for data transformation and processing. Optimize SQL queries, stored procedures, and indexing strategies to enhance performance. Design and implement data models, schemas, and partitioning strategies for large-scale datasets. Collaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows. Ensure data quality, validation, and consistency in data pipelines. Implement error handling, logging, and monitoring for data pipelines. Work with cloud platforms (AWS, Azure, or GCP) for data processing and storage. Optimize data pipelines for cost efficiency and performance. Technical Skills Required: Strong experience in Python for data engineering tasks. Proficiency in PySpark for large-scale data processing. Deep understanding of SQL (Joins, Window Functions, CTEs, Query Optimization). Experience in ETL/ELT development using Spark and SQL. Experience with cloud data services (AWS Glue, Databricks, Azure Synapse, GCP BigQuery). Familiarity with orchestration tools (Airflow, Apache Oozie). Experience with data warehousing (Snowflake, Redshift, BigQuery). Understanding of performance tuning in PySpark and SQL. Familiarity with version control (Git) and CI/CD pipelines. -- Keywords: continuous integration continuous deployment information technology golang Apply Now-Data Engineer-Remote [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=2258193&uid= |
| [email protected] View All |
| 12:40 AM 15-Mar-25 |