| Senior Data engineer || Onsite at Remote, Remote, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=785177&uid= From: Akash, smart it frame [email protected] Reply to: [email protected] Hi , Greetings from Smart IT Frame, Hope you are doing well!!! Smart IT Frame specializes in enabling you with your most critical line of resources. Whether its for permanent staffing, contract staffing, contract-to-hire or executive search, we understand the importance of delivering the most suitable talent; on time and within budget. With our Core focus in emerging technologies, we have provided global technology workforce solutions in North America, Canada & India. We take pride in delivering specialized talent, superior performance, and seamless execution to meet the challenging business needs of customers Role : Senior Data engineer Location : Onsite (Irving, TX) 1.Job title SENIOR DATA ENGINEER 2.Job summary Perform the Data Engineer activities 3.Experience 6to10Yrs 4.Required Skills ,BigQuery,PySpark,Cloud Dataflow,Airflow 5.Nice to have skills ,GCP,Google BigQuery 6.Technology -Not Applicable 7.Shift Day 8.Roles & Responsibilities Analyzes complex data structures from disparate data sources and design large scale data engineering pipeline Develops large scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting needs Collaborates with product business and data science team to collect user stories and translate into technical specifications Uses knowledge in Cloud & Hadoop architecture, HDFS commands and experience designing & optimizing queries to build data pipelines Uses strong programming skills in PySpark, Python, Java or any of the major languages to build robust data pipelines and dynamic systems Builds highly scalable and extensible data marts and data models to support Data Science and other internal customers on Cloud. Integrates data from a variety of sources, assuring that they adhere to data quality and accessibility standards. Analyzes current information technology environments to identify and assess critical capabilities and recommend solutions Experiments with available tools and advice on new tools to determine optimal solution given the requirements dictated by the model/use case Required Qualifications 3+ years of progressively complex related experience in cloud data engineering and data analysis Knowledge in programing languages such as PySpark, Java, Python, Hive, SQL Knowledge in Cloud Technology, Hadoop architecture, HDFS commands and experience designing & optimizing queries against data in the HDFS environment Strong knowledge of large-scale search applications and building high volume data pipelines, preferably using Dataproc, composer services on GCP or other Cloud Platforms 2+ years of development experience in GCP and native tools & services such as DataProc, Composer, BigQuery, Airflow 2 to 3+ years of PySpark or Scala or Python programing proficient in SQL 3+ years of working with data & data warehouse experience. 9.Job Location Primary: USTXIRNC01 Irving - TX USA, CLT Alternate: , 10.Job Type 60CW00 Business Associate 11.Demand Requires Travel N 12.Certification(s) Required NA -- Warm Regards, Akash Smart IT Frame LLC (201) 205- 2459 Ext 1012 akash @smartitframe.com www.smartitframe.com https://www.linkedin.com/in/akash-s-332905212/ -----WBENC------ Keywords: information technology Texas http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=785177&uid= |
| [email protected] View All |
| 12:23 AM 25-Oct-23 |