| Data Architect - Microsoft Fabric & Azure Databricks at Atlanta ,GA at Atlanta, Georgia, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1975427&uid= From: Dheeraj srivastava, Datum Software [email protected] Reply to: [email protected] Data Architect - Microsoft Fabric & Azure Databricks Atlanta, Georgia Onsite Local only Data Architecture: Design end-to-end data architecture leveraging Microsoft Fabric's capabilities. Design data flows within the Microsoft Fabric environment. Implement OneLake storage strategies. Configure Synapse Analytics workspaces. Establish Power BI integration patterns. Integration Design: Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric. Design Delta Lake architecture for IES Gateway data. Implement medallion architecture (Bronze/Silver/Gold layers). Create real-time data ingestion patterns. Establish data quality frameworks. Required Qualifications: Education: Bachelors degree in computer science or related field. Experience: 6+ years of experience in data architecture and engineering. 2+ years hands-on experience with Azure Databricks and Spark. Recent experience with Microsoft Fabric platform. Technical Skills: Microsoft Fabric Expertise: Data Integration: Combining and cleansing data from various sources. Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines. Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets. Data Visualization Techniques: Representing data graphically in impactful and informative ways. Optimization and Security: Optimizing queries, improving performance, and securing data Azure Databricks Experience: Apache Spark Proficiency: Utilizing Spark for large-scale data processing and analytics. Data Engineering: Building and managing data pipelines, including ETL (Extract, Transform, Load) processes. Delta Lake: Implementing Delta Lake for data versioning, ACID transactions, and schema enforcement. Data Analysis and Visualization: Using Databricks notebooks for exploratory data analysis (EDA) and creating visualizations. Cluster Management: Configuring and managing Databricks clusters for optimized performance. (Ex: autoscaling and automatic termination) Integration with Azure Services: Integrating Databricks with other Azure services like Azure Data Lake, Azure SQL Database, and Azure Synapse Analytics. Machine Learning: Developing and deploying machine learning models using Databricks MLflow and other tools. Data Governance: Implementing data governance practices using Unity Catalog and Microsoft Purview Preferred Experience: Azure DevOps Infrastructure as Code (Terraform) CI/CD for data pipelines Data mesh architecture Certifications (preferred): Microsoft Azure Data Engineer Associate Databricks Data Engineer Professional Microsoft Fabric certifications (as they become available) Project-Specific Requirements: Experience designing data architectures for grant management systems Knowledge of federal/state compliance requirements for data handling Understanding of financial data processing requirements Experience with real-time integration patterns Keywords: continuous integration continuous deployment business intelligence Data Architect - Microsoft Fabric & Azure Databricks at Atlanta ,GA [email protected] http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1975427&uid= |
| [email protected] View All |
| 11:34 PM 02-Dec-24 |