Home

Ramakrishna - Senior Data Engineer

[email protected]

Location: Richmond, Virginia, USA

Relocation: open

Visa: GC

Resume file: Ramakrishna Ainala _senior Data Engineer_10_1751568916924.docx Please check the file(s) for viruses. Files are checked manually and then made available for download.

Senior Data Engineer with over 10 years of experience in architecting, developing, and optimizing scalable, cloud-native data pipelines and distributed systems across AWS, Azure, and hybrid environments. I bring deep expertise in building high-performance ETL/ELT workflows using tools like Apache NiFi, AWS Glue, Informatica IICS, Dagster, and Airflow. My experience spans complex data integration, orchestration, and automation with Terraform and DBT, supporting both batch and real-time processing. I am highly proficient in Python, SQL, Scala, and Shell scripting, enabling advanced data transformation, validation, and ML model deployment using TensorFlow, PyTorch, and Databricks MLflow. I ve worked extensively with data warehouses like Snowflake, Azure Synapse, SQL Server, and Cassandra, designing partitioned, optimized, and cross-synced storage architectures for analytical and operational use cases. In previous roles, I led the development of real-time data streaming platforms using Kafka, Spark Streaming, and Flink to power time-sensitive analytics and event-driven systems. I ve also built and managed robust CI/CD pipelines using GitLab CI, Azure DevOps, Docker, and Kubernetes to support continuous integration and automated deployments across environments. My architecture work includes designing entity relationship diagrams (ERDs), dataflow diagrams, and Common Data Models (CDM) for enterprise systems such as Microsoft Dataverse/Dynamics. I maintain strong data governance practices using Collibra, Informatica Axon, and Azure Key Vaults to ensure data quality, lineage, access control, and compliance with HIPAA, GDPR, and SOC2. Additionally, I have delivered impactful business intelligence and visualization solutions using Tableau, Power BI, and AWS QuickSight. A collaborative, agile-driven professional, I m known for translating business requirements into secure, scalable data platforms and mentoring junior engineers to elevate team performance. Technical Skills: Languages & Scripting: Python (2.x, 3.x), SQL, Scala, R, Shell, C/C++, HTML, JSON, JavaScript Data Engineering & ETL: Apache NiFi, AWS Glue, Informatica IICS, Airflow, Dagster, DBT, SSIS, Terraform Cloud Platforms: AWS (S3, EMR, Glue, DynamoDB, Lambda, QuickSight), Azure (ADLS, Blob, Synapse, DevOps, Entra ID), GCP Data Warehousing & Databases: Snowflake, SQL Server, PostgreSQL, Oracle, MySQL, Cassandra, Redis, MongoDB Big Data & Streaming: Apache Spark, PySpark, Hadoop, MapReduce, Hive, Kafka, Flink Machine Learning & MLOps: TensorFlow, PyTorch, Databricks MLflow, Scikit-learn, Pandas, NumPy CI/CD & DevOps: Git, GitLab CI/CD, Azure DevOps, Docker, Kubernetes, Jenkins, Terraform Data Modeling & Governance: ERDs, CDM, Dataflow Diagrams, Collibra, Informatica Axon, HIPAA, GDPR BI & Visualization: Tableau, Power BI, AWS QuickSight, Deck.gl, SAS, JMP Pro Tools & IDEs: PyCharm, Spyder, VS Code, JIRA, Postman, Fiddler Keywords: cprogramm cplusplus continuous integration continuous deployment machine learning access management business intelligence sthree rlang Idaho