Data Scientist | Data Engineer

About Me : With 3.5+ years of industry experience in cloud infrastructure and data engineering, I bring a solid foundation in building and optimizing data pipelines, managing large datasets, and implementing scalable solutions using Big data tech stack and technologies like Python, Spark, AWS, and SQL etc. I’m passionate about the Data Science and Engineering field and their applications in generating valuable insights from messy and large datasets. Imagine a puzzle — I love piecing together information from chaotic datasets to reveal the big picture and unlock valuable insights!

Technical Skills: Kafka, Airflow, AWS S3, Apache Spark, Scala, Autosys, CyberArk, Sqoop, Hive, HDFS, Confluence, WebLogic, Big Data, Python, Linux, MySQL, Shell Scripting, IBM Connect Direct (NDM), ServiceNow, R Programming, Data Mining, SQL, Apache Iceberg, Presto, Deeque, Docker, ArgoCD, AWS, Intellij, Git, Bitbucket, JIRA, Maven, PySpark

Certifications

• Generative AI Fundamentals - Databricks
• AWS Certified Cloud Practitioner
• Spark Framework- Infosys
• Oracle Cloud Infrastructure foundations 2021 Certified Associate- Oracle
• Big Data 101- Infosys
• Infosys Certified Python Associate- Infosys
• Apache Kafka Tutorials- Infosys Springboard

Education

• M.S, Engineering Science - Data Science, GPA: 3.67/4.0

  University at Buffalo, Buffalo, NY, USA

• B.Tech, Software Engineering, CGPA: 8.04/10

  SRM Institute of Science and Technology, India

Work Experience

AI Data Engineer @ Saayam For All (Buffalo, NY)(Feb 2025 - Present)

• Skills: Python (Programming Language) · Application Programming Interfaces (API) · Data Extraction · Extract, Transform, Load (ETL) · Requests · Beautiful Soup · JSON

Associate Cloud Data Engineer @ Calix (San Jose, CA)(Oct 2024 - Nov 2024)

• Skills: Spark, Scala, PySpark, Data Quality, Amazon Deeque, Azkaban, Apache Iceberg, DynamoDB, S3, Data Governance, CDC

Cloud Data Engineer Intern @ Calix (San Jose, CA)(May 2024 - Aug 2024)

• Skills: Spark, Scala, PySpark, SDK, Apache Iceberg, DynamoDB, S3, Presto

Technology Analyst - Data Engineer (Former Senior Systems Engineer) @ Infosys Pvt Ltd (Jan 2020 - Jul 2023)

• Lead real-time data validation efforts using Apache Spark and advanced SQL techniques, ensuring strict adherence to SLAs for seamless data processing.
• Automated data import processes through Shell scripting, Airflow, and Sqoop, resulting in a significant reduction in manual efforts and enhanced operational efficiency.
• Architected seamless integration among Hive, Hbase, and Spark for agile data analysis and swift retrieval, optimizing complex operations.
• Developed and implemented strategies to optimize data querying efficiency, including Hive table management, partitioning, and incremental imports.
• Consistently exceeded client expectations, delivering exceptional results and maintaining a high standard of service delivery.
• Spearheaded configuration and troubleshooting of IBM Connect Direct/NDM connectivity, ensuring smooth data exchange across multiple partner systems.
• Managed end-to-end setup of Linux-based environments supporting Oracle Revenue Management and Billing (ORMB) applications across various instances (DEV/SIT/UAT/PTE/PROD/COB).
• Drove automation initiatives using shell scripts and Ansible playbooks, significantly reducing delivery time.
• Facilitated enhanced password management through the onboarding of database FIDs to CyberArk.
• Proficiently handled VM procurement, middleware application server setup, and system instance management.

Projects

DocuChat AI – Interactive Q&A Assistant

Advanced Predictive Modelling in Healthcare Data Analytics for Early Disease Detection and Proactive Medical Intervention

Loan Approval Predictor

Music Streaming Application Data ETL Pipeline using Python and AWS

E-commerce Data Extraction with Python