Data Engineer

Jan 2024 - Present

Site IQ, Lombard, Illinois, United States

• Developed and optimized real-time data streaming pipelines using Apache Kafka and Amazon Kinesis
• Implemented Docker and Kubernetes for containerization and orchestration of data processing services
• Utilized Clickhouse for high-performance data storage and querying, optimizing data retrieval processes and reducing query response times
• Designed interactive and dynamic data dashboards using Power BI, QuickSight, and Tableau
• Engineered data migration strategies using MySQL and automated ETL pipelines. Developed and maintained robust data infrastructure using Python
• Led data integration and processing projects using Mage AI for machine learning model automation
• Other Activities: Knowledge Transfer, Presentations to other teams about the new features implemented in the website

ETL Developer

Aug 2023 - Oct 2023

Santander Consumer USA, Dallas, Texas, United States

• Proficient in designing and developing ETL (Extract, Transform, Load) processes using Informatica Power Center to ensure smooth data integration
• Proficient in Control-M job scheduling and automation for managing batch processing and workflows. Successfully automated repetitive tasks, reducing manual errors and saving time.
• Utilized Clickhouse for high-performance data storage and querying, optimizing data retrieval processes and reducing query response times
• Strong command of SQL Server for database design, administration, and optimization. Developed complex SQL queries, stored procedures, and views to extract, update, and manipulate data. Performed database maintenance tasks, including backups, restores, and index management.
• Proficient in utilizing Azure DevOps for source code management, continuous integration, and continuous delivery (CI/CD) processes. Created and maintained build and release pipelines to automate software deployment.
• Proficient in using Service-Now for IT service management, incident, problem, and change management.

Senior Systems Engineer

Oct 2019 - Dec 2021

Infosys Ltd, Hyderabad, Telangana, India

• Trained on Python, DBMS, Java, Selenium, SOAP UI, Cucumber, REST API, SAP SD
• Worked as a Azure Data Engineer and played an important role on five year project with client T-Mobile.
• Worked monitoring performance and optimization of databases to ensure efficiency.
• Assisted with the design and development of data storage/integration/transformation/distribution strategies that can handle large volumes of varying types of data in Azure
• Worked with ETL/ELT pipelines including SSIS, Azure Data Factory, Function Apps, Logic Apps, Databricks, SPARK and Azure Synapse Analytics
• Other Activities: Knowledge Transfer to juniors, Presentations to other teams about the new features implemented in the website

Technology Support (Part-time)

Aug 2022 - Jan 2023

Advance Technology Learning Center, Lubbock, TX

• Responsibilities: Computing Lab facility to Staff and Students, Coordinating courses for Students, Computer Hardware and Software Support, Guiding and Assisting Students
• Impact: Introducing new technologies to the interested students through short courses

Grader, Teaching Assistant(Part-time)

Jan 2023 - May 2023

Advance Operating Systems Subject, Computer Science, Texas Tech University

• Responsibilities : Managing Web Page for updating class details, Assisting with student assessments and communication with them to solve their issues, Working with Professor to manage the classroom, student progress monitoring, Providing support and oversight in the classroom alongside professor to help ensure quality learning for all students