Experienced data engineer with 6 years of expertise in complex, custom-designed, and scalable software development projects. Specialized in data engineering using PySpark, Python, Kafka, AWS services, and other backend tools. Proficient in developing robust REST APIs using FastAPI and Flask, as well as web scraping and automation using Python libraries. Strong object-oriented programming skills and knowledge of design patterns. Adept at processing large datasets using data pipelines with PySpark, AWS, and other DevOps tools. Skilled in working with PostgreSQL, MongoDB, and other databases.
Data Engineer & Backend Developer
MSBC Solutions Pvt Ltd (Contractual)Consultant
Virtusa Consulting Pvt LtdFull Stack Developer
NEST TECH UK BASED (Contractual)Full Stack Web Developer
Tetra Quark InnovationFull Stack Developer
Focus LabsPython Developer
PiChain Innovations Pvt LtdPython
NodeJS
MySQL
MongoDB
Redis
Kafka
Jenkins
AWS
Azure
Git
Bitbucket
Javascript
angul
Flask
FastAPI
Django
Node.js
Express.js
PostgreSQL
AWS (Amazon Web Services)
AWS EMR
AWS Lambda
AWS S3
Docker
REGEX
Selenium
requests
Terraform
Redis
RabbitMQ
Celery
Kubernetes
Metabase
DynamoDB
Project 1- KYC APPLICATION & Copilot Management (KYC WEB APPLICATION & APP for Copilots Management)
Technologies Utilized: Python | Request | Selenium| AWS EC2 | MongoDB | AWS S3 | Kafka| Flask | FastAPI | Docker | DevOPS| Azure | Github | RESTAPI | PyTest | Unittest
Roles and Responsibilities: Backend Developer| Team Size 2
Project 2 - AWS and Azure Resource Automation (Terraform-based Resource Creation Automation)
Technologies Used: Python | Azure | DynamoDB | State Machines | API Gateway | AWS Services | Azure Blob | Github | Data Factory | Data Lake | Data Bricks | Azure Logs
Roles and Responsibilities: Backend Developer | Team Size 4
Project- Reltio Platform MDM Modernization (PySpark)
Technologies Used: Python | PySpark | PostgreSQL | AWS EMR Serverless | AWS Lambda | AWS S3 | Jenkins| Docker | REGEX | Azure Data Lake | Azure Data Factory
Roles and Responsibilities: Backend Developer| Team Size 3
Objective:
The project aimed to automate infrastructure management tasks using Terraform configurations, ensuring secure access, efficient resource provisioning, and comprehensive monitoring.
Key Features Implemented:
Objective:
The project aimed to establish and manage a robust Master Data Management (MDM) system tailored for the healthcare industry, ensuring accurate and reliable data management across various sources.
Key Responsibilities and Activities:
Technologies Used:
Benefits:
Project Details:
1. One-Click Verification and Data Extraction API
Objective:
Developed and deployed a FastAPI-based API to automate document verification and extraction from multiple web portals.
Key Responsibilities and Achievements:
2. Legacy API Performance Optimization and Migration
Objective:
Reduced response times for legacy APIs by 90% through request-based optimization techniques and migrated over 70 APIs to the new approach.
Key Responsibilities and Achievements:
3. Backend Service for Portfolio Management System
Objective:
Designed and developed a comprehensive backend service for a Portfolio Management System to streamline investor onboarding processes.
Key Responsibilities and Achievements:
4. Software-as-a-Service Platform for Custom Chatbots
Objective:
Developed a Software-as-a-Service (SaaS) platform tailored for custom chatbots catering to industries such as health and safety and the IT sector.
Key Responsibilities and Achievements:
Technologies Used:
Benefits:
Objective:
The project aimed to develop a feature-rich chat application to facilitate instant messaging and real-time communication among users.
Key Features Implemented: