profile-pic

Rajat Agrawal

Vetted Talent

Rajat Agrawal

Vetted Talent

Dynamic Python Back-end Developer with a proven track record in designing and implementing complex software solutions across diverse industries. Demonstrated expertise in deploying applications on Azure AKS Clusters within internal cloud infrastructures and hands-on experience in AI and Gen AI projects, particularly with LLM models and training data. Proficient in AWS services such as EC2, S3, RDS, and Lambda, along with strong database management skills using SQL, MySQL, and PostgreSQL. Familiar with Elasticsearch for search functionalities and adept at utilizing Pandas and NumPy for data analysis. Experienced in CI/CD practices with tools like Jenkins, and skilled in task automation and workflow management. Knowledgeable in Redis and MongoDB for data caching and storage solutions, and proficient in executing ETL processes. Capable of developing web applications with Django and the AWS SDK, while exhibiting strong debugging skills in Python. Excellent communicator with the ability to collaborate effectively within teams and deliver high-quality results under tight deadlines.

  • Role

    Python Developer

  • Years of Experience

    6.00 years

  • Professional Portfolio

    View here

Skillsets

  • AWS SDK
  • Mongo
  • Kubernetes
  • k8s
  • ETL - 5 Years
  • Ds & algo
  • Debugging
  • Database management
  • Database management
  • Programming
  • Aws
  • Ai and gen ai
  • Ai & gen ai
  • Data Lakes - 3 Years
  • Data warehouse - 3 Years
  • Spark - 3 Years
  • Golang - 3 Years
  • Jenkins - 4 Years
  • Data Integration - 4 Years
  • DBT - 3 Years
  • large datasets - 4 Years
  • Redshift - 2 Years
  • k8s experience - 2 Years
  • Azure DevOps - 2 Years
  • Terraform - 2 Years
  • Github - 5 Years
  • GCP - 4 Years
  • Unit Testing
  • System Design
  • Software Development Life Cycle
  • Scrum & agile methodology
  • Scheduler
  • Redis
  • Programming
  • Restful APIs - 6 Years
  • AWS - 6 Years
  • Docker - 5 Years
  • flask - 2 Years
  • Azure - 4 Years
  • Amazon AWS - 5 Years
  • Team Lead - 3 Years
  • Kubernetes - 3 Years
  • TensorFlow - 3 Years
  • Machine Learning - 4 Years
  • PyTorch/scikit-learn - 3 Years
  • Neo4j - 2 Years
  • Artificial intelligence/machine learning - 3 Years
  • Django - 3 Years
  • Numpy - 2 Years
  • CI/CD - 6 Years
  • Pandas - 2 Years
  • Guardduty - 2 Years
  • Java - 3 Years
  • GenAI - 3 Years
  • Docker/Terraform - 4 Years
  • automations - 5 Years
  • 3rd party API integrations - 5 Years
  • Integration Testing - 4 Years
  • Relational Database - 6 Years
  • SQL - 6 Years
  • Python - 6 Years
  • AWS CodePipeline - 3 Years
  • Aws cloudwatch - 4 Years
  • Cloud ETL Processes - 4 Years
  • aws infrastructure - 4 Years
  • API - 5 Years
  • DynamoDB - 4 Years
  • Django /Flask - 3 Years

Vetted For

9Skills
  • Roles & Skills
  • Results
  • Details
  • icon-skill_image
    Python Cloud ETL Engineer (Remote)AI Screening
  • 64%
    icon-arrow-down
  • Skills assessed :SFMC, Streamlit, API, AWS, ETL, JavaScript, Python, React Js, SQL
  • Score: 58/90

Professional Summary

6.00Years
  • Jun, 2023 - Present1 yr 9 months

    Senior Software Engineer

    Servicenow via Apptad
  • Jun, 2023 - Present1 yr 9 months

    Senior Software Engineer

    ServiceNow [via Apptad Inc.]
  • Sep, 2021 - May, 20231 yr 8 months

    Software Engineer

    Gartner
  • Jan, 2019 - Dec, 20201 yr 11 months

    Junior Associate Software Engineer

    Daffodil Software
  • Jan, 2021 - Sep, 2021 8 months

    Business Technology Solutions Associate

    ZS Associates

Applications & Tools Known

  • icon-tool

    Splunk

  • icon-tool

    Kubernetes

  • icon-tool

    Git

  • icon-tool

    Jenkins

  • icon-tool

    Linux

  • icon-tool

    Django ORM

  • icon-tool

    ELK Stack

  • icon-tool

    ETS

  • icon-tool

    API Gateway

  • icon-tool

    CloudWatch

  • icon-tool

    WAF

  • icon-tool

    MySQL

  • icon-tool

    PostgreSQL

  • icon-tool

    Elasticsearch

  • icon-tool

    Pandas

  • icon-tool

    NumPy

  • icon-tool

    Redis

  • icon-tool

    MongoDB

  • icon-tool

    ETL

  • icon-tool

    Django

  • icon-tool

    AWS SDK

  • icon-tool

    AKS

  • icon-tool

    Azure

  • icon-tool

    Snowflake

  • icon-tool

    NFS

  • icon-tool

    API Gateway

  • icon-tool

    WAF

  • icon-tool

    Falcon

  • icon-tool

    RabbitMQ

Work History

6.00Years

Senior Software Engineer

Servicenow via Apptad
Jun, 2023 - Present1 yr 9 months

    Responsibilities-

    • Developing Python-based data governance and catalog solutions to create efficient data streaming and pipeline solutions for multiple projects
    • Deployed Open source custom SaaS microservice on AKS Cluster using Kubernetes in the internal cloud infrastructure
    • Utilizing Azure cloud services to build scalable and reliable software applications, including AKS, Elasticsearch, API, MySQL Server, NFS, ANF and Fileshare
    • Worked on AI and Gen AI projects, with expertise in LLM models and training data. ( OpenAI)
    • Collaborating with the Development Team to design and implement software solutions using Python programming language, SQL and NoSQL databases, and Rest APIs
    • Build, test, and maintained efficient data pipelines using Pandas and NumPy libraries, with proficiency in using Linux and GIT for version control and code management
    • Used Splunk logs and Kubernetes request and limit params, Anti-affinity to ensure pod security and performance of the software applications and troubleshooting issues as and when they arise
    • Used Azure services like ANF and Snowflake for efficient storage and management of data, and implementing automated ETL processes for data transformation


Senior Software Engineer

ServiceNow [via Apptad Inc.]
Jun, 2023 - Present1 yr 9 months
    Developing Python-based data governance and catalog solutions to create efficient data streaming and pipeline solutions for multiple projects. Deployed Open source custom SaaS microservice on AKS Cluster using Kubernetes in the internal cloud infrastructure. Utilizing Azure cloud services to build scalable and reliable software applications, including AKS, Elasticsearch, API, MySQL Server, NFS, ANF and Fileshare. Collaborating with the Development Team to design and implement software solutions using Python programming language, SQL and NoSQL databases, and Rest APIs. Build, test, and maintained efficient data pipelines using Pandas and NumPy libraries, with proficiency in using Linux and GIT for version control and code management. Used Splunk logs and Kubernetes request and limit params, Anti-affinity to ensure pod security and performance of the software applications and troubleshooting issues as and when they arise. Used Azure services like ANF and Snowflake for efficient storage and management of data, and implementing automated ETL processes for data transformation

Software Engineer

Gartner
Sep, 2021 - May, 20231 yr 8 months
    Developed Python-based data engineering solutions to create efficient data streaming and pipeline solutions for various projects. Utilized AWS services to build scalable and reliable software applications, including Lambda, DynamoDB, API Gateway, WAF, CloudWatch, and AWS SDK. Maintained API Gateway and Lambda functions for API development, and ensuring efficient integration with third-party systems. Used WAF and CloudWatch to ensure security and performance of the software applications and troubleshooting issues as and when they arise. Created and maintained data pipelines, including data cleansing, transformation, and aggregation processes, ensuring high-quality data for downstream consumption

Business Technology Solutions Associate

ZS Associates
Jan, 2021 - Sep, 2021 8 months
    Developed and maintained Python-based data engineering solutions, including data warehousing, using Pandas and Numpy libraries. Designed and implemented efficient data pipelines using Elasticsearch & ETS, ensuring high-quality data for downstream consumption. Collaborated with cross-functional teams to deliver scalable and reliable software applications for various projects. Utilized ETS to build efficient and reliable event-driven systems, ensured smooth data flow throughout the pipeline. Maintained and optimized data pipelines to improve efficiency and performance and troubleshoot issues as and when they arise

Junior Associate Software Engineer

Daffodil Software
Jan, 2019 - Dec, 20201 yr 11 months
    Designed and developed Python-based backend solutions using Django and Falcon frameworks for various applications. Collaborated with the frontend team to ensure smooth integration and efficient communication between the front-end and back-end. Maintained and optimized backend solutions to improve performance and scalability, troubleshooting issues as and when they arise. Utilized Django ORM to manage and interact with databases, ensuring data integrity and security. Stayed up-to-date with the latest trends and developments in Python programming and back-end development, and implementing them in current projects to improve efficiency and productivity

Achievements

  • HackerRank Problem Solving Certificate (Sep 20 - Present)
  • HackerRank Python Star Achieved (Jul 20 - Present)
  • Machine Learning and Python by Ducat India (Mar - Present) The Workshop focused on Basics of Python and its libraries along with brief introduction of Machine Learning

Major Projects

5Projects

Gen AI Data Catalog and Quality Processing System

Jun, 2023 - Present1 yr 9 months

    Project Details -

    • Working on project with multiple micro services architecture using Python, Flask, Azure, Snowflake, Kubernetes.
    • Deployed an open source tool on AKS Cluster using automated deployment pipelines using Kubernetes in clients internal security network and cloud infrastructure
    • Enhanced model accuracy by 20% by fine-tuning pre-trained embedding for domain-specific text analysis in a financial forecasting project.
    • Optimized embedding layers within a recommendation system, reducing model inference time by 30% while maintaining high accuracy.

    Tech Stack - Python, Flask, Azure, Snowflake, Kubernetes, fine tuning, NLP, ML.

Data Catalog and Quality Processing System

Jun, 2023 - Present1 yr 9 months
    Working on project with multiple micro services architecture using Python, Flask, Azure, Snowflake, Kubernetes. Deployed an open source tool on AKS Cluster using automated deployment pipelines using Kubernetes in clients internal security network and cloud infrastructure

Data Workstream Processing

Sep, 2021 - May, 20231 yr 8 months
    Worked on project with multiple micro services architecture using Python, Java, AWS, SQL, DBs. Organized different initiatives on supporting business requirements for various use cases

Data Pipeline Processing

Jan, 2021 - Sep, 2021 8 months
    Worked on Pandas, Numpy, AWS Services, Elastic Search, Data Lake, Domino labs, AWS SDK with Python. Used Python scripts to channelize data from multiple sources to a centralized data lake using ES. Designed and implement Python scripts to automate manual process for performing ETL operations

Python Back-end Developer

Jan, 2019 - Dec, 20201 yr 11 months
    Worked on multiple microservices in django and falcon, database integration (SQL and NoSQL), redis, celery and rabbitmq. Written microservice in Golang to optimize functionality, develop new features and resolve bugs

Education

  • B.Tech. (CSE)

    ABES Engineering College (2019)

  • PGDBM (IT)

    NMIMS, Mumbai (2022)

Certifications

  • Hackerrank problem solving certificate (sep20 - present)

  • Hackerrank python 5 star achieved (jul20 - present)

  • Machine learning and python by ducat india (mar18 - present)

  • Machine learning and python by ducat india

  • Hackerrank python 5 star achieved

  • Hackerrank problem solving certificate

  • Blood donor and volunteer certificate