Kislay srivastava
Vetted Talent
Kislay srivastava
Vetted Talent
I have over 8 years of experience with Python development, I have worked primarily with Django and Flask frameworks to create scalable web applications and deploying them on cloud.
I am confident in my ability to take on complex projects and provide innovative solutions that meet the needs of clients.
- Role
Software Development - Other
- Years of Experience
9 years
- Professional Portfolio
View here
Skillsets
- Git
- Pyspark - 4.0 Years
- ETL - 4.0 Years
- Data Analytics - 4.0 Years
- client-facing - 3.0 Years
- SQL
- Snowflake
- Python - 8.0 Years
- machine learning
- Airflow - 4.0 Years
- GIT
- Django
- Databricks
- Data Engineering - 4.0 Years
- Bash
- Aws
- AWS
Vetted For
13Skills
- Roles & Skills
- Results
- Details
Data Engineer || (Remote)AI Screening- 76%
- Skills assessed :Airflow, Data Governance, machine learning and data science, BigQuery, ETL processes, Hive, Relational DB, Snowflake, Hadoop, Java, PostgreSQL, Python, SQL
- Score: 68/90
Professional Summary
9Years
- Nov, 2022 - Oct, 20241 yr 11 months
Senior Software Engineer
Miratech Pvt ltd - Apr, 2022 - Nov, 2022 7 months
Senior Backend Engineer
Apisero Integration Pvt ltd - Dec, 2015 - May, 20215 yr 5 months
Senior Software Engineer
Infosys Ltd
Applications & Tools Known
Python
Pyspark
AWS (Amazon Web Services)
Apache Airflow
Snowflake
MySQL
.png)
Docker
Kubernetes
Django
.png)
Flask
Athena
Airflow
Azure Databricks
Tableau
AWS S3
AWS
Azure Blob Storage
Azure Databricks
Tableau
AWS Glue
Tableau
Tensorflow
Pandas
Tableau
AWS RDS
AWS Fargate
Kafka
.png)
Jenkins
AWS Elastic Beanstalk
Django Rest Framework
CI/CD
AWS S3
Azure App Service
Databricks
AWS S3
AWS EMR
AWS RDS
Kafka
Azure App Service
JDBC
React
HTML
CSS
Pandas
AWS S3
Javascript
Work History
9Years
Senior Software Engineer
Miratech Pvt ltdNov, 2022 - Oct, 20241 yr 11 months
Responsible for enabling the pipelines which onboard new clients. Integrated data from several sources using python and pyspark and further push it to downstream systems as per the expected internal models. The Data platform so designed is part of a Django based web application. The application is deployed on AWS Elastic beanstalk. Used MySql as my database for the application. It was a managed AWS RDS instance. Developed fanning out mechanisms with Kafka to deal with the sharing of transformed data to the registered clients. The created data platform was fully cloud native and was auto-scalable. Achieved a 17% higher throughput for my workflows using asynchronous processing and using event based triggers. The UX was enhanced by me after adding a AWS ElastiCache as a separate component.
Senior Backend Engineer
Apisero Integration Pvt ltdApr, 2022 - Nov, 2022 7 months
Worked as the designer of new integration pipelines. Worked on enhancing the existing django application which was hosted on a Azure app service environment. Worked with HTTP and Websocket APIs to create efficient web handlers. Was responsible for recreating the REST APIs of the system and make them more standardized. Used PostGreSql as my transactional database. Utilized JDBC connections to connect the application with the database. Leveraged the React/HTML/CSS combination to make the User interface more responsive.
Senior Software Engineer
Infosys LtdDec, 2015 - May, 20215 yr 5 months
Created and deployed several Django based web applications on the cloud. Initially was responsible for developing and personalizing certain web applications. Worked with HTML,CSS and Javascript to optimize the UI of my applications. Worked recently on big data landscape and used AWS EMR to carry out certain python and pyspark scripts. Created Airflow DAGS to enable scheduled triggering of execution. Used Pandas/Pyspark for performing transformations on my input data. The main objective was to create a data pipeline for ingesting the Source files from various systems and ultimately pushing the processed rows to AWS S3.
Achievements
- Developed fanning out mechanisms to deal with the sharing of transformed data to the registered clients.
- Successfully developed and tested end-to-end ETL pipelines for automated ingestion and storing the results on a cloud warehouse.
- Created and deployed several Django-based web applications on the cloud.
- Revised concepts of RDBMS,DW and Python development.
- Pyspark and Hadoop technologies played a key part in the final capstone project.
- Studied SDLC concepts and pipelines in the data cloud.
- Also worked on backend frameworks like Django and Flask, along with Containerized services.
- Learned to utilize MS Azure services for creating event based data pipelines
- Created Big Data pipelines using GCP services
- Used Tensorflow library for creating ML models
- Mostly worked with Pandas and Pyspark API of Python.
- Project work and lab sessions used IBM DSX(data studio) as the service provider.
- Revised concepts of RDBMS, DW and Python development.
- Created Big Data pipelines using GCP services.
- IBM Certified Backend Engineer
- Infosys Python Associate
- Infosys certified Python developer
- Architecting Solutions on AWS
Major Projects
4Projects
Enterprise Data Platform
Blackrock Pvt ltdNov, 2022 - Present2 yr 5 months
- As part of our modernization we moved from traditional architecture to a more cloud native approach.
- The next priority was for us to become as vendor agnostic as possible, this led to the choice of Snowflake with DBT as an ELT framework
- I was regularly involved in POCs for enhancing the existing Index Platform.
- Being a Python developer, I was in charge of understanding the legacy perl code and migrate them to more efficient python scripts.
My team and I were tasked with identifying a viable alternative to the pre-existing Index data platform being used (mostly Perl and SAP Sybase database along with several in-house antiquated tools).
Offline Verification of Digital Signatures using ANN models
Created a Neural Network identifier for offline signature verification. Used Supervised Learning Algorithms to make the classifier.
Financial Services Guidance
Ameriprise Financial ServicesAug, 2019 - May, 20211 yr 9 months
- Python/Pyspark developer AWS cloud: (client Ameriprise Financial Services - 2019 to 2021) I was in-charge of a data migration project wherein the data was being ingested through AWS Glue and were processed downstream using Pyspark programs running on top of EMR clusters. Thereafter the data was sent to an S3 bucket and visualized using Amazon Athena.
Spreadsheet comparator app
Morgan StanleyMay, 2016 - Aug, 20193 yr 3 months
- Python Django Developer: (client Morgan Stanley - 2016 to 2019) My team and I were tasked with creating and maintaining a simple MVC app to perform some minimal transformations on some input files and writing the transformed files to an AWS s3 bucket location.
Education
MASTER OF TECHNOLOGY (CSE)
Indian Institute of Technology, Dhanbad (2015)BACHELOR OF TECHNOLOGY (CSE)
Srm University, Chennai (2011)
Certifications
Ibm certified data engineer
Ibm certified data science professional
Infosys certified python associate
Gcp big data and ml engineer
Ms azure for data engineering
Ibm backend developer
Ibm data science professional
Ibm certified data engineer (07/2022 - present)
Ibm backend developer (01/2023 - present)
Ibm data science professional (09/2019 - present)
Gcp big data and ml engineer (01/2020 - present)
Ms azure for data engineering (08/2022 - present)
Ibm certified backend engineer
Infosys python associate
Infosys certified python developer
Meta backend developer
Architecting solutions on aws (01/2024 - present)
Architecting solutions on aws