• Worked on building an event based data pipeline so as to provide important data metrics generated by the backend business logic and recorded by the primary database to various consumer teams internally.
• After gathering the requirements from the Analytics and Engineering Team, defined specs and designed a common event based architecture using SQS queues that will be used by the engineering team for various other event based features in the future
• The Event based pipeline was built using Spring Boot and AWS Simple Queue Service (SQS) message queues, along with AWS Simple Notification Service (SNS), was used persist the metrics and reroute the messages respectively. The pipeline was further made robust by decoupling the extraction of data through asynchronous tasks in a task queue (FIFO Queue) and using batch processing for delivery of the messages using Spring Batch.
• Skills Used: Java, MySQL, Spring Boot, Spring Batch, Jenkins CI, AWS (Lambda, SQS, SNS), Docker
Fun Fact
that I love soccer and play and watch it but I still don't have a favorite team
Passion
creating products and applications that have an impact and explore places and meet new people!