• Responsible to design, implement, and maintain applications that are often high-volume and low-latency, required for mission-critical systems
• Accountable for designing data applications for software usability, running these tests, and preparing reports on the effectiveness and defects of the application
• Design, code and modify applications from layout to function according to a client's specifications
• Responsible to ensure high quality designs - create and execute test cases, reviews of specifications, design reviews, code reviews)
• Implemented several enhancements, such as enabling single sign-on support through the SAML mechanism.
• Automated the installation of necessary software components, including Tomcat and the database, using Docker
• Created a custom image and made it accessible on Docker Hub
• Introduced support for PostgreSQL as an application schema within the platform
• Resolved runtime cache errors that occurred when Tomcat instances were operating under a load balancer
• Developed APIs using Java servlets in accordance with project requirements
• Managed SMTP functionality for sending emails and addressed issues related to email flooding
• Implemented automated access token persistence and refresh logic based on login responses, allowing seamless interaction with Azure APIs
• Added support for Auth0 Single Sign-On (SSO) using the OpenID Connect mechanism
• Addressed canonical name expansion challenges when sending emails from the SMTP server
• Worked on configuring Kubernetes pods using Minikube within the Docker environment
• Set up Tomcats on an Nginx load balancer for improved performance
• Integrated Apache PDFBox into the Cloudio platform to enhance PDF-related functionality
• Participated in team discussions regarding enhancements and attended management meetings as needed
• Participated in user requirement gathering, as well as development, testing, and bug fixing within an agile work environment
• Created RESTful API services for the Cybeta project using Spring MVC, utilizing a JSON interface
• Developed the DAO (Data Access Object) layer using the Hibernate API to manage transactions with a MySQL database
• Employed various frameworks and libraries (e.g., POI for Excel, Jackson Databind API for JSON) to parse different types of files such as Fixed Width, JSON, Comma Delimited, and Excel files
• Designed an interface to efficiently parse a massive 500 GB file into MongoDB in under 30 minutes which was achieved by running an Apache Beam program on a two-node Apache Spark cluster and a 2-node HDFS (Hadoop Distributed File System)
• Utilized Dig Dag to manage workflow requirements within the project
• Focused on optimizing the performance of MongoDB by implementing sharding and indexing techniques
• Developed a Rest Connector to stream data from the CyR3con API, using Apache Beam 2.1.0 and Apache Spark 2.3.0
• Collaborated with Business Analysts to gather requirements and played an integral role in the design phase by working closely with architects and senior programmers
• Created custom text Input/Output (IO) functionality in Apache Beam for injecting data into a MySQL database
• Developed a Data Integrator project capable of parsing various types of delimited files and executing mapping transformations on the data
• Implemented a logic system enabling remote server file access, processing, and subsequent archival of the files
• Crafted shell scripts in a Linux environment to monitor the Data Integrator project's performance
• Introduced the Hikari connection pooling mechanism to effectively manage database connection pooling
• Fine-tuned Spark configurations at the RDD (Resilient Distributed Dataset) level to enhance the speed of data insertion into MySQL.