I have completed my graduation in 2017, that is from my own hometown and I have completed my Bachelor of Computer Application as a graduation. I have started working from 2018 and it's been 6 years that I am in the IT industry. I am currently working as a senior software engineer and data engineer in Onclusio, it's my current organization where I am working as a permanent role. My roles and responsibilities resides like to build data pipeline, we fetch a lot of data, maybe a petabytes of data and around terabytes of data on each day, we process that data into Amazon Lambda, the streaming service that we use, that is our AWS Kinesis. We pull the data, the scripts are running in the Python, that scripts are running on AWS ECS, then pull the data, each interval and push the data to AWS Kinesis, then transform the data into particular format that we require. That data has been pushed to Elasticsearch. Elasticsearch is our content hub, we have around 7 to 8 clusters, one of our hot clusters has around 200 TB of data, we usually ingest around 10 TB of data each day, so we transform that much of data, different type of articles, different type of data and from there our API service runs that exports that content of data to a different client. So, this is a different team in our own organization, so past from 6 months I was primarily working on the setting of the Elasticsearch site, so yeah, and also we are going to transform our pipelines to the Apache Beam site, that work is not yet started but it is going to be started soon. We have done POC, a lot of POC, I am primarily working on the AWS Lambda side where we process the real-time data and a lot of data basically, so yeah, so basically we are going to use Kafka for our modernization, we are going to use Apache Beam and that will push data to, after the transformation, push data to Elasticsearch and from there the other flow will remain same. So, yeah, that's about my professional journey and apart from my CV, I have, apart from my professional journey, I have done post-graduation Diploma in Management, that resembles as a MBA also, okay, and apart from that, I like to go for trekking and I am mostly foodie, so yeah, that's about my all those personal and professional journey.
