Arjun Mantri has won the title of ISTRA 2024 under Software Engineering in Data for AI/ML and Data Security
- Self intro (Should not include contact details). –
About
As a veteran staff software engineer in data engineering, I specialize in developing and optimizing data pipelines and platforms across various industries, including social media, OTT TV streaming, and travel. My work focuses on ensuring that data systems are efficient, scalable, and robust, enabling organizations to harness the power of big data. Throughout my career, I have led numerous projects that transformed data infrastructure, enhancing performance and reliability. My expertise includes leveraging cutting-edge technologies such as Spark, Hive, and Spark Streaming to create sophisticated data solutions tailored to meet the unique demands of diverse industries.
What I Bring to the Table
With extensive experience in software engineering, machine learning, and big data, I offer a unique perspective that bridges technical expertise with business needs. My technical proficiency allows me to design and implement data systems that not only meet high performance and scalability standards but also align with organizational goals. I excel in optimizing data pipelines, ensuring data integrity, and facilitating data-driven decision-making processes. My ability to understand and translate complex technical requirements into actionable insights has consistently driven successful outcomes in my projects. Additionally, my collaborative approach ensures seamless integration of data solutions across various teams and stakeholders, fostering a cohesive and efficient data environment.
Background
I have a strong background in data engineering, with significant roles at TikTok, Roku, and Expedia. My work has consistently focused on enhancing data infrastructure and enabling data-driven decision-making. At TikTok, I played a pivotal role in developing and optimizing the data platform that supports over 1 billion users, ensuring data consistency and reliability across multiple geolocations. At Roku, I maintained and enhanced the data platform for millions of devices, integrating data from major third- party providers. My tenure at Expedia involved migrating critical data infrastructure to more advanced technologies, significantly improving efficiency and scalability. These experiences have equipped me with a deep understanding of the technical and business aspects of data engineering, enabling me to deliver high-impact solutions.
- Educational qualifications and experience, profile highlights, no.of conferences, publications, etc. –
Arjun Mantri is a Master of Science graduate from San Jose State University’s Charles W. Davidson College of Engineering. He currently works as a Staff Software Engineer, Data, and has published 13 research papers with a total of 230 reads. A key highlight of my career was leading the development and optimization of TikTok’s data platform. This project involved creating an end-to-end data pipeline that served multiple regions, including Singapore, the US, and Europe. The platform’s development ensured timely and efficient data processing, which was crucial for supporting TikTok’s massive user base of over 1 billion users. Additionally, I addressed and resolved data consistency issues across different data centers by developing a custom tool, ensuring reliable and accurate analytics and reporting. This achievement not only enhanced TikTok’s data processing capabilities but also had a significant impact on the company’s ability to make informed decisions and improve user experience. Arjun’s research focuses on the development and deployment of data privacy and data pipeline algorithms, leveraging advanced concepts in cloud engineering and privacy and compliance standards. His work has critical industrial applications in artificial intelligence and machine learning use cases in travel and media services. Some of his notable publications include “Real-Time Data Streaming and AI Enhancements: E-Commerce Live Streaming Shopping”, “Intelligent Automation of ETL Processes for LLM Deployment: A Comparative Study of Dataverse and TPOT”, and “Ensuring Data Integrity: The Role of Data Engineering and Pipelines in Labeling AI-Generated Images and Videos”.
- Previous achievements if any and other profile highlights.
I am committed to leveraging AI and machine learning to drive innovation in data engineering, enhancing data privacy, integrity, and operational efficiency. My professional ethos revolves around continuous
learning and adapting to emerging technologies to stay at the forefront of the data engineering field. I aim to create data systems that are not only technically advanced but also aligned with the highest standards of data privacy and security. By integrating AI and machine learning into data engineering processes, I strive to develop intelligent systems that can automatically detect and rectify anomalies, optimize performance, and provide actionable insights. This commitment to innovation and excellence ensures that my contributions have a lasting and positive impact on the organizations I work with.
Awards & Recognitions Conferred
– VTA (Valley Transportation Authority) Award Winner – Developed an app to gamify public transportation, enhancing user engagement.
– Six Sigma Certified (Lean Six Sigma Green Belt) – Recognized for process improvement and operational efficiency.