Andrea Cola, AI Engineer, BIP xTech
Andrea, 28 years old, studied at the Polytechnic University of Milan, specialising in software engineering, artificial intelligence, and data science. He conducted his master's thesis at BIP xTech in the field of AI-based Data Quality, contributing to the development of a digital asset stemming from the thesis.
Andrea transitioned to a full-time role at BIP xTech as a data scientist for 2 years and later played a key role in establishing the new AI engineering practice, taking on the position of Expert AI Engineer. He focuses on digital assets based on Artificial Intelligence and Generative AI. Additionally, Andrea has expertise in MLOps platforms on Google Cloud, AWS, and Azure, with in-depth experience in NLP and Vision tasks.
Lately, he has been dedicated to studying Generative AI on the Edge of devices.
Session
The session elucidates the methodology to develop conversational agents by using an internal knowledge base, with a primary focus on the following key facets:
- Designing the solution to align with the foundational principles of AI engineering, concurrently harnessing the conversational proficiencies of the Language Model (LLM).
- Crafting the solution within the framework of a serverless cloud infrastructure.
- Systematically engineering the solution to ensure scalability within a production environment.
In particular, the session is meant to provide the perspective of BIP xTech on creating AI-based assets such that they are sustainable and effective in production with a massive amount of users.
Furthermore, we demonstrate how to integrate the powerful LLMs from OpenAI and Google into an efficient architecture capable of achieving scalability, robustness, and cost-effectiveness while simultaneously matching the expectations of end users with a user-friendly experience.