Thursday, March 7, 10:00 AM Pacific time
Building Production-Grade LLM Apps
In this webinar, technical leaders from Pinecone and TruEra will share how to create LLM apps that are high quality and production ready.
Last year, GenAI experimentation spread like wildfire. Developers tinkered with new foundation models, data, and use cases. However, a relatively low percentage of projects moved from prototypes to production to drive real-world impact. One significant reason for this is ensuring app trustworthiness: Is an app reliable, accurate, or fair enough to be unleashed on the world? Which app responses are hallucinatory, which ones are unsafe? Could we identify issues and mitigate them during app development and in production to meet the quality level that end users need?
This year, organizations are taking their learnings from experimentation and focusing on creating and iterating enterprise-grade apps that will be reliable in the harsher realities of production environments.
How can you make your apps enterprise grade? In this webinar, technical leaders from Pinecone and TruEra will share how to create apps that are high quality and production ready. The principles will be illustrated with Pinecone Canopy and TruLens, and notebooks will be available for participants to explore.
In this workshop, you will learn:
- What do you need to create enterprise-ready AI models and apps? Your current stack might have some gaps in it. Here’s what’s working.
- What do you need to evaluate and iterate on apps quickly, so that you can gain confidence that your app is ready for production?
- Rapid response - what happens when an app generates a hallucinatory or irrelevant or unsafe response? How to monitor, recognize when your app is in trouble and quickly get it back on the rails.