Architecting with Semantic AI: A Language Model and an Embedding Model Walk Into a Bar…

Semantic AI, as an evolution of Generative AI, offers a powerful path to integrating meaningful intelligence into modern software systems.
In this talk, Christian Weyer presents practical architecture patterns and approaches for leveraging both large and small language models—such as GPT or LLaMA—alongside embedding models, within contemporary software architectures.
Key concepts like Semantic Routing, Semantic Search & Lightweight RAG, as well as Structured Output generation, are demonstrated using an end-to-end system composed of multiple services and client applications.
Developers and architects will leave with a pragmatic, real-world overview of how to bring Semantic AI into their own solutions—efficiently, modularly, and meaningfully.