The main focus of coding assistants like Copilot is the generation of code, but they can help with other development activities, too. Based on work with a large enterprise, Erik will walk you through buillding a GitHub Copilot extension that brings information from the Backstage developer portal directly into Copilot as an agent. The extension is written in Python and showcases a full implementation of the retrival augmented generation (RAG) pattern. Knowledge of this pattern is useful in may different contexts as it has proven to be the sensible default for building information retrival systems based on LLM's. Erik will show semantic search, prompt rewriting, reranking and use of the ragas library for evals in very practical terms while implementing the extension.