Agentic AI: On Evaluations
This article will go through common metrics for multi-turn chatbots, RAG, and agentic applications. While also reviewing frameworks like DeepEval, RAGAS, and OpenAI’s Evals library, so you know when to pick what.
Technical Builder & Writer
I'm Ida, self-taught developer and technical blogger (within AI) based in Stockholm. Professional experience in product management and marketing. Educated as an economist. Generalist that loves to work on several parts of a business. Always happy to be creative and work on challening problems.
Agentic AI: Implementing Long-Term Memory
If you have ever worked with LLMs, you know they are stateless. That is, they have no short-term memory. To make sure the LLM can pull up the right facts, understand previous conversations, and connect information, we need to build some fairly complex systems.
Agentic RAG: Company Knowledge Slack Agents
An AI knowledge agent can dig through internal documentation — websites, PDFs, random docs — and answer employees in Slack (or Teams/Discord) within a few seconds. I will go through what it takes to build one using using LlamaIndex and Modal.
Agentic AI: Comparing New Open-Source Frameworks
Did you know there are dozens of open-source agentic frameworks out there? I have briefly tested some of the more popular ones to get a feel for how they work and how easy they are to get started with.
Work
- Company
- Role
- A Bit of Everything
- Date
- Company
- Lolo Co
- Role
- CMO / Head of Product / Dev
- Date
- Company
- Columbia Road
- Role
- Senior Consultant
- Date
- Company
- Telia (Halebop)
- Role
- Product Manager
- Date