Most test suites verify that a system does the right thing when inputs are normal. FinBot adds a harder requirement: verify that the system notices when something wrong is happening, even when the wrong thing looks normal on the surface. That is what the CTF detector layer does. And testing it requires a different way of thinking. What Detectors Do Every event that flows through Redis Streams gets evaluated against a set of detectors. Each detector answers one question: did t

How I Approach Testing AI Systems (And Why It's Different) Most testing advice assumes you control what your code returns. With AI systems, you don't. The model decides. That changes everything about how you write tests. Here's the approach I use when testing LLM integration layers — the classes that sit between your application and the AI provider. The One Rule: Mock the Service, Never Your Code When I test an AI client, I mock the network call to OpenAI or Ollama — not the