Partner with us

Get your ticket

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

André
Kerr
Director, Applied AI Lab
American Express
André Kerr is Director of the Applied AI Lab at American Express, where he leads development of enterprise generative AI products from experimentation to global deployment. He builds high-compliance AI systems for regulated environments, drawing on a background in aerospace engineering and systems engineering. Previously he worked at Raytheon Technologies on propulsion and software systems for aircraft and engine performance. He holds an MS in Systems Engineering from Johns Hopkins University and a BE in Mechanical Engineering from City College of New York. He is also an instructor and mentor in AI, focused on practical, scalable and responsible AI systems.
Button
19 August 2026 12:00 - 12:30
Panel | Eval in the wild: What actually breaks when you test agentic AI on real financial data
Eval frameworks that work in research don't always survive contact with production financial data. This session brings together panelists covering what they measure, what they have stopped measuring, how they handle non-determinism at scale, and what broke before they got it right. What this session will cover: - Why standard benchmarks fail on production financial datasets - How teams are handling non-determinism in multi-step agent pipelines - Observability tooling being used in live financial environments - What good eval hygiene looks like six months into production Bring your own war stories, this one tends to turn into a comparison of notes.