Choosing the Right Tasks for AI Agent Evaluation

How to turn real developer workflows into test cases that reveal where coding agents succeed, struggle, and need better product support.

Three winding paths with blue spheres and geometric obstacles on a textured cream background

Latest Articles

Articles on AI agent evaluation workflows, applied AI systems, and Quantiles product updates.

How to Evaluate AI Agent Access and Permissions

Testing whether agents complete authorized work, respect access restrictions, and request approval when needed.

Building Realistic Environments for AI Agent Evaluation

The tools, data, permissions, and starting conditions that bring real workflows into controlled, repeatable agent evaluations.

AI Agent Documentation: A Guide to llms.txt, AGENTS.md, SKILL.md, and MCP

An overview of the documentation, instructions, and protocols that help coding agents understand developer products, complete workflows, and work more reliably.

Using Token Data to Improve the AI Agent Experience

Token usage as a signal for agent behavior, workflow efficiency, reliability, and friction in developer products.

Does your SKILL.md help coding agents?

How to evaluate whether agents find and use your skill, how it affects their behavior, and whether it helps or harms the use of your product.