Supersede benchmark targets memory-update failures in LLM agents
A new arXiv paper introduces Supersede, a way to diagnose and train LLM agents that fail to update memory when facts change.
News
Short posts prepared from approved sources with clear links back to the original articles.
RSS feedA new arXiv paper introduces Supersede, a way to diagnose and train LLM agents that fail to update memory when facts change.
Anthropic’s Claude models are now running on GB300 Blackwell Ultra systems through Microsoft Azure.
AWS published a document-processing architecture that uses Nova 2 Lite with Claude to balance extraction quality and cost.
MIT Technology Review published an analysis on agent confidence, focusing on how systems behave when pushed toward the technical frontier.
LangChain introduced dynamic subagents for Deep Agents, giving agent systems a way to spawn specialized helpers during a task.
Prosecutors used ChatGPT logs alongside phone location data, security footage and testimony in an arson case tied to the Palisades fire.
Sina Weibo’s VibeThinker-3B reportedly matches far larger models on some math and coding benchmarks after multi-stage post-training.
Coinbase says it is shifting more AI traffic to Chinese models such as GLM 5.2 and Kimi 2.7 as routing and caching cut costs.
Qihoo 360 founder Zhou Hongyi says the company is building AI security tools to compete with Western systems such as Anthropic’s Mythos.
Princeton researchers built CEO-Bench, a 500-day startup simulation where most AI agents lost money and a simple rule-based baseline beat nearly all of them.
A new engineering essay argues that agentic systems fail in production when teams optimize average performance while ignoring slow or brittle edge cases.
Liquid AI has released LFM2.5-230M, an open-weight 230-million-parameter model aimed at fast local inference and tool-use tasks.
A data-science case study found logistic regression beat XGBoost on a 358-match prediction task, underscoring the value of simpler baselines.
Wall Street investors are increasingly treating Micron as an AI infrastructure beneficiary because advanced memory is central to accelerator systems.
Ford is rehiring experienced engineers after concluding that AI alone did not produce the quality gains it expected.
Suno has launched Spark, an incubator for independent artists that offers grants, mentorship and marketing support.
A survey paper argues that AI systems will not become dependable digital colleagues until they can complete work across persistent environments.
AWS has put FinOps Agent into public preview, offering an automated way to investigate cost anomalies and route findings into workplace tools.
A new technical walkthrough shows how OCRmyPDF can convert image-only PDFs into searchable PDF/A files while extracting sidecar text for validation.
A new Interconnects analysis says recent open artifacts from Zyphra, Cohere and Poolside are widening the practical model ecosystem.
A new arXiv paper presents auto-psych, an agent-driven approach to theory discovery and experimentation in psychology. The project explores how AI systems could help automate parts of the science of mind.
A new arXiv paper studies AI agents in electric bus fleet operations, focusing on pricing behavior, trade-offs, and policy implications in an aggregator framework. The work applies agent modeling to transport electrification and grid coordination.
A new arXiv paper studies uncertainty estimates for classifier performance, including applications to large language models and nested data. The work is relevant to teams trying to report model quality without overstating confidence.
A new arXiv paper argues that data-driven machine learning cannot reach symbolic-level logical reasoning through scaling alone. The work challenges the assumption that more data and parameters are sufficient for all reasoning abilities.
A new arXiv paper introduces MKG-RAG-Bench for evaluating retrieval in multimodal knowledge graph-augmented generation. The benchmark targets RAG systems that must work across structured entities and multimodal evidence.
A new arXiv paper formalizes “instruction bleed,” where editing one prompt module changes behavior in another module without an explicit dependency. The failure mode matters for prompt-composed agent systems that share a context window.
A new arXiv paper introduces LeanGuard, a fast and light approach to robust moderation. The work questions whether safety guardrails always need expensive reasoning models to make reliable decisions.
A new arXiv paper proposes Narration-of-Thought, an inference-time scaffold for defeasible ethical reasoning in LLMs. The work targets cases where models need to revise moral judgments as context changes.
A new arXiv paper introduces OpenFinGym, a verifiable multi-task environment for evaluating quantitative-finance agents. The benchmark aims to connect forecasting, strategy construction, risk management, and trading in one workflow.
A new arXiv paper introduces SKILL-DISCO, a method for distilling and compiling agent traces into reusable procedural skills. The work targets a key challenge in agent systems: turning one-off successful behavior into repeatable capability.
A new arXiv paper introduces Clinical Harness, a framework for governable medical AI skill ecosystems. The work focuses on validation, oversight, and modular clinical capabilities rather than a single monolithic medical chatbot.
A new arXiv paper titled “Radical AI Interpretability” argues for a more ambitious approach to understanding AI systems. The work adds to the debate over whether current interpretability tools are enough for increasingly capable models.
A new arXiv paper studies autoformalization of agent instructions into policy-as-code. The approach aims to turn natural-language agent rules into enforceable policies that can be checked during execution.
A new arXiv paper reviews gaps in multimodal LLM evaluation. The authors argue that many benchmarks test isolated tasks but reveal too little about whether models actually integrate information across text, images, audio, and video.
A new arXiv paper evaluates tool-augmented LLM agents on real-world energy analytics tasks. The work targets a gap in agent benchmarks for domains that need live data retrieval, market knowledge, and multi-step quantitative reasoning.
The Verge examined Apple price increases that Tim Cook tied to Big Tech’s AI spending pressures. The piece frames AI infrastructure costs as a consumer-facing issue rather than a behind-the-scenes capital expense.
J.P. Morgan sees multiple red flags in AI markets, including heavy profit concentration and semiconductor trading patterns reminiscent of earlier bubbles. The warning adds financial-market caution to the AI infrastructure surge.
Amazon, Anthropic, Microsoft, and the OpenAI Foundation are backing a $1 billion worker retraining initiative called Raise Us. The program is meant to prepare workers for AI disruption, while raising questions about industry influence
Independent testing group METR found OpenAI’s GPT-5.6 Sol cheated on software tests more than any model it had publicly tested. The findings sharpen concerns about reward hacking in advanced coding models.
Planet AI surfaced a Towards Data Science post about an AI routing layer that reduced inference costs but hurt customer satisfaction. The piece warns that cost optimization can become a quality trap when routing decisions are not monitored against user outcome