Peyash's Log

What's New — Tuesday, August 11, 2026

← latest digest ← 2026-08-10 2026-08-12 →

Papers 8

  • DuplexGen: Adaptive Synthesis of Human-AI Turn-Taking Dialogues

    UIUC · Seoul National · Columbia · Berkeley · Georgia Tech ▲5

    Generates dialogue data with scenario-adaptive turn-taking by calibrating LLM predictions against a small set of slot-level human preference annotations, rather than scaling the corpus or tuning prompts. Across six cooperative and competitive tasks where human turn-taking preferences genuinely differ, models trained on its data track those preferences better than uncalibrated prompting or generic human-human speech.

    Turn-taking is the hard part of full-duplex voice agents, and the claim here is that human calibration — not corpus scale — is what makes it scenario-specific.

    #speech-ai #turn-taking #dialogue #datasets HF ↗

  • FATE: Frame-Level Audio-Visual Temporal Embedding

    Kaisi Guan et al. ▲7

    Keeps frame-level sequences from both encoders instead of pooling each modality into a single vector, aligns audio and video on the physical timeline, and scores cross-modal similarity as the mean inner product over aligned frame pairs — trained with a semantic contrastive loss across videos plus a temporal soft-contrastive loss within them. Intra-video V2A Recall@3 of 55.74% against Synchformer's 38.89%, and 48.3% zero-shot on AVE event localization, matching supervised baselines.

    Captures synchronization rather than just semantics — the same frame-level alignment problem that forced alignment and word-level timing run into.

    #audio #temporal-alignment #representation-learning HF ↗

  • When Activation Oracles Learn Not to Read: Concept-Specific Blind Spots in Fine-Tuned Oracles

    BAISH · Queen Mary University of London ▲0

    Fine-tuning a model to answer questions about another model's activations turns it into a concept-specific anti-reader. On Taboo Word Guessing, exact recovery drops from 94% with a base oracle to 35% with an oracle fine-tuned on the matching concept, while cross-trained oracles do better. Linear probes confirm the concept is still decodable inside the fine-tuned oracle, and layer ablations localize the suppression to readout layers L18–L23.

    A clean negative result about interpretability tooling itself: training a probe on the concept you care about can be exactly what blinds it.

    #interpretability #probing #evals HF ↗

  • MatrAIx: Simulating the World with 8.3 Billion Persona Agents

    MIT · Harvard ▲498

    Simulated-user evaluation infrastructure: 8.3 billion persona records across 1,290 categorical dimensions (1M released publicly, 599,847 of them human-grounded), a playground with Survey, Chatbot, Web, and App environments, and 1,010 reusable task specs across 25+ domains. 18,189 evaluation trials were run; a 400-trial controlled study found 91.5% behavioral adherence.

    The day's runaway top paper at 498 upvotes, and a serious attempt at population-scale simulated-user eval for cases where human evaluation is the bottleneck.

    #evals #simulated-users #benchmarks HF ↗

  • SPOT: Sparse Probing and Outcome Calibration for On-Policy Distillation

    CUHK-Shenzhen · East China Normal · Beihang · City University of Hong Kong ▲14

    Targets a known failure of on-policy distillation: standard reverse-KL training under-weights other plausible continuations. SPOT uses an acquisition-exploration-exploitation procedure — normalized teacher entropy, top-k probability mass, student-teacher mismatch — to choose where to probe, then derives outcome-calibrated targets from verifier-scored continuations anchored to the teacher distribution.

    A concrete fix for reverse-KL mode-seeking in student-from-teacher training, pairing uncertainty probing with verifier-based calibration.

    #llm-distillation #on-policy-training #verifier-calibration HF ↗

  • RoMeRL: Balancing Feedback Coverage and the Memory-Reward Trap in Self-Evolving Agent Memory

    Nanjing · Xiamen · Zhejiang University ▲8

    Identifies a "memory-reward trap" where co-retrieved memories in self-evolving agents receive misleading utility updates despite contributing little causally to task success. Replacing expanding trajectory-indexed utilities with a fixed four-dimensional state organized by outcome polarity and memory dynamics gives 80% fewer cold-start utilities, 6× higher feedback density, an 84.4% smaller memory footprint, and 21.1% fewer LLM calls — with no change to the base model.

    Credit assignment in agent memory is an under-examined failure mode, and the entire win comes from bookkeeping rather than a bigger model.

    #agent-memory #credit-assignment #efficiency HF ↗

  • OneEmo: A Unified Multimodal Reasoning Model for Emotion

    Tongji · Fujian Normal · Shenzhen Tech · HK PolyU ▲9

    Introduces EmoWorld-130K, a 130k-sample corpus with psychology-grounded reasoning traces across eight emotion tasks, plus Emo-Chord, a multi-task RL strategy pairing an offline cold start with online exploration. The 4.5B model beats Gemini-3.1-Pro by 3.08 points on intent recognition and reaches 72.48% average WAF on basic emotion recognition.

    Worth noting for the dataset — but it is vision-language only, with no audio path, which is precisely the gap for paralinguistics from speech.

    #emotion #multimodal #datasets HF ↗

  • Evidence-RL: Towards Evidence-intensive Visual Reasoning

    hhj-ai et al. ▲3

    GRPO post-training with a counterfactual reward: neutralize the hypothesized evidence region via mean-token replacement, then reward answers whose confidence actually drops — pushing the model off language priors and dataset shortcuts. Trained on 15,314 filtered COCO samples and evaluated on nine benchmarks across three backbones, with no inference-time overhead.

    Rewards causal reliance on evidence rather than plausible-sounding output, and the counterfactual-ablation trick generalizes past vision to any grounding eval.

    #evals #interpretability #rl-post-training HF ↗

Tech radar 23

  • Prefill-decode kernel mismatch quietly corrupts RL training

    @yifanzhang_

    Equal checkpoints are not an on-policy guarantee: the effective policy is parameters plus execution path, so prefill and decode kernels silently diverge and corrupt the training signal.

    A train/inference mismatch caused by the serving stack rather than the model — the class of harness effect that silently invalidates eval and RL results.

    #rl-scaling #inference-serving #eval-methodology X ↗

  • Meta releases Muse Glimmer 30B — Apache 2.0, 18GB RAM, vision

    Daniel Han (Unsloth AI)

    Open weights, runs locally in 18GB RAM with vision support, pitched as the strongest agentic-coding model at its size.

    A permissively licensed 30B that fits on one consumer machine is a real option for local eval harnesses and tool-use experiments.

    #model-release #open-weights #agentic-coding LinkedIn ↗

  • Muse Glimmer — the official release

    @AIatMeta

    Open weights on Hugging Face, a technical blog, and developer resources, positioned for local AI agents on everyday hardware.

    The primary source for the day's biggest open-weights release, with a published technical report.

    #model-release #open-weights #meta X ↗

  • Programmatic tool calling beats JSON on 11 of 14 models

    DAIR.AI

    Tools exposed as typed Python stubs invoked through code, compared against native JSON tool calling across 14 models on BFCL v4. The GPT-5.6 family gains 10.6% over the JSON baseline.

    Tool-calling format is normally treated as a fixed default; this quantifies it as a measurable accuracy lever on a standard agentic benchmark.

    #benchmark #tool-calling #eval-methodology LinkedIn ↗

  • Another same-model-different-harness sweep

    Composio, via @tokenbender

    DeepSeek V4 Flash run through four more agent harnesses — Hermes, Pi, Prime, Deep Agent — to isolate how much the harness rather than the model drives agentic scores.

    Reinforces yesterday's SWE-bench Pro finding: agentic leaderboards measure the scaffold as much as the model.

    #agent-harness #benchmarking #eval-methodology X ↗

  • Sync API — text in as few as ~134ms after speech ends

    AssemblyAI

    Synchronous speech-to-text completing a three-tier lineup alongside Realtime, which returns text during speech, and async batch. Post is about three weeks old, resurfaced in the feed.

    Speaks to STT latency tiering and the turn-end latency budget for voice agents. (Disclosure: I work on this.)

    #speech-to-text #latency #realtime LinkedIn ↗

  • The HF speech-to-speech stack, restated with the API-compatibility angle

    Hao Hoang

    VAD → STT → LLM → TTS as four swappable components behind an OpenAI Realtime-compatible WebSocket API, so existing clients switch by changing one URL.

    The same release covered in yesterday's digest, resurfacing — the point that each stage stays independently benchmarkable is the part worth keeping.

    #speech-to-speech #voice-agents #open-source LinkedIn ↗

  • SGLang v0.5.17: Kimi K3 in main, DSpark speculative decoding, 1M context

    SGLang

    KDA-aware prefix caching and DCP for 1M-token context, running on both NVIDIA and AMD; MiniMax-H3 added to SGLang-Diffusion.

    Serving-stack support for long context and speculative decoding, with verified recipes for both GPU vendors.

    #inference #speculative-decoding #long-context LinkedIn ↗

  • Muse Glimmer 30B day-0 serving numbers

    @Prince_Canuma

    Roughly 400 tok/s prefill and 33 tok/s decode on a single request via Nativ, with throughput holding out to 128K context.

    Day-0 numbers including the long-context throughput claim that usually degrades — useful reference points for inference benchmarking.

    #inference-serving #throughput #long-context X ↗

  • 2-bit Muse Glimmer made 100+ tool calls on 14GB RAM

    Unsloth AI

    A five-minute repo bug hunt that produced evidence, a repro, a fix, tests, and a PR writeup.

    Evidence that aggressive 2-bit quantization survives long multi-step tool-calling chains, not just single-turn generation.

    #quantization #gguf #agentic-ai LinkedIn ↗

  • Kimi K3 at 1-bit: 1.56TB → 594GB, ~78.9% accuracy retained

    Daniel Han (Unsloth AI)

    The 2-bit variant at 861.3GB reaches roughly 90%. Runs on a Mac Studio with a 128GB RAM device attached.

    A concrete accuracy-versus-size curve for extreme quantization of a 2.8T-parameter frontier open model.

    #quantization #kimi-k3 #local-inference LinkedIn ↗

  • OpenAI ships GPT-5.6-Cyber, a defense-scoped model

    @sama, quoting Eric Wallace

    Described as OpenAI's first large-scale attempt at directly improving cyber-defense capability, with the framing that defenders should use it to harden their own systems.

    A frontier lab shipping a domain-specialized model rather than a general upgrade, with a stated defensive-security target.

    #model-release #openai #cybersecurity X ↗

  • Ant Ling open-weights an 8B MoE with 1.3B active params

    Tom Aarsen (Hugging Face)

    Following Ling-3.0-flash, positioned against similarly sized Qwen and Gemma models.

    A sparse 8B at 1.3B active parameters is an efficiency point worth benchmarking against dense models in the same class.

    #model-release #moe #efficiency LinkedIn ↗

  • Prefill on a DGX Spark, decode on a MacBook

    Daniel Isaac, via @0xSero

    One model split across two machines, using each box for the phase it is better suited to.

    Disaggregated prefill/decode is normally a datacenter technique; doing it across consumer and workstation hardware is a novel take on local serving economics.

    #heterogeneous-inference #prefill-decode #local-inference X ↗

  • Exploration as a third pre-training scaling axis

    Maxime Labonne (Liquid AI)

    Beyond parameters and data: how many candidate outputs a model tries at each training step. Motivated by mode-averaging, where one input maps to many valid outputs and the plain loss lands on a blurred average.

    Mode-averaging on one-to-many targets is exactly the failure mode in generative speech tasks like TTS.

    #pretraining #scaling #research-paper LinkedIn ↗

  • Meta's coupled scaling law, with the error numbers attached

    Elvis S.

    Couples model capacity and data through a single interaction exponent rather than treating them independently, cutting mean absolute percentage error 1.5–3× on both interpolation and extrapolation, with the largest corrections in data-scarce and heavy-overtraining regimes.

    The same Skaling paper picked up yesterday, now with the error reduction quantified and the regimes where it actually bites.

    #scaling-laws #pretraining LinkedIn ↗

  • Spotify open-sources Xirp, its multi-vendor agent environment

    @SpotifyEng

    A vendor-neutral agentic development environment managing agent sessions across Claude Code, Gemini CLI, and OpenAI Codex from one place, with 1,300+ Spotify engineers already using it internally.

    A large engineering org shipping its internal agent orchestration layer with a real adoption number attached.

    #agentic-ai #coding-tools #developer-tooling X ↗

  • Pi ships four tools total: read, bash, edit, write

    @pidotdev

    The argument being that this minimal set covers most coding work.

    Deliberate minimalism against the trend of expanding tool surfaces — it bears on how much agent performance comes from tool design versus model capability.

    #agentic-ai #tool-use #coding-agents X ↗

  • Measuring prefix caching mostly found a bug in the harness

    Rudragouda Patil

    A week on two consumer GPUs with a chat workload that replays the whole conversation each turn; the measurement surfaced a bug unrelated to caching, which the author argues was the more useful result.

    Benchmarking harnesses routinely measure their own defects before they measure the feature under test.

    #benchmarking #inference #measurement LinkedIn ↗

  • TLX on AMD MI350X: 1.8× on fused GEMM+GLU

    Stanley Winata (AMD)

    Triton Low-Level Language Extensions against the existing baseline on Instinct MI350X.

    Kernel-level headroom on AMD matters for anyone evaluating non-NVIDIA inference paths.

    #gpu-kernels #amd #inference-optimization LinkedIn ↗

  • An unreleased Claude took a run at the Riemann hypothesis

    @lukaszkaiser

    It did not solve it, but the attempt was substantive enough that Kaiser, at OpenAI, joked about wanting a prediction market on the problem falling this year.

    Frontier-math attempts from unreleased checkpoints are one of the few public capability signals ahead of release, and a rival lab researcher's reaction is itself informative.

    #frontier-math #reasoning #capability-signals X ↗

  • Primus: prompt to paper in one agent loop

    Jay Alammar, sharing Ali Asaria

    Transformer Lab's agent takes a single prompt through the full ML-research loop.

    Another automated-research agent, and a useful eval target given this category's known failure modes around hallucinated results and fabricated citations.

    #agentic-ai #research-automation LinkedIn ↗

  • SGLang as the serving layer in a commercial managed-infra play

    @TechFollowrazzi

    radixark is turning open-source AI systems into managed infrastructure, with SGLang handling model serving.

    A small signal about which open inference engines are winning production adoption.

    #inference-serving #sglang #managed-infrastructure X ↗

Briefly noted 16

  • Dylan Fox (AssemblyAI) (LinkedIn) — Over 120 million weekly voice conversations handled in Q2 — the highest volume yet — across phone-call voice agents, contact-center automation, healthcare ambient scribes, and consumer apps. (Disclosure: I work there.)
  • Sebastian Raschka (LinkedIn) — The LLMs-from-scratch repository passed 100,000 GitHub stars.
  • Leonie Monigatti (Liquid AI) (LinkedIn) — A fine-tuning cookbook covering text, vision, audio, and encoder models across CPT, SFT, DPO, and GRPO, with Unsloth and TRL notebooks.
  • Ahmed Haroon (LinkedIn) — Walkthrough of vLLM internals: continuous batching, paged attention, prefix caching, disaggregated prefill/decode, and speculative decoding.
  • Thomas J. Fan (Modal) (LinkedIn) — Running the PyTorch profiler without a local GPU, with traces saved locally for inspection.
  • Massimiliano Viola (LinkedIn) — Writeup on HGNetV2, the backbone behind real-time detectors like D-FINE and DEIMv2, which never had its own arXiv paper.
  • Jiri Borovec (Roboflow) (LinkedIn) — trackers 2.6.0 adds dynamic frame-rate support for object tracking on live video with variable frame timing.
  • Charles Maddock (LinkedIn) — Spotify's Xirp vibe-coding platform, reportedly used daily by around 99% of Spotify's developers.
  • @OwainEvans_UK (X) — Moonshot, the lab behind Kimi K3, appears to have only 400–500 staff, against roughly 5,000 at Anthropic.
  • @AndrewCurran_ (X) — Follow-on point: the Chinese labs went from zero to the frontier in just over two years, which is arguably more remarkable than the headcount gap.
  • @0xMarioNawfal (X) — Clip of the creator of Claude Code claiming 90% of their engineers now run dozens or hundreds of agents simultaneously.
  • @trq212 (X) — Argues AI work rewards two skills: compute allocation — deciding where to spend model effort when there is no task list — and verification.
  • @drfeifei (X) — A 2h08m Huberman Lab episode on using AI to increase intelligence, covering vision, human perception's contribution to AI, and the computer-vision revolution.
  • Carlos E. Perez (X) — Carl Feynman announced he has stopped doing AI research and has been trying to talk peers out of it, calling current models superhuman in many ways and aggressively out of control.
  • Pedro Domingos (X) — Endorses Mark Zuckerberg's essay on Meta's superintelligence philosophy as a needed dose of common sense in the AI debate.
  • CJ Zafir (X) — Claims DeepSeek Flash 0731, run inside the Hermes or Pi harness, surfaces deep-research findings that Fable 5 and GPT 5.6 deep-research modes missed.

Past days

August 2026

MTWTFSS 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31