CLAP paper proposes direct VLM-to-VLA adaptation to isolate semantic transfer
A new arXiv paper introduces CLAP, a method that converts pretrained vision-language models (VLMs) into vision-language-action models (VLAs) with minimal architectural changes, avoiding the distribution mismatch caused by predicting actions as bare numeric tokens. The approach aims to clarify how VLM capabilities transfer across model scales for robot control.
Entities
Related
LLM/VLA models enable prompt-driven exploration in RL
A new research paper proposes using large language models (LLMs) and vision-language-action (VLA) models to drive exploration in reinforcement learning by modifying natural language prompts, which induce global behavioral changes beyond standard action noise. This approach could help policies escape weak local optima more effectively.
VAORA reward design addresses VLM failures in interactive physical reasoning
A new paper on arXiv introduces VAORA (Visual Action Outcome Reasoning Alignment), a reward design that targets two key failure modes in vision-language models: hallucinated chain-of-thought reasoning and misalignment between reasoning and actions. VAORA uses a Visual Alignment Reward to anchor reasoning to visual context, aiming to improve generalization in unseen interactive physical reasoning tasks.
Robustifying Vision-Language Models via Test-Time Prompt Adaptation
A new arxiv paper proposes a test-time prompt adaptation method to improve robustness of Vision-Language Models like CLIP against adversarial perturbations. The approach leverages distributional structure rather than sample-level heuristics to distinguish adversarial mispredictions from true semantic consistency.
TCLA: Training-Free Few-Shot Adaptation for Medical VLMs
Researchers propose TCLA, a training-free method to adapt medical Vision-Language Models (VLMs) to out-of-distribution data using only a few examples. It corrects inference logits without additional trainable components, improving stability in low-data regimes like 1-shot. The method is model-agnostic and fast, addressing domain shifts and class bias in medical imaging.
Robbyant releases LingBot-Video, an open model that predicts future frames from action signals
Robbyant released LingBot-Video, an open-weight model that takes a first frame and an action signal to predict subsequent video frames. The model sparks debate on whether such action-conditioned video prediction qualifies as a world model, compared to approaches like Dreamer or JEPA.
