arXiv:2611.20765v1 Announce Type: cross
Abstract: Multimodal reinforcement learning (MRL) offers a promising paradigm for autonomous driving by jointly leveraging complementary sensor observations to learn effective decision-making policies. However, its effectiveness critically depends on temporal alignment across modalities, making temporal inconsistency a fundamental vulnerability. Even subtle misalignment or latency can corrupt fused representations and ultimately lead to decision failures. Existing studies have explored adversarial attacks to induce cross-modal temporal inconsistencies, thereby enabling systematic evaluation of the temporal robustness of MRL policies. However, existing methods remain limited in generality, realism, and adaptivity. To address these limitations, we propose the Split Temporal Adversary (STA), which formulates multimodal temporal attacks as a unified decision process that jointly optimizes attack timing and modality selection under realistic policy-aware and budget-constrained settings. STA includes two mechanisms: a) a unified multimodal temporal perturbation mechanism that delays observations via historical states, removing the need for modality-specific noise; b) a split multimodal adversarial decision mechanism that jointly optimizes attack timing and modality selection through adaptive optimization while leveraging the victim policy’s clean actions to identify sensitive decision patterns. We provide a theoretical analysis of the induced distribution shift and a modality selection principle. Experiments in the CARLA simulator show that STA more than doubles the collision rate of the strongest baseline against PPO while using 17.8\% fewer attack attempts, and that it generalizes to a VLM-based driving policy. These results reveal temporal consistency as a critical vulnerability, highlighting temporal robustness as essential for safe autonomous driving.
Trending
- Chips can survive the space environment. Can their financing?
- Prescribed Bayesian Efficiency under Lifetime Adjustment Costs
- Robot Videos: Morphing Robots, Dancing Humanoids, More
- You Can Reveal The Full GTA 6 Map In Minutes Using This Simple Plane Trick
- State-Space Compression for AI-Based Radio Resource Management of Vehicular Services
- The 23 Best Early Black Friday Deals: Our Ultimate Picks (2026)
- SplitReAlign: Partition-Aware Representation Realignment for Split Federated Unlearning
- Efficient Hybrid LLM Serving with Transparent Cache Management and Layer-Wise Streaming
