LG Electronics
LG Electronics Toronto AI Lab

Route-Guided CBF-QP Repair for
Safe Vision-Language-Action Models

Chan Park1,3, Sunwoo Hong2,3, Kirak Kim2,3, Yoonjeong Park2,3,
Alexander W. Olson3, Ali Pesaranghader4,*

1Sungkyunkwan University  ยท  2KAIST  ยท  3University of Toronto  ยท  4LG Electronics, Toronto AI Lab
* Corresponding author

RSS 2026 Workshop on Trustworthy Embodied Foundation Models

Abstract

Vision-language-action (VLA) models can generate task-oriented robot actions, but they do not guarantee safe execution in obstacle-rich manipulation scenes. Although CBF-QP safety filters can locally project unsafe actions into a safe set, such correction may push the robot away from the learned task trajectory and leave the VLA policy without a reliable recovery direction. We propose Route-Guided CBF-QP Repair, a post-hoc repair module that uses the short-horizon action chunk predicted by the VLA to detect blocked nominal trajectories and generate entry-exit-rejoin guidance around obstacles. The selected route is added to the CBF-QP objective as a soft guidance term, while the CBF safety constraint remains hard. On SafeLIBERO, our method improves average collision avoidance, task success, and SafeSuccess compared with AEGIS.

Experimental Setup

  • VLA backbone: Both AEGIS and our method use the same OpenPI ฯ€โ‚€.โ‚… checkpoint fine-tuned on LIBERO (gs://openpi-assets/checkpoints/pi05_libero). Since the VLA backbone is fixed, the comparison isolates the effect of route-guided repair.
  • Baselines: AEGIS applies a post-hoc CBF-QP safety layer that projects unsafe VLA actions into the safe set. Route-Guided CBF-QP Repair (Ours) adds blocked-path detection, route candidate generation, and entry-exit-rejoin guidance to the QP objective while keeping the CBF constraint hard.
  • Benchmark: Evaluations are conducted on SafeLIBERO, which extends LIBERO-style language-conditioned manipulation with obstacle constraints. For task suites, safety levels, obstacle types, and evaluation protocol, please refer to the SafeLIBERO project page.
  • Evaluation protocol: Four suites โ€” Spatial, Goal, Object, and Long โ€” with 10 episodes per task. Metrics: Collision Avoidance Rate (CAR), Task Success Rate (TSR), SafeSuccess, and Execution Time Steps (ETS).

Quantitative Results

TABLE I  ยท  Quantitative results on the SafeLIBERO benchmark.

Method Metric SafeLIBERO Suite Average
Spatial Goal Object Long
AEGIS CAR (โ†‘) 63.75% 83.75% 56.25% 55.00% 64.69%
TSR (โ†‘) 60.00% 85.00% 67.50% 38.75% 62.81%
SafeSuccess (โ†‘) 52.50% 73.75% 41.25% 21.25% 47.19%
ETS (โ†“) 85.61 104.33 67.68 181.85 109.87
Route-Guided CBF-QP Repair (Ours) CAR (โ†‘) 66.25% 81.25% 76.25% 52.50% 69.06%
TSR (โ†‘) 65.00% 80.00% 72.50% 42.50% 65.00%
SafeSuccess (โ†‘) 53.75% 67.50% 55.00% 22.50% 49.69%
ETS (โ†“) 91.20 129.50 65.10 188.00 118.45

CAR โ€” Collision Avoidance Rate  ยท  TSR โ€” Task Success Rate  ยท  SafeSuccess โ€” successful task completion without collision  ยท  ETS โ€” Execution Time Steps. Arrows indicate direction of improvement (โ†‘ higher is better, โ†“ lower is better). Best results per metric and category are in bold.

TABLE II  ยท  Ablation study of route-guided CBF-QP components.

Components Average Performance
Path Gate Score Rejoin CAR (%) TSR (%) SafeSucc. (%) ETS
ร—ร—ร—ร— 64.6962.8147.19109.87
โœ“โœ“โœ“ร— 67.1263.9547.92112.50
โœ“โœ“ร—โœ“ 65.8863.1048.15114.12
โœ“โœ“โœ“โœ“ 69.0665.0049.69118.45

The first row is local CBF-QP repair (AEGIS) without blocked-path detection, route scoring, or rejoin. The full model (last row) achieves the best average CAR, TSR, and SafeSuccess.

Qualitative Comparisons

Representative cases where AEGIS completes the task with collision, while Route-Guided CBF-QP Repair achieves SafeSuccess through obstacle bypass and trajectory rejoin.

Case 1 โ€” put the cream cheese in the bowl

Suite / LevelGoal / II (task 3, ep 4)
Obstaclemilk_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 2 โ€” put the white mug on the left plate and put the yellow and white mug on the right plate

Suite / LevelLong / II (task 2, ep 1)
Obstacleyellow_book_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 3 โ€” pick up the bbq sauce and place it in the basket

Suite / LevelObject / II (task 3, ep 0)
Obstaclemoka_pot_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 4 โ€” pick up the chocolate pudding and place it in the basket

Suite / LevelObject / I (task 1, ep 0)
Obstaclewine_bottle_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 5 โ€” pick up the chocolate pudding and place it in the basket

Suite / LevelObject / I (task 1, ep 5)
Obstaclewine_bottle_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 6 โ€” pick up the chocolate pudding and place it in the basket

Suite / LevelObject / I (task 1, ep 6)
Obstaclewine_bottle_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 7 โ€” pick up the chocolate pudding and place it in the basket

Suite / LevelObject / I (task 1, ep 7)
Obstaclewine_bottle_obstacle_1
AEGISSuccess + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 8 โ€” pick up the black bowl on the ramekin and place it on the plate

Suite / LevelSpatial / II (task 1, ep 6)
Obstaclemilk_obstacle_1
AEGISFailure + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Case 9 โ€” pick up the black bowl on the ramekin and place it on the plate

Suite / LevelSpatial / II (task 1, ep 9)
Obstacleyellow_book_obstacle_1
AEGISFailure + Collision (unsafe)
OursSuccess + Safe (SafeSuccess)

AEGIS

Route-Guided CBF-QP Repair (Ours)

Citation

If you find this work useful, please cite:

@inproceedings{park2026routeguided,
  title     = {Route-Guided {CBF-QP} Repair for Safe Vision-Language-Action Models},
  author    = {Park, Chan and Hong, Sunwoo and Kim, Kirak and Park, Yoonjeong
               and Olson, Alexander W. and Pesaranghader, Ali},
  booktitle = {RSS 2026 Workshop on Trustworthy Embodied Foundation Models},
  year      = {2026}
}