Spring Dataset and Benchmark Logo

Spring: L. Mehl, J. Schmalfuss, A. Jahedi, Y. Nalivayko, A. Bruhn — University of Stuttgart

RobustSpring: V. Oei, J. Schmalfuss, L. Mehl, M. Bartsch, S. Agnihotri, M. Keuper, A. Bulling, A. Bruhn — University of Stuttgart, University of Mannheim, MPI for Informatics

Not logged in | Login | Create Account

RoCo-67-M02

Oct. 1, 2026, 8:01 a.m.  —  Public

Private diagnostic: FP32 clean and 18 corruptions; FP16 forward for spatter and speckle_noise. Same checkpoint, overlap 0.9. Mixed inference precision; matched-setting RoCo eligibility is not claimed.

 

Stereo

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
7.135 6.824 25.907 5.940 30.855 7.371 3.551 2.935 7.757 13.246
 
Abs
total
Abs
low-detail
Abs
high-detail
Abs
matched
Abs
unmatched
Abs
not sky
Abs
sky
Abs
s0-10
Abs
s10-40
Abs
s40+
0.471 0.452 1.610 0.371 2.451 0.470 0.482 0.264 0.462 0.889
 
D1
total
D1
low-detail
D1
high-detail
D1
matched
D1
unmatched
D1
not sky
D1
sky
D1
s0-10
D1
s10-40
D1
s40+
2.705 2.658 5.541 2.094 14.837 2.762 1.836 1.239 3.777 2.287

Robustness Evaluation (Overall)

1px
total
Abs
total
D1
total
22.979 2.436 4.488

Robustness per Corruption

Robustness Evaluation (Per-Corruption)

Corruption 1px Abs D1
Brightness 2.662 0.303 0.467
Contrast 5.058 0.375 0.562
Defocus Blur 3.008 0.340 0.421
Elastic Transform 60.476 1.682 0.520
Fog 5.982 0.555 0.676
Frost 32.104 7.178 16.047
Gaussian Blur 3.837 0.426 0.551
Gaussian Noise 21.028 1.614 2.934
Glass Blur 3.744 0.414 0.460
Impulse Noise 27.623 2.515 4.551
JPEG Compression 44.450 4.231 5.773
Motion Blur 7.498 1.308 1.866
Pixelate 29.420 1.394 1.633
Rain 37.978 3.901 9.076
Saturate 2.141 0.206 0.270
Shot Noise 19.087 1.392 2.408
Snow 36.421 4.886 12.001
Spatter 34.001 7.566 16.353
Speckle Noise 20.284 1.364 2.120
Zoom Blur 62.785 7.072 11.063
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
Error visualization color code
blue to white to red error visualization color code