Spring Dataset and Benchmark Logo

Spring: L. Mehl, J. Schmalfuss, A. Jahedi, Y. Nalivayko, A. Bruhn — University of Stuttgart

RobustSpring: V. Oei, J. Schmalfuss, L. Mehl, M. Bartsch, S. Agnihotri, M. Keuper, A. Bulling, A. Bruhn — University of Stuttgart, University of Mannheim, MPI for Informatics

Not logged in | Login | Create Account

RoCo-67-M03

Oct. 1, 2026, 9:02 a.m.  —  Public

Fixed 8-candidate Tile Global selection, overlap 0.7, FP16. Clean: forward-only AMP; corruptions: whole-call AMP on different GPUs. This numerical-scope difference is retained; exact matched-setting eligibility is not claimed.

 

Stereo

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
7.283 6.963 26.589 6.081 31.151 7.511 3.819 3.046 7.874 13.558
 
Abs
total
Abs
low-detail
Abs
high-detail
Abs
matched
Abs
unmatched
Abs
not sky
Abs
sky
Abs
s0-10
Abs
s10-40
Abs
s40+
0.474 0.454 1.624 0.378 2.371 0.474 0.474 0.256 0.461 0.923
 
D1
total
D1
low-detail
D1
high-detail
D1
matched
D1
unmatched
D1
not sky
D1
sky
D1
s0-10
D1
s10-40
D1
s40+
2.725 2.675 5.693 2.128 14.568 2.778 1.908 1.279 3.753 2.397

Robustness Evaluation (Overall)

1px
total
Abs
total
D1
total
21.162 2.040 3.903

Robustness per Corruption

Robustness Evaluation (Per-Corruption)

Corruption 1px Abs D1
Brightness 2.164 0.193 0.267
Contrast 5.608 0.390 0.582
Defocus Blur 3.150 0.324 0.386
Elastic Transform 56.878 1.586 0.528
Fog 6.437 0.565 0.649
Frost 32.256 6.555 15.589
Gaussian Blur 3.965 0.394 0.490
Gaussian Noise 20.082 1.310 2.063
Glass Blur 3.670 0.390 0.412
Impulse Noise 23.888 1.760 2.772
JPEG Compression 39.967 3.066 4.260
Motion Blur 7.630 1.065 1.708
Pixelate 11.331 0.723 0.507
Rain 35.004 3.403 7.645
Saturate 2.265 0.199 0.296
Shot Noise 18.213 1.141 1.698
Snow 34.587 4.348 11.253
Spatter 33.856 5.837 15.151
Speckle Noise 19.113 1.181 1.636
Zoom Blur 63.183 6.375 10.167
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
Error visualization color code
blue to white to red error visualization color code