Spring Dataset and Benchmark Logo

Spring: L. Mehl, J. Schmalfuss, A. Jahedi, Y. Nalivayko, A. Bruhn — University of Stuttgart

RobustSpring: V. Oei, J. Schmalfuss, L. Mehl, M. Bartsch, S. Agnihotri, M. Keuper, A. Bulling, A. Bruhn — University of Stuttgart, University of Mannheim, MPI for Informatics

Not logged in | Login | Create Account

RAFT

Nov. 1, 2022, 2 p.m.  —  Public

đŸ’¡ submitted by spring team | Z. Teed, and J. Deng. "RAFT: Recurrent All-Pairs Field Transforms for Optical Flow." In European Conference on Computer Vision (ECCV), 2020.

Code: https://github.com/princeton-vl/RAFT

Optical Flow

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
rigid
1px
non-rigid
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
6.790 6.426 64.087 5.999 39.481 4.107 27.088 5.250 30.183 3.134 5.301 41.403
 
EPE
total
EPE
low-detail
EPE
high-detail
EPE
matched
EPE
unmatched
EPE
rigid
EPE
non-rigid
EPE
not sky
EPE
sky
EPE
s0-10
EPE
s10-40
EPE
s40+
1.476 1.406 12.523 1.306 8.511 1.168 3.813 0.714 13.069 0.469 0.620 12.222
 
Fl
total
Fl
low-detail
Fl
high-detail
Fl
matched
Fl
unmatched
Fl
rigid
Fl
non-rigid
Fl
not sky
Fl
sky
Fl
s0-10
Fl
s10-40
Fl
s40+
3.198 3.019 31.379 2.773 20.776 2.335 9.731 2.094 19.979 1.355 3.148 18.751
 
WAUC
total
WAUC
low-detail
WAUC
high-detail
WAUC
matched
WAUC
unmatched
WAUC
rigid
WAUC
non-rigid
WAUC
not sky
WAUC
sky
WAUC
s0-10
WAUC
s10-40
WAUC
s40+
90.920 91.222 43.347 91.631 61.506 93.362 72.445 92.281 70.236 94.305 91.820 60.169

Robustness Evaluation (Overall)

EPE
total
Fl
total
1px
total
5.640 11.470 20.180

Robustness per Corruption

Robustness Evaluation (Per-Corruption)

Corruption EPE Fl 1px
Brightness 0.920 1.610 3.490
Contrast 1.320 2.640 5.730
Saturate 0.930 1.470 3.330
Defocus Blur 1.030 2.070 4.700
Gaussian Blur 1.100 2.260 5.120
Glass Blur 1.050 1.970 5.130
Motion Blur 2.060 6.350 14.330
Zoom Blur 3.140 7.610 22.800
Gaussian Noise 7.430 18.990 27.920
Impulse Noise 6.510 18.320 29.650
Speckle Noise 6.620 16.480 26.050
Shot Noise 6.740 17.080 25.640
Pixelate 1.650 2.000 21.470
JPEG Compression 3.190 13.670 37.720
Elastic Transform 1.330 4.780 19.430
Fog 1.970 7.110 12.010
Frost 8.370 21.760 32.750
Rain 42.410 31.990 38.890
Snow 7.160 31.370 37.040
Spatter 7.980 19.870 30.370
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
Error visualization color code
blue to white to red error visualization color code