Spring Dataset and Benchmark Logo

Spring: L. Mehl, J. Schmalfuss, A. Jahedi, Y. Nalivayko, A. Bruhn — University of Stuttgart

RobustSpring: V. Oei, J. Schmalfuss, L. Mehl, M. Bartsch, S. Agnihotri, M. Keuper, A. Bulling, A. Bruhn — University of Stuttgart, University of Mannheim, MPI for Informatics

Not logged in | Login | Create Account

FlowFormer

Nov. 1, 2022, 2 p.m.  —  Public

đŸ’¡ submitted by spring team | Z. Huang, X. Shi, C. Zhang, Q. Wang, K. C. Cheung, H. Qin, J. Dai, and H. Li. "FlowFormer: A Transformer Architecture for Optical Flow." In European Conference on Computer Vision (ECCV), 2022.

Code: https://github.com/drinkingcoder/FlowFormer-Official

Optical Flow

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
rigid
1px
non-rigid
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
6.510 6.144 64.219 5.766 37.294 3.527 29.084 5.500 21.858 3.381 5.530 35.344
 
EPE
total
EPE
low-detail
EPE
high-detail
EPE
matched
EPE
unmatched
EPE
rigid
EPE
non-rigid
EPE
not sky
EPE
sky
EPE
s0-10
EPE
s10-40
EPE
s40+
0.723 0.648 12.524 0.565 7.258 0.299 3.934 0.694 1.164 0.217 0.429 5.753
 
Fl
total
Fl
low-detail
Fl
high-detail
Fl
matched
Fl
unmatched
Fl
rigid
Fl
non-rigid
Fl
not sky
Fl
sky
Fl
s0-10
Fl
s10-40
Fl
s40+
2.384 2.198 31.650 1.985 18.903 1.318 10.449 2.144 6.027 0.922 3.146 12.556
 
WAUC
total
WAUC
low-detail
WAUC
high-detail
WAUC
matched
WAUC
unmatched
WAUC
rigid
WAUC
non-rigid
WAUC
not sky
WAUC
sky
WAUC
s0-10
WAUC
s10-40
WAUC
s40+
91.679 91.987 43.233 92.358 63.606 94.349 71.477 92.498 79.235 94.779 91.913 65.110

Robustness Evaluation (Overall)

EPE
total
Fl
total
1px
total
3.770 11.210 21.530

Robustness per Corruption

Robustness Evaluation (Per-Corruption)

Corruption EPE Fl 1px
Brightness 0.680 1.050 2.820
Contrast 0.930 1.960 5.480
Saturate 0.420 0.880 2.390
Defocus Blur 0.550 1.190 3.850
Gaussian Blur 0.630 1.370 4.320
Glass Blur 0.640 1.170 4.040
Motion Blur 1.350 5.770 14.030
Zoom Blur 1.660 6.770 22.720
Gaussian Noise 6.560 18.300 27.830
Impulse Noise 7.330 14.470 23.580
Speckle Noise 5.470 15.600 25.520
Shot Noise 5.750 16.010 26.020
Pixelate 1.480 2.590 31.680
JPEG Compression 2.890 14.960 42.620
Elastic Transform 2.620 11.010 35.780
Fog 0.860 5.670 9.660
Frost 8.180 23.870 34.190
Rain 11.130 20.830 33.500
Snow 7.920 33.820 40.200
Spatter 8.410 26.920 40.380
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
reference frame
Reference Frame
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
Error visualization color code
blue to white to red error visualization color code