Spring Dataset and Benchmark Logo

L. Mehl, J. Schmalfuss, A. Jahedi, Y. Nalivayko, A. Bruhn — University of Stuttgart

Not logged in | Login | Create Account

M-FUSE (F)

Nov. 1, 2022, 2 p.m.  —  Public

💡 submitted by spring team | L. Mehl, A. Jahedi, J. Schmalfuss, and A. Bruhn. "M-FUSE: Multi-frame Fusion for Scene Flow Estimation." In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023.

Code: https://github.com/cv-stuttgart/M-FUSE

Scene Flow

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
rigid
1px
non-rigid
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
34.896 34.298 64.324 32.028 71.943 29.810 73.377 31.355 88.712 29.890 23.911 69.148
 
SF
total
SF
low-detail
SF
high-detail
SF
matched
SF
unmatched
1px
rigid
1px
non-rigid
SF
not sky
SF
sky
SF
s0-10
SF
s10-40
SF
s40+
16.103 15.748 33.553 13.554 49.034 12.847 40.735 13.050 62.502 14.262 8.188 38.919

Disparity 1

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
19.888 19.547 40.396 17.611 65.086 16.735 67.805 19.076 13.861 39.412
 
Abs
total
Abs
low-detail
Abs
high-detail
Abs
matched
Abs
unmatched
Abs
not sky
Abs
sky
Abs
s0-10
Abs
s10-40
Abs
s40+
3.884 3.850 5.934 2.795 25.485 2.443 25.771 5.440 1.759 7.272
 
D1
total
D1
low-detail
D1
high-detail
D1
matched
D1
unmatched
D1
not sky
D1
sky
D1
s0-10
D1
s10-40
D1
s40+
9.194 9.116 13.884 7.321 46.378 7.417 36.191 9.609 6.293 17.062

Disparity 2

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
24.256 23.925 44.192 21.867 63.259 21.262 69.755 23.327 17.005 47.656
 
Abs
total
Abs
low-detail
Abs
high-detail
Abs
matched
Abs
unmatched
Abs
not sky
Abs
sky
Abs
s0-10
Abs
s10-40
Abs
s40+
4.069 4.035 6.114 2.975 21.928 2.636 25.854 5.572 1.903 7.682
 
D2
total
D2
low-detail
D2
high-detail
D2
matched
D2
unmatched
D2
not sky
D2
sky
D2
s0-10
D2
s10-40
D2
s40+
10.171 10.095 14.755 8.195 42.439 8.439 36.495 10.316 6.800 19.956

Optical Flow

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
rigid
1px
non-rigid
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
20.374 19.993 80.398 19.382 61.415 15.312 58.668 18.381 50.653 9.734 29.588 84.458
 
EPE
total
EPE
low-detail
EPE
high-detail
EPE
matched
EPE
unmatched
EPE
rigid
EPE
non-rigid
EPE
not sky
EPE
sky
EPE
s0-10
EPE
s10-40
EPE
s40+
2.948 2.833 21.047 2.678 14.103 2.106 9.317 2.003 17.308 1.051 1.444 22.886
 
Fl
total
Fl
low-detail
Fl
high-detail
Fl
matched
Fl
unmatched
Fl
rigid
Fl
non-rigid
Fl
not sky
Fl
sky
Fl
s0-10
Fl
s10-40
Fl
s40+
8.791 8.495 55.544 8.111 36.942 6.205 28.360 6.792 39.181 3.447 10.080 50.018
 
WAUC
total
WAUC
low-detail
WAUC
high-detail
WAUC
matched
WAUC
unmatched
WAUC
rigid
WAUC
non-rigid
WAUC
not sky
WAUC
sky
WAUC
s0-10
WAUC
s10-40
WAUC
s40+
76.550 76.869 26.430 77.376 42.373 80.436 47.151 78.420 48.138 84.778 70.287 24.665
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
Error visualization color code
blue to white to red error visualization color code