Spring Dataset and Benchmark Logo

L. Mehl, J. Schmalfuss, A. Jahedi, Y. Nalivayko, A. Bruhn — University of Stuttgart

Not logged in | Login | Create Account

M-FUSE (K)

Nov. 1, 2022, 2 p.m.  —  Public

💡 submitted by spring team | L. Mehl, A. Jahedi, J. Schmalfuss, and A. Bruhn. "M-FUSE: Multi-frame Fusion for Scene Flow Estimation." In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023.

Code: https://github.com/cv-stuttgart/M-FUSE

Scene Flow

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
rigid
1px
non-rigid
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
62.490 62.291 72.306 60.574 87.247 60.385 78.416 60.032 99.850 82.966 49.200 75.963
 
SF
total
SF
low-detail
SF
high-detail
SF
matched
SF
unmatched
1px
rigid
1px
non-rigid
SF
not sky
SF
sky
SF
s0-10
SF
s10-40
SF
s40+
25.232 24.935 39.807 22.333 62.680 22.616 45.023 20.362 99.244 31.990 15.060 44.937

Disparity 1

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
52.232 52.185 55.051 50.647 83.685 49.104 99.771 80.774 34.056 52.347
 
Abs
total
Abs
low-detail
Abs
high-detail
Abs
matched
Abs
unmatched
Abs
not sky
Abs
sky
Abs
s0-10
Abs
s10-40
Abs
s40+
7.890 7.907 6.908 6.715 31.222 4.143 64.840 16.260 2.836 7.103
 
D1
total
D1
low-detail
D1
high-detail
D1
matched
D1
unmatched
D1
not sky
D1
sky
D1
s0-10
D1
s10-40
D1
s40+
19.836 19.798 22.085 17.671 62.816 14.618 99.136 34.182 11.009 18.971

Disparity 2

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
57.029 57.013 58.037 55.430 83.141 54.216 99.791 83.191 39.742 58.972
 
Abs
total
Abs
low-detail
Abs
high-detail
Abs
matched
Abs
unmatched
Abs
not sky
Abs
sky
Abs
s0-10
Abs
s10-40
Abs
s40+
8.076 8.093 7.057 6.893 27.392 4.336 64.916 16.396 2.983 7.486
 
D2
total
D2
low-detail
D2
high-detail
D2
matched
D2
unmatched
D2
not sky
D2
sky
D2
s0-10
D2
s10-40
D2
s40+
21.536 21.510 23.126 19.252 58.823 16.436 99.050 35.615 12.224 22.609

Optical Flow

1px
total
1px
low-detail
1px
high-detail
1px
matched
1px
unmatched
1px
rigid
1px
non-rigid
1px
not sky
1px
sky
1px
s0-10
1px
s10-40
1px
s40+
20.979 20.600 80.743 19.942 63.882 15.953 59.005 19.500 43.455 10.131 30.966 84.713
 
EPE
total
EPE
low-detail
EPE
high-detail
EPE
matched
EPE
unmatched
EPE
rigid
EPE
non-rigid
EPE
not sky
EPE
sky
EPE
s0-10
EPE
s10-40
EPE
s40+
2.526 2.408 21.176 2.236 14.545 1.598 9.547 2.098 9.031 0.773 1.477 20.035
 
Fl
total
Fl
low-detail
Fl
high-detail
Fl
matched
Fl
unmatched
Fl
rigid
Fl
non-rigid
Fl
not sky
Fl
sky
Fl
s0-10
Fl
s10-40
Fl
s40+
8.480 8.177 56.222 7.737 39.239 5.849 28.383 7.109 29.309 3.178 9.726 49.467
 
WAUC
total
WAUC
low-detail
WAUC
high-detail
WAUC
matched
WAUC
unmatched
WAUC
rigid
WAUC
non-rigid
WAUC
not sky
WAUC
sky
WAUC
s0-10
WAUC
s10-40
WAUC
s40+
76.182 76.501 26.016 77.049 40.302 80.041 46.989 77.427 57.269 84.450 69.614 24.786
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
reference frame
Reference Frame
color visualization of disparity 1
Disparity 1 visualization
grayscale visualization of disparity 1 error
Disparity 1 error
color visualization of disparity 2
Disparity 2 visualization
grayscale visualization of disparity 2 error
Disparity 2 error
color visualization of optical flow
Flow visualization
grayscale visualization of optical flow error
Flow error
grayscale visualization of optical flow error
Scene flow error
Error visualization color code
blue to white to red error visualization color code