learning-based pde: a new perspective for pde methods in...
TRANSCRIPT
![Page 1: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/1.jpg)
Learning-Based PDE: A New Perspective for PDE Methods in
Computer Vision
Risheng Liu Dalian University of Technology
http://cggi.dlut.edu.cn/people/~rsliu/ [email protected]
![Page 2: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/2.jpg)
Outline
• Motivation
• Learning a specified PDE system
• Learning the general PDE system
• Discussions
![Page 3: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/3.jpg)
PDE Methods in Computer Vision
• PDEs have been applied to – Denoising, Deblurring, Inpainting, Segmentation, Stereo, …
• Roughly have two kinds of methodologies for PDE design – Direct design: write down PDEs directly using some insights from physics
– Variational design: energy functional Euler-Lagrange equation
Not a hot topic in computer vision society RECENTLY!
Anisotropic Diffusion:
Total Variation:
![Page 4: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/4.jpg)
Why PDEs fell out of favor?
• PDE is a powerful tool for data analysis – PDE is indeed a general regressor to approximate the nonlinear mapping between input
and output vision data.
– Differential system should be more efficient than linear equation for data analysis.
• Unfortunately… – It is challenging to design PDE in handcraft way (huge feasible solution set)
• Deep insights for the problem and the data
• High mathematical skills for building a PDE system
– Fixed PDE formulation and/or boundary conditions is lack of flexibility
Beautiful mathematical formulation, BUT poor performance and limited application!!
理想很丰满、现实很骨感
![Page 5: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/5.jpg)
New Perspective: PDE + Learning
Two possible ways to incorporate “learning” ideas into PDE designing:
• For a specific kind of PDE system (e.g., heat diffusion), we may adaptively learn its form and boundary for different data and tasks – Risheng Liu, Junjie Cao, Zhouchen Lin and Shiguang Shan. Adaptive Partial Differential Equation Learning
for Visual Saliency Detection. CVPR’2014 (Oral)
• For using PDE to address general vision tasks, we may learn the PDE form from the “dictionary of differential operators” for different image processing and analysis tasks
– Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
– Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
![Page 6: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/6.jpg)
Outline
• Motivation
• Learning a specified PDE system
• Learning the general PDE system
• Discussions
![Page 7: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/7.jpg)
Saliency Detection
Saliency detection is a hot topic in computer vision recently.
• Bottom-up methods: from image features
– Feature + Clustering [Itti’98, Cheng’11, Lang’12, Shen’12, Wei’12, Xie’13]
– Candidates + Refinement [Jiang’13, Yang’13]
• Top-down methods: from saliency model
– CRF [Liu’11, Yang’12].
Saliency Detection
Input Image Masked Salient Region
![Page 8: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/8.jpg)
Learning Heat Diffusion for Saliency Detection
• General heat diffusion system for image processing
• But not for saliency detection!
• Difficulties of PDE methods Learn Governing
Equation
Learn Boundary Conditions
8><>:
@f(p; t)
@t= F (f;rf); (p; t) 2 £ (0; T ];
f(p; t) = g(t); p 2 @£ (0; T ];
f(p; 0) = I(p):
Governing Equation
Boundary Condition
Initial Condition
• We assume that visual attention starts from saliency seeds and then propagates to a salient region.
– Hard to describe high-level information
– Using fixed boundary conditions
![Page 9: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/9.jpg)
@f(p; t)
@t= F(f;rf); s:t: boundary conditions:
Propagate visual attention from saliency seeds to other image elements
We need a diffusion equation
F(f;rf) = div(Kprf(p)) + (̧f(p)¡ g(p))):
Guidance Map
Steady state F(f;rf) = 0; s:t: f(g) = 0; f(p) = sp;p 2 S:
Local Diffusivity
How to determine S?How to determine Kp, g(p), and sp?
We need Dirichlet boundary conditions
f(g) = 0; f(p) = sp;p 2 S:
![Page 10: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/10.jpg)
Learning PDEs – Graph Representation
²Oversegment to superpixels: V = fp1;¢¢¢;pjVjg
²Undirected graph G = (V;E).
Superpixel Segmentation Input Image
Over-segment
![Page 11: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/11.jpg)
Learning PDEs – Candidate Foreground and Background
• Use Harris operator to detect corners and contour points and estimate a convex hull C.
– Candidate foreground Fc = nodes inside C.
– Pure background Bc = nodes outside C’.
• Add adjacent nodes to C to form an expanded hull C‘.
![Page 12: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/12.jpg)
Learning PDEs – Graph Construction ²Undirected graph G = (V;E).
¡ Nodes in Fc within distance 2 are connected to each other (Fig. (a)).
¡ All nodes in Bc are connected to each other: for smoothness of
background (Fig. (b)).
The red and yellow regions in (a) and (b) represent Fc and Bc, respectively.
Lines in (b) indicate that all nodes in Bc are connected to each other.
(a) (b)
De n̄es neighborhood Np.
¡ All nodes are connected an environment point g.
g
![Page 13: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/13.jpg)
Learning PDEs – Learning Kp
²Feature vectors: fh(p);p 2 Vg { mean of each superpixel in CIELAB color
space.
Kp = diag(k(p;q1);¢¢¢; k(p;qjNpj¡1); "g);
where Np = fq1;¢¢¢;qjNpj¡1;gg is the neighborhood of p,
k(p;q) = exp(¡ k̄h(p)¡ h(q)k2);
and 0 < "g ¿ 1 is the dissipation conductance at p.
![Page 14: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/14.jpg)
Learning PDEs – Learning g(p) and sp
g(p) = fl(p)£ fc(p)£ ff(p);
and then normalized.
²ff(p) = 1¡ fb(p): probability of belonging to foreground.
div(Kprfb(p)) = 0; s:t: fb(g) = 0; fb(p) = 1;p 2 Bc.
²fc(p) and fl(p) are computed according to [Shen'12] and [Judd'09].
X. Shen and Y. Wu. A unified approach to salient object detection via low rank matrix recovery. In CVPR, 2012. T. Judd, K. Ehinger, F. Durand, and A. Torralba. Learning to predict where humans look. In ICCV, 2009.
sp = g(p), for p 2 S.
Center Prior Color Prior Foreground Prior
![Page 15: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/15.jpg)
Learning PDEs – Learning S
²Optimize saliency seeds by searching for the most representative foreground
nodes in Fc as S.²Maximize the sum of scores f w.r.t. all image elements in V.
maxS½Fc;jSj·n
L(S) ´Pp2V
f(p);
s:t:
½div(Kprf(p)) + (̧f(p)¡ g(p))) = 0;
f(g) = 0; f(p) = sp;p 2 S:
PDE Constrained Discrete Optimal
Control
Theorem: L(S) is submodular and monotone w.r.t. S.
Greedy algorithm works well.
![Page 16: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/16.jpg)
The Pipeline of PDE Based Saliency Detection
Input image
Superpixel segmentation
Pure background (outside)
Candidate foreground (inside)
Background prior
Color prior
Center prior
Guidance map
Saliency seeds (yellow regions)
Saliency score map
Masked saliency region
![Page 17: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/17.jpg)
Experiments – Qualitative Comparison
The top three rows are examples in MSRA and the bottom is in Berkeley.
![Page 18: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/18.jpg)
Experiments – Quantitative Comparisons
Results on the MSRA-5000 image set. (a) Precision-recall curves. (b) Average precision, recall, and F-measure values.
![Page 19: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/19.jpg)
Experiments – Quantitative Comparisons
Results on the Berkeley image set. (a) Precision-recall curves. (b) Average precision, recall, and F-measure values.
![Page 20: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/20.jpg)
• Propose an adaptive PDE to model the saliency diffusion.
– Learn both the governing equation and the boundary condition of the PDE.
– The first PDE based method for saliency detection.
• Optimize saliency seeds by submodular maximization.
– Saliency seeds make the boundary condition.
Summary
• Learning a specific PDE system for more vision and graphics tasks (Ongoing)
– Robust object tracking
– Mesh segmentation and labeling
![Page 21: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/21.jpg)
Outline
• Motivation
• Learning a specified PDE system
• Learning the general PDE system
• Discussions
![Page 22: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/22.jpg)
Can we just consider PDEs as a BLACK BOX for computer vision?
• A user only have to prepare input/output training data!
• The same framework for various problems!
• Can we have such a convenient way?
Possible!!! Learning a general PDE system for computer vision
• Design a general “dictionary” of differential operators
• Learn combination “codes” for specific task and/or data
![Page 23: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/23.jpg)
General PDE Formulation
• The space of PDEs is infinitely dimensional • The designing of PDEs is heavily rely on intuition • It is hard to quantify and describe the intuition • The designed PDEs can only reflect very limited aspects of a vision task
![Page 24: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/24.jpg)
Dictionary for PDEs in Computer Vision (Shift/Rotation Invariant Fundamental Differential Invariants)
![Page 25: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/25.jpg)
Linear Combination of Differential Invariants
![Page 26: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/26.jpg)
Learning Coefficients by Optimal Control
![Page 27: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/27.jpg)
Experiments
• The same form of PDE for different problems!
– Only differ in coefficients
• Some of them have never been tried by PDEs!
Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013 Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
![Page 28: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/28.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
Denoising (Gaussian)
![Page 29: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/29.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
Denoising (Mixture of Gaussian, Poisson and Salt & Pepper )
![Page 30: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/30.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
![Page 31: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/31.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
Inpainting
![Page 32: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/32.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
Perceptual Edge Detection
![Page 33: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/33.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
Object Detection (Training)
![Page 34: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/34.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
Object Detection (Testing, Positive)
![Page 35: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/35.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
Object Detection (Testing, Negative)
![Page 36: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/36.jpg)
Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
Color2gray Demosaicking
Color Image Processing
![Page 37: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/37.jpg)
Outline
• Motivation
• Learning a specified PDE system
• Learning the general PDE system
• Discussions
![Page 38: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/38.jpg)
The spring of Neural Network is coming, but when is PDE?
• Feature learning beats handcraft features
• Can we do similar thing for PDE methods?
– Building blocks of DNN are linear systems, while PDE considers more powerful differential systems
– The evolution of PDE is very similar to the multiple layers NN learning process
![Page 39: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/39.jpg)
Take Home Message
• PDE + Learning is a promising direction for computer vision
– Potential connections to deep learning?!
• Learning a specific PDE for particular task
• Learning a general PDE for various tasks
• Build “deep” PDE system for challenging tasks?
![Page 40: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/40.jpg)
References • Risheng Liu, Junjie Cao, Zhouchen Lin and Shiguang Shan. Adaptive Partial
Differential Equation Learning for Visual Saliency Detection. CVPR’2014 (Oral)
• Risheng Liu, Zhouchen Lin, Wei Zhang, Kewei Tang and Zhixun Su. Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach. Image and Vision Computing, 2013
• Risheng Liu, Zhouchen Lin, Wei Zhang and Zhixun Su. Learning PDEs for Image Restoration via Optimal Control. ECCV’2010
![Page 41: Learning-Based PDE: A New Perspective for PDE Methods in ...valser.org/webinar/slide/slides/20141022/LPDE_RishengLiu.pdfBeautiful mathematical formulation, BUT ... ² f c ( p ) and](https://reader030.vdocuments.us/reader030/viewer/2022040921/5e99915186f3d54f942bd2de/html5/thumbnails/41.jpg)
小广告
• 大连理工大学数字媒体技术团队招生(计算数学、计算机科学与技术和软件工程专业博士、硕士)
• 欢迎各位老师同学以任何形式与我们开展交流、合作
• 诚邀各位CV同仁到大工、到软件学院指导、访问