2. Linear Algrebra & CNN & 速记

Matrix

Norms

$$ \begin{gather} \begin{aligned} || \mathcal{X} ||0 &= \sum{ i=1 }^{ n } \frac{ \mathcal{X}_i }{ \mathcal{X_i} }, \mathcal{X}i \neq 0 \\ || \mathcal{X} ||p &= \Big[ \sum{ i = 1 }^{ n } \mathcal{X}i^p \Big]^{1/p} \\ || \mathcal{X} ||{\infin} &= \mathcal{X}{max} \end{aligned} \end{gather} $$

Mode-n Unfolding Matrix

沿着第$n$个纬度把张量展开

Global Pooling

Category Concept
全局平均池化(Global Average Pooling, GAP) 对特征图上的所有元素取平均值
全局最大池化(Global Max Pooling, GMP) 对特征图上的所有元素取最大值

Q-Shift

Category Concept
计算效率高
模型压缩
保留表达能力

指标介绍

MS-Fusion

Category Concept
HS-HRI $\longrightarrow$ HS-LRI $\widehat{ MS }_k = (f * \widehat{ MS }_k) \downarrow^k + \pmb{N}_k$
$f$ 模糊算子
$\pmb N$ 噪声
$\downarrow^k$ 下采样$n$倍
Category Concept
HS-HRI$\longrightarrow$ MS-HRI(Pan) $\pmb P = \pmb r^T \mathcal{MS} = \sum_{ k=1 }^{ N } \pmb{r_k MS_k}, \sum_{ k =1 }^{ N } r_i = 1$

Cross Correlation

CNN

Category

Category Concept
Width 太宽容易过拟合
Depth 过深,有些层可能会失效;梯度可能会消失
Multi-Path
Feature-Maps 卷积核对特征的提取
Attention 对图像重点部分的关注
Channel(Dimension) 分路卷积,分别提取Spatial/Channel Imformation
Channel Boosting 特征增强
  • 超过3层才叫Deep Network

Application

Denoise

  1. AWNI(Additive White Noisy Imgae)
  • Changing Network Architecture
Category Concept
Fusion
改变Width, Depth
改变Loss Function
Cascade Connection
Skip Connection
Plugins Activation, Pooling, Fully-Connected Layer(展开成一维)
  1. Real Noisy Image (现实中的噪声)

  2. Blind Denoising (盲源去噪)

Challenge

Category Concept
Hyper-Para Settings 超参数设置十分重要
Hard to Explain

速记

Category Concept

Important Networks

Mamba Network

Residual Network

Appendix

Concept

Category Concept
Weak Edge-Information Noisy Image 物体与背景的边缘模糊
Sparse Input 大部分输入数据为0
Licensed under CC BY-NC-SA 4.0
comments powered by Disqus
Built with Hugo
Theme Stack designed by Jimmy