ResNets:即残差网络,能帮助解决由于网络结构过于deep而产生的梯度消失问题。
Two main types of blocks are used in a ResNet, depending mainly on whether the input/output dimensions are same or different:
The identity block is the standard block used in ResNets, and corresponds to the case where the input activation(say a[l]) has the same dimension as the output activation(say a[l+2]), here is an alternative diagram showing the individual steps:
Figure 1 : Identity block . Skip connection "skip over" 2 layers.
Figure 2 : Identity block . Skip connection "skip over" 3 layers.
Figure 3 : Convolutiional block .
上述两种方式,代码实现起来也比较简单,可以参考deeplearning作业(这里用keras实现):https://github.com/NumberFairy/deep_learning_answer/blob/master/test4_2_residualNetworks/residualNetworks/index.py