1、dropout一定在激活函数之后
2、问题在Batch Normalization在激活函数之后还是之前
两种位置排列:
CONV / FC - > ReLu(或其他激活) - > Dropout - > BatchNorm - > CONV / FC
CONV / FC - > BatchNorm - > ReLu(或其他激活) - > Dropout - > CONV / FC
1、dropout一定在激活函数之后
2、问题在Batch Normalization在激活函数之后还是之前
两种位置排列:
CONV / FC - > ReLu(或其他激活) - > Dropout - > BatchNorm - > CONV / FC
CONV / FC - > BatchNorm - > ReLu(或其他激活) - > Dropout - > CONV / FC