想要简单地得到模型的参数量,在pytorch可以通过简单调用得到,还能区分所有参数和训练参数:
# Find total parameters and trainable parameters
total_params = sum(p.numel() for p in model.parameters())
print(f'{total_params:,} total parameters.')
total_trainable_params = sum(
p.numel() for p in model.parameters() if p.requires_grad)
print(f'{total_trainable_params:,} training parameters.')
135,335,076 total parameters.
1,074,532 training parameters.