参数相关

打印梯度更新的参数

for name, p in model.named_parameters():
    if p.requires_grad == True:
        print(name)

统计参数量

sum(p.numel() for p in model.parameters() if p.requires_grad

打印更新参数和大小

for name, param in model.named_parameters():
    if param.requires_grad:
        logging.info("{}: {}".format(name, param.numel()))