Warm-up和Cos设置LR
Warm-up和Cos设置LR import bisect from bisect import bisect_right import matplotlib.pyplot as plt import numpy as np import math lr = [] iters=[] def _get_warmup_factor_at_iter( method: str, iter: int, warmup_iters: int, warmup_factor: float ): """ Return the learning rate warmup factor at a specific iteration. See :paper:`in1k1h` for more details. Args: method (str): warmup method; either "constant" or "linear". iter (int): iteration at which to calculate the warmup factor. warmup_iters (int): the number of warmup iterations. warmup_factor (float): the base warmup factor (the meaning changes