Support arbitrary down-sampling factor.Store info for show no-show frames for supporting alt_ref. If parent frame is alt_ref, child has one too.