The declines hit all regions of the country and affected students of most races. But students of color saw some of the steepest decreases.