only store intra prediction modes on the boundary for keyframes, not as a plane.