avcodec/rscc: Check pixel_size for overflow