mpeg12enc: Correctly mask dimensions