avcodec/vp3: Error out on invalid num_coeffs in unpack_vlcs()