libx264.c: distinguish between x264 parameter errors.