Fix undefined shift on assumed 8-bit input.
authorDale Curtis <dalecurtis@chromium.org>
Sat, 18 Nov 2017 00:05:30 +0000 (16:05 -0800)
committerMichael Niedermayer <michael@niedermayer.cc>
Mon, 8 Jan 2018 22:19:14 +0000 (23:19 +0100)
commit13763f71926057e57ddd75b7c8ff93e6ab23f8ab
treea0ef907ed1eb5fe8070792bc73dcfd4ba96f8a18
parent380515e5b9581fa9852f2c8fac091ec67c03c358
Fix undefined shift on assumed 8-bit input.

decode_user_data() attempts to create an integer |build|
value with 8 bits of spacing for 3 components. However
each component is an int32_t, so shifting each component
is undefined for values outside of the 8 bit range.

This patch simply clamps input to 8-bits per component
and prints out a warning that the values were clamped.

Signed-off-by: Dale Curtis <dalecurtis@chromium.org>
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit 7010dd98b575d2e39fca947e609b85be7490b269)
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavcodec/mpeg4videodec.c