Fix undefined shift on assumed 8-bit input.
authorDale Curtis <dalecurtis@chromium.org>
Sat, 18 Nov 2017 00:05:30 +0000 (16:05 -0800)
committerMichael Niedermayer <michael@niedermayer.cc>
Fri, 1 Dec 2017 23:28:59 +0000 (00:28 +0100)
commitc09d587ac54d0ecb8190618fb867e9fd907e1359
tree4f8c0907b2bb1b1dd5f4a435140bc280697751aa
parent712814fb17b62557d17d0bcff5b57e2a9d8e613c
Fix undefined shift on assumed 8-bit input.

decode_user_data() attempts to create an integer |build|
value with 8 bits of spacing for 3 components. However
each component is an int32_t, so shifting each component
is undefined for values outside of the 8 bit range.

This patch simply clamps input to 8-bits per component
and prints out a warning that the values were clamped.

Signed-off-by: Dale Curtis <dalecurtis@chromium.org>
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit 7010dd98b575d2e39fca947e609b85be7490b269)
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavcodec/mpeg4videodec.c