avcodec/h264_cabac: Tighten allowed coeff_abs range
authorMichael Niedermayer <michael@niedermayer.cc>
Tue, 13 Feb 2018 23:32:30 +0000 (00:32 +0100)
committerMichael Niedermayer <michael@niedermayer.cc>
Mon, 19 Feb 2018 01:52:16 +0000 (02:52 +0100)
commit340c315c671efe137651d75da351c0f292d234fb
treedb32043f2f17849a27f218bbfa06187270f650c3
parentd4f9119532564c631bf9dfcfc3ab3498cdedcad7
avcodec/h264_cabac: Tighten allowed coeff_abs range

Fixes: integer overflows
Reported-by: "Xiaohan Wang (王消寒)" <xhwang@chromium.org>
Based on limits in "8.5 Transform coefficient decoding process and picture
construction process prior to deblocking  filter process"

Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit f26a63c4ee1bdbe21d7ab462cd66f8ba20b14244)
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavcodec/h264_cabac.c