avcodec/ilbcdec: Fix undefined integer overflow lsf2poly()
authorMichael Niedermayer <michael@niedermayer.cc>
Mon, 14 Jan 2019 23:09:30 +0000 (00:09 +0100)
committerMichael Niedermayer <michael@niedermayer.cc>
Thu, 31 Jan 2019 16:20:38 +0000 (17:20 +0100)
commitd8b8b27dc3126c9c18d22b81815076c43ebcac7f
tree2163cae63b08214cbdb38d270e9d3d1eb62aeef1
parent62f5325ca30a3cc27c625bb468d65e2e4bfd7996
avcodec/ilbcdec: Fix undefined integer overflow lsf2poly()

The addition is moved up into the context where the variable is unsigned avoiding
the undefined behavior

Fixes: runtime error: signed integer overflow: 2147481972 + 4096 cannot be represented in type 'int'
Fixes: 12444/clusterfuzz-testcase-minimized-ffmpeg_AV_CODEC_ID_ILBC_fuzzer-5755706244857856

Found-by: continuous fuzzing process https://github.com/google/oss-fuzz/tree/master/projects/ffmpeg
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit 4523cc5e75c8ecfba8975d16e96c29f9bf70973f)
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavcodec/ilbcdec.c