avcodec/hevcdsp_template.c: Fix undefined shift in FUNC(dequant)
authorMichael Niedermayer <michael@niedermayer.cc>
Fri, 22 Dec 2017 02:12:03 +0000 (03:12 +0100)
committerMichael Niedermayer <michael@niedermayer.cc>
Tue, 26 Dec 2017 17:05:10 +0000 (18:05 +0100)
Fixes: runtime error: left shift of negative value -180
Fixes: 4626/clusterfuzz-testcase-minimized-5647837887987712

Found-by: continuous fuzzing process https://github.com/google/oss-fuzz/tree/master/projects/ffmpeg
Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavcodec/hevcdsp_template.c

index 4017af8..903aa3f 100644 (file)
@@ -121,7 +121,7 @@ static void FUNC(dequant)(int16_t *coeffs, int16_t log2_size)
     } else {
         for (y = 0; y < size; y++) {
             for (x = 0; x < size; x++) {
-                *coeffs = *coeffs << -shift;
+                *coeffs = *(uint16_t*)coeffs << -shift;
                 coeffs++;
             }
         }