avutil/mathematics: Do not treat INT64_MIN as positive in av_rescale_rnd
authorMichael Niedermayer <michael@niedermayer.cc>
Tue, 1 Dec 2015 11:44:23 +0000 (12:44 +0100)
committerMichael Niedermayer <michael@niedermayer.cc>
Sun, 20 Dec 2015 09:59:27 +0000 (10:59 +0100)
commit100dbe1bf007024224c7ae2bb5d1aa956d979722
treea1f87b0ff38ec035ba3ea4163cee28dd5d407590
parentd8a66a150ae1ef88b6d9a43905de0f90f4a1385f
avutil/mathematics: Do not treat INT64_MIN as positive in av_rescale_rnd

The code expects actual positive numbers and gives completely wrong
results if INT64_MIN is treated as positive
Instead clip it into the valid range that is add 1 and treat it as
negative

Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
(cherry picked from commit 25e37f5ea92d4201976a59ae306ce848d257a7e6)

Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavutil/mathematics.c