rtmpcrypt: Do the xtea decryption in little endian mode
authorMartin Storsjö <martin@martin.st>
Wed, 11 Nov 2015 19:42:02 +0000 (21:42 +0200)
committerMichael Niedermayer <michael@niedermayer.cc>
Thu, 26 Nov 2015 15:06:39 +0000 (16:06 +0100)
commit1290c85c9d451eaf45bf552fa313ea7f6cccb3f3
tree11c07862ee7d1c3ab1428a116a036e69e7c6d893
parentb70f7d20e1140983bf986ca240f2d868074a8585
rtmpcrypt: Do the xtea decryption in little endian mode

The XTEA algorithm operates on 32 bit numbers, not on byte sequences.
The XTEA implementation in libavutil is written assuming big endian
numbers, while the rtmpe signature encryption assumes little endian.

This fixes rtmpe communication with rtmpe servers that use signature
type 8 (XTEA), e.g. crunchyroll.

CC: libav-stable@libav.org
Signed-off-by: Martin Storsjö <martin@martin.st>
(cherry picked from commit e7728319b92dbb4fb949155e33de7ff5358ddff3)

Signed-off-by: Michael Niedermayer <michael@niedermayer.cc>
libavformat/rtmpcrypt.c