h264: disallow constrained intra prediction modes for luma.
authorRonald S. Bultje <rsbultje@gmail.com>
Fri, 10 Feb 2012 06:57:01 +0000 (22:57 -0800)
committerRonald S. Bultje <rsbultje@gmail.com>
Fri, 10 Feb 2012 06:57:01 +0000 (22:57 -0800)
commit45b7bd7c53b41bc5ff6fc2158831f2b1b1256113
tree51923d7569c3c823380fcca869fa8361055dcc3e
parent81749f30cd84b35f774d7d1bbe6bf3f96e2362c8
h264: disallow constrained intra prediction modes for luma.

Conversion of the luma intra prediction mode to one of the constrained
("alzheimer") ones can happen by crafting special bitstreams, causing
a crash because we'll call a NULL function pointer for 16x16 block intra
prediction, since constrained intra prediction functions are only
implemented for chroma (8x8 blocks).

Found-by: Mateusz "j00ru" Jurczyk and Gynvael Coldwind
CC: libav-stable@libav.org
libavcodec/h264.c
libavcodec/h264.h
libavcodec/h264_cabac.c
libavcodec/h264_cavlc.c
libavcodec/svq3.c