avcodec/apedec: Check length in long_filter_high_3800()