avcodec/texturedsp: Fix runtime error: left shift of 255 by 24 places cannot be repre...