avcodec/hevc_ps: do not loose all reference to pointers still in use