Do not free sps & pps on width/height changes.