rtp: Don't read priv_data unless it is allocated