Try to keep track of interlaced and top field first.