This reverts commit04aa09c4bcand reintroduces0ff5567a30that was temporarily reverted due to minor regressions. It also revertse5bce8b4cethat fixed FATE refs. The fate-ffm change is caused by field_order now being set on the output format because the first frame arrives earlier. The fate-mxf change is assumed to be the same.