If you change the sensor format or layout dramatically, all the old data and all the new data becomes hard to hybridize.

I don’t see why that would have to be the case if the new data is a complete superset of the old data. If all the same cameras are there, then the additional sensors and the data those sensors collect can actually help train the processing of the visual-only data, right?