If an alien civilization harvested all plants from earth but left the animals behind, would that be ok?

All agriculture kills animals, even farmers who only grow crops.