I want to note that there isn’t actually a lot of historical evidence for Jewish people being driven out of Judea in any large numbers by the Romans.

The area did get conquered as part of the Arab conquests though, and while Islam didn’t actually do conversion by the sword, as you mention, they did do conversion by tax relief. It wasn’t just a social heirarchy, they would literally tax you more money if you didn’t convert.

What almost certainly happened to the Jewish majority in Judea was simple conversion. I was easier to follow Allah than Yahweh, and if they’re theoretically the same god anyways…