what we perceive as the world can never be determined because we perceive things differently.

I’d actually argue that that is proof that the world CAN be determined: if several people with different perception and perspectives agree on how something looks, feels, tastes etc, that commonality in spite of differences is proof that the shared experience of something is objectively real.

many of us don’t even see the exact same colors for example

But most of us do, which can’t be a coincidence.

And this can be extended to quantum physics even when you consider that certain things are based on when they are observed.

Hey! No fair bringing physics to a philosophy discussion! How would you like it if I used football to prove that golf is boring? 😉