Isn’t that more like “you can’t ask an elm tree for pears?”

And even more literally “don’t ask for pears to the elm?”