Yep, it's a dilemma. I always insist on a half, or full day test ride before making a final decision on a bike change.
Some dealers refuse to allow such test rides, but fortunately my dealer is ok with it.
I would never change bikes without a L O N G test ride. I can't imagine the though of " Oh shi- I think I have dropped a bollock here" whilst only a few hours/days into new bike ownership.