Sideways isn't the same thing. Newton's first law says the water will slosh out and the object will try to stay still relative to 'the universe' as the glass moves. If you move the glass up, however, the buoyant forces will increase. If the object if floating, it will continue to do so.

So do your experiment accelerating upwards. Of course it will be a mess when you stop :-)