Usually I find a way to simply excuse myself politely. Say I need to use the restroom, or tell them I need to step away for a moment. No need to give a reason. You can still be gracious in speech but tell them in a honest way you need to step out.