Fable Studio did something similar with their Lucy project. I was in the alpha test before it got cancelled, and the interactions and voice synthesis were very natural.