You can take either the Northeast Regional or the Acela straight from Providence, or if you’re willing to cheap out a little, you can drive out to Kingston (near URI) and get the Regional from there.

Or if you’re that much a penny pincher with train fares, take the Shore Line East out of either New London or Old Saybrook, then transfer to Metro-North at New Haven Union.