The simplest thing to start is to walk around to your windows when it is cold, and just feel for drafts. Roll up a towel, or use something like grey caulk weather cord (something cheap from any hardware store) to block drafts. For doors, there are a variety if fixes, with a rolled up towel a quick fix for drafts under the doors.