Dont build a rager, and you will be fine. Use dry wood to keep smoking low, and your neighbors shouldn't have too much of a problem. If you are really concerned, you can just spray the wood fence and siding beforehand. I have been lighting shit on fire since I was a kid and never had to call the fire lords to banish my unwanted flames.