Code around here mandates that a fire pit, bbq, etc be a minimum of 10 feet from the nearest building. That's for safety, being considerate is another thing.

Me, I don't care it's the same as a chimney on a fireplace from my point of view.