Yikes, that would be awful. I can't stand the smell of cigarette smoke. The neighbors smoke outside and I can usually tell when they're out. But we're far enough away I guess, that it's just whiffs.
I'm not sure how you'd tactfully bring it up but maybe you could use the excuse someone has asthma or something?
Is there such a thing as venting the smoke odors back out of the house? Either they smoke like chimneys or they must do it right outside your door.