I'll add that I really like patchouli combined with vetiver. Vetiver can also be a polarizing scent, but it is much more woody and less funky, so I think it balances patchouli well as the base of a fragrance.

Now I'm trying to think of what I have with a fair amount of patchouli that I really like ...