It's probably not a good idea to take a weight loss drug with any kind of warning label (including one that tells you not to mix it with anything else). But that's just my personal opinion. I'm into natural weight loss/gain.
To answer your question, if it says not to take it with caffeine, then don't take it with caffeine.