Well, I think, being a mathematician, I have an advantage when it comes to stumping it. It doesn't seem to "know" much higher mathematics and gave absurd answers to a question I posed. I'm guessing it hasn't digested the entire content of arXiv.org as part of its training.
That said, one of my colleagues got it to write a proposal for a degree program in applied mathematics, and it did almost as well as the committee our department convened to do just that, at least as to the verbiage justifying the new program. Obviously, our course offerings not being part of its training, it couldn't actually design a program.
