Part of the problem is that Xander knows Willow is right with Anya. Xander never loved her for being herself; he always tried to teach her to be more human. However, she is wrong that he doesn't know that kind of all-consuming love.