How exactly do The Matrix and The Terminator tie in with each other?

It just doesn't seem to make sense why the machines would stop short of exterminating all humans, and instead began to harvest our BTU's. And why is there no mention of John Connor by anyone in the Matrix?