Well, that depends.
But, in general the mohair will stretch more than the silk.
Or, if you like, the silk will prevent the mohair form stretching as much.
Also whwat size needles didi you use? Larger, then more stretch.
http://www.knitpicks.com/images/pdf/bestfiber.pdf