I'm not sure about the theory, but I had .com and .co.uk sites on a US server and it did seem to affect them. I moved them all to the UK and the co.uk's have improved, but the .com's seem the same. But then I am in the UK.
Hope this is of some help...
Anna