I don't think it makes any difference. Just do what is convenient and accessible.
The only thing to note is that the charcoal will tend to burn first from the side where the fan is blowing. So you might want to have the blower positioned so that, later on in the cook, you could either push or pull the remaining coals into a pile closer to where the blower is.