Shouldn't matter, providing your volume adjustment tracks both channels properly at all levels (and I'm honestly not sure how much of a difference this would make...I mean, if it was severely off, sure, otherwise it might just pull very slightly to one side or the other of center)...and as long...