Yeah you have some mixed grounds somewhere. I'm assuming you mean you have a CD changer in the trunk or something of that sorts?
With the way your setup is now, you should completely bypass the whole splice box thing for the amp. Run RCAs and the Remote wire directly from the Headunit. You'll get much cleaner sound that way as well, and it will ensure all your connections are proper.