All electrical must have a reference. Ground or negative is usually it. If the ground is unstable, the electrical will be unstable and funny things happen in an unstable environment.
Once you understand this, all of the rest of the stuff is principle.
I am not trying to insult you by trivializing your question, but I think this might be enough to grasp the concepts.