With many people, it is a matter of extremes, especially when it comes to working out. Either they are outright killing themselves in the gym, or they are sprawled out on the couch eating cookie dough ice cream. Or, it could just be a matter of intensity. Some will tell you that you have to "confuse" your body to make changes to your metabolism, or that you have to crush yourself every workout or there won't be any adaptive response.
If only it were that simple! The body is a tremendously complicated organism and to approach it from extreme angles makes no sense. So does more intense exercise equate to better results? Not that anyone can definitively say, because there really hasn't been any research done to prove it wrong or right.
But, there is one thing that is guaranteed. If you find a workout program that you love to do, and you surround yourself with people you enjoy spending time with, then you're more likely to stick with it. If you are absolutely miserable very time you walk into the gym, or even dread the thought of going, then you are definitely doing the wrong program and you are going to use any excuse to not go or to quit.
The long and short of this subject is this: find something you love, do it with people you enjoy spending time with, and keep going!