Please check what you eat for breakfast the next time. If you are eating a full English breakfast which usually consists of egg and bacon regularly, then you are likely to have love handles.
In 3 hours after your fat-rich breakfast, this fat will become fatty tissue. And it will be stored around your waist. If you continue to follow this poor eating habit, pretty soon your buttocks, thighs, and hips will be become bigger, thanks to the accumulation of fat.
One way to deal with this fat is to exercise. In fact, if you are fit, it would be easier for you to burn this unwanted fat.
Check out this study by Oxford University.