What's annoying about being fat

This morning I have been listening to the radio while doing driving for work,  they had a guy on who used to be 35 Stone but has lost a lot of weight.  He spoke about how he consumed 7000 calories a day,  and didn't leave the house or do anything.   You read about people in magazines who used to eat 5 loafs of bread,  3 fish and chips and that was just lunch,  who suddenly lose lots of weight.
I man,  my size has a resting calorie burn of about 3500 calories,  that is if I do nothing that's how many calories my body uses to breath and live,  on top of that I am active when I don't go to gym and burn about 500 more calories off,  so that's 4000 calories.  When I visit the gym I burn off say another 500 calories.
So take the gym our of the equation if I eat less than 4000 calories a day,  I should loss weight.  
My diet consists of 1800 calories plus about a 1/4 of my burn calories,  so if I go to gym,  I can eat maybe 125 calories a day more than if I don't.  Yet my weight sticks.  
The problem is people read these magazines and hear these radio shows and judge all the fat people the same.