Maybe you're not aware of the Southwest policy of open seating. You pick where you sit....exit row, isle seat, whatever...so the earlier you can board is a big plus.
I agree with you if you have an asigned seat where in that case, I'm usually the last to board the plane as well...why sit on the plane longer than you have to.