Why are boxers considered athletes if all they do is punch each other?

Boxing is actually pretty technical. I don't group boxers with golfers, race car drivers or bowlers because boxing is a contact sport, it requires peak physical fitness and rigorous work outs, unlike the other sports you have listed. As long as there is physical contact, I consider them athletes.