I think this depends on the context and tone of the comment. If it was said in a condescending way or with an intent to belittle you, then it should be taken as rude and dismissive. However, if it was said in a friendly and encouraging way, it could simply mean that he noticed you aren’t really into sports and thought it might be an activity you’d like to try out.