What would you think about someone who constantly walks away during our conversation?

It depends on the situation and the conversation. If something intelligent, just means they can not keep up with the conversation. If its only going one way, it might be that they are avoiding an argument. Or rather that you might be talking to much and they feel they won’t get their point across.