Do you actually like him or do you just feel sorry for him?
If it is the former, sure, if it is the latter, no.
Pity or feelings of obligation / guilt are not the right reasons to start a relationship, at least in my opinion. I would never want a girlfriend with those feelings towards me, no matter how I felt about her in return.