As a person and a parent am i doing the right thing?

If I were in your situation, the needs/wants of my children would come first. The person would have to move near us. It may seem wrong or selfish to that person but it isn't and that is the only option IMO. You worked hard to make a better life for them and you wouldn't want to jeopardize that in any way.