Although I understand how your friend will miss you, a true friend would not put you in a position to walk on egg shells and you must do what is best for you and your family.
With time, friend will realize if it were the other way around, it would be expected of you to understand and move forward.