Don't do it if you don't feel comfortable with it. In my opinion, it shouldn't feel like a loss... it should feel like you are gaining something. If you feel like you'll be losing something important to you, just keep waiting. Never mind their feelings. Your feelings matter too.