You have to give it all you got before you give up on the relationship. If you feel that there is a strong connection then go with your heart. If you give up now you may always regret your decision. If you follow your heart and things don't work out well then atleast you tried. Good luck!