Well the best thing that you can do is try and understand whether or not you can live with that…my partner is diagnosed ADHDer with a capothal H…problems concentrating,regulating emotions etc…i feel your anexiety, i really do…but you need to take care of yourself and do what empowers you.
Maybe you can try looking at those challenges like a tool that you can use to learn how to handle your own insecurities and anxieties..my therapist told me that we tend to choose partners that in one way or another put a mirror in front of us, i try to keep that in mind when i get anxious.