You definitely do need to give yourself a break — although that is easier said than done. I think a lot of this has to do with perfectionism (which roots in anxiety).
This article outlines how to stop the emotional distress cycle:
Penny
ADDitude Community Moderator, Parenting ADHD Trainer & Author, Mom to teen w/ ADHD, LDs, and autism