I actually find a lot of doctors like this anyway. Way before having any ADHD / ASD assessments, I found a lump and it took 2 years and it growing and becoming very painful before the collective they of my doctors did anything, it turned out to be sinister but sorted just in time.
I have only found one doctor who really listened and acted swiftly, unfortunately you really do have to be your own advocate these days.