Experience helps but its not everything. Availability for emergencies can be important. I pay a little more for my well-care treatment, but it saves me a bundle that I have a vet that's available 24/7 (the emergency vet hosp is pricey).
Every vet will make mistakes. It doesn't mean they're a bad vet. [some mistakes are inexcusable]
The questions you ask aren't as important as the vet's answer. Are they overly-opinionated, or do they offer advice and let you make final decisions. (good questions: flea control, food brands, etc.). Related to that-'bedside manner'. How do they act around your/other pets? Do they pay attention to your pet first? How does your pet react around them? I have one dog that freaks out over a lot of simple things, like nail clipping. I've met two vets that can clip his nails with absolutely no drama or reaction from my dog, one vet that told me he needed to be sedated, and one that hurt him in the process, manhandled him and my dog lost control of his bowels.
Well first how old is the pup?
If he's around 6 weeks of age he should be on the dog food with a bit of water to have it soft while his teeth are still coming in. And are his teeth adult teeth or puppy teeth?
And yes goat milk is good for pups, I have an all natural vet and when my dog a litter she was weaning them to fast, so my vet said goats milk. But ask your vet if you feel like you need a second opinion. The more opinion's the better.
And over all it sounds like he's doing really well :)
I really hope this helped!