There is no one answer and both sides are "right" in some sense. It really comes down to your personal risk vs benefit analysis, and I think for most people that is going to be informed by their particular world view.
And most world views have some truth to them - yes, raw milk products are responsible for a ridiculously small number of problems and arguably those problems are linked to improper collection, storage and handling, so the hysteria about raw milk products is out of proportion.
But it’s understandable why people have concerns. At one time milk borne illness was a real public health problem that was virtually eradicated by the process of pasteurization. Remember, however, that those health problems were at a time prior to widespread refrigeration and before the concepts of sterilization and even washing hands was fully understood and implemented.