Google’s Med-PaLM 2, an AI instrument designed to reply questions on medical info, has been in testing on the Mayo Clinic analysis hospital, amongst others, since April, The Wall Street Journal reported this morning. Med-PaLM 2 is a variant of PaLM 2, which was introduced at Google I/O in Might this 12 months. PaLM 2 is the language mannequin underpinning Google’s Bard.
The paper additionally mentions research Google made public in May (pdf) displaying that Med-PaLM 2 nonetheless suffers from among the accuracy points we’re already used to seeing in massive language fashions. Within the research, physicians discovered extra inaccuracies and irrelevant info in solutions offered by Google’s Med-PaLM and Med-PalM 2 than these of different medical doctors.
Nonetheless, in virtually each different metric, akin to displaying proof of reasoning, consensus-supported solutions, or displaying no signal of incorrect comprehension, Med-PaLM 2 carried out roughly in addition to the precise medical doctors.
WSJ stories prospects testing Med-PaLM 2 will management their knowledge, which can be encrypted, and Google gained’t have entry to it.
In accordance with Google senior analysis director Greg Corrado, WSJ says, Med-PaLM 2 remains to be in its early phases. Corrado stated that whereas he wouldn’t need it to be part of his circle of relatives’s “healthcare journey,” he believes Med-PaLM 2 “takes the locations in healthcare the place AI could be helpful and expands them by 10-fold.”
We’ve reached out to Google and Mayo Clinic for extra info.
