A group of researchers took [MiniGPT-4](https://minigpt-4.github.io /) (visual encoder based on Visual Transformer and QFormer connected by a linear layer with the open language model Vicuna) and trained it on 50+k annotated pictures with skin diseases.
The results were checked by experts on 150 real cases, 78% of which doctors agreed with the conclusions of the new AI colleague.
The model is proposed to be used for preliminary consultation of patients.
I have heard many times that the medical field is one of the most resistant to this kind of innovation. I hope the current LLM boom won’t leave any chances for the conservatives.