LLM Responses compared
I thought a nice exercise would be to take a relatively simple prompt and assess how the Closed and Open models currently available compare. This is the prompt that I used:
<PROMPT>
I’m taking my daughter to an oral surgeon today to discuss removing her 3 present wisdom teeth. In overwhelming (?) circumstances wisdom teeth are removed as there is not room in the mouth for them. Is there ever going to be a chance mother nature starts creating humans without any wisdom teeth?
</PROMPT>
First, all the responses essentially touched on the same items. Some had more detail and more flourish in their delivery. Consider how I’m using this data; it has informed me and enlightened me on the question at hand. I have no intention of repurposing this copy on any site except for illustrative purposes, which is Chrisspeak for not caring as much about how “pretty” the prose of the LLMs are. Here’s a slideshow of the responses.
Here are a couple opinions in no particular order:
1. the Meta.ai response is sad, and they are the only Open source US model in the list.
2. Deepseek R1 and Qwen both have impressive results.
3. I like the Grok response more that I anticipated. But then again, I was predisposed not to like it (shakes fist at Elon) but I keep an open mind.
Subscribed to One Useful Thing
One Useful Thing is the name of Ethan Mollick's substack newsletter. Ethan is the Co-Director of the Wharton Generative AI Labs. Wharton Generative AI Labs has lots of good information including a prompt library: https://gail.wharton.upenn.edu/prompt-library/ Check...