LLM Responses compared

I thought a nice exercise would be to take a relatively simple prompt and assess how the Closed and Open models currently available compare.  This is the prompt that I used:

<PROMPT>

I’m taking my daughter to an oral surgeon today to discuss removing her 3 present wisdom teeth.  In overwhelming (?) circumstances wisdom teeth are removed as there is not room in the mouth for them.  Is there ever going to be a chance mother nature starts creating humans without any wisdom teeth?

</PROMPT>

First, all the responses essentially touched on the same items.  Some had more detail and more flourish in their delivery.  Consider how I’m using this data; it has informed me and enlightened me on the question at hand.  I have no intention of repurposing this copy on any site except for illustrative purposes, which is Chrisspeak for not caring as much about how “pretty” the prose of the LLMs are.  Here’s a slideshow of the responses.

Here are a couple opinions in no particular order:

1.  the Meta.ai response is sad, and they are the only Open source US model in the list.

2. Deepseek R1 and Qwen both have impressive results.

3.  I like the Grok response more that I anticipated.  But then again, I was predisposed not to like it (shakes fist at Elon) but I keep an open mind.

Always clever Google

Tuckahoe! I wanted information on how RAG and Live Intenet Search work with LLMs.  I chose Gemini 2.5 Pro Reasoning, Math & Code for the task.  The final example included as a follow up to expand on real time search included my physical location, which is freely...

read more

Always clever Google

Tuckahoe! I wanted information on how RAG and Live Intenet Search work with LLMs.  I chose Gemini 2.5 Pro Reasoning, Math & Code for the task.  The final example included as a follow up to expand on real time search included my physical location, which is freely...

read more

Perplexed-ity?

Perplexed-ity? I came across this blog post from Cloudfare: Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives I've read and heard a lot of positive things about Perplexity's Comet browser.  I want to like them and I want to cheer...

read more

AI Action plan, and stuff

AI Action plan Here ya go folks - this is the current administration's AI Action Plan:  https://www.ai.gov/action-plan Here are some words from the current administration about preventing "woke AI" in the federal government...

read more

Subscribed to One Useful Thing

One Useful Thing is the name of Ethan Mollick's substack newsletter.  Ethan is the Co-Director of the Wharton Generative AI Labs. Wharton Generative AI Labs has lots of good information including a prompt library: https://gail.wharton.upenn.edu/prompt-library/ Check...

read more

“Accumulation of Cognitive Debt”

There's an article published at MIT that studied "Your Brain on ChatGPT: Accumulation of Cognitive Debt when Using an AI Assistant for Essay Writing Task https://arxiv.org/abs/2506.08872 This blog post was pitched as a rebuttal of sorts to the MIT study - definitely...

read more

The upside of AI

Positive thoughts? I came across two older items last week that really made me feel good about Artificial Intelligence and some of the good aspects and possibilities.  Like most people grounded in reality, the very impact of AI's disruption on the job front and...

read more