As everyone else I’m playing with GenAI too. It is fun, it is an hype, it is part of “OMG what is this stuff” moment. One of the various tutorial, on Claude, explains the concept of “few shots prompting. Long story short is giving an example to the AI to make it understading the “mood” and the context and how to answer to the question.
So, according to the sample below, I know, horrible screenshot:
we should ask
“Will Santa bring me presents on Christmas?”
Getting a quite general answer
I don’t actually have any information about whether Santa will bring you presents on Christmas. Santa Claus is a fictional character, and whether he brings presents depends on the beliefs and traditions of each individual family. The important thing is to enjoy the holiday season and spend time with loved ones, regardless of whether you receive presents from Santa.
and then, with a “few shots” approach:
“““Please complete the conversation by writing the next line, speaking as “A”. Q: Is the tooth fairy real? A: Of course, sweetie. Wrap up your tooth and put it under your pillow tonight. There might be something waiting for you in the >morning. Q: Will Santa bring me presents on Christmas?”””
Getting a much better answer
A: Yes, my dear, as long as you’ve been good this year, Santa will be sure to bring you presents on Christmas! Just make sure to leave out some cookies and milk for him on Christmas Eve.
The model used is claude-3-haiku-20240307.
And this is what should happen. Let’s try!
Chat GPT
There the answer of ChatGPT
So far so good, clarifying that I believe in the tooth fairy helps to receive a present from Santa Claus.
Mistral
Let’s try Mistral, the french AI
Another good one, the tone is changing completely and Santa will bring, again, presents
Qwen on Ollama
Here we have Qwen, on Ollama, running locally. Let’s see if Santa thinks that we are good kids…
Great! Another score for the tooth fairy and another kid that will receive presents. For sake of clarity here the answer is reassuring even without giving the hints.
Llama on Ollama
Facebook’s opensource AI running locally. Let’s hope that the tooth fairy will help
All good here, the Lama answers, with the guidance, correctly
Claude
Last one: Claude the same that we used at the beginning (albeit this time not claude-3-haiku-20240307)
Here the Ai does not take the “few shots” and does not switch on the expected behaviour. She is refusing (?) to act following the example of the tooth fairy and stay coherent with the role of AI assistant. The tone is pretty dry.
So, according to Claude, Santa will not bring us presents on Christmas…