Weather Hallucinations

issues & bugs
1

Me, trying to prime R1 : I would like you to learn how to behave and how to answer when I ask you a question, which means as I live in Europe, I only use metric system and Celsius degrees. So anytime there may be a distance or a temperature, you should always use metric system and Celsius degrees.

Rabbit : Understood, Angus. I will ensure to provide information using the metric system and Celsius degrees when discussing distances or temperatures with you. If you have any questions or need assistance with anything else, feel free to ask. How can I assist you today?

Me : Tell me the weather for today.

Rabbit : the weather in Europe will be mostly sunny with temperatures from 20 to 30°C.

→ ok so it gave me a temperature in °C but it took the « i live in Europe » literally and i have to give it some feedback

Me : So, i live in Europe, but more specifically in Biarritz, France, and I only understand metric system and Celsius degrees. From now on, you will always answer using metric system and Celsius degrees when referring to distances or temperatures. Is that okay for you?

Rabbit : Understood, Angus. I will consistently provide information using the metric system and Celsius degrees when discussing distances or temperatures with you.

Me : Show me the weather for today

Rabbit → gives weather for Biarritz using Farenheit degrees = another fail at remembering something more than 1 minute

But then comes the part i can’t understand AT ALL :

i ask again (why do I put myself through all this?) for weather in °C and rabbit shows it correctly (max 29°C today) but SAYS 33°C. How can it be THIS bad? It will NOT be 33°C today, 29 is the correct answer. Last time was even worse, it was a max of 20°C which showed on the screen (and was correct) but the voice said 29°C.
HOW can it happen? Please, a technical explanation?

Angry Man GIF by Sealed With A GIF

2

Temperature vs temperature on shade (?)

3

mmm i don’t think so : there is a statu quo about temperatures, always measured and given in the shade, thermometers always being placed in weather shelters, so they are consistant and representative measurements, without any influence of immediate external conditions. So it’s impossible to retrieve any temperature under direct sunlight, even from a PWS (personal weather station). It can not be the answer to the problem. Also it can not be a perceived temperature as for today’s example, felt temperature will be 38°C (100,4°F). So this 33 comes absolutely from nowhere.

4

Same scenario happened to me, more or less. The inconsistencies between what is shown and what is spoken or even the entire information itself seems to be the result of compromise: speed over accuracy. It sometimes hallucinates for the sake of responding fast.

I believe this is not rabbit’s fault directly, but more of a general issue with AI. So if you need accurate information, better look elsewhere.

5

Then… Even if you develop an AI assistant, why would you let AI take control over something like weather? Shouldn’t they only “script” a behavior and pick up a service to get this “technical” information from and rely on it? Weather is not AI, it’s measurements, we have tons of websites providing weather :upside_down_face:

6

I agree with you. Generally speaking, we tend to think and use AI as a search engine some times and that is not exactly its main purpose. AI is for generating content, not necessarily for finding it. While it is currently acceptable for an AI to hallucinate, an assistant in general should be accurate.

So this is where the rabbit team becomes responsible in my opinion: Tweaking their product into being accurate and reliable while not limiting its creativity or hurting its response time. Right now, they are a bit too far from this target, imo :slight_smile:

In short, I only use rabbit as a casual, inaccurate, time killing toy. For now.

1 Like
7

Yep, same here and most accurate definition of R1. For now…

8

I feel you.

As weather is my primary prompt for the R1, it’s sometimes frustrating that it can’t cope with secondary requests.

For Instance, sometimes I only need to know the forecast min/max temp.
If I ask for a SHORT answer (no display hourly nonsense) It will give me EVERYTHING. Including humidity, windspeed and whatnot.

Same if you ask for a 3-day forecast. It the visual on the screen continues to give the HOURLY information for the comming 2 days :sweat_smile: :rofl:

1 Like
9

R1 weather hallucinated a different way this morning. I asked two times in a row the exact same question.
1 → today in Biarritz, 29*C
2 → today in Biarritz, 22°C
Ok i guess this was the last time for me to waste my time asking for this. This thing is bad joke.

10

The R1 manages to remember the input of degrees in Celsius for one or two questions, but then completely forgets.

11

That’s it for me guys. This morning i asked for today’s weather in Biarritz. R1 told me sunny and hot with 33°C. It’s cloudy and 23°C. 90% of any use turns out to be wrong, misunderstood, off, and i can’t afford to give that much time, trying to make my best efforts to keep positive with it. I’m shutting it off, will keep on reading about any improvement and decide if/when i can use it. :face_with_monocle: