We need the Rabbit-Eye in Teach Mode

Teach mode is really, really cool and you can do a lot with it, but the next step should be to make real-life content usable in teach mode using Rabbit-Eye.

If you can’t imagine why, just imagine the following example:

I have a text on a piece of paper and I want to use this text in digital form (via OCR) as content in teach mode in order to fill in a field on a website, etc…

I mean, wow, that would be really great if you could do something like that with r1 and I think in terms of effort it would definitely be worth it for Rabbit to implement such an idea together with further fine-tuning from the community.

3 Likes

I have something very important to add to this suggestion! It would open up endless possibilities if you could also use the current location or, ideally, all the data that r1 can provide in Teach Mode. How mind-blowingly good that would be! And it would also be great if Teach Mode could deliver images or graphics or take screenshots and send it back to r1…

2 Likes

:slight_smile: yeah if the teach mode is actually functioning properly

2 Likes

Technically, you already can use TM with the eye. I haven’t personally tested anything too complex so I can speak to how complex a lesson you can use the camera with it for, but it does work in conjunction with the camera.

I’ve only tested basic things like running a lesson to add the picture of an item to a shopping cart instead of specifying, or having it create and send an email or make a word doc based on written text I took a picture of.

Would definitely be curious how complex a lesson you can use the picture for.

2 Likes

And we also absolutely need the possibility for r1 to read out and query selection options on select fields. :heart: :weatherrabbit: @rabbit

1 Like

Yeah it would be absolutely cool to use the Rabbit Eye when doing windows shopping to just say “add this product into my Amazon shopping cart” through a pre-trained lesson in teach mode. Then once we got all of the products in place, just say “checkout from my Amazon shopping cart” and it will just retrieve another pre-trained lesson to order the stuff you want together with a notification in R1 for your authentication PIN. This would be a real, time-saver especially during sales seasons such Black Friday or Cyber Monday.

2 Likes

I’ve noticed that there are unfortunately a lot of hurdles on the internet for 1r, I would love to teach my r1 how to solve Captcha, because that’s really a problem, at least currently. @simon

Adam Sandler Comedy GIF by Netflix Is a Joke

I have an idea, but it would take a lot of time and it would be good to develop it as a general solution, so it’s not necessarily a community job.

But you can still do so many great things with it!

Jan Böhmermann Reaction GIF by ZDF Magazin Royale

2 Likes