LAM Playground: Unlock the Power of AI Automation
The LAM Playground gives users the ability to automate tasks across websites, applications, and more, using the power of Large Action Models (LAMs). Whether you’re filling out forms, navigating complex web processes, or managing social media, LAM Playground allows you to perform these tasks simply by giving natural language instructions. Below are practical use cases and a community table for sharing more experiments and tips.
How It Works:
- Voice or Text Prompts: Command the AI with instructions like “Add a movie to my Netflix watchlist” or “Find me the latest gaming deals.”
- Real-Time Execution: Watch the AI agent as it hops between websites to gather information or complete tasks.
- Cross-Platform Potential: Currently optimized for websites, but capable of expanding into apps, desktop software, and more.
Community Use Cases & Experiments
We encourage users to explore the capabilities of LAM Playground by experimenting with tasks and sharing their experiences. Below is a table where you can add your own use cases, complete with detailed steps and outcomes. This will help build a living library of ideas for all users to reference.
~Thanks @C28 for the idea for this wiki post creation.
Example Use Cases:
Verified | Use Case Description | Prompt Example | Expected Outcome | Source | Notes |
---|---|---|---|---|---|
Add Movie to Netflix Watchlist | “Add ‘The Matrix’ to my Netflix watchlist.” | AI logs into Netflix, searches for the movie, and adds it to your watchlist. | Check login credentials. | ||
Automated Grocery List Creation | “Search for ingredients for ‘spaghetti carbonara’ and make a list.” | AI searches various cooking sites, compiles a list, and stores it. | Make sure to specify serving size. | ||
Book a Dinner Reservation on OpenTable | “Book a table for two at The French Laundry for this Saturday at 7pm.” | AI navigates to OpenTable, finds availability, and makes a reservation. | Include dietary preferences. | ||
Add an Event to Google Calendar | “Schedule a meeting with my team on Monday at 10 AM.” | AI creates a Google Calendar event and sends invites. | Check time zone settings. | ||
Set a Reminder in Todoist | “Add a reminder to buy groceries tomorrow at 6 PM in Todoist.” | AI logs into Todoist and sets up the reminder with the given time. | Confirm reminder notifications. | ||
Automated Flight Check-in | “Check me in for my flight on American Airlines for tomorrow morning.” | AI logs into the airline site, checks you in, and sends a confirmation email. | Double-check flight details. | ||
Monitor Price Drops on Amazon | “Set a price alert for the ‘Apple AirPods’ and notify me when it drops under $150.” | AI monitors the product and notifies when the price drops. | Use accurate product listing. | ||
Organize Spotify Playlists | “Move all my ‘Liked’ songs from 2023 to a new playlist called ‘2023 Favorites’.” | AI creates the playlist and organizes the songs accordingly. | Check duplicate song entries. | ||
Check top twitch streams online at the moment | “Browse twitch.tv and tell me the top 10 streams online at the moment and what game they are playing” | AI provides a list of the most popular streams online at the moment, what game they are playing and how many viewers they have | It seems like it is not an accurate top 10 | ||
Make a CV/Resume | “Browse kickresume website and make a resume for [name] whose main skills including x, y and z” | AI creates a polished CV based on the skills identified | |||
Verify If Currently Logged In | “Go to <site> and check if I am currently logged in.” |
AI goes to site and looks for clues that you are indeed logged in, like personalized welcome, profile icons, etc. (or not logged in: a big “Login” button). | I tend to do this now because I don’t want LAM to attempt 10 logins with [your_username_here] and [your_password] and make sysadmins mad. |
||
Add Topic to Rabbit Community Forum | “Go to community.rabbit.tech, create a new topic in the <category> category that says, “…”. Note at the end of the topic that this topic was written by LAM (Playground)” |
AI creates a new topic on community.rabbit.tech in the correct category, conveying the correct information and intention, and signing it by LAM Playground | It seems tricky to get it to stop for review before submitting the topic. | ||
Communicate with Healthcare Providers | "Go to <healthcare site> , send an extremely polite message to my doctor about “…”. Or “go to <medical site> and check if my doctor has written me a recent message, if so, summarize that message for me (be discreet).” |
AI either sends a message to healthcare provider or summarizes and reads out a message from the provider. | Use “extremely polite” or something similar when you want to sound nice and polite rather than terse and informal. | ||
Creating a new event | Add a new event titled ‘Team Meeting’ on <date> at <time> . |
Google Calendar | |||
Summarize unread Discord messages | On discord.com, review all unread messages in all servers and/or channels (e.g., LAMatHome, omi, and rabbit), concisely summarize the most interesting and most official messages, then mark all messages as read. I want a summary of less than 200 words for all servers/channels put together. If all the most interesting messages mean you don’t mention some servers/channels, that is OK | It methodically goes through each server and each channel and reads unread messages, scores them on interesting or officialness, then summarizes the top few messages to me in less than ~200 words. | Discord.com | I was not able to get this to work. It would look at one or two servers and one or two channels and then summarize for me. As far as I can tell, all servers still had unread messages. | |
Place Hold on Library Book | “Go to <library site> , find the first book from the Dark Materials series by Phillip Pullman, find the most recent version of it in book format, and place a hold on it.” |
It looks up book 1 of the series, checks for formats, if multiple years of book format chooses most recent, places hold. | |||
[Vision mode] Pay this Bill | “Go to the website on this bill and find a way for me to pay as a guest.” | It actually went to the correct website and told me the information I needed to enter in order to look up my bill. | At a later stage, I would really love to say, “Pay this bill”, it takes a picture, goes to the website, enters the account number and last name from the bill, solves the CAPTCHA, sees the bill amount, and pays using my pre-populated method for that site (i.e., Credit card info). |
Keep adding your use case here (Or adjust previous ones)! The more examples we gather, the better we can explore the full potential of LAM Playground and uncover exciting new possibilities. Let’s push the boundaries together!