I've been thinking for a while about creating a personal AI assistant based on Telegram. It would be great to potentially turn this into a platform where anyone could write plugins. The main goal is to make repetitive tasks (sending reminders, writing emails, checking text, posting) easier, ideally either fully automated or executable "on the go".
The plan is roughly as follows: there is a central AI agent that receives all user messages and then selects an action from existing plugins/agents (search the internet, write and post a message in Telegram, set an alarm, correct grammar, record an entry in a personal diary, etc.). Each plugin/agent should have a unified format for interacting with the main agent (what parameters are expected as input, what the agent can do, what will be output, etc.).
Important elements:
- Memory for each user about preferences based on previous interactions.
- Memory in RAG format about previous uses (successful and unsuccessful) to assist future runs. For example, last time for request X, we did Y and the user liked it, so we will respond similarly to similar requests.
- Access to functional elements (sending emails, searching the internet, adding entries to the database, etc.).
From the current agent frameworks (like CrewAI), I dislike the complete lack of control and unpredictability. The system somehow works internally, and it's unclear what's happening.
Overall, what do you think about a project like this? Are there any analogs? What should I read in this direction? What pitfalls should I be aware of? Would you use such an assistant?