Skip to main content

LetMeDoIt AI, an advanced AI assistant, leveraging the capabilities of ChatGPT API, Gemini Pro and AutoGen, capable of engaging in conversations, executing codes with auto-healing, and assisting you with a wide range of tasks on your local devices.

Project description

# LetMeDoIt AI

Welcome to LetMeDoIt AI, your premier virtual assistant designed to revolutionize the way you work! More than a mere chatbot, I am equipped with the capability to conduct meaningful interactions and actively carry out computing tasks as per your directives. My real-time code generation and execution prowess guarantees not only effectiveness but also efficiency in task fulfillment. With an advanced auto-correction feature, I autonomously repair any malfunctioning code segments and automatically install necessary libraries, ensuring uninterrupted workflow. My commitment to your digital safety is paramount, with inbuilt risk assessments and tailored user confirmation protocols to protect your data and device.

With LetMeDoIt AI, you can access OpenAI ChatGPT-4, Google Gemini Pro, and Microsoft AutoGen, local LLMs, all in one place, to enhance your productivity. [Read more …](https://github.com/eliranwong/letmedoit/wiki#letmedoit-ai)

Developer: [Eliran Wong](https://github.com/eliranwong)

Website: https://LetMeDoIt.ai

Source: https://github.com/eliranwong/letmedoit

Installation: https://github.com/eliranwong/letmedoit/wiki/Installation

Quick-Guide: https://github.com/eliranwong/letmedoit/wiki/Quick-Guide

Wiki: https://github.com/eliranwong/letmedoit/wiki

Video Demo: https://www.youtube.com/watch?v=Eeat6h_ktbQ&list=PLo4xQ5NqC8SEMM71xC4NNhOHJCFlW-jaJ

Support this project: https://www.paypal.me/letmedoitai

# Video Demo

[![Watch the video](https://img.youtube.com/vi/Eeat6h_ktbQ/maxresdefault.jpg)](https://youtu.be/Eeat6h_ktbQ)

Youtube Playlist: https://www.youtube.com/watch?v=Eeat6h_ktbQ&list=PLo4xQ5NqC8SEMM71xC4NNhOHJCFlW-jaJ

# LetMeDoIt Features without OpenAI?

You can utilize Google Gemini or open-source LLMs through Ollama for chat features in the LetMeDoIt AI.

If you’re seeking the complete functionality of LetMeDoIt, which includes both chat and task execution features, without the need for an Open AI API key, we offer support for Gemini Pro, Ollama, and Llama.cpp in our related project, FreeGenius AI:

https://github.com/eliranwong/freegenius

# Requirements

  1. ChatGPT API key (read https://github.com/eliranwong/letmedoit/wiki/ChatGPT-API-Key)

  2. [Python](https://www.python.org) version 3.8-3.11; read [Install a Supported Python Version](https://github.com/eliranwong/letmedoit/wiki/Install-a-Supported-Python-Version)

  3. Supported OS: Windows / macOS / Linux / ChromeOS / Android (Termux)

# Recent Additions

[Generate tweets](https://github.com/eliranwong/letmedoit/wiki/Social-Media)

<img width=”798” alt=”twitter” src=”https://github.com/eliranwong/letmedoit/assets/25262722/d19c7bca-3bdc-48be-a907-b75afb34615b”>

[Run Local LLM Offline](https://github.com/eliranwong/letmedoit/wiki/Run-Local-LLM-Offline)

<img width=”832” alt=”support_localllm” src=”https://github.com/eliranwong/letmedoit/assets/25262722/587aba21-7f89-4b78-bfc4-3b32b442b287”>

[Talk to LetMeDoIt in Multiple Languages](https://github.com/eliranwong/letmedoit/wiki/Speak-to-LetMeDoIt-AI)

![talk_to_letmedoit](https://github.com/eliranwong/letmedoit/assets/25262722/6aa33f2d-8971-45ad-b5ac-e8f4e290bff5)

[Analyze audio](https://github.com/eliranwong/letmedoit/wiki/Analyze-Audio)

<img width=”1440” alt=”analyze_audio” src=”https://github.com/eliranwong/letmedoit/assets/25262722/24e49f3b-289d-40f6-bf9c-45ed1e0eeed6”>

[Search / Analyze Financial Data](https://github.com/eliranwong/letmedoit/wiki/Search-Financial-Data)

<img width=”1312” alt=”search_financial_data” src=”https://github.com/eliranwong/letmedoit/assets/25262722/9976f15b-85e1-4c5b-97a0-5124c04ffa8a”>

[Access Weather Information](https://github.com/eliranwong/letmedoit/wiki/Search-Weather-Information)

![test_weather_plugin](https://github.com/eliranwong/letmedoit/assets/25262722/e9fd4376-1579-40e0-b1b2-a2b7c5583f0c)

[Search and Load Old Conversations](https://github.com/eliranwong/letmedoit/wiki/Search-and-Load-Old-Conversations)

![search_chat_records_0](https://github.com/eliranwong/letmedoit/assets/25262722/f2fb9c1c-d239-4723-b9ff-65634863d96f)

[System Tray for Quick Access](https://github.com/eliranwong/letmedoit/wiki/System-Tray-for-Quick-Access)

<img width=”1440” alt=”system_tray” src=”https://github.com/eliranwong/letmedoit/assets/25262722/639d9cd4-a42a-4ca6-85bb-c290f38c023d”>

[Work with Database Files](https://github.com/eliranwong/letmedoit/wiki/Work-with-Database-Files)

<img width=”1440” alt=”work_with_database” src=”https://github.com/eliranwong/letmedoit/assets/25262722/c163bf47-8d0b-4831-a51d-211c9455d9b6”>

[Support Android & Termux-API Commands](https://github.com/eliranwong/letmedoit/wiki/Android-Support)

<img width=”1215” alt=”termux_api_command” src=”https://github.com/eliranwong/letmedoit/assets/25262722/d5fcfd5f-cbf4-45d3-9e1f-d82ed9aa96a1”>

[Work with text selection in third-party applications](https://github.com/eliranwong/letmedoit/wiki/Work-with-Text-Selection)

<img width=”1432” alt=”download_youtube_video” src=”https://github.com/eliranwong/letmedoit/assets/25262722/89a556ce-f524-44b5-b143-85a48e81f20e”>

[Modify your images with simple words](https://github.com/eliranwong/letmedoit/wiki/Modify-your-images-with-simple-words)

![Modify images](https://github.com/eliranwong/letmedoit/assets/25262722/0aff4481-9f72-41db-865f-36dc7fcc46ae)

[Create a map anytime](https://github.com/eliranwong/letmedoit/wiki/Create-Maps)

![Map Creation](https://github.com/eliranwong/letmedoit/assets/25262722/90971eef-4943-4ef2-8f2b-34e80ee1fd0e)

[You can name your assistants!](https://github.com/eliranwong/letmedoit/wiki/Change-Assistant-Name)

![letmedoit_assistants](https://github.com/eliranwong/letmedoit/assets/25262722/f0362159-4e3a-4b93-bf9d-77040fec988c)

LetMeDoIt AI just got smarter with memory retention!

[Plugin - memory](https://github.com/eliranwong/letmedoit/blob/main/pip/letmedoit/plugins/memory.py)

![memory_after_restarted](https://github.com/eliranwong/letmedoit/assets/25262722/6bd4a839-89fe-4691-b7af-8150209f082b)

[Plugin - create statistical graphics](https://github.com/eliranwong/letmedoit/wiki/Create-Statistical-Graphics)

![create_statistical_graphics](https://github.com/eliranwong/letmedoit/assets/25262722/3b7337ad-5eba-4761-8037-b245b9d78311)

[Plugin - anaylze images](https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Analyze-Images)

![analyze_image_demo](https://github.com/eliranwong/letmedoit/assets/25262722/e8767d02-bcc7-47f7-8169-29a0325e9ef9)

[Plugin - anaylze files](https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Analyze-Files)

![integration_autogen_retriever](https://github.com/eliranwong/letmedoit/assets/25262722/0e31735c-5126-41ac-881c-eb8abce2aace)

[Execute code with auto-healing and risk assessment](https://github.com/eliranwong/letmedoit/wiki/Command-Execution)

![code_management](https://github.com/eliranwong/myhand/assets/25262722/fc6c4527-cf0b-47fe-b1e6-3047baf4eb86)

# Examples of LetMeDoIt Built-in Features (selective only):

# Examples of Plugin Features (selective only):

Latest LetMeDoIt Plugins allow you to acheive variety of tasks with natural language:

  • [NEW] generate tweets

> Post a short tweet about LetMeDoIt AI

  • [NEW] analyze audio

> transcribe “meeting_records.mp3”

  • [NEW] search / analyze financial data

> What was the average stock price of Apple Inc. in 2023?

> Analyze Apple Inc’s stock price over last 5 years.

  • [NEW] search weather information

> what is the current weather in New York?

  • [NEW] search latest news

> tell me the latest news about ChatGPT

  • [NEW] search old conversations

> search for “joke” in chat records

  • [NEW] load old conversations

> load chat records with this ID: 2024-01-20_19_21_04

  • [NEW] connect a sqlite file and fetch data or make changes

> connect /temp/my_database.sqlite and tell me about the tables that it contains

  • [NEW] integrated Google Gemini Pro (+Vision) multiturn chat, e.g.

> ask Gemini Pro to write an article about Google

  • [NEW] integrated Google PaLM 2 multiturn chat, e.g.

> ask PaLM 2 to write an article about Google

  • [NEW] integrated Google Codey multiturn chat, e.g.

> ask Codey how to use decorators in python

  • [NEW] create ai assistants based on the requested task, e.g.

> create a team of AI assistants to write a Christmas drama

> create a team of AI assistants to build a scalable and customisable python application to remove image noise

  • execute python codes with auto-healing feature and risk assessment, e.g.

> join “01.mp3” and “02.mp3” into a single file

  • execute system commands to achieve specific tasks, e.g.

> Launch VLC player and play music in folder “music_folder”

  • manipulate files, e.g.

> remove all desktop files with names starting with “Screenshot”

> zip “folder1”

  • save memory, e.g.

> Remember, my birthday is January 1st.

  • send Whatsapp messages, e.g.

> send Whatsapp message “come to office 9am tomorrow” to “staff” group

  • retrieve memory, e.g.

> When is my birthday?

  • search for online information when ChatGPT lacks information, e.g.

> Tell me somtheing about LetMeDoIt AI?

  • add google or outlook calendar events, e.g.

> I am going to London on Friday. Add it to my outlook calendar

  • send google or outlook emails, e.g.

> Email an appreciation letter to someone@someone.com

  • analyze files, e.g.

> Summarize ‘Hello_World.docx’

  • analyze web content, e.g.

> Give me a summary on https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/1171397/CC3_feb20.pdf

  • analyze images, e.g.

> Describe the image ‘Hello.png’ in detail

> Compare images insider folder ‘images’

  • create images, e.g.

> Create an app icon for “LetMeDoIt AI”

  • modify images, e.g.

> Make a cartoon verion of image “my_photo.png”

  • remove image background, e.g.

> Remove image background of “my_photo.png”

  • create qrcode, e.g.

> Create a QR code for the website: https://letmedoit.ai

  • create maps, e.g.

> Show me a map with Hype Park Corner and Victoria stations pinned

  • create statistical graphics, e.g.

> Create a bar chart that illustrates the correlation between each of the 12 months and their respective number of days

> Create a pie chart: Mary £10, Peter 8£, John £15

  • solve queries about dates and times, e.g.

> What is the current time in Hong Kong?

  • solve math problem, e.g.

> You have a standard deck of 52 playing cards, which is composed of 4 suits: hearts, diamonds, clubs, and spades. Each suit has 13 cards: Ace through 10, and the face cards Jack, Queen, and King. If you draw 5 cards from the deck, in how many ways can you draw exactly 3 cards of one suit and exactly 2 cards of another suit?

  • pronounce words in different dialects, e.g.

> read tomato in American English

> read tomato in British English

> read 中文 in Mandarin

> read 中文 in Cantonese

  • download Youtube video files, e.g.

> Download https://www.youtube.com/watch?v=CDdvReNKKuk

  • download Youtube audio files and convert them into mp3 format, e.g.

> Download https://www.youtube.com/watch?v=CDdvReNKKuk and convert it into mp3

  • edit text with built-in or custom text editors, e.g.

> Edit README.md

  • improve language skills, e.g. British English trainer, e.g.

> Improve my writing according to British English style

  • convert text display, e.g. from simplified Chinese to traditional Chinese, e.g.

> Translate your last response into Chinese

  • create entry aliases, input suggestions, predefined contexts and instructions, e.g.

> !auto

Read more about LetMeDoIt Plugins at https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Overview

# Documentation

Read https://github.com/eliranwong/letmedoit/wiki

# Install with pip

> pip install –upgrade letmedoit

> letmedoit

Alternately, you may install “myhand”, “cybertask” and “taskwiz”:

> pip install –upgrade myhand cybertask taskwiz

> myhand

> cybertask

> taskwiz

Tips: You can change the assistant’s name regardless of the package you choose to install.

## Android Users

> pip install –upgrade letmedoit_android

> letmedoit

Remarks: Please note that the name of the Android package is “letmedoit_android” but the cli command remains the same, i.e. “letmedoit”

Read more at: https://github.com/eliranwong/letmedoit/wiki/Android-Support

# Install with pip and venv (recommended)

## macOS / Linux Users

> python3 -m venv letmedoit

> source letmedoit/bin/activate

> pip install –upgrade letmedoit

> letmedoit

## Windows Users

> python -m venv letmedoit

> .letmedoitScriptsactivate

> pip install –upgrade letmedoit

> letmedoit

## Android Users

> cd

> python -m venv –system-site-packages letmedoit

> source letmedoit/bin/activate

> pip install letmedoit_android

> letmedoit

Read more at: https://github.com/eliranwong/letmedoit/wiki/Installation

# Usage and Options

https://github.com/eliranwong/letmedoit/wiki/Command-Line-Interface-Options

# Setup of Multiple Assistants

https://github.com/eliranwong/letmedoit/wiki/Change-Assistant-Name#suggestion-on-setup-of-multiple-assistants

# Quick Quide

https://github.com/eliranwong/letmedoit/wiki/Quick-Guide

# Upgrade

You can manually upgrade by running:

> pip install –upgrade letmedoit

You can also enable [Automatic Upgrade Option](https://github.com/eliranwong/letmedoit/wiki/Automatic-Upgrade-Option) on macOS and Linux.

# Features

LetMeDoIt is an advanced AI assistant that brings a wide range of powerful features to enhance your virtual assistance experience. Here are some key features of LetMeDoIt:

  • Open source

  • Cross-Platform Compatibility

  • Access to Real-time Internet Information

  • Versatile Task Execution

  • Harnessing the Power of Python

  • Customizable and Extensible

  • Seamless Integration with Other Virtual Assistants

  • Natural Language Support

Read more at https://github.com/eliranwong/letmedoit/wiki/Features

# Highlight - Plugins

Developers can write their own plugins to add functionalities or to run customised tasks with LetMeDoIt

Read more at https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Overview

Check our built-in plugins at: https://github.com/eliranwong/letmedoit/tree/main/plugins

# Highlight - Command Execution

LetMeDoIt AI is now equipped with an [auto-healing feature for Python code](https://github.com/eliranwong/letmedoit/wiki/Python-Code-Auto%E2%80%90heal-Feature).

Overview: Command execution enables you to:

  1. Retrieve the requested information from your device.

  2. Perform computing tasks on your device.

  3. Interact with third-party applications.

  4. Construct anything that system commands and Python libraries are capable of executing.

LetMeDoIt goes beyond just being a chatbot by offering a unique and powerful capability - the ability to execute commands and perform computing tasks on your behalf. Unlike a mere chatbot, LetMeDoIt can interact with your computer system and carry out specific commands to accomplish various computing tasks. This feature allows you to leverage the expertise and efficiency of LetMeDoIt to automate processes, streamline workflows, and perform complex tasks with ease. However, it is essential to remember that with great power comes great responsibility, and users should exercise caution and use this feature at their own risk.

[Disclaimer](https://github.com/eliranwong/letmedoit/wiki/Command-Execution#disclaimer)

[Confirmation Prompt Options for Command Execution](https://github.com/eliranwong/letmedoit/wiki/Command-Execution#confirmation-prompt-options-for-command-execution)

Read more at https://github.com/eliranwong/letmedoit/wiki/Command-Execution

# Comparison with ChatGPT

LetMeDoIt offers advanced features beyond standard ChatGPT, including task execution on local devices and real-time access to the internet.

Read https://github.com/eliranwong/letmedoit/wiki/Compare-with-ChatGPT

# Comparison with ShellGPT

[ShellGPT](https://github.com/TheR1D/shell_gpt) only supports platform that run shell command-prompt. Therefore, ShellGPT does not support Windows.

In most cases, LetMeDoIt run Python codes for task execution. This makes LetMeDoIt terms of platforms, LetMeDoIt was developed and tested on Windows, macOS, Linux, ChromeOS and Termux (Android).

In addition, LetMeDoIt offers more options for risk managements:

https://github.com/eliranwong/letmedoit/wiki/Command-Execution#confirmation-prompt-options-for-command-execution

# Comparison with Open Interpreter

Both LetMeDoIt AI and the [Open Interpreter](https://github.com/KillianLucas/open-interpreter) have the ability to execute code on a local device to accomplish specific tasks. Both platforms employ the same principle for code execution, which involves using ChatGPT function calls along with the Python exec() function.

However, LetMeDoIt AI offers additional advantages, particularly in terms of [customization and extensibility through the use of plugins](https://github.com/eliranwong/letmedoit/wiki/Plugins-%E2%80%90-Overview). These plugins allow users to tailor LetMeDoIt AI to their specific needs and enhance its functionality beyond basic code execution.

One key advantage of LetMeDoIt AI is the seamless integration with the Open Interpreter. You can conveniently launch the Open Interpreter directly from LetMeDoIt AI by running the command “!interpreter” [[read more](https://github.com/eliranwong/letmedoit/assets/25262722/4233b3c8-364e-466b-8218-c2dca7c134e5)]. This integration eliminates the need to choose between the two platforms; you can utilize both simultaneously.

Additionally, LetMeDoIt integrates [AutoGen Assistants and Builder](https://github.com/eliranwong/letmedoit/wiki/Integration-with-AutoGen) and Google AI tools, like Gemini Pro, Gemini Pro Vision & PaLM 2, making it convenient to have all these powerful tools in one place.

# Comparison with Siri and Others

Unlike popular options such as Siri (macOS, iOS), Cortana (Windows), and Google Assistant (Android), LetMeDoIt offers enhanced power, customization, flexibility, and compatibility.

Read https://github.com/eliranwong/letmedoit/wiki/Features

# Integrateion with AutoGen and Open Interpreter

[Integration with Google AI Tools](https://github.com/eliranwong/letmedoit/wiki/Integration-with-Google-AI-Tools)

[Integration with AutoGen](https://github.com/eliranwong/letmedoit/wiki/Integration-with-AutoGen)

[Launch Open Interpreter from LetMeDoIt AI](https://github.com/eliranwong/letmedoit/wiki/Integration-with-Open-Interpreter)

![integrate_autogen_retriever_1](https://github.com/eliranwong/letmedoit/assets/25262722/9ab39e40-d51e-44d4-9266-eba1dd3b5f97)

# Mobile Support

LetMeDoIt is also tested on [Termux](https://termux.dev/en/). LetMeDoIt also integrates [Termux:API](https://wiki.termux.com/wiki/Termux:API) for task execution.

For examples, users can run on Android:

> open Google Chrome and perform a search for “ChatGPT”

> share text “Hello World!” on Android

Read more at: https://github.com/eliranwong/letmedoit/wiki/Android-Support

# Donations

https://www.paypal.me/letmedoitai

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

letmedoit-2.1.83.tar.gz (8.3 MB view hashes)

Uploaded Source

Built Distribution

letmedoit-2.1.83-py3-none-any.whl (8.3 MB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page