A CLI aimed at making it easier to run QuantConnect's LEAN engine locally and in the cloud
Project description
QuantConnect Lean CLI
This CLI is still in development. Bugs may still occur and breaking changes may still happen before the first beta release. Use with caution.
The Lean CLI is a cross-platform CLI aimed at making it easier to develop with the LEAN engine locally and in the cloud.
Table of Contents
Roadmap
The following features are currently planned to be implemented (in order of priority):
- Project scaffolding
- Local autocompletion
- CLI configuration
- Local backtesting
- Local debugging
- Local research environment
- Cloud synchronization
- Cloud backtesting
- First beta release
- Local data downloading
- Local optimization
- Local backtest visualization
- Local live trading
- Cloud optimization
- Cloud live trading
- Local library support
Installation
The CLI can be installed and updated by running pip install -U lean
.
Note that many commands in the CLI require Docker to run. See Get Docker for instructions on how to install Docker for your operating system.
After installing the CLI, simply cd
into an empty directory and run lean init
to set up a Lean CLI project. This will scaffold a standard directory structure for you to hit the ground running.
Usage
The Lean CLI supports multiple workflows. The examples below serve as a starting point, you're free to mix local and cloud features in any way you'd like.
A locally-focused workflow (local development, local execution) with the CLI may look like this:
cd
into the Lean CLI project.- Run
lean create-project "RSI Strategy"
to create a new project with some basic code to get you started. - Work on your strategy in
./RSI Strategy
. - Run
lean research "RSI Strategy"
to launch a Jupyter Lab session to work on research notebooks. - Run a backtest with
lean backtest "RSI Strategy"
. This runs your backtest in a Docker container containing the same packages as the ones used on QuantConnect.com, but with your own data.
A cloud-focused workflow (local development, cloud execution) with the CLI may look like this:
cd
into the Lean CLI project.- Run
lean cloud pull
to pull remotely changed files. - Start programming locally and run backtests in the cloud with
lean cloud backtest "Project Name" --open --push
whenever there is something to backtest. The--open
flag means that the backtest results will be opened in the browser when done, while the--push
flag means that local changes are pushed to the cloud before running the backtest. - Whenever you need to create a new project, run
lean create-project "Project Name"
andlean cloud push --project "Project Name"
to create a new project containing some basic code and to push it to the cloud. - When you're done for the moment, run
lean cloud push
to push all locally changed files to the cloud.
Commands
lean backtest
lean cloud backtest
lean cloud pull
lean cloud push
lean config get
lean config list
lean config set
lean create-project
lean init
lean login
lean logout
lean research
lean backtest
Backtest a project locally using Docker.
Usage: lean backtest [OPTIONS] PROJECT
Backtest a project locally using Docker.
If PROJECT is a directory, the algorithm in the main.py or Main.cs file inside it will be executed.
If PROJECT is a file, the algorithm in the specified file will be executed.
Go to the following url to learn how to debug backtests locally using the Lean CLI:
https://github.com/QuantConnect/lean-cli#local-debugging
Options:
--output PATH Directory to store results in (defaults to PROJECT/backtests/TIMESTAMP)
--update Pull the selected LEAN engine version before running the backtest
--version TEXT The LEAN engine version to run (defaults to the latest installed version)
--debug [pycharm|ptvsd|mono] Enable a certain debugging method (see --help for more information)
--help Show this message and exit.
-c, --config FILE The Lean configuration file that should be used (defaults to the nearest lean.json)
--verbose Enable debug logging
See code: lean/commands/backtest.py
lean cloud backtest
Run a backtest in the cloud.
Usage: lean cloud backtest [OPTIONS] PROJECT
Run a backtest in the cloud.
PROJECT should be the name or id of a cloud project.
If the project that has to be backtested has been pulled to the local drive with `lean cloud pull` it is possible to
use the --push option to push local modifications to the cloud before running the backtest.
Options:
--name TEXT The name of the backtest (a random one is generated if not specified)
--push Push local modifications to the cloud before running the backtest
--open Automatically open the browser with the results when the backtest is finished
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/cloud/backtest.py
lean cloud pull
Pull projects from QuantConnect to the local drive.
Usage: lean cloud pull [OPTIONS]
Pull projects from QuantConnect to the local drive.
This command overrides the content of local files with the content of their respective counterparts in the cloud.
This command will not delete local files for which there is no counterpart in the cloud.
If you pull a specific project, all the libraries linked to that project are pulled as well (recursively).
Options:
--project TEXT Name or id of the project to pull (all cloud projects if not specified)
--pull-bootcamp Pull Boot Camp projects (disabled by default)
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/cloud/pull.py
lean cloud push
Push local projects to QuantConnect.
Usage: lean cloud push [OPTIONS]
Push local projects to QuantConnect.
This command overrides the content of cloud files with the content of their respective local counterparts.
This command will not delete cloud files which don't have a local counterpart.
If you push a specific project, all the libraries linked to that project are pushed as well (recursively).
Options:
--project DIRECTORY Path to the local project to push (all local projects if not specified)
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/cloud/push.py
lean config get
Get the current value of a configurable option.
Usage: lean config get [OPTIONS] KEY
Get the current value of a configurable option.
Sensitive options like credentials cannot be retrieved this way for security reasons. Please open
~/.lean/credentials if you want to see your currently stored credentials.
Run `lean config list` to show all available options.
Options:
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/config/get.py
lean config list
List the configurable options and their current values.
Usage: lean config list [OPTIONS]
List the configurable options and their current values.
Options:
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/config/list.py
lean config set
Set a configurable option.
Usage: lean config set [OPTIONS] KEY VALUE
Set a configurable option.
Run `lean config list` to show all available options.
Options:
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/config/set.py
lean create-project
Create a new project containing starter code.
Usage: lean create-project [OPTIONS] NAME
Create a new project containing starter code.
If NAME is a path containing subdirectories those will be created automatically.
The default language can be set using `lean config set default-language python/csharp`.
Options:
-l, --language [python|csharp] The language of the project to create
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/create_project.py
lean init
Bootstrap a Lean CLI project.
Usage: lean init [OPTIONS]
Bootstrap a Lean CLI project.
Options:
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/init.py
lean login
Log in with a QuantConnect account.
Usage: lean login [OPTIONS]
Log in with a QuantConnect account.
If user id or API token is not provided an interactive prompt will show.
Credentials are stored in ~/.lean/credentials and are removed upon running `lean logout`.
Options:
-u, --user-id TEXT QuantConnect.com user id
-t, --api-token TEXT QuantConnect.com API token
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/login.py
lean logout
Log out and remove stored credentials.
Usage: lean logout [OPTIONS]
Log out and remove stored credentials.
Options:
--help Show this message and exit.
--verbose Enable debug logging
See code: lean/commands/logout.py
lean research
Run a Jupyter Lab environment locally using Docker.
Usage: lean research [OPTIONS] PROJECT
Run a Jupyter Lab environment locally using Docker.
Options:
--port INTEGER The port to run Jupyter Lab on [default: 8888]
--update Pull the selected research environment version before starting it
--version TEXT The version of the research environment version to run (defaults to the latest installed version)
--help Show this message and exit.
-c, --config FILE The Lean configuration file that should be used (defaults to the nearest lean.json)
--verbose Enable debug logging
See code: lean/commands/research.py
Local debugging
To debug backtests locally some additional setup is needed depending on the editor and language you use.
Note: When debugging C#, after you attach to the debugger, a breakpoint will be hit for which your editor will tell you it has no code for. This is expected behavior, simply continue from that breakpoint and your algorithm will start running.
VS Code + Python
- Install the Python extension.
- Run the
lean backtest
command with the--debug ptvsd
option. - Wait until the CLI tells you to attach to the debugger.
- In VS Code, open the Run tab and run the configuration called "Debug Python with Lean CLI" (this configuration is created when you run
lean init
).
VS Code + C#
- Install version 15.8 of the Mono Debug extension. You can do this by first installing the latest version and then clicking on the arrow button next to the Uninstall button, which will open a context menu containing the "Install Another Version" option.
- Run the
lean backtest
command with the--debug mono
option. - Wait until the CLI tells you to attach to the debugger.
- In VS Code, open the Run tab and run the configuration called "Debug C# with Lean CLI" (this configuration is created when you run
lean init
).
PyCharm + Python
Note: This combination requires PyCharm Professional.
- In PyCharm, start debugging using the "Debug with Lean CLI" run configuration (this configuration is created when you run
lean init
). - Run the
lean backtest
command with the--debug pycharm
option.
Visual Studio + C#
- Install the VSMonoDebugger extension.
- In Visual Studio, go to "Extensions > Mono > Settings" and enter the following settings:
- Remote Host IP: 127.0.0.1
- Remote Host Port: 55555
- Mono Debug Port: 55555
- Run the
lean backtest
command with the--debug mono
option. - Wait until the CLI tells you to attach to the debugger.
- In Visual Studio, attach to the debugger using "Extensions > Mono > Attach to mono debugger".
Rider + C#
- Run the
lean backtest
command with the--debug mono
option. - Wait until the CLI tells you to attach to the debugger.
- In Rider, start debugging using the "Debug with Lean CLI" run configuration (this configuration is created when you run
lean init
).
Development
To work on the Lean CLI, clone the repository, enter an environment containing Python 3.6+ and run pip install -r requirements.txt
. This command will install the required dependencies and installs the CLI in editable mode. This means you'll be able to edit the code and immediately see the results the next time you run lean
.
If you need to add dependencies, first update setup.py
(if it is a production dependency) or requirements.txt
(if it is a development dependency) and then re-run pip install -r requirements.txt
.
The automated tests can be ran by running pytest
. The filesystem and HTTP requests are mocked when running tests to make sure they run in an isolated environment.
To update the commands reference part of the readme run python scripts/readme.py
from the root of the project.
Maintainers can publish new releases by pushing a Git tag containing the new version to GitHub. This will trigger a GitHub Actions workflow which releases the current main
branch to PyPI with the value of the tag as version. Make sure the version is not prefixed with "v".
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.