File added late

1 file was added to this release more than 14 days after its initial publication. Inspect the release files before installing.

Flexible & Efficient Heterogeneous Transfer Toolkit

Getting Started

DLSlime offers a set of peer-to-peer communication interfaces. For instance, consider the task of batched slice assignment from a remote tensor to a local tensor. You can accomplish this using the following APIs.

Assignment Operation .

Here are some examples of DLSlime interface.

RDMA RC Mode

RDMA RC Read (Sync / Async mode)

python example/python/p2p_rdma_rc_read.py

RDMA RC Read (Coroutine mode)

python example/python/p2p_rdma_rc_read_coroutine.py

RDMA RC Write (Sync / Async mode)

python example/python/p2p_rdma_rc_write.py

RDMA RC Write with immediate data (Sync / Async mode)

python example/python/p2p_rdma_rc_write_with_imm_data.py

RDMA RC Send/Recv

python example/python/p2p_rdma_rc_send_recv.py

python example/python/p2p_rdma_rc_send_recv_gdr.py

DLSlime torch backend

python example/python/p2p_rdma_rc_send_recv_torch.py --rank 0
python example/python/p2p_rdma_rc_send_recv_torch.py --rank 1

NVLink Mode

# initiator
python example/python/p2p_nvlink.py --initiator-url "127.0.0.1:6006" --target-url "127.0.0.1:6007" --role initiator

# target
python example/python/p2p_nvlink.py --initiator-url "127.0.0.1:6006" --target-url "127.0.0.1:6007" --role target

NVShmem Mode

# send
python example/python/p2p_nvshmem_ibgda_sendrecv.py --rank 0 --world-size 2

# recv
python example/python/p2p_nvshmem_ibgda_sendrecv.py --rank 1 --world-size 2

[!Caution] DLSlime NVShmem transfer engine is in the experimental stage.

Install

pip install

pip install dlslime==0.0.1.post8

[!Note] The DLSlime pip version is built with default FLAGS (see Build from source for details).

Build from source

Python

git clone https://github.com/deeplink-org/DLSlime.git
FLAG=<ON|OFF> pip install -v --no-build-isolation -e .

CPP

git clone https://github.com/deeplink-org/DLSlime.git
mkdir -p DLSlime/build && cmake -DFLAG=<ON|OFF> ..

Build flags

The FLAG can be

Flag	Description	Platform	default
`BUILD_RDMA`	Build RDMA Transfer Engine	Hetero	ON
`BUILD_PYTHON`	Build Python wrapper	Hetero	ON
`BUILD_NVLINK`	Build NVLINK Transfer Engine	GPGPU	OFF
`BUILD_NVSHMEM`	Build NVShmem Transfer Engine	NVIDIA	OFF
`BUILD_TORCH_PLUGIN`	Build DLSlime as a torch backend	Hetero	OFF
`USE_GLOO_BACKEND`	Use GLOO RDMA Send/Recv torch backend	Hetero	OFF

[!Note] Please enable USE_MECA when using DLSlime as a torch backend in Metax platform.

Benchmark

GDRDMA P2P Read/Write

Platform: NVIDIA ConnectX-7 HHHL Adapter Card; 200GbE (default mode) / NDR200 IB; Dual-port QSFP112; PCIe 5.0 x16 with x16 PCIe extension option; RoCE v2.

#BS=1, #Concurrency=1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 1 --node-rank 1 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 1 --num-iteration 100 --num-concurrency 1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 1 --node-rank 0 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 1 --num-iteration 100 --num-concurrency 1

Transfer Engine	#Channels	Message Size (bytes)	Batch Size	Num Concurrency	Avg Latency(ms)	Bandwidth(MB/s)
dlslime	1	2,048	1	1	0.039	52
dlslime	1	4,096	1	1	0.037	111
dlslime	1	8,192	1	1	0.038	216
dlslime	1	16,384	1	1	0.037	442
dlslime	1	32,768	1	1	0.039	836
dlslime	1	65,536	1	1	0.039	1689
dlslime	1	131,072	1	1	0.041	3195
dlslime	1	262,144	1	1	0.043	6059
dlslime	1	524,288	1	1	0.049	10689
dlslime	1	1,048,576	1	1	0.062	17012
dlslime	1	2,097,152	1	1	0.083	25154
dlslime	1	4,194,304	1	1	0.127	33112
dlslime	1	8,388,608	1	1	0.211	39797
dlslime	1	16,777,216	1	1	0.382	43893
dlslime	1	33,554,432	1	1	0.726	46244
dlslime	1	67,108,864	1	1	1.412	47518
dlslime	1	134,217,728	1	1	2.783	48235

#BS=64, #Concurrency=1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 1 --node-rank 1 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 1 --node-rank 0 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 1

Transfer Engine	#Channels	Message Size (bytes)	Batch Size	Num Concurrency	Avg Latency(ms)	Bandwidth(MB/s)
dlslime	1	2,048	64	1	0.084	1562
dlslime	1	4,096	64	1	0.082	3213
dlslime	1	8,192	64	1	0.086	6095
dlslime	1	16,384	64	1	0.093	11249
dlslime	1	32,768	64	1	0.115	18193
dlslime	1	65,536	64	1	0.158	26542
dlslime	1	131,072	64	1	0.243	34498
dlslime	1	262,144	64	1	0.414	40549
dlslime	1	524,288	64	1	0.758	44248
dlslime	1	1,048,576	64	1	1.443	46510
dlslime	1	2,097,152	64	1	2.809	47782
dlslime	1	4,194,304	64	1	5.555	48327
dlslime	1	8,388,608	64	1	11.041	48624
dlslime	1	16,777,216	64	1	22.003	48798
dlslime	1	33,554,432	64	1	43.941	48872
dlslime	1	67,108,864	64	1	87.809	48912
dlslime	1	134,217,728	64	1	175.512	48942

#BS=64, #Concurrency=8

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 1 --node-rank 1 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 8

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 1 --node-rank 0 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 8

Transfer Engine	#Channels	Message Size (bytes)	Batch Size	Num Concurrency	Avg Latency(ms)	Bandwidth(MB/s)
dlslime	1	2,048	64	8	0.037	3519
dlslime	1	4,096	64	8	0.038	6948
dlslime	1	8,192	64	8	0.038	13758
dlslime	1	16,384	64	8	0.04	26416
dlslime	1	32,768	64	8	0.057	36997
dlslime	1	65,536	64	8	0.098	42618
dlslime	1	131,072	64	8	0.184	45602
dlslime	1	262,144	64	8	0.356	47148
dlslime	1	524,288	64	8	0.699	47975
dlslime	1	1,048,576	64	8	1.384	48478
dlslime	1	2,097,152	64	8	2.755	48709
dlslime	1	4,194,304	64	8	5.498	48823
dlslime	1	8,388,608	64	8	10.982	48884
dlslime	1	16,777,216	64	8	21.954	48908
dlslime	1	33,554,432	64	8	43.895	48923
dlslime	1	67,108,864	64	8	87.766	48936
dlslime	1	134,217,728	64	8	175.517	48940

GDRDMA Aggregated Bandwidth

#BS=1, #Concurrency=1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 8 --node-rank 1 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 1 --num-iteration 100 --num-concurrency 1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 8 --node-rank 0 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 1 --num-iteration 100 --num-concurrency 1

Transfer Engine	#Channels	Message Size (bytes)	Batch Size	Num Concurrency	Avg Latency(ms)	Bandwidth(MB/s)
dlslime	8	2,048	1	1	0.051	157
dlslime	8	4,096	1	1	0.042	768
dlslime	8	8,192	1	1	0.04	1576
dlslime	8	16,384	1	1	0.054	2929
dlslime	8	32,768	1	1	0.051	5713
dlslime	8	65,536	1	1	0.052	11547
dlslime	8	131,072	1	1	0.055	22039
dlslime	8	262,144	1	1	0.058	42313
dlslime	8	524,288	1	1	0.064	74753
dlslime	8	1,048,576	1	1	0.072	127489
dlslime	8	2,097,152	1	1	0.101	184823
dlslime	8	4,194,304	1	1	0.149	246861
dlslime	8	8,388,608	1	1	0.237	299510
dlslime	8	16,777,216	1	1	0.403	340252
dlslime	8	33,554,432	1	1	0.743	364918
dlslime	8	67,108,864	1	1	1.423	378620
dlslime	8	134,217,728	1	1	2.79	384630

#BS=64, #Concurrency=1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 8 --node-rank 1 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 1

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 8 --node-rank 0 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 1

Transfer Engine	#Channels	Message Size (bytes)	Batch Size	Num Concurrency	Avg Latency(ms)	Bandwidth(MB/s)
dlslime	8	2,048	64	1	0.091	11690
dlslime	8	4,096	64	1	0.081	24403
dlslime	8	8,192	64	1	0.091	45926
dlslime	8	16,384	64	1	0.098	84092
dlslime	8	32,768	64	1	0.117	138696
dlslime	8	65,536	64	1	0.16	206866
dlslime	8	131,072	64	1	0.241	273976
dlslime	8	262,144	64	1	0.415	320008
dlslime	8	524,288	64	1	0.757	353714
dlslime	8	1,048,576	64	1	1.439	372217
dlslime	8	2,097,152	64	1	2.819	381397
dlslime	8	4,194,304	64	1	5.555	386489
dlslime	8	8,388,608	64	1	11.044	388927
dlslime	8	16,777,216	64	1	22.009	390278
dlslime	8	33,554,432	64	1	43.951	390978
dlslime	8	67,108,864	64	1	87.804	391370
dlslime	8	134,217,728	64	1	175.508	391588

#BS=64, #Concurrency=8

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 8 --node-rank 1 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 8

torchrun --master-addr 10.130.8.145 --master-port 6006 --nnodes 2 --nproc-per-node 8 --node-rank 0 bench/python/agg_transfer_bench_spmd.py --qp-num 8 --transfer-engine dlslime --batch-size 64 --num-iteration 100 --num-concurrency 8

Transfer Engine	#Channels	Message Size (bytes)	Batch Size	Num Concurrency	Avg Latency(ms)	Bandwidth(MB/s)
dlslime	8	2,048	64	8	0.036	28494
dlslime	8	4,096	64	8	0.038	50860
dlslime	8	8,192	64	8	0.048	104545
dlslime	8	16,384	64	8	0.041	207051
dlslime	8	32,768	64	8	0.056	297354
dlslime	8	65,536	64	8	0.099	337571
dlslime	8	131,072	64	8	0.185	363003
dlslime	8	262,144	64	8	0.356	376743
dlslime	8	524,288	64	8	0.701	383701
dlslime	8	1,048,576	64	8	1.386	387629
dlslime	8	2,097,152	64	8	2.757	389493
dlslime	8	4,194,304	64	8	5.5	390523
dlslime	8	8,388,608	64	8	10.984	391043
dlslime	8	16,777,216	64	8	21.955	391291
dlslime	8	33,554,432	64	8	43.891	391407
dlslime	8	67,108,864	64	8	87.771	391480
dlslime	8	134,217,728	64	8	175.518	391530

Heterogeneous Interconnection

hardware configs

Device	NIC Model	Bandwidth	PCIe Version	PCIe Lanes
A	Mellanox ConnectX-7 Lx (MT4129)	400 Gbps	PCIe 5.0	x16
B	Mellanox ConnectX-7 Lx (MT4129)	400 Gbps	PCIe 5.0	x8
C	Mellanox ConnectX-7 Lx (MT4129)	200 Gbps	PCIe 5.0	x16
D	Mellanox ConnectX-7 Lx (MT4129)	400 Gbps	PCIe 5.0	x16

experiments configs
- Message Size = 128 MB
- RDMA RC Read(single NIC)
- Under affinity scenario
- RDMA with GPU Direct
Interconnect bandwidth matrix：(MB/s, demonstrates attainment of the theoretical bound).

Throughput (MB/s)	A	B	C	D
A	48967.45	28686.29	24524.29	27676.57
B	28915.72	28275.85	23472.29	27234.60
C	24496.14	24496.51	24513.57	24493.89
D	29317.66	28683.25	24515.30	27491.33

detailed results: bench

Metadata

Release files for dlslime 0.0.1.post10

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

File added late

1 file was uploaded more than 14 days after the first file in this release.

While project maintainers occasionally add legitimate files to an existing release, late additions can also indicate a security compromise.

We recommend inspecting the release files before installing.

Built distributions (wheels)

Table of built distributions (wheels) for dlslime 0.0.1.post10
File	Interpreter	ABI	Platform	Reset
dlslime-0.0.1.post10-cp313-cp313-manylinux2014_x86_64.whl 569.5 kB Dec 3, 2025	CPython 3.13	CPython 3.13	Linux glibc 2.17+ x86-64	Details
dlslime-0.0.1.post10-cp312-cp312-manylinux2014_x86_64.whl 343.9 kB Sep 22, 2025	CPython 3.12	CPython 3.12	Linux glibc 2.17+ x86-64	Details
dlslime-0.0.1.post10-cp311-cp311-manylinux2014_x86_64.whl 344.8 kB Sep 22, 2025	CPython 3.11	CPython 3.11	Linux glibc 2.17+ x86-64	Details
dlslime-0.0.1.post10-cp310-cp310-manylinux2014_x86_64.whl 342.9 kB Sep 22, 2025	CPython 3.10	CPython 3.10	Linux glibc 2.17+ x86-64	Details
dlslime-0.0.1.post10-cp39-cp39-manylinux2014_x86_64.whl 344.1 kB Sep 22, 2025	CPython 3.9	CPython 3.9	Linux glibc 2.17+ x86-64	Details
dlslime-0.0.1.post10-cp38-cp38-manylinux2014_x86_64.whl 343.4 kB Sep 22, 2025	CPython 3.8	CPython 3.8	Linux glibc 2.17+ x86-64	Details

Total release size: 2.3 MB

Release files / dlslime-0.0.1.post10-cp313-cp313-manylinux2014_x86_64.whl

File added late

This file was uploaded more than 14 days after the first file in this release.

While project maintainers occasionally add legitimate files to an existing release, late additions can also indicate a security compromise.

We recommend inspecting the release file before installing.

Download URL	dlslime-0.0.1.post10-cp313-cp313-manylinux2014_x86_64.whl
Size	569.5 kB
Tags	CPython 3.13 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`02946255a493b3444aface908afa97427d0d1579dcbe3461f8d8cf47effdc3e6`
BLAKE2b-256 checksum How to use checksums	`90d095edf1ffde98417ce1c4bff1785826265a4494395df9361ec01f6973533b`
Upload date	Dec 3, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.13.9`

Release files / dlslime-0.0.1.post10-cp312-cp312-manylinux2014_x86_64.whl

Download URL	dlslime-0.0.1.post10-cp312-cp312-manylinux2014_x86_64.whl
Size	343.9 kB
Tags	CPython 3.12 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`1e950cb0286e1d73e5d6309f714cbb98d1aa8e8a24f391d4564473bf8dc2e297`
BLAKE2b-256 checksum How to use checksums	`ec865721e096eb80ded54cdd3b6a107dcf232206fa17273e11f7eb748e0e611e`
Upload date	Sep 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.10.12`

Release files / dlslime-0.0.1.post10-cp311-cp311-manylinux2014_x86_64.whl

Download URL	dlslime-0.0.1.post10-cp311-cp311-manylinux2014_x86_64.whl
Size	344.8 kB
Tags	CPython 3.11 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`5516e6b75b509a7d767403b9fa7c59e7f21a3f1aa04e20dbd100205104b33634`
BLAKE2b-256 checksum How to use checksums	`8cf85a06ef7346ae4004f8bb99b57df5af0e2039f42c5c914819de9f8c168292`
Upload date	Sep 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.10.12`

Release files / dlslime-0.0.1.post10-cp310-cp310-manylinux2014_x86_64.whl

Download URL	dlslime-0.0.1.post10-cp310-cp310-manylinux2014_x86_64.whl
Size	342.9 kB
Tags	CPython 3.10 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`ec669cdbc29cbf21a9302f1def46fe91be6bd99b1650c1931a17ba8d5701b342`
BLAKE2b-256 checksum How to use checksums	`0be6d3a1a2892ea80515f99f81a8ab200a8b5226c58d7b1f6ce8bdf879ce756d`
Upload date	Sep 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.10.12`

Release files / dlslime-0.0.1.post10-cp39-cp39-manylinux2014_x86_64.whl

Download URL	dlslime-0.0.1.post10-cp39-cp39-manylinux2014_x86_64.whl
Size	344.1 kB
Tags	CPython 3.9 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`79c71adee8cb78baac7dd2055db4ce8df32c629010637ba43010c566abdb0aac`
BLAKE2b-256 checksum How to use checksums	`9ec521ff194cb48824c29f35a59d3bd32d9a5f46086e70ae076368e7d97737bc`
Upload date	Sep 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.10.12`

Release files / dlslime-0.0.1.post10-cp38-cp38-manylinux2014_x86_64.whl

Download URL	dlslime-0.0.1.post10-cp38-cp38-manylinux2014_x86_64.whl
Size	343.4 kB
Tags	CPython 3.8 Linux glibc 2.17+ x86-64
SHA-256 checksum How to use checksums	`4069fe24ba2a384d4ce3e578fce90c7f0237af5518857ab4435973f4222c5409`
BLAKE2b-256 checksum How to use checksums	`88454b96b15422d986b8034021b45d9920e9be7948fd964a67e56171196137e8`
Upload date	Sep 22, 2025
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/6.2.0 CPython/3.10.12`

Release history Release notifications | RSS feed

0.1.23

Sep 1, 2026 5 release files

0.1.22

Jun 5, 2026 5 release files

0.1.20

Jun 4, 2026 5 release files

0.1.18

Jun 4, 2026 5 release files

0.1.17

Jun 2, 2026 5 release files

0.1.16

May 28, 2026 5 release files

0.1.15

May 28, 2026 5 release files

0.1.14

May 28, 2026 5 release files

0.1.11

May 27, 2026 5 release files

0.1.7

May 25, 2026 5 release files

0.1.0.post1

May 10, 2026 6 release files

0.1.0

May 10, 2026 6 release files

0.0.3

May 10, 2026 6 release files

Pre-release

0.0.3rc2

May 6, 2026 6 release files

Pre-release

0.0.3rc1

Mar 31, 2026 4 release files

0.0.2.post1

Jan 6, 2026 6 release files

0.0.2

Jan 5, 2026 6 release files

Pre-release

0.0.2rc1

Jan 5, 2026 6 release files

This release

0.0.1.post10 This release

Sep 22, 2025 6 release files

0.0.1.post7

May 6, 2025 3 release files

0.0.1.post6

Apr 29, 2025 2 release files

0.0.1.post5

Apr 29, 2025 2 release files

0.0.1.post4

Apr 26, 2025 2 release files

0.0.1.post3

Apr 24, 2025 2 release files

0.0.1.post2

Apr 8, 2025 2 release files

0.0.1.post1

Apr 3, 2025 2 release files

0.0.1

Apr 2, 2025 2 release files

dlslime 0.0.1.post10

Flexible & Efficient Heterogeneous Transfer Toolkit

Getting Started

RDMA RC Mode

NVLink Mode

NVShmem Mode

Install

pip install

Build from source

Python

CPP

Build flags

Benchmark

GDRDMA P2P Read/Write

#BS=1, #Concurrency=1

#BS=64, #Concurrency=1

#BS=64, #Concurrency=8

GDRDMA Aggregated Bandwidth

#BS=1, #Concurrency=1

#BS=64, #Concurrency=1

#BS=64, #Concurrency=8

Heterogeneous Interconnection​

Project links

Key dates

2 maintainers

Credits

License

Requires

Classifiers

Metadata

Project links

Key dates

2 maintainers

Credits

License

Requires

Classifiers

Release files for dlslime 0.0.1.post10

File added late

Built distributions (wheels)

Release files / dlslime-0.0.1.post10-cp313-cp313-manylinux2014_x86_64.whl

File added late

Release files / dlslime-0.0.1.post10-cp312-cp312-manylinux2014_x86_64.whl

Release files / dlslime-0.0.1.post10-cp311-cp311-manylinux2014_x86_64.whl

Release files / dlslime-0.0.1.post10-cp310-cp310-manylinux2014_x86_64.whl

Release files / dlslime-0.0.1.post10-cp39-cp39-manylinux2014_x86_64.whl

Release files / dlslime-0.0.1.post10-cp38-cp38-manylinux2014_x86_64.whl

Release history Release notifications | RSS feed

Heterogeneous Interconnection