Skip to main content

semantic-text-splitter

Documentation Status Licence

Large language models (LLMs) can be used for many tasks, but often have a limited context size that can be smaller than documents you might want to use. To use documents of larger length, you often have to split your text into chunks to fit within this context size.

This crate provides methods for splitting longer pieces of text into smaller chunks, aiming to maximize a desired chunk size, but still splitting at semantically sensible boundaries whenever possible.

Get Started

By Number of Characters

from semantic_text_splitter import TextSplitter

# Maximum number of characters in a chunk
max_characters = 1000
# Optionally can also have the splitter not trim whitespace for you
splitter = TextSplitter(max_characters)
# splitter = TextSplitter(max_characters, trim=False)

chunks = splitter.chunks("your document text")

Using a Range for Chunk Capacity

You also have the option of specifying your chunk capacity as a range.

Once a chunk has reached a length that falls within the range it will be returned.

It is always possible that a chunk may be returned that is less than the start value, as adding the next piece of text may have made it larger than the end capacity.

from semantic_text_splitter import TextSplitter


# Maximum number of characters in a chunk. Will fill up the
# chunk until it is somewhere in this range.
splitter = TextSplitter((200,1000))

chunks = splitter.chunks("your document text")

Using a Hugging Face Tokenizer

from semantic_text_splitter import TextSplitter
from tokenizers import Tokenizer

# Maximum number of tokens in a chunk
max_tokens = 1000
tokenizer = Tokenizer.from_pretrained("bert-base-uncased")
# If your tokenizer has truncation enabled, disable it before passing it to
# the splitter. Otherwise chunk sizes can be capped by the tokenizer's
# truncation limit.
tokenizer.no_truncation()
splitter = TextSplitter.from_huggingface_tokenizer(tokenizer, max_tokens)

chunks = splitter.chunks("your document text")

Using a Tiktoken Tokenizer

from semantic_text_splitter import TextSplitter

# Maximum number of tokens in a chunk
max_tokens = 1000
splitter = TextSplitter.from_tiktoken_model("gpt-3.5-turbo", max_tokens)

chunks = splitter.chunks("your document text")

Using a Custom Callback

from semantic_text_splitter import TextSplitter

splitter = TextSplitter.from_callback(lambda text: len(text), 1000)

chunks = splitter.chunks("your document text")

Markdown

All of the above examples also can also work with Markdown text. You can use the MarkdownSplitter in the same ways as the TextSplitter.

from semantic_text_splitter import MarkdownSplitter

# Maximum number of characters in a chunk
max_characters = 1000
# Optionally can also have the splitter not trim whitespace for you
splitter = MarkdownSplitter(max_characters)
# splitter = MarkdownSplitter(max_characters, trim=False)

chunks = splitter.chunks("# Header\n\nyour document text")

Method

To preserve as much semantic meaning within a chunk as possible, each chunk is composed of the largest semantic units that can fit in the next given chunk. For each splitter type, there is a defined set of semantic levels. Here is an example of the steps used:

  1. Split the text by a increasing semantic levels.
  2. Check the first item for each level and select the highest level whose first item still fits within the chunk size.
  3. Merge as many of these neighboring sections of this level or above into a chunk to maximize chunk length. Boundaries of higher semantic levels are always included when merging, so that the chunk doesn't inadvertantly cross semantic boundaries.

The boundaries used to split the text if using the chunks method, in ascending order:

TextSplitter Semantic Levels

  1. Characters
  2. Unicode Grapheme Cluster Boundaries
  3. Unicode Word Boundaries
  4. Unicode Sentence Boundaries
  5. Ascending sequence length of newlines. (Newline is \r\n, \n, or \r) Each unique length of consecutive newline sequences is treated as its own semantic level. So a sequence of 2 newlines is a higher level than a sequence of 1 newline, and so on.

Splitting doesn't occur below the character level, otherwise you could get partial bytes of a char, which may not be a valid unicode str.

MarkdownSplitter Semantic Levels

Markdown is parsed according to the CommonMark spec, along with some optional features such as GitHub Flavored Markdown.

  1. Characters
  2. Unicode Grapheme Cluster Boundaries
  3. Unicode Word Boundaries
  4. Unicode Sentence Boundaries
  5. Soft line breaks (single newline) which isn't necessarily a new element in Markdown.
  6. Inline elements such as: text nodes, emphasis, strong, strikethrough, link, image, table cells, inline code, footnote references, task list markers, and inline html.
  7. Block elements suce as: paragraphs, code blocks, footnote definitions, metadata. Also, a block quote or row/item within a table or list that can contain other "block" type elements, and a list or table that contains items.
  8. Thematic breaks or horizontal rules.
  9. Headings by level

Splitting doesn't occur below the character level, otherwise you could get partial bytes of a char, which may not be a valid unicode str.

Note on sentences

There are lots of methods of determining sentence breaks, all to varying degrees of accuracy, and many requiring ML models to do so. Rather than trying to find the perfect sentence breaks, we rely on unicode method of sentence boundaries, which in most cases is good enough for finding a decent semantic breaking point if a paragraph is too large, and avoids the performance penalties of many other methods.

Inspiration

This crate was inspired by LangChain's TextSplitter. But, looking into the implementation, there was potential for better performance as well as better semantic chunking.

A big thank you to the Unicode team for their icu_segmenter crate that manages a lot of the complexity of matching the Unicode rules for words and sentences.

Metadata

Release files for semantic-text-splitter 0.33.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for semantic-text-splitter 0.33.0
File Size Uploaded
semantic_text_splitter-0.33.0.tar.gz 292.4 kB Details

Built distributions (wheels)

Table of built distributions (wheels) for semantic-text-splitter 0.33.0
File
semantic_text_splitter-0.33.0-cp314-cp314t-win_amd64.whl CPython 3.14 CPython 3.14 free-threading Windows x86-64 Details
semantic_text_splitter-0.33.0-cp314-cp314t-win32.whl CPython 3.14 CPython 3.14 free-threading Windows x86-32 Details
semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_x86_64.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ x86-64 Details
semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_s390x.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ IBM System/390x Details
semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_ppc64le.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ PowerPC 64-le Details
semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_armv7l.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ ARMv7l Details
semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_aarch64.whl CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ ARM64 Details
semantic_text_splitter-0.33.0-cp314-cp314t-macosx_11_0_arm64.whl CPython 3.14 CPython 3.14 free-threading macOS 11.0+ ARM64 Details
semantic_text_splitter-0.33.0-cp314-cp314t-macosx_10_12_x86_64.whl CPython 3.14 CPython 3.14 free-threading macOS 10.12+ x86-64 Details
semantic_text_splitter-0.33.0-cp310-abi3-win_amd64.whl CPython 3.10 abi3 Windows x86-64 Details
semantic_text_splitter-0.33.0-cp310-abi3-win32.whl CPython 3.10 abi3 Windows x86-32 Details
semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_x86_64.whl CPython 3.10 abi3 Linux glibc 2.28+ x86-64 Details
semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_s390x.whl CPython 3.10 abi3 Linux glibc 2.28+ IBM System/390x Details
semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_ppc64le.whl CPython 3.10 abi3 Linux glibc 2.28+ PowerPC 64-le Details
semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_armv7l.whl CPython 3.10 abi3 Linux glibc 2.28+ ARMv7l Details
semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_aarch64.whl CPython 3.10 abi3 Linux glibc 2.28+ ARM64 Details
semantic_text_splitter-0.33.0-cp310-abi3-macosx_11_0_arm64.whl CPython 3.10 abi3 macOS 11.0+ ARM64 Details
semantic_text_splitter-0.33.0-cp310-abi3-macosx_10_12_x86_64.whl CPython 3.10 abi3 macOS 10.12+ x86-64 Details

Total release size: 151.2 MB

Release files / semantic_text_splitter-0.33.0.tar.gz

Download URL semantic_text_splitter-0.33.0.tar.gz
Size 292.4 kB
Tags Source
SHA-256 checksum
How to use checksums
6d5db802af52ce6a2a2035f4e72f22b46d346bd0850fd9ca97011f8841aa7826
BLAKE2b-256 checksum
How to use checksums
9c4ab6922f5982ced4751244858266523622866a4c83666b045149a269d9c4c4
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-win_amd64.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-win_amd64.whl
Size 8.0 MB
Tags CPython 3.14 CPython 3.14 free-threading Windows x86-64
SHA-256 checksum
How to use checksums
a9398e1e2ccea8977a3d02e9e5153fccb61a9c851c217291ac7f3bb1ac75fabe
BLAKE2b-256 checksum
How to use checksums
7d581c327b76c8a7c43bafaf2d969a7e5b9e7bee5c2b5c15e6170b8dad5cd929
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-win32.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-win32.whl
Size 7.8 MB
Tags CPython 3.14 CPython 3.14 free-threading Windows x86-32
SHA-256 checksum
How to use checksums
9f64e4e8666cac9fe606afe106845500b9b224a95f175683b6502d7ef68419f5
BLAKE2b-256 checksum
How to use checksums
2c89ac5862d8db421263c19eb963aba970006dc73bd6f019d3edbf524ea750d0
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_x86_64.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_x86_64.whl
Size 8.5 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ x86-64
SHA-256 checksum
How to use checksums
e9f15af4093e5dd5bead0e7a39174c3ffac4f5b8ea3b64c238914345f8a15518
BLAKE2b-256 checksum
How to use checksums
c7569da47312f5efbe3f3659ec9844b9abd09394adc67dada16680cf6b403c3a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_s390x.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_s390x.whl
Size 8.7 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ IBM System/390x
SHA-256 checksum
How to use checksums
6c623fd455e86aaee15def66d9bfa38e076a3594fe434736b840f921328037fc
BLAKE2b-256 checksum
How to use checksums
440737fcc4f24e533491e507f8df2d7dfd8fbd027014352220b26fd4af6ca449
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_ppc64le.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_ppc64le.whl
Size 8.9 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ PowerPC 64-le
SHA-256 checksum
How to use checksums
a3b247ddd07e1827895318120881ff4561e5c9d3a63a69345da74c9257a8c17f
BLAKE2b-256 checksum
How to use checksums
f957abe140558cb152a076a00ed54d0aaebc2a207adcb4482300e1a2356d374c
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_armv7l.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_armv7l.whl
Size 8.4 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ ARMv7l
SHA-256 checksum
How to use checksums
69736b5854ae0d38645d182fc08c054bbeeaae20d64a9f5b31f92ba69a7fb72d
BLAKE2b-256 checksum
How to use checksums
17092b1b421838c00e2ce7a4f4351476c408bc5a5273f991d786a74974f22728
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_aarch64.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-manylinux_2_28_aarch64.whl
Size 8.5 MB
Tags CPython 3.14 CPython 3.14 free-threading Linux glibc 2.28+ ARM64
SHA-256 checksum
How to use checksums
d1d5813a7790e6151e4d9985d3787ce90080aa5a2d499ecc7a37406168f35419
BLAKE2b-256 checksum
How to use checksums
658ecd2a16778f08e4273e7fb08fa0f5991eb8bc547eb166cee5d737cf43ec50
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-macosx_11_0_arm64.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-macosx_11_0_arm64.whl
Size 8.3 MB
Tags CPython 3.14 CPython 3.14 free-threading macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
feb0ac384e9f8f8e048ac540a49ac258a8689a00ff9b7329dddffbf290781c02
BLAKE2b-256 checksum
How to use checksums
4afb42f17a691458fb66bf00fb01e6891db166413754eab925732928fac89b97
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp314-cp314t-macosx_10_12_x86_64.whl

Download URL semantic_text_splitter-0.33.0-cp314-cp314t-macosx_10_12_x86_64.whl
Size 8.3 MB
Tags CPython 3.14 CPython 3.14 free-threading macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
39bf99866693b433f0a50f237a0fe55543de5ae901e6b51e34e48c5e170cc1b3
BLAKE2b-256 checksum
How to use checksums
3798d695a10fbc36a95ba946cf5ad948885b4ef8e381598bb8dce7f5f34cdd24
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-win_amd64.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-win_amd64.whl
Size 8.1 MB
Tags CPython 3.10 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
b74eb60519c0b012087184b4997f6ab599c055cca98b194f5bb44b4c5ba2bc7e
BLAKE2b-256 checksum
How to use checksums
c062d27f449c189ae7eaee1c65222a926fde9ba45250c08ca3a18f9aa07380f5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-win32.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-win32.whl
Size 7.8 MB
Tags CPython 3.10 Windows x86-32 abi3
SHA-256 checksum
How to use checksums
a77be74d19e5901f48f49cbac32a5c12b49be5a982a1471087ee9a56c7e0dbfd
BLAKE2b-256 checksum
How to use checksums
6f5acb1756d777d3e1cb43fb42906bb1624803bcf1ac6f73533caebc9b5c76ec
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_x86_64.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_x86_64.whl
Size 8.5 MB
Tags CPython 3.10 Linux glibc 2.28+ x86-64 abi3
SHA-256 checksum
How to use checksums
9b44c7a484a1fcbdc1f5370ba98529e215675b7a550eae8ad628662912e609ef
BLAKE2b-256 checksum
How to use checksums
4f2f6b1e0c2285a415b0b677a9027973f09913d85d8ca225bf217e0db83b732a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_s390x.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_s390x.whl
Size 8.7 MB
Tags CPython 3.10 Linux glibc 2.28+ IBM System/390x abi3
SHA-256 checksum
How to use checksums
b773b39e94ba9decf886f0e047fa70abfcdc05f32fa2ea67e8ddbd79eb8090db
BLAKE2b-256 checksum
How to use checksums
ee57c9789267cca4c45619d4be506edb7b2493627ed0a71f0d2251321833a60a
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_ppc64le.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_ppc64le.whl
Size 8.9 MB
Tags CPython 3.10 Linux glibc 2.28+ PowerPC 64-le abi3
SHA-256 checksum
How to use checksums
2859625d1b85fcd125004c074aaef6d992215f990737ce64cb3318f277f3aba4
BLAKE2b-256 checksum
How to use checksums
337b9f01013eee4b0c01c2ba1d51281d0d7c6871fb297e14b0fae4d0f9870786
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_armv7l.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_armv7l.whl
Size 8.4 MB
Tags CPython 3.10 Linux glibc 2.28+ ARMv7l abi3
SHA-256 checksum
How to use checksums
186dd8554acb97dccdaf888ac2ebd8f34c4d3c96b3d01ec8e69284637d604420
BLAKE2b-256 checksum
How to use checksums
e3891cdd7e4c780699eaefb0e6a8cb4b3f02c780ef4a26666bb1daf934c96879
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_aarch64.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-manylinux_2_28_aarch64.whl
Size 8.5 MB
Tags CPython 3.10 Linux glibc 2.28+ ARM64 abi3
SHA-256 checksum
How to use checksums
fd118f9e6699522e170c0051b2cddb2b68be01b45f93764f072511a3db67867e
BLAKE2b-256 checksum
How to use checksums
1101cdb3004d76804cca8a02f4eca66c33d50536866ba274cfa95dc33fd50d12
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-macosx_11_0_arm64.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-macosx_11_0_arm64.whl
Size 8.3 MB
Tags CPython 3.10 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
6b5f85a465460253a83fcfa6a71f7fadaca008807a8d46f9dc570c19b77c9cf9
BLAKE2b-256 checksum
How to use checksums
0be588684514e35ecce1793fe816d103784d36cb091a97bf1b7d22c20cb6f12f
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release files / semantic_text_splitter-0.33.0-cp310-abi3-macosx_10_12_x86_64.whl

Download URL semantic_text_splitter-0.33.0-cp310-abi3-macosx_10_12_x86_64.whl
Size 8.3 MB
Tags CPython 3.10 abi3 macOS 10.12+ x86-64
SHA-256 checksum
How to use checksums
fdc1b1e09c934a0c1e5c24f8ad5693728b09786d6314f14aea9f0772bef8b23a
BLAKE2b-256 checksum
How to use checksums
5ffc37ad3f2d708ba2653d2b3930da5da2724317a65c53ddc1630ca3feceb106
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via uv/0.12.18 {"installer":{"name":"uv","version":"0.12.18","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

Release history Release notifications | RSS feed

This release

0.33.0 This release

19 release files

0.8.1

11 release files

0.8.0

11 release files

0.6.3

11 release files

0.6.2

11 release files

0.6.0

11 release files

0.5.1

11 release files

0.3.1

11 release files

0.2.4

11 release files

0.2.3

11 release files

0.2.1

11 release files

0.2.0

11 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page