Skip to main content

Tensorflow Operation Wrapper of cppjieba (Chinese Word Segamentation)

Project description

Jieba Op for Tensorflow

Intro

This is a tensorflow wrapper for the cpp version of the famous Chinese word segmentation tool, cppjieba.

I made some changes from the original cppjieba. This is my fork of cppjieba.

Most code of this repo are from Didi's deep learning language platform: Delta

Install

pip install tf-jieba

Usage

  1. Clone the cppjieba repository for resource files like model and dict files.
git clone https://github.com/applenob/cppjieba.git
  1. Download or copy the test python script custom_test.py to the same project. You should have cppjieba and custom_test.py under your test directory now.
python3 custom_test.py

Demo output:

Support Platform

  • python == 3.6
  • tensorflow >= 1.14.0
  • OS: MacOS / Linux

Please refer to my Chinese blog post for more detail.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for tf-jieba, version 0.3
Filename, size File type Python version Upload date Hashes
Filename, size tf_jieba-0.3-cp36-cp36m-macosx_10_7_x86_64.whl (4.3 MB) File type Wheel Python version cp36 Upload date Hashes View
Filename, size tf_jieba-0.3-cp36-cp36m-manylinux1_x86_64.whl (5.2 MB) File type Wheel Python version cp36 Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page