Skip to main content

A bert sentence encoding tool

Project description

This is a bert sentence encoding tool.

## How to use it
### install package
git clone ssh://git@gitlab.leihuo.netease.com:32200/shaojianzhi/bert-sent-encoding.git
cd bert-sent-encoding
python setup.py install
### then use it

from bert_sent_encoding import bert_sent_encoding
bse = bert_sent_encoding(model_path='bert_sent_encoding/model/chinese_L-12_H-768_A-12', seq_length=64, batch_size=8)
(model_path is required, seq_length and batch_size are optional)
vector = bse.get_vector('你好') # 1. get vector of string
vectors = bse.get_vector(['你好', '哈哈']) # 2. get vector list of strings
bse.write_txt2vector(input_file, output_file) # 3. get and write vectors of strings


### for
bse = bert_sent_encoding(model_path='bert_sent_encoding/model/chinese_L-12_H-768_A-12', seq_length=64, batch_size=8)
(model_path is required, seq_length and batch_size are optional)
**input_file**:

the first line text
the second line text
...

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bert_sent_encoding-0.1.1.tar.gz (22.0 kB view hashes)

Uploaded Source

Built Distributions

bert_sent_encoding-0.1.1-py3.6.egg (54.1 kB view hashes)

Uploaded Source

bert_sent_encoding-0.1.1-py3-none-any.whl (25.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page