dataflow-sdk
Example
from dataflow_sdk import save_items, Record
from dataflow_sdk.entity.model import CrawlType
result = {
'name': 'xiaoming',
"age": 25,
"hello": "world",
"world": 1121211
}
records = [Record(
crawl_url=f"https://add.weee.tsinghua.edu.cn/{x}",
crawl_type=CrawlType.ITEM,
data=result,
metadata={"name": "gage"},
) for x in range(10)]
save_items('Your Sink ID', records)
1 maintainer
Metadata
1 maintainer
Release files for dataflow-sdk 0.2.2
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| dataflow_sdk-0.2.2.tar.gz | 8.7 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| dataflow_sdk-0.2.2-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 22.3 kB
Release files / dataflow_sdk-0.2.2.tar.gz
| Download URL | dataflow_sdk-0.2.2.tar.gz |
|---|---|
| Size | 8.7 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
6e6bcdc7b874b99797c020651d894f3a81f24600f3b6d6fe90d601362499283e
|
|
BLAKE2b-256 checksum How to use checksums |
571e469dee0a461e9c7ac1d32cecc043e106b4c5eeaaceec0f7e084ee804d370
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.5
|
Release files / dataflow_sdk-0.2.2-py3-none-any.whl
| Download URL | dataflow_sdk-0.2.2-py3-none-any.whl |
|---|---|
| Size | 13.6 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
750e7a29f9b8b2abb1ba0aa7c27991794dac15dd097be841a6edbc515225cb10
|
|
BLAKE2b-256 checksum How to use checksums |
fd356190b3afa5bf81edb84e1e31ac99f8fe2cfbf7f69eb36e8b45b79b884bf5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.13.5
|
