Astrodetection
Astrodetection is a Python library designed for detecting astroturfing clues from lists of posts (mainly on X up to now, but not exclusively)
Installation
Pip
pip install "astrodetection[standard]"
or
pip install "astrodetection[light]"
Conda
-
Use the YAML file to configure the environment with conda:
conda create -n astrodetection_env conda activate astrodetection_env conda env update -f environment_standard.yml
Note: the environment_standard.yml configuration file uses FAISS and Fasttext libraries for VIGINUM D3LTA implementation
**If you have compatibility issues, prefer environment_light.yml and use astrodetection_light module
Usage
You can import directly the main functions:
from astrodetection import semantic_faiss, prepare_input_data, compute_bot_likelihood_metrics, create_network
Or use them directly:
import glob
import pandas as pd
import os
import numpy as np
import astrodetection
# Load a single JSON file into a DataFrame
file = "file_path" # Select the first file
df = pd.read_json(file)
df.index = df.index.astype(str) # Compatibility with d3lta
# Preprocess the DataFrame
df = df[df['tweet'].str.len() > 100]
df = df[df['username'] != 'grok']
df.index = df.index.astype(str)
# Compute matches and scores
df_filtered, df_emb = astrodetection.prepare_input_data(df, embeddings=df['emb'])
matches, df_cluster = astrodetection.semantic_faiss(
df_filtered.rename(columns={'tweet': 'original'}),
min_size_txt=0,
df_embeddings_use=df_emb,
threshold_grapheme=0.8,
threshold_language=0.715,
threshold_semantic=0.9
) #function taken from D3LTA
scores = astrodetection.compute_bot_likelihood_metrics(df, matches=matches)
# Create a network
network = astrodetection.create_network(matches, df)
New changes
-
semantic_faissfunction can now take detect only copypastas based on levenshtein distance, ignoring embeddings, if "skip" is passed as argument in df_embeddings_use field. -
compute_bot_likelihood_metricsfunction can now take columns' names as arguments for more customization -
compute_bot_likelihood_metricsnow returnshigh_following_followers_ratio (%), the share of rows whose following/followers ratio exceeds fw_ratio_threshold (default 10).
1 maintainer
Release files for astrodetection 0.2.8.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| astrodetection-0.2.8.1.tar.gz | 54.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| astrodetection-0.2.8.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 109.5 kB
Release files / astrodetection-0.2.8.1.tar.gz
| Download URL | astrodetection-0.2.8.1.tar.gz |
|---|---|
| Size | 54.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3e8f49a14cf5a2def44bb47e0573388a89a5ad64c7ab6b83b5a3cea7695e52ca
|
|
BLAKE2b-256 checksum How to use checksums |
3eb81c951276249ba8462b30cc7510bb02445b1d7d9da40f98725e474a14d857
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.4
|
Release files / astrodetection-0.2.8.1-py3-none-any.whl
| Download URL | astrodetection-0.2.8.1-py3-none-any.whl |
|---|---|
| Size | 55.5 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ba25f65f2f8149c7dd404d50056f2760309300186bb388592d839b3b3f35c44c
|
|
BLAKE2b-256 checksum How to use checksums |
58846f9c242c85a2446d8c9ff6f55836f3cd62b2ca49711492c496e43e2b27d3
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.4
|
