Selective Few-Random-Shot Augmentation for text data augmentation.
Project description
SFRSA
Selective Few-Random-Shot Augmentation (SFRSA) is a two-stage text augmentation workflow:
- Over-generate candidate minority-class texts with few-random-shot LLM prompting.
- Select a fixed-size subset that balances minority relevance and diversity.
The package exposes three main workflows:
select_augmented_texts: select generated texts usingkmeans,dpp, oriu-dpp.generate_few_random_shot: call an LLM API to generate texts from random positive and negative examples.train_step0_utility_modelandcompute_utility_scores: train a Step-0 classifier and score candidates for IU-DPP.
Install
pip install sfrsa
For OpenAI generation support:
pip install "sfrsa[llm]"
Select Generated Texts
import pandas as pd
from sfrsa import select_augmented_texts
df = pd.read_csv("example_data.csv")
generated = df[df["type"] == "generated"]
minority = df[df["type"] == "original"]
selected = select_augmented_texts(
candidates=generated,
minority_texts=minority,
method="dpp",
budget=20,
text_column="text",
embedding_model_name="bert-base-uncased",
alpha=1.0,
gamma=2.0,
random_state=42,
)
print(selected.head())
By default, selection computes BERT embeddings using the same representation as the original SFRSA notebooks: sum the last four BERT hidden layers and average over tokens. If you already computed BERT or sentence-transformer embeddings, pass them directly:
selected = select_augmented_texts(
candidates=generated,
minority_texts=minority,
candidate_embeddings=candidate_embeddings,
minority_embeddings=minority_embeddings,
method="kmeans",
budget=100,
)
For IU-DPP, provide training-aware utility scores for the candidates:
selected = select_augmented_texts(
candidates=generated,
minority_texts=minority,
candidate_embeddings=candidate_embeddings,
method="iu-dpp",
budget=100,
utility_scores=utility_scores,
beta=1.0,
gamma=1.0,
)
Step-0 Utility Scores
IU-DPP uses utility scores that estimate whether a candidate is useful for the downstream classifier. The package includes a lightweight Step-0 utility model based on a class-weighted text classifier and first-order validation-gradient scoring.
import pandas as pd
from sfrsa import compute_utility_scores, train_step0_utility_model
train = pd.read_csv("example_data_step0_training.csv")
step0 = train_step0_utility_model(
train,
text_column="review2",
label_column="label",
positive_label=1,
negative_label=0,
validation_size=0.1,
random_state=42,
)
utility_scores = compute_utility_scores(
step0,
candidates=generated,
text_column="text",
candidate_label=1,
)
Generate Few-Random-Shot Candidates
Set OPENAI_API_KEY in your environment or pass a configured OpenAI client.
import pandas as pd
from sfrsa import generate_few_random_shot
train = pd.read_csv("training.csv")
texts = generate_few_random_shot(
training_data=train,
text_column="text",
label_column="label",
positive_label=1,
negative_label=0,
total=50,
positive_examples=10,
negative_examples=10,
n_per_prompt=1,
model="gpt-4.1-mini",
prompt=(
"Write {n} movie review(s) within 170 words that are similar to the "
"positive examples but different from the negative examples.\n\n"
"Positive examples:\n{positive_examples}\n\n"
"Negative examples:\n{negative_examples}"
),
)
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file sfrsa-0.1.2.tar.gz.
File metadata
- Download URL: sfrsa-0.1.2.tar.gz
- Upload date:
- Size: 13.7 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
2ef0a8d2cf6e6efd8f1b63dbbf6eea41912fae691e9ac8ee5c7aeaa493327dd1
|
|
| MD5 |
5833bb0c5bab24cd2c2a6b9a1d76eebc
|
|
| BLAKE2b-256 |
17a1b110b3e2614e3bfd7fcb8b96311fce3c29c38b5ce971baf4c7118db9ffff
|
File details
Details for the file sfrsa-0.1.2-py3-none-any.whl.
File metadata
- Download URL: sfrsa-0.1.2-py3-none-any.whl
- Upload date:
- Size: 12.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.11.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0c0af3f171c83b15b0ba17fb3dd832a5d075137f8af5f60fe686a966d88cbee5
|
|
| MD5 |
ca6818c7d29b5dd786b71e786ceda8c4
|
|
| BLAKE2b-256 |
42e12882cf44aac35b338d59d914a9db27b18a8fc33fa24484d18058d60d7b0d
|