No project description provided
Project description
UltimaScraper (Python 3.10.1+)
27th January 2023 Migration
You can either start the script or create the __settings__ and __user_data__ folders manually.
~~~~~~~~
Move config.json file into "__settings__"
RENAME ".profiles" folder to "profiles" and move it into "__user_data__"
List of things I know that are broken:
Profile and header images aren't downloading
UI (Download Progress Bars to be exact)
Mandatory Tutorial
Read the #FAQ at the bottom of this page before submitting a issue.
Running the app locally
From the project folder open Windows Powershell/Terminal and run the commands below:
Installation commands:
Install Poetry
Update:
python updater.py
Start:
poetry run python start_us.py
Open and edit:
__user_data__/profiles/default/auth.json
[auth]
You have to fill in the following:
{"cookie":"cookie_value"}
{"x_bc":"x-bc_value"}
{"user_agent":"user-agent_value"}
Go to www.onlyfans.com and login, open the network debugger, then check the image below on how to get said above auth values. Using Chrome for this process is recommended, as other browsers sometimes have issues producing values that will auth properly.
Your auth config should look similar to this
If you get auth attempt errors, only YOU can fix it unless you're willing to let me into your account so I can see if it's working or not.
Note: If active is set to False, the script will ignore the profile.
USAGE
poetry run python start_us.py
Enter in inputs as prompted by console.
OPTIONAL
Open:
config.json
(Open with a texteditor)
[settings]
profile_directories:
Where your account information is stored (auth.json).
Default = ["__user_data__/profiles"]
If you're going to fill, please remember to use forward ("/") slashes only.
download_directories:
Where downloaded content is stored.
Default = ["__user_data__/sites"]
If you're going to fill, please remember to use forward ("/") slashes only.
You can add multiple directories and the script will automatically rollover to the next directory if the current is full.
metadata_directories:
Where metadata content is stored.
Default = ["__user_data__/sites"]
If you're going to fill, please remember to use forward ("/") slashes only.
Automatic rollover not supported yet.
path_formatting:
Overview for file_directory_format, filename_format and metadata_directory_format
{site_name} = The site you're scraping.
{first_letter} = First letter of the model you're scraping.
{post_id} = The posts' ID.
{media_id} = The media's ID.
{profile_username} = Your account's username.
{model_username} = The model's username.
{api_type} = Posts, Messages, etc.
{media_type} = Images, Videos, etc.
{filename} = The media's filename.
{value} = Value of the content. Paid or Free.
{text} = The media's text.
{date} = The post's creation date.
{ext} = The media's file extension.
Don't use the text variable. If you do, enjoy emojis in your filepaths and errors lmao.
file_directory_format:
This puts each media file into a folder.
The list below are unique identifiers that you must include.
You can choose one or more.
Default = "{site_name}/{model_username}/{api_type}/{value}/{media_type}"
Default Translated = "OnlyFans/belledelphine/Posts/Free/Images"
{model_username} = belledelphine
filename_format:
Usage: Format for a filename
The list below are unique identifiers that you must include.
You must choose one or more.
Default = "{filename}.{ext}"
Default Translated = "5fb5a5e4b4ce6c47ce2b4_source.mp4"
{filename} = 5fb5a5e4b4ce6c47ce2b4_source
{media_id} = 133742069
metadata_directory_format:
Usage: Filepath for metadata. It's tied with download_directories so ignore metadata_directories in the config.
The list below are unique identifiers that you must include.
You must choose one or more.
Default = "{site_name}/{model_username}/Metadata"
Default Translated = "OnlyFans/belledelphine/Metadata"
{model_username} = belledelphine
text_length:
Usage: When you use {text} in filename_format, a limit of how many characters can be set by inputting a number.
Default = ""
Ideal = "50"
Max = "255"
The ideal is actually 0.
video_quality:
Usage: Select the resolution of the video.
Default = "source"
720p = "720" | "720p"
240p = "240" | "240p"
auto_profile_choice:
Types: str|int
Usage: You can automatically choose which profile you want to scrape.
Default = ""
If you've got a profile folder named "user_one", set auto_profile_choice to "user_one" and it will choose it automatically.
auto_site_choice:
Types: list|str|bool
Usage: You can automatically choose which site you want to scrape.
Default = ""
Inputs: onlyfans, fansly
auto_media_choice:
Types: list|str|bool
Usage: You can automatically choose which media type you want to scrape.
Default = ""
Inputs: All, Images, Videos, etc
You can automatically choose which type of media you want to scrape.
auto_model_choice:
Types: list|str|bool
Default = false
Inputs: All, username, etc
If set to true, the script will scrape all the names.
auto_api_choice:
Default = true
If set to false, you'll be given the option to scrape individual apis.
jobs:
(Downloads)
"subscriptions" - This will scrape your standard content
"paid_content" - This will scrape paid content
If set to false, it won't do the job.
export_type:
Default = "json"
JSON = "json"
You can export an archive to different formats (not anymore lol).
overwrite_files:
Default = false
If set to true, any file with the same name will be redownloaded.
date_format:
Default = "%d-%m-%Y"
If you live in the USA and you want to use the incorrect format, use the following:
"%m-%d-%Y"
max_threads:
Default = -1
When number is set below 1, it will use all threads.
Set a number higher than 0 to limit threads.
min_drive_space:
Default = 0
Type: Float
Space is calculated in GBs.
0.5 is 500mb, 1 is 1gb,etc.
When a drive goes below minimum drive space, it will move onto the next drive or go into an infinite loop until drive is above the minimum space.
webhooks:
Default = []
Supported webhooks:
Discord
Data is sent whenever you've completely downloaded a model.
You can also put in your own custom url and parse the data.
Need another webhook? Open an issue.
exit_on_completion:
Default = false
If set to true the scraper run once and exit upon completion, otherwise the scraper will give the option to run again. This is useful if the scraper is being executed by a cron job or another script.
infinite_loop:
Default = true
If set to false, the script will run once and ask you to input anything to continue.
loop_timeout:
Default = 0
When infinite_loop is set to true this will set the time in seconds to pause the loop in between runs.
boards:
Default = []
Example = ["s", "gif"]
Input boards names that you want to automatically scrape.
ignored_keywords:
Default = []
Example = ["ignore", "me"]
Any words you input, the script will ignore any content that contains these words.
ignore_type:
Default = ""
a = "paid"
b = "free"
This setting will not include any paid or free accounts in your subscription list.
Example: "ignore_type": "paid"
This choice will not include any accounts that you've paid for.
export_metadata:
Default = true
Set to false if you don't want to save metadata.
blacklist_name:
Default = ""
Example = ["Blacklisted"]
Example = "Blacklisted,alsoforbidden"
This setting allows you to remove usernames when you choose the "scrap all" option by using lists or targetting specific usernames.
1. Go to https://onlyfans.com/my/lists and create a new list; you can name it whatever you want but I called mine "Blacklisted".
Add the list's name to the config.
Example: "blacklist_name": "Blacklisted"
2. Or simply put the username of the content creator in the list.
Other Tutorials:
Running the app via docker
Build and run the image, mounting the appropriate directories:
docker build -t only-fans . && docker run -it --rm --name onlyfans -v ${PWD}/__settings__:/usr/src/app/__settings__ -v ${PWD}/__user_data__:/usr/src/app/__user_data__ only-fans
Running on Linux
FAQ:
Before troubleshooting, make sure you're using Python 3.10.1 and the latest commit of the script.
Error: Access Denied / Auth Loop
Quadrupal check that the cookies and user agent are correct. Remove 2FA.
I'm getting authed into the wrong account
Enjoy the free content. | This has been patched lol.
Do OnlyFans or OnlyFans models know I'm using this script?
OnlyFans may know that you're using this script, but I try to keep it as anon as possible.
Generally, models will not know unless OnlyFans tells them but other than that there is identifiable information in the metadata folder which contains your IP address, so don't share it unless you're using a proxy/vpn or just don't care.
Do you collect session information?
No. The code is on Github which allows you to audit the codebase yourself. You can use wireshark or any other network analysis program to verify the outgoing connections are respective to the modules you chose.
Serious Disclaimer (lmao):
OnlyFans is a registered trademark of Fenix International Limited 🤓☝️.
The contributors of this script isn't in any way affiliated with, sponsored by, or endorsed by Fenix International Limited 🤓☝️.
The contributors of this script are not responsible for the end users' actions... 🤓☝️.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for ultima_scraper-9.0.15-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 70030a8dcf85607db8402e8ac41cfd5ea6540303ca12c8584c4718aad33794b2 |
|
MD5 | 164dc70482ad10592d260e59503e3195 |
|
BLAKE2b-256 | 082b79bb630cac0b7214b173cea9149ea1874af8b54a3dac094e92a1caa4b884 |