flask-noai 1.1.0

A simple Flask extension to block AI crawlers.

flask-noAI

A simple Flask extension to block AI crawlers.

How it works

Flask-noAI adds certain rules to robots.txt expecting it to be respected, and if a violation of those rules is detected, content access is blocked.

How to use it

import flask_noai

flask_noai.noai(app)

Yes, it's this easy.

You can even do it like this:

from flask import Flask
from flask_noai import noai

app = noai(Flask(__name__))

Note: noai() does not need to be called at initialization of the app. It can be called later since it only registers route handlers:

...
...
...
app = Flask(__name__)
...
...
...
noai(app)
...
...
...

noai() returns back the original application to allow for chaining. noai() is basically the same as init_app() in most extensions except that noai() is mainly a route register rather than a "true" flask extension, which is why I chose the naming of noai() over init_app()!

Handling

• If you want to have a custom message when unauthorised scraping was detected, use noai(..., on_detect="...")
• If you want to return a non-200 code when it was detected, use noai(..., code=401) or other codes.
• You can still add custom robots.txt by simply creating a route.
• You should not make /robots, /robots/, or /robots.txt/ routes since they are handled by this extension.