Skip to main content

Simple robots.txt app for django

Project description

This is a simple application to create a robots.txt file for django. It has no models at all and you’re supposed to edit a template to update the robots.txt file. I got tired of having to add this view to each and every project because Django doesn’t have a built in text/plain view.

See the robots page for details what the file should look like.


Get django-robots-txt into your python path:

pip install django-robots-txt

Create your custom robots.txt file in one of your template directories as robots_txt/robots.txt.

Add a robots.txt view to your root

from django.conf.urls.defaults import patterns, include, url
from robots_txt.views import RobotsTextView

urlpatterns = patterns('',
    url(r'^robots.txt$', RobotsTextView.as_view()),

That’s it, your robots.txt template will be served.

This urlconf entry is also supported if you prefer to keep it short:

urlpatterns = patterns('',
    url(r'', include('robots_txt.urls')),

You can add robots_txt to your INSTALLED_APPS in if you don’t want to create your own template and don’t mind having an empty robots.txt:



0.4: - Refactor tests - Updates for Django 1.6

0.3: - Bugfix for included urlconfig

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

django-robots-txt-0.4.tar.gz (3.5 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page