Skip to main content
This is a pre-production deployment of Warehouse. Changes made here affect the production instance of PyPI (
Help us improve Python packaging - Donate today!

Simple robots.txt app for django

Project Description

This is a simple application to create a robots.txt file for django. It has no models at all and you’re supposed to edit a template to update the robots.txt file. I got tired of having to add this view to each and every project because Django doesn’t have a built in text/plain view.

See the robots page for details what the file should look like.


Get django-robots-txt into your python path:

pip install django-robots-txt

Create your custom robots.txt file in one of your template directories as robots_txt/robots.txt.

Add a robots.txt view to your root

from django.conf.urls.defaults import patterns, include, url
from robots_txt.views import RobotsTextView

urlpatterns = patterns('',
    url(r'^robots.txt$', RobotsTextView.as_view()),

That’s it, your robots.txt template will be served.

This urlconf entry is also supported if you prefer to keep it short:

urlpatterns = patterns('',
    url(r'', include('robots_txt.urls')),

You can add robots_txt to your INSTALLED_APPS in if you don’t want to create your own template and don’t mind having an empty robots.txt:



0.4: - Refactor tests - Updates for Django 1.6

0.3: - Bugfix for included urlconfig

Release History

This version
History Node


History Node


History Node


History Node


Download Files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, Size & Hash SHA256 Hash Help File Type Python Version Upload Date
(3.5 kB) Copy SHA256 Hash SHA256
Source None Jan 12, 2014

Supported By

Elastic Elastic Search Pingdom Pingdom Monitoring Dyn Dyn DNS Sentry Sentry Error Logging CloudAMQP CloudAMQP RabbitMQ Heroku Heroku PaaS Kabu Creative Kabu Creative UX & Design Fastly Fastly CDN DigiCert DigiCert EV Certificate Google Google Cloud Servers