Install and access data files (conf, json, sqlite3, ...) in an easy way.
datafolder is a small python library that makes it very easy to install the data files of your package and access them later.
If you want to install some data files (conf, sqlite, csv, …) to a place like the user’s home directory and find it difficult with setuptools, then here is some help.
WARNING: this is pre-alpha software!!!
First, let’s make life easier and use some ‘configuration by convention’.
I assume that (1) you have layout your project like:
MANIFEST.in README.rst setup.py mypkg │ ├── __init__.py ├── mypkg.conf ├── mypkg.db └── ...
And that (2) you want to put a folder, in the home directory of the user (in Windows will be in %APPDATA%), with your data files (conf, csv, …) inside. This folder will have the name of your package (preceded with a ‘.’ in UNIX systems), let’s say ‘.mypkg’ and, of course, with the right permissions (it will work with sudo pip install mypkg). For virtual environements the data folder will be put at the root of the environement.
How to do it?
First, install the datafolder package:
$ pip install -U datafolder
It will make a file called bootdf.py that you must put in your mypkg directory.
it will create a new file called setup_TPL.py that you must put at the root of your project.
- That file is a template that you have to adapt to your case:
import sys import pkg_resources from setuptools import setup from mypkg.bootdf import Installer # <-- ADAPT THIS # write the name of the package (in this case 'mypkg'!) MYPKG = 'mypkg' # <-- ADAPT THIS # list of data files in mypkg (just the names) # [don't forget to include these files in MANIFEST.in!] MYDATAFILES = ['mypkg.conf', 'mypkg.db'] # <-- ADAPT THIS # tell setup were these files are in your package # (I assume that they are together with the first __init__.py) MYRESOURCES = [pkg_resources.resource_filename(MYPKG, datafile) for datafile in MYDATAFILES] # now, create the installer installer = Installer(sys.argv) # create the data folder and tell setup to put the data files there DATAPATH = installer.data_path(MYPKG) data_files = [(DATAPATH, MYRESOURCES)] # now, setup can do his thing... setup( name=MYPKG, packages=[MYPKG], # <-- ADAPT THIS data_files=data_files, install_requires=["datafolder>=0.0.8"], ) # but we are NOT READY, in some cases the data files # don't have the appropriate permissions, # let us fix that... installer.pos_setup(MYDATAFILES)
- Now, rename the file to ‘setup.py’.
And that is all!
“But, I have the reverse problem, how can I access these files in my code?” I heard you say.
Very easy, in your code:
from datafolder import DataFolder data = DataFolder('mypkg') # now you can get the full path of each data file, e.g. conffile = data.files['mypkg.conf'] # do your thing... (read, write, ...)
For your convinience, the DataFolder class discovers the location of the data folder for you and provides attributes and methods, that make it easy to handle the files presente in the data folder.
Release history Release notifications
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size & hash SHA256 hash help||File type||Python version||Upload date|
|datafolder-0.0.8-py2.py3-none-any.whl (7.7 kB) Copy SHA256 hash SHA256||Wheel||2.7||Jul 16, 2014|
|datafolder-0.0.8.tar.gz (8.6 kB) Copy SHA256 hash SHA256||Source||None||Jul 16, 2014|