Skip to main content

💾 Data loader for Humans

Project description

Sargilo

💾 Data loader for Humans

Sargilo lets you declare your data in a visually pleasing and non-frustrating way and loads it into your environment of choice. YAML usage, validation and auto-completion help you get boring jobs done.

💡 Motivation

The idea for this project came from the testing I had to do at work. Surely, you will need sample data to test the project you currently work on. After some time, two ways how to approach this have been emerged:

  • Create a minimal and abstract data sample for each test or group of tests and test against those
  • Find a more comphrehensive data set that satisfies most of edge cases and only add to it in rare cases

There are of course advantages and disadvantages to both approaches. However, I prefer the second approach and think of it as telling a little story. I prefer this way since the dataset can be used as a fixture when running your application and after working on it for quite some time, you will get a feeling for the result a function should produce, making it easier to spot errors.

📦 Install

pip install sargilo

Or if you prefer an alternative installation method

poetry add sargilo
pipenv install sargilo

🔗 Integrations

To know how to load your data, sargilo has to know how to deal with your framework or ORM of choice. While sargilo provides the interface and basic functionaly, the specifics on how to load the data are up to the integration. Currently, the following integrations are supported:

  • Django (ORM)

📒 Examples

# models.py
from django import models
from django.contrib.auth.models import User


class Tag(models.Model):
    name = models.CharField(max_length=255, blank=False, null=False)

class Post(models.Model):
    title = models.CharField(max_length=255)
    content = models.TextField()

    tag = models.ForeignKey(
        Tag,
        verbose_name='Tag',
        related_name='posts',
        on_delete=models.PROTECT
    )

    author = models.ForeignKey(
        User,
        verbose_name='Author',
        related_name='posts',
        on_delete=models.PROTECT
    )
# dataset.yaml
auth:
  users:
    - &Admin
      username:     "Admin"
      first_name:   "Christoph"
      last_name:    "Smaul"
      email:        "christoph@mail.de"
      password:     "very_secret"
      is_staff:      True
      is_superuser:  True
    - &Editor
      username:     "Editor"
      first_name:   "Wendy"
      last_name:    "Lator"
      email:        "wendy@mail.de"
      password:     "very_secret"
      is_staff:      True
      is_superuser:  False


blog:
  tags:
    - &TestTag
      name: "Test"
    - &BlueTag
      name: "Blue"
  posts:
    - title: "Hello world"
      text: "Lorem ipsum dolor amet sunt"
      tag: *TestTag
      author: *Admin

    - title: "Just a test"
      text: "This is just a test. This is just a test. This is just a test."
      tag: *TestTag
      author: *Editor

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sargilo-0.1.6.tar.gz (24.7 kB view details)

Uploaded Source

Built Distribution

sargilo-0.1.6-py2.py3-none-any.whl (43.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file sargilo-0.1.6.tar.gz.

File metadata

  • Download URL: sargilo-0.1.6.tar.gz
  • Upload date:
  • Size: 24.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.0b9 CPython/3.8.0 Linux/4.19.76-linuxkit

File hashes

Hashes for sargilo-0.1.6.tar.gz
Algorithm Hash digest
SHA256 7dc77be5973da03ae79ed659f550fdaf2c1982fc4e81b86c96d98e88d436af11
MD5 4f1ddd2f2b6cf6457d28bb1890f194ea
BLAKE2b-256 2ac267de21eab5b4fe1d3d88ff397487a94965ff3f0882fe84715b2421c151a2

See more details on using hashes here.

File details

Details for the file sargilo-0.1.6-py2.py3-none-any.whl.

File metadata

  • Download URL: sargilo-0.1.6-py2.py3-none-any.whl
  • Upload date:
  • Size: 43.5 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.0.0b9 CPython/3.8.0 Linux/4.19.76-linuxkit

File hashes

Hashes for sargilo-0.1.6-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 2400ec6234f51f26068c3d91bda51a5a7e68e42f709cb11e838f12498379a060
MD5 7ae8351c598c327cab3fc420c436008a
BLAKE2b-256 6686eefc9ff2acc07931912dcec6245873db5324bedf90619035ff62054e8cba

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page