Langara Course Information Aggregator
Project description
LangaraCourseInfo
This project collects course and transfer information from Langara College, Vancouver, into an SQLite database.
Once built, the database weighs around 15 MB for all data (~250 MB with source HTML/PDFs), which should be lightweight enough for most uses.
The transfer agreement scraper currently takes an excruciating amount of time - approximately an hour - this will be improved with multithreading in the future.
Collected Data
- Course Information: course description & other attributes
- Course Offerings: dating from 1999 - present.
- Transfer Information: only active transfer agreements are collected.
Table Definitions
-
TransferInformation(subject, course_code, source, destination, credit, effective_start, effective_end)
-
CourseInfo(subject, course_code, credits, title, description, lecture_hours, seminar_hours, lab_hours, AR, SC, HUM, LSC, SCI, SOC, UT)
-
Sections(year, term, seats, waitlist, subject, course_code, crn, credits, additional_fees, repeat_limit)
-
Schedules(year, term, crn, type, days,, time, start_date, end_date, room, instructor)
-
SemesterHTML(year, term, sectionHTML, catalogueHTML, attributeHTML)
-
TransferPDF(subject, pdf)
Stack
- SQLite
- Selenium
- Beautifulsoup
Build
python -m build
Build the package.twine upload -r pypi dist/*
Upload the package to pypi.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for LangaraCourseInfo-2.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | ecb2496e8b8d9e522f4ba44455cc7afcc98ed53a16f967aa3f28ad71d3b629fd |
|
MD5 | b6b03b5b0b94fd43d5313beca9e26fd2 |
|
BLAKE2b-256 | 62a1be8603c5f5196d191dd1539fab666c4a3f0f3bd256b877de0498ba0f8f43 |