Skip to main content

Classes and Utilities that are shared in the Operation Battleship Application

Project description

Common Utilities

Operation Battleship is spread among several different repositories. We've got the data pipeline and also the microservices deployed to Digital Ocean that provide the job recomendations for the job applicants. In order to follow basic engineering practices and support modular code, we have split out some of the common and shared classes into their own repo.

Files and Classes

Here's a quick list of the files that are in the Common Utilities and a short description for each file.

  • ApifyJobsCaller.py This file is the one that interacts directly with the Apify SDK. No other instances of the Apify dependency should exist outside this Python class

  • CandidateRequirementsDao.py This Python script is a data access object (DAO) for managing candidate requirements data in a PostgreSQL database. It includes a method for inserting multiple records from a DataFrame into the Candidate_Requirements table in the database. The script uses environment variables for database connection parameters, ensuring secure handling of sensitive data.

  • CompanyDao.py This Python script is a data access object (DAO) for managing company data in a PostgreSQL database. It includes methods for checking if a company exists in the database, retrieving a company’s UUID by its LinkedIn URL, and inserting new company data from a DataFrame into the Companies table.

  • FailureLogger.py This Python script is designed to handle and log instances where a Language Learning Model (LLM) fails to generate a well-formed JSON response. It saves the LLM response and the associated job title to disk for later analysis, aiding in the identification of potential issues with job postings.

  • GenaricDatabaseDao.py This script is intended to be the only class that actually calls the PostGres DB. All other DAO Classes will reference this Class.

  • GeographyHelper.py This Python script, GeographyHelper, is designed to parse and extract city and state information from a given string. It uses regular expressions to match patterns and returns the results as a DataFrame, making it useful for processing and standardizing geographical data.

  • JobKeyWordsDao.py This Python script defines a class JobKeyWordsDao that connects to a PostgreSQL database and inserts job keywords from a pandas DataFrame into the ‘Job_Keywords’ table. It uses environment variables for secure database access and includes logging for execution tracking.

  • JobPostingDao.py

  • JobTitleCategoryClassifier.py

  • OpenAICaller.py

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

Built Distribution

File details

Details for the file OperationBattleshipCommonUtilities-0.4.17.tar.gz.

File metadata

File hashes

Hashes for OperationBattleshipCommonUtilities-0.4.17.tar.gz
Algorithm Hash digest
SHA256 63e2473b22219de38e092f0c42f85911c8657c1805cf15dcd6baccf915b4dc74
MD5 e46b2950c10322595cef59c03021de30
BLAKE2b-256 3015350cc400282d77d25e75d219513c9cdff6a95e7cf8ac766029a6631baf9d

See more details on using hashes here.

File details

Details for the file OperationBattleshipCommonUtilities-0.4.17-py3-none-any.whl.

File metadata

File hashes

Hashes for OperationBattleshipCommonUtilities-0.4.17-py3-none-any.whl
Algorithm Hash digest
SHA256 5bb53064201716ed2c1eafaecb64b54995facb1a4ded420af84b0da31d4c9468
MD5 e97e1836e14b8932f808b5972be9cb3e
BLAKE2b-256 bb476e124491092ae6e7d4faea57b14d3a43a1145b43db20d014dc7c55a3ee15

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page