Skip to main content

Search Engine is a project that implements a basic search engine using C++, Python, and Cython. It builds a reverse index and ranks pages with the PageRank algorithm based on keyword relevance and page importance.

Project description

Search Engine

Contributor Covenant CMake Build and Test Pages Build Deployment Poetry PyPi

Logo da biblioteca


Search Engine is a simple, efficient engine that builds a reverse index for keyword searching and ranks results using the PageRank algorithm.

Aqui está o arquivo Markdown corrigido, com os emojis adicionados nos títulos para manter o padrão e com a seção "Requirements" ajustada para contribuições:

⚙️ Installation

Please create a virtual environment using venv, as the project is still in alpha testing and in its initial implementations.

python3 -m venv .env
source .env/bin/activate
pip install search-engine-cpp

🚀 Usage

from search_engine.crawler import Crawler

crawler = Crawler("https://en.wikipedia.org", "/wiki/", "Cat", test_mode=True)
graph = crawler.run(limit=10)
my_dict = graph.compute_page_rank()
top = sorted(my_dict.items(), key=lambda item: item[1], reverse=True)[:3]

print(top)

📋 Requirements for Contributions

Before compiling the project, ensure your environment meets the following requirements:

  • CMake 3.10 or higher
  • Google Test for unit testing
  • A C++11 compatible compiler or higher

📂 Project Structure

The project is organized as follows:

  • src/: Main implementation of the search engine, including reverse indexing and the PageRank algorithm.
  • tests/: Unit tests to verify the functionality of the system.
  • CMakeLists.txt: Configuration file for building the project with CMake.

🔧 Building the Project

To compile the project, follow these steps:

  1. Create a build directory and navigate into it:

    mkdir build && cd build
    
  2. Run CMake to generate the build files:

    cmake ..
    
  3. Compile the project using make:

    make
    

🧪 Running Tests for Contributions

Run unit tests to ensure the correctness of the system.

  1. After building the project, navigate to the build directory and execute:

    ./tests/unit-tests/LibUnitTests
    

This will run the tests covering search engine functionality, reverse indexing, and the PageRank algorithm.


🏃 Running Examples for Contributions

The first step is building the project, for this to run:

poetry install
poetry build

After building it, run this command to see the library working:

poetry run python Examples/graph_example.py

⚙️ How It Works

  • Reverse Indexing: Maps keywords to the documents where they appear.
  • PageRank: An algorithm that assigns a relevance score to each document based on its links and structure.
  • Querying: Searches for documents related to a keyword and ranks them according to their PageRank score.

📄 License

This project is licensed under the MIT License - see the LICENSE file for details.


👥 Contributors

We welcome all contributions to this project! Please make sure to follow the guidelines outlined in the CONTRIBUTING.md file.
Thanks to all contributors

Contributors

Made with contrib.rocks.


Keep learning,
Pedro;)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

search_engine_cpp-0.1.2.tar.gz (16.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

search_engine_cpp-0.1.2-cp311-cp311-manylinux_2_39_x86_64.whl (746.8 kB view details)

Uploaded CPython 3.11manylinux: glibc 2.39+ x86-64

File details

Details for the file search_engine_cpp-0.1.2.tar.gz.

File metadata

  • Download URL: search_engine_cpp-0.1.2.tar.gz
  • Upload date:
  • Size: 16.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.5 CPython/3.11.11 Linux/6.8.0-1017-azure

File hashes

Hashes for search_engine_cpp-0.1.2.tar.gz
Algorithm Hash digest
SHA256 d721ccf6999ec6f53d8c58ddc712fd7171dd1ed9fb7406d9c3b62bca17faaf53
MD5 c7b62c8a1b95ba056214f1cbf88682da
BLAKE2b-256 efb731e2ea10d7b2d16e75597bff588db03865ee7dd49740e0b336abed827fad

See more details on using hashes here.

File details

Details for the file search_engine_cpp-0.1.2-cp311-cp311-manylinux_2_39_x86_64.whl.

File metadata

File hashes

Hashes for search_engine_cpp-0.1.2-cp311-cp311-manylinux_2_39_x86_64.whl
Algorithm Hash digest
SHA256 f606777d39a5e57e6416217b42422c8e96979e739f98bea9e6b2e5d2743017aa
MD5 486a7c6ebd298a4e275e30f1fb34e3d4
BLAKE2b-256 1ca2b5435882086c0019255d004daf17232e2b62ec186bd2d5e78eaac41b0b57

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page