Skip to main content

fossick

search finds URLs. fetch / to_md read them (plain → heavy → stealthy → session). cdp_connect drives a real Chrome when you need a login or multi-step UI. Dedicated readers cover YouTube, arXiv, and GitHub.

Install

uv add fossick

Text/image/news search need no Docker. JS rendering, stealth fetch, and google() use a bundled headless browser.

Quick start

results = search('koshas github fts semantic code graph', method='flashrank', n=5)
for r in results: print(r['score'], r['engines'], r['title'], r['href'])
0.030536 ['brave', 'yahoo'] github.com › codegraph-ai › CodeGraphGitHub - codegraph-ai/CodeGraph: CodeGraph builds a semantic... https://github.com/codegraph-ai/CodeGraph
0.016129 ['yahoo'] vedicreader.github.io › kosha › graphgraph – koshas - vedicreader.github.io https://vedicreader.github.io/kosha/graph.html
0.015873 ['brave'] fts · GitHub Topics · GitHub https://github.com/topics/fts?o=desc&s=updated
0.016393 ['yahoo'] pypi.org › project › koshaskoshas · PyPI https://pypi.org/project/koshas/
0.015625 ['brave'] GitHub - colbymchenry/codegraph: Pre-indexed code knowledge graph, auto syncs on code changes, for Claude Code, Codex, Gemini, Cursor, OpenCode, AntiGravity, Kiro, and Hermes Agent — fewer tokens, fewer tool calls, 100% local https://github.com/colbymchenry/codegraph
res = research('sqlite WAL mode vs journal mode', n=5)
print(res['digest'][:500])
print([s['href'] for s in res['sources']])
## Write-Ahead Logging
https://www.sqlite.org/wal.html

Write-Ahead Logging

Table Of Contents

# 1\. Overview

The default method by which SQLite implements atomic commit and rollback is a rollback journal. Beginning with version 3.7.0 (2010-07-21), a new "Write-Ahead Log" option (hereafter referred to as "WAL") is available.

There are advantages and disadvantages to using WAL instead of a rollback journal. Advantages include:

1. WAL is significantly faster in most scenarios. 
  2. WAL provid
['https://www.sqlite.org/wal.html', 'https://blog.sqlite.ai/journal-modes-in-sqlite', 'https://mohit-bhalla.medium.com/understanding-wal-mode-in-sqlite-boosting-performance-in-sql-crud-operations-for-ios-5a8bd8be93d2', 'https://til.simonwillison.net/sqlite/enabling-wal-mode', 'https://fly.io/blog/wal-mode-in-litefs/']
page = fetch('https://en.wikipedia.org/wiki/Web_scraping', verify=False)
print(to_md(page)[:400])
The legality of web scraping varies across the world. In general, web scraping may be against the terms of service of some websites, but the enforceability of these terms is unclear.[11]

In the United States, website owners can use three major legal claims to prevent undesired web scraping: (1) copyright infringement (compilation), (2) violation of the Computer Fraud and Abuse Act ("CFAA"), and (

Modules

notebook for
00_core fetch, to_md, crawl, readers (yt/arxiv/gh), hidden APIs
01_cdp Chrome over DevTools — snapshot, fill_form, act
02_search metasearch, RRF/BM25/flashrank, google, research
03_cli fossick CLI
04_mcp MCP server for agents
05_shop cart/checkout automation on a live page
06_quality plan, curate, authority, diversity

One-liners

search('query', n=10, region='auto', timelimit='y')
research('query', n=5)                    # search → read → cited digest
fetch(url, auto=True)                     # escalate past bot walls
crawl(url, max_pages=5, same_domain=True)
google('query', n=10)                     # real Google via stealth browser
cdp_connect(); pg = await cdp.new_page(url); print(await pg.snapshot())

CLI: fossick search "q", fossick fetch URL --auto, fossick research "q". MCP: uvx fossick-mcp (or fossick-mcp --http).

Debug Chrome

Persistent profile for logged-in fetches (session=True) and CDP:

fossick cdp-install   # launch agent + keep-alive

Cookies survive restarts; log in once by hand.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fossick-0.1.13.tar.gz (97.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fossick-0.1.13-py3-none-any.whl (97.8 kB view details)

Uploaded Python 3

File details

Details for the file fossick-0.1.13.tar.gz.

File metadata

  • Download URL: fossick-0.1.13.tar.gz
  • Upload date:
  • Size: 97.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.14.6

File hashes

Hashes for fossick-0.1.13.tar.gz
Algorithm Hash digest
SHA256 73ecd83d68ce4d1b37f1a467219650625495967fdf21d550638b5fc9ee809ff1
MD5 f91d23a9f2399d634f149ce6a93bba55
BLAKE2b-256 0721776369e6e0d10e616db92cb1a841d002af5173039a7589ccaa2d59b0a24d

See more details on using hashes here.

File details

Details for the file fossick-0.1.13-py3-none-any.whl.

File metadata

  • Download URL: fossick-0.1.13-py3-none-any.whl
  • Upload date:
  • Size: 97.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.14.6

File hashes

Hashes for fossick-0.1.13-py3-none-any.whl
Algorithm Hash digest
SHA256 ff5f13355c311204b8832cd7653095b2d0f8316775976ca48079d2eaebb2337c
MD5 2011600a036bc9842f9132f4b195fb8d
BLAKE2b-256 31efe4fc72e58f95af7d7ecbff2a7f10aa87a32045c2600c889324a678950d8c

See more details on using hashes here.

Release history Release notifications | RSS feed

0.1.17

2 files

0.1.16

2 files

0.1.14

2 files

This release

0.1.13 This release

2 files

0.1.12

2 files

0.1.11

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

2 files

0.1.7

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.15

2 files

0.0.14

2 files

0.0.13

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page