Skip to main content

fossick

search finds URLs. fetch / to_md read them (plain → heavy → stealthy → session). cdp_connect drives a real Chrome when you need a login or multi-step UI. Dedicated readers cover YouTube, arXiv, and GitHub.

Install

uv add fossick

Text/image/news search need no Docker. JS rendering, stealth fetch, and google() use a bundled headless browser.

Quick start

results = search('koshas github fts semantic code graph', method='flashrank', n=5)
for r in results: print(r['score'], r['engines'], r['title'], r['href'])
0.030536 ['brave', 'yahoo'] github.com › codegraph-ai › CodeGraphGitHub - codegraph-ai/CodeGraph: CodeGraph builds a semantic... https://github.com/codegraph-ai/CodeGraph
0.016129 ['yahoo'] vedicreader.github.io › kosha › graphgraph – koshas - vedicreader.github.io https://vedicreader.github.io/kosha/graph.html
0.015873 ['brave'] fts · GitHub Topics · GitHub https://github.com/topics/fts?o=desc&s=updated
0.016393 ['yahoo'] pypi.org › project › koshaskoshas · PyPI https://pypi.org/project/koshas/
0.015625 ['brave'] GitHub - colbymchenry/codegraph: Pre-indexed code knowledge graph, auto syncs on code changes, for Claude Code, Codex, Gemini, Cursor, OpenCode, AntiGravity, Kiro, and Hermes Agent — fewer tokens, fewer tool calls, 100% local https://github.com/colbymchenry/codegraph
res = research('sqlite WAL mode vs journal mode', n=5)
print(res['digest'][:500])
print([s['href'] for s in res['sources']])
## Write-Ahead Logging
https://www.sqlite.org/wal.html

Write-Ahead Logging

Table Of Contents

# 1\. Overview

The default method by which SQLite implements atomic commit and rollback is a rollback journal. Beginning with version 3.7.0 (2010-07-21), a new "Write-Ahead Log" option (hereafter referred to as "WAL") is available.

There are advantages and disadvantages to using WAL instead of a rollback journal. Advantages include:

1. WAL is significantly faster in most scenarios. 
  2. WAL provid
['https://www.sqlite.org/wal.html', 'https://blog.sqlite.ai/journal-modes-in-sqlite', 'https://mohit-bhalla.medium.com/understanding-wal-mode-in-sqlite-boosting-performance-in-sql-crud-operations-for-ios-5a8bd8be93d2', 'https://til.simonwillison.net/sqlite/enabling-wal-mode', 'https://fly.io/blog/wal-mode-in-litefs/']
page = fetch('https://en.wikipedia.org/wiki/Web_scraping', verify=False)
print(to_md(page)[:400])
The legality of web scraping varies across the world. In general, web scraping may be against the terms of service of some websites, but the enforceability of these terms is unclear.[11]

In the United States, website owners can use three major legal claims to prevent undesired web scraping: (1) copyright infringement (compilation), (2) violation of the Computer Fraud and Abuse Act ("CFAA"), and (

Modules

notebook for
00_core fetch, to_md, crawl, readers (yt/arxiv/gh), hidden APIs
01_cdp Chrome over DevTools — snapshot, fill_form, act
02_search metasearch, RRF/BM25/flashrank, google, research
03_cli fossick CLI
04_mcp MCP server for agents
05_shop cart/checkout automation on a live page
06_quality plan, curate, authority, diversity

One-liners

search('query', n=10, region='auto', timelimit='y')
research('query', n=5)                    # search → read → cited digest
fetch(url, auto=True)                     # escalate past bot walls
crawl(url, max_pages=5, same_domain=True)
google('query', n=10)                     # real Google via stealth browser
cdp_connect(); pg = await cdp.new_page(url); print(await pg.snapshot())

CLI: fossick search "q", fossick fetch URL --auto, fossick research "q". MCP: uvx fossick-mcp (or fossick-mcp --http).

Debug Chrome

Persistent profile for logged-in fetches (session=True) and CDP:

fossick cdp-install   # launch agent + keep-alive

Cookies survive restarts; log in once by hand.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fossick-0.1.12.tar.gz (97.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fossick-0.1.12-py3-none-any.whl (97.4 kB view details)

Uploaded Python 3

File details

Details for the file fossick-0.1.12.tar.gz.

File metadata

  • Download URL: fossick-0.1.12.tar.gz
  • Upload date:
  • Size: 97.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.14.6

File hashes

Hashes for fossick-0.1.12.tar.gz
Algorithm Hash digest
SHA256 6c2767528df44e05fbc1b6eb791d961c596f21e2d74e6d129527ae08c9ceaf79
MD5 fe3832992a01a42cc464384b81e1f910
BLAKE2b-256 0d5478e9bbb2f74e1d7ab4247ca4f977989a8eaa9ff43c404da944a8ac1442c8

See more details on using hashes here.

File details

Details for the file fossick-0.1.12-py3-none-any.whl.

File metadata

  • Download URL: fossick-0.1.12-py3-none-any.whl
  • Upload date:
  • Size: 97.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.14.6

File hashes

Hashes for fossick-0.1.12-py3-none-any.whl
Algorithm Hash digest
SHA256 0faaf6d7fb544281bb08f40181fd511f314b435bbcd80e38a66f18d528940176
MD5 ba220c4594263f736a9699d3087de74f
BLAKE2b-256 7d2da7192ed32cb24f7b74cc9a5c470784a67255eaf9a922294dea89992ada4d

See more details on using hashes here.

Release history Release notifications | RSS feed

0.1.17

2 files

0.1.16

2 files

0.1.14

2 files

0.1.13

2 files

This release

0.1.12 This release

2 files

0.1.11

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

2 files

0.1.7

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.15

2 files

0.0.14

2 files

0.0.13

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page