Skip to main content

fossick

search finds URLs. fetch / to_md read them (plain → heavy → stealthy → session). cdp_connect drives a real Chrome when you need a login or multi-step UI. Dedicated readers cover YouTube, arXiv, and GitHub.

Install

uv add fossick

Text/image/news search need no Docker. JS rendering, stealth fetch, and google() use a bundled headless browser.

Quick start

results = search('koshas github fts semantic code graph', method='flashrank', n=5)
for r in results: print(r['score'], r['engines'], r['title'], r['href'])
0.030536 ['brave', 'yahoo'] github.com › codegraph-ai › CodeGraphGitHub - codegraph-ai/CodeGraph: CodeGraph builds a semantic... https://github.com/codegraph-ai/CodeGraph
0.016129 ['yahoo'] vedicreader.github.io › kosha › graphgraph – koshas - vedicreader.github.io https://vedicreader.github.io/kosha/graph.html
0.015873 ['brave'] fts · GitHub Topics · GitHub https://github.com/topics/fts?o=desc&s=updated
0.016393 ['yahoo'] pypi.org › project › koshaskoshas · PyPI https://pypi.org/project/koshas/
0.015625 ['brave'] GitHub - colbymchenry/codegraph: Pre-indexed code knowledge graph, auto syncs on code changes, for Claude Code, Codex, Gemini, Cursor, OpenCode, AntiGravity, Kiro, and Hermes Agent — fewer tokens, fewer tool calls, 100% local https://github.com/colbymchenry/codegraph
res = research('sqlite WAL mode vs journal mode', n=5)
print(res['digest'][:500])
print([s['href'] for s in res['sources']])
## Write-Ahead Logging
https://www.sqlite.org/wal.html

Write-Ahead Logging

Table Of Contents

# 1\. Overview

The default method by which SQLite implements atomic commit and rollback is a rollback journal. Beginning with version 3.7.0 (2010-07-21), a new "Write-Ahead Log" option (hereafter referred to as "WAL") is available.

There are advantages and disadvantages to using WAL instead of a rollback journal. Advantages include:

1. WAL is significantly faster in most scenarios. 
  2. WAL provid
['https://www.sqlite.org/wal.html', 'https://blog.sqlite.ai/journal-modes-in-sqlite', 'https://mohit-bhalla.medium.com/understanding-wal-mode-in-sqlite-boosting-performance-in-sql-crud-operations-for-ios-5a8bd8be93d2', 'https://til.simonwillison.net/sqlite/enabling-wal-mode', 'https://fly.io/blog/wal-mode-in-litefs/']
page = fetch('https://en.wikipedia.org/wiki/Web_scraping', verify=False)
print(to_md(page)[:400])
The legality of web scraping varies across the world. In general, web scraping may be against the terms of service of some websites, but the enforceability of these terms is unclear.[11]

In the United States, website owners can use three major legal claims to prevent undesired web scraping: (1) copyright infringement (compilation), (2) violation of the Computer Fraud and Abuse Act ("CFAA"), and (

Modules

notebook for
00_core fetch, to_md, crawl, readers (yt/arxiv/gh), hidden APIs
01_cdp Chrome over DevTools — snapshot, fill_form, act
02_search metasearch, RRF/BM25/flashrank, google, research
03_cli fossick CLI
04_mcp MCP server for agents
05_shop cart/checkout automation on a live page
06_quality plan, curate, authority, diversity

One-liners

search('query', n=10, region='auto', timelimit='y')
research('query', n=5)                    # search → read → cited digest
fetch(url, auto=True)                     # escalate past bot walls
crawl(url, max_pages=5, same_domain=True)
google('query', n=10)                     # real Google via stealth browser
cdp_connect(); pg = await cdp.new_page(url); print(await pg.snapshot())

CLI: fossick search "q", fossick fetch URL --auto, fossick research "q". MCP: uvx fossick-mcp (or fossick-mcp --http).

Debug Chrome

Persistent profile for logged-in fetches (session=True) and CDP:

fossick cdp-install   # launch agent + keep-alive

Cookies survive restarts; log in once by hand.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fossick-0.1.11.tar.gz (96.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fossick-0.1.11-py3-none-any.whl (96.7 kB view details)

Uploaded Python 3

File details

Details for the file fossick-0.1.11.tar.gz.

File metadata

  • Download URL: fossick-0.1.11.tar.gz
  • Upload date:
  • Size: 96.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.14.6

File hashes

Hashes for fossick-0.1.11.tar.gz
Algorithm Hash digest
SHA256 ca3758e42c8433021496684bdc9dbb6ce4558e66363469740b374b902be5aa4e
MD5 586800ce9609f2802fdb9cc0ff097771
BLAKE2b-256 c8be683a351d68d63edc7f75bc6db51281ddf187e2883142f033197e1fef1617

See more details on using hashes here.

File details

Details for the file fossick-0.1.11-py3-none-any.whl.

File metadata

  • Download URL: fossick-0.1.11-py3-none-any.whl
  • Upload date:
  • Size: 96.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/7.0.0 CPython/3.14.6

File hashes

Hashes for fossick-0.1.11-py3-none-any.whl
Algorithm Hash digest
SHA256 eba85eac47f4201556dab4710997491daf5511b7c0396337b7e2ee1be5bc3a3f
MD5 dd299384404d02c782be7456870ad86f
BLAKE2b-256 dab6b400510f4b591fecee270f98e2e03163e2767ff8d7ef84d97144ac9a8c3b

See more details on using hashes here.

Release history Release notifications | RSS feed

0.1.17

2 files

0.1.16

2 files

0.1.14

2 files

0.1.13

2 files

0.1.12

2 files

This release

0.1.11 This release

2 files

0.1.10

2 files

0.1.9

2 files

0.1.8

2 files

0.1.7

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.15

2 files

0.0.14

2 files

0.0.13

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.7

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page