Twitter search & user timeline components for Haystack

Search Twitter and fetch public user timelines in Haystack RAG pipelines. Each Xquik result becomes a Haystack Document.

Xquik is the world's fastest and cheapest X Twitter scraper service with the most complete X data. Xquik charges only for delivered, unique, filter-matching results and never pads rows.

Read the Xquik Haystack guide.

Components

Import both read-only components from the Haystack integration namespace.

from haystack_integrations.components.websearch.xquik import XquikTweetSearch, XquikUserTweetsFetcher

Both components read XQUIK_API_KEY by default and accept a Haystack Secret. They send x-api-key and xquik-api-contract: 2026-04-29 headers. Set base_url for another Xquik-compatible endpoint. Results include documents, links, has_more, and next_cursor.

Use an Xquik SDK for follower exports or posting.

Install

pip install xquik-haystack

Build a Haystack RAG pipeline with Twitter search

Search posts

from haystack import Pipeline
from haystack.utils import Secret
from haystack_integrations.components.websearch.xquik import XquikTweetSearch

search = XquikTweetSearch(api_key=Secret.from_env_var("XQUIK_API_KEY"), top_k=10)

pipeline = Pipeline()
pipeline.add_component("x_search", search)

result = pipeline.run({"x_search": {"query": "haystack ai"}})
documents = result["x_search"]["documents"]

Fetch user posts

from haystack.utils import Secret
from haystack_integrations.components.websearch.xquik import XquikUserTweetsFetcher

fetcher = XquikUserTweetsFetcher(api_key=Secret.from_env_var("XQUIK_API_KEY"))

result = fetcher.run(user_id="example_user", include_replies=False)
documents = result["documents"]

Document mapping

Each tweet becomes a Haystack Document with this mapping.

• Document.content holds the tweet text, or an empty string when text is missing.
• Document.meta["endpoint"] names the Xquik endpoint family the component used.
• Document.meta holds the available id, url, and created_at source values.
• Document.meta["author"] holds the available author identity and verification data.
• Document.meta holds the available like, repost, reply, quote, view & bookmark counts.

Development

Use Hatch for builds and environment management.

pip install hatch==1.18.0
hatch run fmt-check
hatch run test:unit
hatch build

Unit tests mock all Xquik HTTP calls.

Run bin/check-local before you open a pull request. It runs the lint, license, test & CodeQL checks.

Maintainers release with bin/release-local <version> on a clean main. It runs the checks, builds, uploads to PyPI, tags the commit and creates the GitHub release. bin/release-local --dry-run <version> uploads, tags and releases nothing.

PyPI has no trusted publisher for xquik-haystack. A maintainer's PyPI token is the only way it publishes. bin/release-local reads it from the Keychain item that PYPI_KEYCHAIN_SERVICE names.

Support & project policies

• Organization support policy
• Organization security policy
• Contribution guide

License

xquik-haystack is distributed under the terms of the Apache-2.0 license.

Xquik is an independent third-party service. Not affiliated with X Corp. "Twitter" and "X" are trademarks of X Corp.