🖥️ CamoufoxDf - Webscraping with Camoufox, Pandas and Cython

pip install pandascamoufox

Important: Cython and a C++ compiler must be installed! The module will be compiled the first time you import it!

This project provides:

• CamoufoxDf wrapper: Extract DOM elements from a Camoufox browser session into a Pandas DataFrame, including both element attributes and bound methods for direct interaction (e.g., click, hover, type).

✨ Features

• Use CamoufoxDf to fetch DOM elements into a DataFrame with:
  • All element attributes (id, classes, styles, geometry, dataset, etc.)
  • Pre-bound executable methods (click, hover, type, screenshot, etc.)

⚠️ Important Notes

• ❌ Does not work inside IPython or Jupyter Notebook This is due to async conflicts between IPython and Camoufox (Playwright). Attempting to run inside IPython will result in event-loop errors.

• ✅ Recommended Environment To use this effectively, run it inside:

  • VTM Terminal — for advanced terminal rendering (no line breaks)
  • ptpython — for an enhanced interactive REPL

🚀 Usage

from pandascamoufox import CamoufoxDf
from camoufox.utils import DefaultAddons
import pandas as pd
from contextlib import suppress as contextlib_suppress
from time import sleep

cfox = CamoufoxDf(
    humanize=False, headless=False, **{"exclude_addons": [DefaultAddons.UBO]}
)

def gf(selector="*"):
    while True:
        with contextlib_suppress(Exception):
            df = cfox.get_df(selector)
            if "aa_text" in df.columns:
                return df

cfox.page.goto("https://bet365.com")
df=gf()
print(df)