Freely Scrape Google Search Results Fast and Easy ✨
Project description
Novexity
Open Source SerpAPI Google Search Alternative 🌐
Freely Scrape Google Search Results Fast and Easy ✨
🔧 Installation
pip install Novexity
🛠 Setup
Make an AWS account and create a new IAM user with the permission of AmazonAPIGatewayAdministrator
. Then, to find your access key ID and secret access key, follow the official AWS tutorial.
Set up your AWS credentials in your .env
file or with awscli by running aws configure
.
GOOGLE_SEARCH_AWS_ACCESS_KEY_ID=your_access_key_id
GOOGLE_SEARCH_AWS_SECRET_ACCESS_KEY=your_secret_access_key
📖 Usage
Example usage:
import os
from novexity import search, configure
from dotenv import load_dotenv
load_dotenv()
AWS_ACCESS_KEY_ID = os.getenv('GOOGLE_SEARCH_AWS_ACCESS_KEY_ID')
AWS_SECRET_ACCESS_KEY = os.getenv('GOOGLE_SEARCH_AWS_SECRET_ACCESS_KEY')
configure(aws_access_key_id=AWS_ACCESS_KEY_ID,
aws_secret_access_key=AWS_SECRET_ACCESS_KEY)
# Call the search function
novexity, returned_gateway = search(
"Time")
# Save the results to search.json
with open("google-search.json", "w", encoding="utf-8") as file:
file.write(novexity)
# Shut down the gateways
returned_gateway.shutdown()
Please remember that if gateways are not shutdown via the shutdown()
method, you may be charged in the future.
Output:
{
"organic_results": [
{
"position": 1,
"title": "Time.is - exact time, any time zone",
"link": "https://time.is/",
"displayed_link": "Time.is https://time.is",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAMAAABEpIrGAAAAVFBMVEVHcEzOMULqFjLrByrxDC3yFTLxACnwFDHuHDakT1jKQlDkITjrEzDrGzXxABwAq6PrDi31b3r//v7wAAj3iZL6vMH81djzO0395OXfHjUAsaDGMD8ufdWhAAAAHHRSTlMAVMLx////zXckOpPo0/8H3v//////////ugp3X9i4HQAAALFJREFUeAG90kUCwzAMAEEFrLJBcvj/7yyEQSm3c16z4W+CMIrVFV6pqzjabGFkgwK1g06Iohhae1xxgMYBVxzFFYQ1TrhCzQK9KEwTWGy4+H6gHfWTaM3CDOxJ3QrN7JKUlwFyQhmz8inlXqMQIKfkc6IkY41ykBDljhmvxEB7T56xZxYXpa9QCAR/CtSzz33AFfbZLwcFiqKyC0qxOO5gEBT2GI0cbViVMGHKCQNfcwEXFBWOnAumeQAAAABJRU5ErkJggg==",
"snippet": "Your clock is 38 minutes and 57.8 seconds behind. Accuracy of synchronization was ±0.005 seconds. Time in New York, United States now: 11:39:03am.",
"source": "https://time.is"
},
{
"position": 2,
"title": "TIME | Current & Breaking News | National & World Updates",
"link": "https://time.com/",
"displayed_link": "Time Magazine https://time.com",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgAQMAAABJtOi3AAAABlBMVEX////0DAxCDAtVAAAAAXRSTlMAQObYZgAAAB5JREFUeAFjkP///weEEGA+wIFOMDAfYBg4Qv4HAwCWWB254jDUcwAAAABJRU5ErkJggg==",
"snippet": "Breaking news and analysis from TIME.com. Politics, world news, photos, video, tech reviews, health, science and entertainment news.",
"source": "https://time.com"
},
{
"position": 3,
"title": "Time",
"link": "https://en.wikipedia.org/wiki/Time",
"displayed_link": "Wikipedia https://en.wikipedia.org › wiki › Time",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAMAAABEpIrGAAAAM1BMVEUAAAD+/v41NTUBAQEAAABZWVknJycWFhaZmZmIiIjp6ellZWXMzMzX19eurq54eHhHR0dExXFyAAAAAXRSTlMAQObYZgAAAPtJREFUeAG8kAWOBDAMA9d1Sin+/7XXbpZZdBaURlMrhx28ycGCD/n0bvkBwJf8C+AoIvRAWGtMyHGtCWkfxW+DRopuuIjUtTQJDStevNoXWaRjRSllLd1O8FFhgEZx2BmkAmHC8HwpOUyxSA50VqOjXgAl50URvNWPBRcAnmwnhbcduthqQCO9KYTFBG7eDWoK1T47AZX9DuiUYT/TuhX3MGpnD51kPprSA9Dl+BCKl7jWHHEHmHsLWhNZZMxPQCLTEuy+cYF6D9i8Q5e2Lcyz4AGwKdJbX0p7AegC2qnvxAsAxQRAYH8J6Dg1a/lvpKRJinMW4cxLMPsDAJjSCaG8cPmnAAAAAElFTkSuQmCC",
"snippet": "Time is the continued sequence of existence and events that occurs in an apparently irreversible succession from the past, through the present, into the ...",
"source": "https://en.wikipedia.org › wiki › Time"
},
{
"position": 4,
"title": "Time and Date",
"link": "https://www.timeanddate.com/",
"displayed_link": "Time and Date https://www.timeanddate.com",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAMAAABEpIrGAAAA0lBMVEVHcEz////////////9/v/////////////////////r6+v////////////////////////1+vH////////////////////++/fj5+D96tL3+fgWndn/xQD81+T/++13uT/f8PnsC2D19ObMzMzR58GZynPy7+7woW/BwcH/56//34JxvuWnp6f/6KP1v53qdR7thjvpcQ7J5fT6xdXyb5nwVIijo6ONjY2Kw1y22Jvxh31KrN663/LuL3Sfz+v2p7yWlpahoaH/1E//00zqcwD41L+JE8JMAAAAFnRSTlMAPqzn/CzLBxhN7ppdsr5+jvF2gtiD5PU8twAAAZFJREFUOI19k+eSgkAQhAkLQoFg6dUQlCCgeIc5W4bL7/9Kt7ugLKg3P0Doz55eaobjKqVIvMQ9K0kTgZao8Y07tSE1gSlZrSGKBrVqVlpJcl3HxZhI6IGOiZu/Ub60LIbgi3xMvGgyccqnF4UCavFfcnnt9d78kuhQAxrQshPEAI6TtyIWPPnhJvt9UgJO+jOlhIkBgfYeBMEgugJ+OpvNI/pRMYByhyAIDi44X98TC6bz2WJ67aEUEQ/YwgbfcXyw0sUijfL3eh6BNhkkbgH/pvPrYdvkkGFI2kR2ebz8EJ4HoHE6QJZdToQZMgh4q/f1xsKACmEXV7YEZI+Hpb4+9/t9D1qclAPHE3YYj3EKFBOj4aZPAZ3jAC0vWfdIAtrbEUC8pZ3W5837ygI8FfhLo3AZUmP7M7Y/4iKDR254JnQmGcS73chlnmUyDSzgjip6PjOtClHRZTp1ighPChUjpT4DzGJsG+3HuqDctqbzv46JB11ajE5Wo1mVxfruYRO5XB9Dv99eypiCYQimypr/AdnvS9Q5ruOyAAAAAElFTkSuQmCC",
"snippet": "Current Time (World Clock) and online and printable Calendars for countries worldwide. Find the best time for web meetings (Meeting Planner) or use the Time ...",
"source": "https://www.timeanddate.com"
},
{
"position": 5,
"title": "What time is it - Exact time - Any time zone",
"link": "https://vclock.com/time/",
"displayed_link": "vClock.com https://vclock.com › time",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAMAAABEpIrGAAAAY1BMVEX////4+/7O3fGqw+WWtN/7/v/T4fJpl9MAW7wAV7wAU7oodMfq8fkAWbwAX747ecdjktF4oNccbMMHZcAAW73Y5PRYjc8AY8FBfspmlNIncMXj7PeHq9ufu+LA0+y0y+l9pNjnYfitAAABAElEQVR4AbzSAxbFMBAF0FcjTmrvf5NfNY//rRHNDP7Msh3XdWwP1/wgjL5igis0YIwLqZQk8rK5Drnyrd9A3tV3k4gU96hOsn07K7exEYTi8L0IsGEzPvbvLS0EtkqmxtdVjZ8mp7v+kqkDkpT4aiMfW3YkLHx1LLG/l7jHjhOVGGVcAD5rsOdGA0Y+Zz012dRxUZ9+wMCNmcaDit3TEKAm0XM7GTm7SY66wMbIEpF9XOaOz8OlWckGnCgWHEO9k3LmY1EekwVPhMFTur0s0fShYFKRGP9YcglX6VhyqeKh9nFAy2/RlsNQCs5YQHFml8l7nGAgIsmEP+Mw0jm/AgDVXwzahod34wAAAABJRU5ErkJggg==",
"snippet": "Online clock. What time is it in different regions of United States, Canada, Australia, Europe and the World.",
"source": "https://vclock.com › time"
},
{
"position": 6,
"title": "Exact Time Clock Now (With Seconds, Milliseconds)",
"link": "https://clock.zone/",
"displayed_link": "Clock.Zone https://clock.zone",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAMAAABEpIrGAAAALVBMVEVHcEwAAFUAAFUAAFUAAFUAAFX/AAAAAFhwAEGNADqxAC5OAEnLACIqAE/jABXKkiA9AAAABXRSTlMA7XPscvwJ5a0AAADoSURBVDiNlZPRFoQgCETNkhHN/v9zVywN3dbOzpPCVRhKY+zqfmq1xmy/06LNLHNgMfO8c/8BEF3L6EcALnIIeygEPJ2LBsDvdKpsEw0AapoOXFvWADindhbKl7gsdA8I+QBw5HiqfOqaTDEfjFKiViD0LlCuqa3VXvo5gEoLEI/NhJ5DqeBFUoG/AD5IKw6jjjTI9QCuMHtmDtVNX+I0KWJl4gaKyR2us9sBrXVoEwqgOv8yce9GQKZ3zh/a5Q2k5m0GoJVIjyUub/4RAHNtLP+dLa8/FtyT3t/F69OzcyA/bzu5Y7HmAzdJFrzSm6EUAAAAAElFTkSuQmCC",
"snippet": "My main goal was to build a website where you can find real exact time. ... This clock shows time from our dedicated server synchronised with atomic clock.",
"source": "https://clock.zone"
},
{
"position": 7,
"title": "TIME (@TIME) / X",
"link": "https://twitter.com/TIME",
"displayed_link": "Twitter https://twitter.com › TIME",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAAAAABWESUoAAAA3ElEQVR4Ac2SGQDFMBBE1ylOcYpTner0neK0TnGpU53iFKc6xWl+p+f25D7InZ295Cv0mGjFUOzWDVVVa/WykaBiaBBFfsiyory3JASRjs8mInqxUGRw47CIBIy7Ew0Sh0nED4OXCwkNh8h7GrrgCkVK9a7w6Q2BjoVa6Oo9EZEDVJ7I1M4UeMDXzIEhvoukFxNMaP8o4gpon1l9qnqc7DcPIgpd7Ce0t/fJVO0q0qIsVeuY1XwNYK1gwm8J2GAqvHRF5mD7BcG0Rl6yegjw0BqdakE8Bni0RyjyDf4Y1Y0n0wNT4wAAAABJRU5ErkJggg==",
"snippet": "isn't just the biggest K-pop act on the charts. They've become the biggest band in the world—full stop. “We climbed our way up slowly, so it feels like we ...",
"source": "https://twitter.com › TIME"
},
{
"position": 8,
"title": "Time Converter and World Clock - Conversion at a Glance ...",
"link": "https://www.worldtimebuddy.com/",
"displayed_link": "World Time Buddy https://www.worldtimebuddy.com",
"favicon": "data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAYAAABzenr0AAADwUlEQVR4AWJABqPAIaFdwSa5fb8NoJ1y3Jo0ieH4Xspex/K1bdu2bdvqXvPr2raNsY0byCTpyclbk2dwAVPn/E5YVf/uTnXpxDW0QDyJPF4yARyXcc4b6SNkr+mZ+AnPCLrr5U+VTV97qmwKnsSLGPQ5JiSWXDmiccDnHKE5PU9jTxFPl898FFQxA0EV08zT5YdwY1u/OyRK9xDk411GQDBezlSSCIZ9zZPV2n+nLsC5yzdg7ZUPOa99Ymc98ooREFI1C0zlDCJ+wIZWuTanZxtk/fzPSekTJLZWfSsgrHoOPKmyudzeHRXw70mnhiJ1TxUhOUTrVkB4zTwIEWSxma0L5/L6dw8L0JruRdx9nFPfCoisXQAP6ECTK+jfA1m//HvKe0/NXc4i0DcCouoWgYgWqz7h1IoG9kHWryggkF9g6+5b0H0uVkBM/RIEWGQrxDaoLxQNHqiA/06B7Il2+zjP2JwVQBfFNSwzsWwVrjVqrXjIB7J++++05LlPzhFBEbUL8tvzADJeQxjfuAJ3Zxnim5ZB/NJhK4AulAEMxksCf2gzgomNgISmFSASm1dBbGKTorVVKBvxg6yf6H/A8/0roYLmrIDkljVIwgsY9tfESo6/gVj8pPl9dzxD/R9gX2N9jmFsNW8FtK4DiUgJWMenTx+NgyNPqWriOZB15NRFyitY12fnPkHB8xmmtq1DamsA8ulyuph+W35K9frE3vv6Dzi8tl//WGra5xkrRkB6+wYQaXg5feU09TLZTD1byqGAP+HOdeT0RSgePJB+8zI0zzkrIKNjkz49Dxn91glIfJOSoBbKhv1w4cpN8Frvf/MnvxLu1zPo9UhM1nsIEwNDKC9AfLRUE1/J6dmBlZfeM2Iofuntb2hwZZ/BCJChY+wgIphHNKf9eb278PI736oCFYICP9AzFCsgrW0DDO2bPJASpzLriNsjterx5+Cj7/42Qr757SjVsFf3ec5ARjvSsQXip3OscN3NOf3kE7PPvA0Xr7o/C8Wyh841ArI6t4HpIitsGd/kBIm7tLb56kdw6baQNz/7jXLSYwXkdO9Abvcu5HTtAPmCxLkeueyubbSE1jiWM7DeOPMibOH/RPmw3+kzAvJ6duEw+b17btyj8QPjnOHuNwIK+/Y+Kujbh4K+PaaQ2Wc4T77WJXb7JK+YGtn83n2fEVDUtxtUPHAAxf0IWQefWukhPPo19rFfpL3kkz1W1OV79BGvVTbkCyod9P9UOuiDEqSUGPKz1ZyfYV+QvLMHMTX/R0VD7uUP1y08Jnm8PtpM8AAAAABJRU5ErkJggg==",
"snippet": "Effortless time conversion and world time. Schedule conference calls, webinars & online meetings, plan travel and track flight arrival time across time ...",
"source": "https://www.worldtimebuddy.com"
}
]
}
🎯 Filtering Fields
🔍 You can filter info based on specific fields, if you do not choose any to filter with then all will appear in output. Here are the available fields:
title
link
displayed_link
favicon
snippet
source
🌟 Example use:
# Call the search function with the fields you want to filter with
novexity, returned_gateway = search(
"Time", 'title', 'link')
🌎 Country-based Search:
To tailor the search results to a specific country, you can use the country
parameter. Simply provide the country's ISO 3166-1 alpha-2 code, available from World Data's country codes list.
# Call the search function with the country parameter
novexity, returned_gateway = search(
"Time", country="fr")
🤝 Contributing
-
🍴 Fork the repo!
-
🔧 Make your changes.
-
📦 Push your changes to a new branch and create a Pull Request.
Every contribution is welcome! 💖
📄 License
This project is licensed under the MIT License. For more details, see LICENSE.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.