Skip to main content

Python MediaWiki Bot Framework

Project description

Github CI AppVeyor Build Status Code coverage Maintainability Python Pywikibot release Total downloads Monthly downloads

Pywikibot

The Pywikibot framework is a Python library that interfaces with the MediaWiki API version 1.23 or higher.

Also included are various general function scripts that can be adapted for different tasks.

For further information about the library excluding scripts see the full code documentation.

Quick start

pip install requests
git clone https://gerrit.wikimedia.org/r/pywikibot/core.git
cd core
git submodule update --init
python pwb.py script_name

Or to install using PyPI (excluding scripts)

pip install -U setuptools
pip install pywikibot
pwb <scriptname>

In addition a MediaWiki markup parser is required. Please install one of them:

pip install mwparserfromhell

or

pip install wikitextparser

Our installation guide has more details for advanced usage.

Basic Usage

If you wish to write your own script it’s very easy to get started:

import pywikibot
site = pywikibot.Site('en', 'wikipedia')  # The site we want to run our bot on
page = pywikibot.Page(site, 'Wikipedia:Sandbox')
page.text = page.text.replace('foo', 'bar')
page.save('Replacing "foo" with "bar"')  # Saves the page

Wikibase Usage

Wikibase is a flexible knowledge base software that drives Wikidata. A sample pywikibot script for getting data from Wikibase:

import pywikibot
site = pywikibot.Site('wikipedia:en')
repo = site.data_repository()  # the Wikibase repository for given site
page = repo.page_from_repository('Q91')  # create a local page for the given item
item = pywikibot.ItemPage(repo, 'Q91')  # a repository item
data = item.get()  # get all item data from repository for this item

Script example

Pywikibot provides bot classes to develop your own script easily:

import pywikibot
from pywikibot import pagegenerators
from pywikibot.bot import ExistingPageBot

class MyBot(ExistingPageBot):

    update_options = {
        'text': 'This is a test text',
        'summary: 'Bot: a bot test edit with Pywikibot.'
    }

    def treat_page(self):
        """Load the given page, do some changes, and save it."""
        text = self.current_page.text
        text += '\n' + self.opt.text
        self.put_current(text, summary=self.opt.summary)

def main():
    """Parse command line arguments and invoke bot."""
    options = {}
    gen_factory = pagegenerators.GeneratorFactory()
    # Option parsing
    local_args = pywikibot.handle_args(args)  # global options
    local_args = gen_factory.handle_args(local_args)  # generators options
    for arg in local_args:
        opt, sep, value = arg.partition(':')
        if opt in ('-summary', '-text'):
            options[opt[1:]] = value
    MyBot(generator=gen_factory.getCombinedGenerator(), **options).run()

if __name == '__main__':
    main()

For more documentation on Pywikibot see our docs.

Roadmap

Current release 7.5.0

  • Add support for blkwiki (T310875)

  • L10N Updates

  • Fix duplicate source detection in pywikibot.WikidataBot.user_add_claim_unless_exists

  • pywikibot.textlib.tzoneFixedOffset class was renamed to pywikibot.time.TZoneFixedOffset

  • Wrapper method parsevalue() around wbparsevalue was added (T112140, T312755)

  • L10N updates

  • Fix cp encodings in get_charset_from_content_type()

    (T312230)

  • New pywikibot.time module with new functions in addition to Timestamp

  • Page.revisions() supports more formats/types for starttime and endtime parameters, in addition to those allowed by Timestamp.fromISOformat().

  • New Timestamp.set_timestamp() method

  • Fully ISO8601 and POSIX format support with pywikibot.Timestamp; formats are compliant with MediaWiki supported formats

  • Handle asynchronous page_put_queue after KeyboardInterrupt in Python 3.9+ (T311076)

  • No longer expect a specific namespace alias in cosmetic_changes translateAndCapitalizeNamespaces

Deprecations

  • 7.5.0: pywikibot.textlib.tzoneFixedOffset class will be removed in favour of pywikibot.time.TZoneFixedOffset

  • 7.4.0: FilePage.usingPages() was renamed to using_pages()

  • 7.2.0: tb parameter of exception() function was renamed to exc_info

  • 7.2.0: XMLDumpOldPageGenerator is deprecated in favour of a content parameter of XMLDumpPageGenerator (T306134)

  • 7.2.0: RedirectPageBot and NoRedirectPageBot bot classes are deprecated in favour of use_redirects attribute

  • 7.2.0: tools.formatter.color_format is deprecated and will be removed

  • 7.1.0: Unused get_redirect parameter of Page.getOldVersion() will be removed

  • 7.1.0: APISite._simple_request() will be removed in favour of APISite.simple_request()

  • 7.0.0: User.isBlocked() method is renamed to is_blocked for consistency

  • 7.0.0: Private BaseBot counters _treat_counter, _save_counter, _skip_counter will be removed in favour of collections.Counter counter attribute

  • 7.0.0: A boolean watch parameter in Page.save() is deprecated and will be desupported

  • 7.0.0: baserevid parameter of editSource(), editQualifier(), removeClaims(), removeSources(), remove_qualifiers() DataSite methods will be removed

  • 7.0.0: Values of APISite.allpages() parameter filterredir other than True, False and None are deprecated

  • 6.5.0: OutputOption.output() method will be removed in favour of OutputOption.out property

  • 6.5.0: Infinite rotating file handler with logfilecount of -1 is deprecated

  • 6.4.0: ‘allow_duplicates’ parameter of tools.intersect_generators as positional argument is deprecated, use keyword argument instead

  • 6.4.0: ‘iterables’ of tools.intersect_generators given as a list or tuple is deprecated, either use consecutive iterables or use ‘*’ to unpack

  • 6.2.0: outputter of OutputProxyOption without out property is deprecated

  • 6.2.0: ContextOption.output_range() and HighlightContextOption.output_range() are deprecated

  • 6.2.0: Error messages with ‘%’ style is deprecated in favour for str.format() style

  • 6.2.0: page.url2unicode() function is deprecated in favour of tools.chars.url2string()

  • 6.2.0: Throttle.multiplydelay attribute is deprecated

  • 6.2.0: SequenceOutputter.format_list() is deprecated in favour of ‘out’ property

  • 6.0.0: config.register_family_file() is deprecated

Will be removed in Pywikibot 8

  • 7.3.0: Python 3.5 support will be dropped (T301908)

  • 7.1.0: win32_unicode.py will be removed

  • 7.0.0: The i18n identifier ‘cosmetic_changes-append’ will be removed in favour of ‘pywikibot-cosmetic-changes’

  • 7.0.0: pymysql < 0.7.11 will be dropped; require pymysql >= 0.7.11 (T216741)

  • 5.5.0: APISite.redirectRegex() will be removed in favour of APISite.redirect_regex()

  • 4.0.0: Revision.parent_id will be removed in favour of Revision.parentid

  • 4.0.0: Revision.content_model will be removed in favour of Revision.contentmodel

Release history

See https://github.com/wikimedia/pywikibot/blob/stable/HISTORY.rst

Contributing

Our code is maintained on Wikimedia’s Gerrit installation, learn how to get started.

Code of Conduct

The development of this software is covered by a Code of Conduct.

Project details


Release history Release notifications | RSS feed

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pywikibot-7.5.0.tar.gz (582.3 kB view details)

Uploaded Source

Built Distribution

pywikibot-7.5.0-py3-none-any.whl (675.3 kB view details)

Uploaded Python 3

File details

Details for the file pywikibot-7.5.0.tar.gz.

File metadata

  • Download URL: pywikibot-7.5.0.tar.gz
  • Upload date:
  • Size: 582.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.5

File hashes

Hashes for pywikibot-7.5.0.tar.gz
Algorithm Hash digest
SHA256 905ab433088022a342d5f8b1fee0acadd239c131eaacc33f917d7bafba1d28fe
MD5 f61a6cbf623c16cdd642fe8a310b4c97
BLAKE2b-256 ec5ce7c0ffb4ae63125bbf4ab7d3ba17abc444fa6a961d28e764816ab51277ed

See more details on using hashes here.

File details

Details for the file pywikibot-7.5.0-py3-none-any.whl.

File metadata

  • Download URL: pywikibot-7.5.0-py3-none-any.whl
  • Upload date:
  • Size: 675.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.10.5

File hashes

Hashes for pywikibot-7.5.0-py3-none-any.whl
Algorithm Hash digest
SHA256 96f7a130bb9920c26aa2eb0bee5196b509cfc04a369c2c07b498b2f424e60600
MD5 24526b91e16b98966a47db1f385c14c9
BLAKE2b-256 a83826b6bbfd7297dd05b46158a33af43499650930c51d66ffb1bb34688713d8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page