维基百科
Wikipedia 是一个多语言的免费在线百科全书，由一群志愿者（称为维基人）通过开放协作和使用基于维基的编辑系统 MediaWiki 编写和维护。
Wikipedia是历史上最大且最受欢迎的参考作品。
本笔记本展示了如何将来自wikipedia.org的维基页面加载到我们下游使用的文档格式中。
安装
首先，你需要安装langchain_community和wikipedia包。
%pip install -qU langchain_community wikipedia
参数
WikipediaLoader 有以下参数：
query: 用于在维基百科中查找文档的自由文本lang(可选): 默认="en". 使用它来搜索维基百科的特定语言部分load_max_docs(可选): 默认=100。用于限制下载文档的数量。下载所有100个文档需要时间，因此实验时请使用较小的数字。目前有一个300的硬性限制。load_all_available_meta（可选）：默认=False。默认情况下，只下载最重要的字段：title和summary。如果为True，则将下载所有可用的字段。doc_content_chars_max(可选): 默认=4000。文档内容的最大字符数。
示例
from langchain_community.document_loaders import WikipediaLoader
API Reference:WikipediaLoader
docs = WikipediaLoader(query="HUNTER X HUNTER", load_max_docs=2).load()
len(docs)
2
docs[0].metadata # metadata of the first document
{'title': 'Hunter × Hunter',
'summary': 'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy named Gon Freecss who discovers that his father, who left him at a young age, is actually a world-renowned Hunter, a licensed professional who specializes in fantastical pursuits such as locating rare or unidentified animal species, treasure hunting, surveying unexplored enclaves, or hunting down lawless individuals. Gon departs on a journey to become a Hunter and eventually find his father. Along the way, Gon meets various other Hunters and encounters the paranormal.\nHunter × Hunter was adapted into a 62-episode anime television series by Nippon Animation and directed by Kazuhiro Furuhashi, which ran on Fuji Television from October 1999 to March 2001. Three separate original video animations (OVAs) totaling 30 episodes were subsequently produced by Nippon Animation and released in Japan from 2002 to 2004. A second anime television series by Madhouse aired on Nippon Television from October 2011 to September 2014, totaling 148 episodes, with two animated theatrical films released in 2013. There are also numerous audio albums, video games, musicals, and other media based on Hunter × Hunter.\nThe manga has been licensed for English release in North America by Viz Media since April 2005. Both television series have been also licensed by Viz Media, with the first series having aired on the Funimation Channel in 2009 and the second series broadcast on Adult Swim\'s Toonami programming block from April 2016 to June 2019.\nHunter × Hunter has been a huge critical and financial success and has become one of the best-selling manga series of all time, having over 84 million copies in circulation by July 2022.',
'source': 'https://en.wikipedia.org/wiki/Hunter_%C3%97_Hunter'}
docs[0].page_content[:400] # a part of the page content
'Hunter × Hunter (pronounced "hunter hunter") is a Japanese manga series written and illustrated by Yoshihiro Togashi. It has been serialized in Shueisha\'s shōnen manga magazine Weekly Shōnen Jump since March 1998, although the manga has frequently gone on extended hiatuses since 2006. Its chapters have been collected in 37 tankōbon volumes as of November 2022. The story focuses on a young boy name'