Newspaper4k Python Article Extraction and NLP Library

Newspaper4k is an actively maintained fork of the popular Newspaper3k library for Python. It extracts articles, titles, images, authors, and metadata from news websites, with built-in NLP for keyword extraction and text summarization.

Installation

Use the upstream install or setup path that matches your environment:

• pip install newspaper4k
• pip install newspaper4k[gnews]
• brew install libxml2 libxslt
• brew install libtiff libjpeg webp little-cms2

Requirements and caveats from upstream:

• Python compatibility

• Python 3.10+ minimum
• python -m newspaper --url="https://edition.cnn.com/2023/11/17/success/job-seekers-use-ai/index.html" --language=en --output-format=json --output-file=article.json

Basic usage or getting-started notes:

• bash

• Using the CLI

• You can start directly from the command line, using the included CLI:

• Source: https://github.com/AndyTheFactory/newspaper4k

• Extracted from upstream docs: https://raw.githubusercontent.com/AndyTheFactory/newspaper4k/HEAD/README.md

Source

• Agent Skill Exchange