Create Full-Text Feeds — from FiveFilters.org

Create full-text feed from webpage or feed URL
Options

For the site owner

Thanks for downloading and setting this up. If you haven't done so already, check server compatibility to see if your environment will support this application.

If everything's okay, feel free to edit this file (index.html) and make any changes you like. If you plan to offer this service to others, please keep a download link so users can grab a copy of the code if they want it (you can either offer the download yourself, or link to the download page on fivefilters.org). That's one requirement of the license.

Thanks! :)

For everyone else

About

This is a free software project to help people extract content from web pages. It can extract content from a standard HTML page and return a 1-item feed or it can transform an existing feed into a full-text feed. It is being developed as part of the Five Filters project to promote independent, non-corporate media.

Bookmarklet

To easily transform partial-feeds you encounter (or convert any content on a page into a 1-item feed), drag the link below to your browser's bookmarks toolbar. Then whenever you'd like a full-text feed, click the bookmarklet.

Drag this:

API

To extract content from a web page or to transform an existing partial feed to full text, pass the URL (encoded) in the querystring to the following URL:

If you have an API key, add that to the querystring:

If you're not hosting this yourself, you do not have to rely on an external API if you don't want to — this is a free software (open source) project licensed under the AGPL. You're free to download your own copy.

Source Code and Technologies

Source code available on launchpad.net.

The application uses PHP, PHP Readability, SimplePie, FeedWriter, Humble HTTP Agent, Zend Cache and IRI. Readability is the magic piece of code that tries to identify and extract the content block from any given web page.

System Requirements

PHP 5.2 or above is required. The code has been tested on Windows and Linux using the Apache web server. If you're a Windows user, you can try it on your own machine using WampServer.

Download and Installation

The software can be downloaded free of charge through launchpad.net using a Bazaar client (see below). However, for those who'd like a simpler solution, you can also buy a zip package with the source code.

Installation with the Bazaar client

  1. Log in to your host using SSH
  2. Change to the directory where you want Full-Text RSS installed
  3. Enter bzr export full-text-rss http://bazaar.launchpad.net/~keyvan/fivefilters/content-only/
  4. Now enter chmod -R 0777 full-text-rss/cache/
  5. That's it! Try accessing the full-text-rss folder through your web browser, you should see the form asking for a URL.
  6. (Optional) If you'd like to customise the software, rename config-sample.php to config.php and edit the file.

If you'd like to create a feed without going through the form first, you can simply pass the URL in the query string to makefulltextfeed.php (see the API section above).

License

AGPL logo
This web application is licensed under the AGPL version 3 — which basically means if you use the code to offer the same or similar service for your users, you are also required to share the code with your users so they can do the same themselves. (More on why this is important.)

The libraries used by the application are licensed as follows...

To support the development of the Full-Text RSS project, please donate. All donations greatly appreciated.