Thanks to visit codestin.com
Credit goes to github.com

Skip to content

quick rss recorder to avoid query to much website you like

Notifications You must be signed in to change notification settings

cybunk/RssRecorder

Repository files navigation

RSS provider

Description

A simple Node js script to load, save rss feed and serve a chunk as a Json over http.

Usage

Tree endpoint to access the rss element :

  • Mongo db query :

    Format : q?query={}&sort={}&field={}&limit=30&skipe=0

    Exemple : q?query={"title":"Install%20mod_wsgi%20in%20mamp"}

  • Direct query to access a rss in JSON without storing it :

    dq?url=http%3A%2F%2Fstackoverflow.com%2Ffeeds%2Ftag%2Fphp&callback=test

  • Statistiques on the db : (Not yet implemented)

    s?query={}&sort={}&field={}&limit=30&skipe=0

Jsonp is available on all request :

_query :_
q?query={}&callback="myjsonpfunction"

_provide :_ 
myjsonpfunction([{},{},{} ...])

Dependencies

feedparser https://github.com/danmactough/node-feedparser

npm install feedparser

Installing

Download the latest version here:

Or, from the command line:

git clone https://github.com/cybunk/RssRecorder.git

How to start :

  • Recorder part : 'node rssrecorder.js setting.js'

  • Server part : 'node rssprovider.js'

Configuration

module.exports = {
	dbName:"_vs_examples",			// mongo db dbName
	dbCollection:"myCollection",	// mongo db collection
	serverPort:9616,				// server port for http provider
	url:[							// url array to query 
		"http://stackoverflow.com/feeds/",
		],
	delay:60*1000,  // interval to query in milllisecondes, default = 2 minute
	id:'guid'		// element to identify one entry to anoter and don't record two time the same element 
}

About

quick rss recorder to avoid query to much website you like

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors