Cron Jobs, Task Queue or Deferred Tasks?

In Google App Engine, for a task like scanning some RSS feeds and adding new entries from the feed to the datastore every 10-15 seconds, should I use Cron Jobs, Task Queue or Deferred Tasks? I'm really confused.

Answers


Invoke a cron job every 1 minute, which would get the RSS and sleep for 15 seconds four times. You can locks to prevent overlapping (although the database insertion provides some measure of concurrency control).

Python-like pseudo code:

if cant_get_lock:
    exit
else:
for i in (1,2,3,4):
    get RSS
    sleep 15 seconds

  • I think if it happens every 15 seconds(not skipping) than I would cron jobs because that is easiest to implement. But if you need to be able cancel task then you should use task queue.
  • BTW you should use PubSubHubbub(hubbub) to receive updates for the feeds in realtime if I understand you correctly.

Need Your Help

How to add the indivdual option menu for posts like facebook ,google Plus

css ajax jquery drop-down-menu

I have made something here at Jsfiddle :) http://jsfiddle.net/madhu131313/gZWjb/ But the problem is I have list of Items when I click on the the dropdown button all the dropdowns are opening S...

About UNIX Resources Network

Original, collect and organize Developers related documents, information and materials, contains jQuery, Html, CSS, MySQL, .NET, ASP.NET, SQL, objective-c, iPhone, Ruby on Rails, C, SQL Server, Ruby, Arrays, Regex, ASP.NET MVC, WPF, XML, Ajax, DataBase, and so on.