Home > rss > De-Duplicate RSS Feeds

De-Duplicate RSS Feeds

August 21Hits:1

Does anyone know of a web service/desktop RSS Reader application that has some built-in smarts to de-duplicate posts across blogs?

Its gets just downright annoying when you have 7-8 RSS Feeds on a similar subject, and have to go through 7-8 posts about the same topic 'Eg: Business X has released patches'.

Recently http://www.feedafever.com/ was released. I really like the way it works, but dont really want to have to set up a SQL Server to run it.

Does anyone have any ideas on this?


I don't know about any specific application that will do this for you but you can use Yahoo Pipes to do this for you. You can build up your own pipe that filters out duplicated items in a particular RSS feed, and then point your preferred RSS reader at the newly generated feed from Yahoo.

I have been using this technique for quite a while you amalgamate all the separate BBC news feeds. You can view and clone the pipe I created here. Or the much simpler one that just does the de-duplication here.

Tags:web, rss, newsreader

Related Articles

  • De-Duplicate RSS FeedsAugust 21

    Does anyone know of a web service/desktop RSS Reader application that has some built-in smarts to de-duplicate posts across blogs? Its gets just downright annoying when you have 7-8 RSS Feeds on a similar subject, and have to go through 7-8 posts abo

  • RSS Feed Custom Title? (code placing) October 29

    Possible Duplicate: RSS Feed Custom Title? For some reason the RSS feed of my wordpress blog is repeating the site title twice without a space. "BlognameBlogname" for example. I want to change it to "Blogname" I found this answer but i

  • Will content from my site's RSS feed that is published on other sites be considered duplicate content by search engines?March 2

    I know Google is giving a penalties for websites with duplicate content. What happens if I'm having an RSS feed with news articles and other sites publishes on their website my news? Isn't it duplicate content? --------------Solutions------------- It

  • How do I Import an RSS feed as Wordpress posts without duplicates?October 17

    I have an XML feed url I am now using this code to create new Custom Post Type Posts from an rss feed in my functions.php file: /* | ------------------------------------------------------------------- | Schedule and update fashion news with the news

  • Multiple RSS feeds scroller in one sidebarSeptember 28

    How can i have multiple RSS feeds scroller in one sidebar. I want the RSS feeds of CNN, BBC, google news, USA today etc, all at the same time, is it possible to duplicate an RSS scrolling widget? --------------Solutions------------- If you're running

  • Is there a googlebot equivalent for RSS feeds?October 11

    I have a lot of feeds generated on my pages - and it seems to let them go to waste (Googlebot does not seem to see them). The RSS feeds display correctly in the pages when viewed through a browser, so I know they are working correctly. Is there a way

  • Where did the Twitter Profile RSS Feed go? October 29

    Possible Duplicate: How do you find a Twitter RSS feed? I can't find my Twitter Profile RSS feed (icon) on the "new Twitter" =) Can anyone find it? Or tell me how to get the feed url for my own profile stream? Thanks! --------------Solutions----

  • How do I get a daily email containing every new article from all of my RSS feeds? November 4

    Possible Duplicate: Are there any good webapps that will convert an RSS feed to email? I'm looking for a service that will let my enter a bunch of RSS feeds then send me a daily email, at a given time, containing all of the new articles up to that ti

  • Monitoring websites and RSS feeds every 15 seconds September 18

    Possible Duplicate: Check RSS feed every x seconds I need to monitor web pages and RSS feeds for changes every 15 seconds. What is the best way to do this? --------------Solutions------------- The best way to monitor a commercial website for changes

  • Is 301 redirects enough for RSS feeds, or will some readers fail?August 6

    I am in the process of moving an entire site from ID based pages to user friendly / descriptive urls, and I would like to move the blogs as well. My problem is then, that I am uncertain if 301 redirects will be enough to be completely covered, as I a

  • Should I send my content to other websites by RSS Feed? January 10

    This question already has an answer here: Will content from my site's RSS feed that is published on other sites be considered duplicate content by search engines? 2 answers This is a real estate website with thousants of items published with informat

  • Will get good traffic from Google if I pull content via RSS feeds?January 20

    Now-a-days, There are many plugins available in Wordpress to perform Auto Post / blogging. I know it grabs content from RSS feeds and posts it to our blog. Some of the Premium plugin will grabs full content from other sites and post it to our blog. B

  • Will having a section that aggregates news from another site's RSS feeds get me penalized for SEO?July 24

    SEO newbie here, I have a news section on my front page that essentially reads off another sites feed (example.com/feed/) and posts direct links to each article back to that site. Pretty much a mini RSS reader with one subscription. Will I get penali

  • How can I make sure the exacttarget email I've built using ampscript only sends if there are new posts in my RSS feed?April 11

    I've created an email using ampscript that pulls in the latest blog posts from an RSS feed. I would like to automate the sending of this email on a daily basis. This blog may have days where there is not a post, and I don't want to send out duplicate

  • How do I remove featured images and captions from a wordpress RSS feed?August 25

    I'm trying to remove featured images and captions from my feed and struggling to do it. As another question has identified it is very difficult to format captions and so as a newsletter feed I want to remove them. I have added the below to functions.

  • How do I extract all URL links from an RSS feed? January 18

    This question already has an answer here: How do you parse and process HTML/XML in PHP? 35 answers I need to extract all the links to news articles from the NY Times RSS feed to a MySQL database periodically. How do I go about doing this? Can I use s

  • Use Custom Tags to Aggregate RSS Feeds into JSP-Based Web AppsNovember 11

    With the abundance of news and blog (Weblog) sites growing continuously, keeping track of what's going on can be a daunting task. Fortunately, standards such as RSS (Really Simple Syndication) provide an easy way to grab content from a particular sit

  • [Quickie]New Macromedia Product RSS Feeds Available

    [Quickie]New Macromedia Product RSS Feeds AvailableJune 29

    A series of new RSS feeds are available from the Macromedia site for updating you on product updates, TechNotes and security bulletins. The list encompasses the majority of the MM product range, apart from HomeSite (which I assume active development

  • New Macromedia RSS Feeds for ColdFusion and moreJuly 3

    Now this is a bit old but I'm catching up for those of you who use this blog as your primary source of information etc. Macromedia has finally published an RSS Feed listing for most, if not all of their products. Each time Macromedia releases a TechN

  • Securing an RSS FeedJuly 21

    While Kevin has pointed out some important issues in regards to Greasemonkey – I found this new concept for securing an RSS feed an invaluable tip. Joe Gregorio wanted a way to syndicate content for himself and appears to be onto a method. With some

Copyright (C) 2017 ceus-now.com, All Rights Reserved. webmaster#ceus-now.com 14 q. 1.070 s.