Skin of Stars » ruby http://skinofstars.com Machines, Media and Miscellanea Mon, 06 Feb 2012 18:17:40 +0000 en hourly 1 http://wordpress.org/?v=3.1.2 Ruby On Rails, RSS and Atom feed parsing with Feed Normalizer and subsequent storage http://skinofstars.com/2009/03/ruby-on-rails-rss-and-atom-feed-parsing-with-feed-normalizer-and-subsequent-storage/ http://skinofstars.com/2009/03/ruby-on-rails-rss-and-atom-feed-parsing-with-feed-normalizer-and-subsequent-storage/#comments Mon, 23 Mar 2009 02:47:10 +0000 Kevin ... Read the remaining 81 words]]> I’ve battled for days on this, but I now finally know how to parse feeds and store them in a database in Ruby On Rails. This won’t be of much interest to the casual reader, but if you are scouring the web for an answer (as I was) then you will probably find this very useful:


class Feed < ActiveRecord::Base
require_association 'post'
require 'feed-normalizer'
require 'open-uri'
require 'rss/2.0'

belongs_to :user
has_many :posts, :dependent => :destroy

#put some other stuff here for feed validation etc

def refresh_all
refresh(Feed.find(:all))
end

def refresh(feeds)
feeds.each do |feed|
rss = FeedNormalizer::FeedNormalizer.parse open(feed.uri)
rss.entries.each do |item|
post = Post.new(:feed_id => feed.id)
post.link = item.url or raise "post has no link tag"
post.title = item.title or "no title"
post.content = item.content or "no text"
post.created_at = item.date_published if item.date_published
post.save
end
end
end

end

]]> http://skinofstars.com/2009/03/ruby-on-rails-rss-and-atom-feed-parsing-with-feed-normalizer-and-subsequent-storage/feed/ 2