DISQUS

stevenhaddox · 1 year ago

Ben,
I'm just getting started with Django (literally got my first project started today). Anyway, this is perfect for what I'm trying to do (parse all my feeds for a lifestream). All the plugins for WordPress are not to my personal liking. The hardest thing I'm seeing is finding a good way to parse all my RSS feeds to create the source of my lifestream. It seems you've already figured that out with a technology I'm wanting to learn. Any chance you can share your code (cleaned up of course)?

Thanks

Benjamin Golub · 1 year ago

I can tell you the gist of it. Basically I use Universal Feed Parser (http://www.feedparser.org/) to write a "Crawler" for each type of source. There are 3 big objects in my database. A source (netflix, blog, google reader, etc) which defines how a stream is crawled, what color it gets, and how it is displayed. A stream is a type of source, the only reason to have streams is so you can have more than 1 of each source (and so this can be multi user friendly...although in my setup I only have 1 user it is built from the ground up to allow for more). Each stream carries things like username/link/feed/etc information so you know where to get the data from. And an entry is what comes out of each stream (actual blog posts, shared stories, etc). This is where you store the data from Universal Feed Parser (the title, content, date, tags, etc).

Makes sense? If you need more help just leave another comment or email me at bgolub@benjamingolub.com