If you had ideas about the previously noted RSS Scaling Problem and are at OSCON now, stop by Douglas Fir to chat about it. Here's the session blurb:

With RSS usage growing like mad, does having every client pull their own copy still make sense? Might it make more sense for some centralized services to aggregate the data? Or maybe a push system? PubSub? Other ideas?
Let's toss some ideas around.

Or see the session page.

Posted by jzawodn at July 29, 2004 02:02 PM

Reader Comments
# Stuart Watson said:

Please post comments/ideas/etc. To bad someone can't run a IRC chat while it's going on. We have some ideas on how to handle but looking forward to more comments suggestions. As we our member base grows we have to handle not only the RSS load but the load on the website.

Thanks

Stuart

"Feed Your Need to Shop.."
Real Simple Shopping
www.realsimpleshopping.com

on July 29, 2004 02:27 PM
# rdhatt said:

Adding a centralized hub just seems like solving the problem the usual way, just adding another layer of abstraction.

As others have pointed out, using techniques like HTTP Conditional Get and HTTP compression, server load can be dramatically reduced, today. Nothing new.

on July 29, 2004 03:44 PM
# rdhatt said:

Oops, I see what I said was already mentioned in your previous post. Just to add then there needs to be an effort to make sure all the major clients support such things.

One thing I noticed that Mark Fletcher said was "the aggregator still has to query the server, so there will always be a load issue." Well duh, server are supposed to have a load on them. If the load is problematic, then there are already ways to solve this.

on July 29, 2004 03:52 PM
# Randy said:

The scaling concern is simply exaggerated. Dare made Chad look dumb in raising the concern. Should I poll Yahoo! feeds 288 times per day?

on July 29, 2004 06:37 PM
# justin said:

Multicast is your friend

on July 30, 2004 01:00 AM
# Mike Kruckenberg said:

I started to make a comment or two on what happened at the meeting, but turned into a very long comment. Thought it better to put thoughts on the meeting somewhere else.

on July 30, 2004 01:32 AM
# Arhuaco said:

RSS is OK as we don't get spammed. People have to use HTTP well, as previously stated.

My webpage is arhuaco in geocities... which is questionable content :)

on July 30, 2004 08:47 AM
Disclaimer: The opinions expressed here are mine and mine alone. My current, past, or previous employers are not responsible for what I write here, the comments left by others, or the photos I may share. If you have questions, please contact me. Also, I am not a journalist or reporter. Don't "pitch" me.

 

Privacy: I do not share or publish the email addresses or IP addresses of anyone posting a comment here without consent. However, I do reserve the right to remove comments that are spammy, off-topic, or otherwise unsuitable based on my comment policy. In a few cases, I may leave spammy comments but remove any URLs they contain.