For far too long now RSS has been used in ways that don't really tap its true potential. Being able to syndicate my favorite headlines or blog posts is great. In fact, it helped to kick off a revolution in personal on-line publishing that is still growing and evolving. But I want so much more.
It's not for lack of vision. Back in 2005, Adam Bosworth painted a vision that eventually manifested itself as GData. I wrote about that a bit in Google's GData, MySQL, and the Future of on-line Databases.
It's not for lack of data either. You can get RSS output from lots of non-news and non-blog stuff. Everything from classifieds on eBay and craigslist to Bugzilla, Wikis, and so on.
The problem has been a lack of good tools for pulling it all together. In the Unix world, we often connect sources of data to filters and utilities using pipes. A pipe is a way of constructing ad-hoc workflows composed of any number of inputs, filters, and manipulation tools. And the beauty of the whole system is that they all use a very simple input and output method, so there's a nearly infinite set of ways you can combine and recombine them.
Yahoo! Pipes is one of a very small set of completely amazing on-line data manipulation and data mashup environments that can really change the way we work with on-line data sources. (The others are DabbleDB and Dapper.)
Yahoo! Pipes is...
Pipes is a hosted service that lets you remix feeds and create new data mashups in a visual programming environment. The name of the service pays tribute to Unix pipes, which let programmers do astonishingly clever things by making it easy to chain simple utilities together on the command line.
So if you're interested in an interactive on-line data mashup construction set, check it out and have a look at the existing pipes developers have created. I think it's one of the coolest web apps we've released in a long time, and I'm not just saying that because I know the guys who built it. Not only does it make hard things easy (like Perl has done for years), the user interface kicks ass too. It's exciting both from a technological point of view and because of the implications for the web as a whole. :-)
For another great take on this, check out what Tim O'Reilly has to say about Pipes. I don't think he's over-selling it by calling Pipes "milestone in the history of the internet." It's seriously cool stuff.
I'm hoping we can pull together some demos and interviews with the team next week. Watch the Yahoo! Developer Network blog for more...
- Remixing the Web with Yahoo! Pipes by Ed Ho, one of the amazing Pipes developers
- Pipes! by Bradley Horowitz
- Yahoo Pipes - The Internet is a Series of Them by Pete Cashmore
- Yahoo Pipes by Glenn Slaven
- Review: Yahoo! Pipes by Matt Cutts of Google
- Yahoo Pipes on Gadgetopia
- Pipes: Remixing the Web by Jonathon Trevor, another of the kick-ass Pipes developers
- Yahoo! Pipes remixes the syndicated web by Niall Kennedy
- Yahoo Pipes by Anil Dash
- cat rss | ... by Ryan Kennedy of Y! Mail API fame
- yahoo pipes…rss splicing and more… by Don Loeb of Feedburner
- Yahoo! Pipes by Avi Bryant of DabbleDB
- Yahoo Launches Pipes, an RSS Remixer by Richard MacManus
- Yahoo! Launches Pipes by Nik on TechCrunch
- Yahoo! Pipes: “a milestone in the history of the internet” by Chad Dickerson of the Yahoo! Developer Network
- Pipes! by Pasha Sadri, the man behind Pipes
- Yahoo Pipes becomes belle of the RSS ball by Larry Dignan of ZDNet
- The WOW starts now: Yahoo! Pipes by Garvin Hicking
- Pipes on the Internet: Yahoo Pipes by Ajit K
- Online Visual Programming with Yahoo! Pipes by Heritage Tech
Update @7:20am on Feb 8th: Pipes is currently down. There's a lot of interest, so things are getting tweaked on the backend. I'll post more when we have an update.
Update @7:00am on Feb 9th: Pipes is alive and tuned! Try it out.
Posted by jzawodn at February 07, 2007 08:06 PM