Skip navigation

 

stripped down VW

I just heard through the Berkeley grapevine about the BashReduce effort at Last.fm: MapReduce in 126 lines of bash script! Awesome. I’m sure it doesn’t do X, Y and Z. So ask yourself: do you need X? Y? Z? Maybe instead you want V and W. Maybe you should roll your own tool.  

 

Makes you think.

About these ads

2 Comments

  1. Or to turn this inside-out yet again, you can write a bash script and run it in parallel via Hadoop using ParBASH. I can’t wait for an easy implementation of Java map and reduce functions running over the BashReduce engine! Somebody please?

  2. See also this implementation of HBase in bash: http://pastebin.com/f64fc84a9.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 60 other followers

%d bloggers like this: