Four short links: 19 November 2009

Chumby One, Gorgeous IE Debugger, Freer Than Free, and Phone-a-Friend for Government IT

by Nat Torkington | @gnat | comments: 0

1. Chumby One (Bunnie Huang) -- new Chumby product released. In addition to being about half the price of the original chumby, the new device added some features: it has an FM radio, and it has support for a rechargeable lithium ion battery (although it’s not included with the device, you have to buy one and install it yourself). There’s also a knob so you can easily/quickly adjust the volume. But I don’t think those are really the significant new features. What really gets me excited about this one is that it’s much more hackable.
2. Deep Tracing of Internet Explorer (John Resig) -- very sexy deep inspection of Internet Explorer. Finally, something IE does better than Firefox (other than exploits). dynaTrace Ajax works by sticking low-level instrumentation into Internet Explorer when it launches, capturing any activity that occurs - and I mean virtually any activity that you can imagine. (via Simon Willison)
3. Less Than Free -- begins by talking about Google giving away turn-by-turn directions on Android, and then analyses Google's "less than free" business model: Additionally, because Google has created an open source version of Android, carriers believe they have an “out” if they part ways with Google in the future. I then asked my friend, “so why would they ever use the Google (non open source) license version.” Here was the big punch line - because Google will give you ad splits on search if you use that version! That’s right; Google will pay you to use their mobile OS. I like to call this the “less than free” business model. This is a remarkable card to play. Because of its dominance in search, Google has ad rates that blow away the competition. To compete at an equally “less than free” price point, Symbian or windows mobile would need to subsidize. Double ouch!!
4. Expert Labs -- a new independent initiative to help policy makers in our government take advantage of the expertise of their fellow citizens. How does it work? Simple: 1. We ask policy makers what questions they need answered to make better decisions. 2. We help the technology community create the tools that will get those answers. 3. We prompt the scientific & research communities to provide the answers that will make our country run better. New non-profit from Anil Dash.

Four short links: 17 November 2009

Digital Natives, Supersexy C64 Debugger, a Google Tripwire, and a Patient Botnet

by Nat Torkington | @gnat | comments: 1

1. Digital Natives (Ze Frank) -- digital natives have grown up in a landscape where access to information and influence has been flattened. they have watched media distribution bottlenecks in the form of networks and studios lose influence to youtube and independent production houses. They have watched companies bow down to viral video critiques, and watched political systems get hacked by social networks. this is a generation that doesn't understand restrictions on access to media if those restrictions are inefficient or obviously detrimental to the system as a whole. this is a generation that has been at war with DRM and copyright right from the start. it is a generation awash with free tutorials and download-able source code. When is a conversation with a precocious 17 year old a glimpse into an inter-generational gulf with implications for the role and status of formal education, and when is it just an encounter with a brat? Ze's piece is worth reading, whichever way it comes out.
2. ICU64 -- an open source Commodore 64 emulator (Frodo) hacked to visually and textually display memory. Watch the video embedded below, it's hypnotic and seductive. It immediately made me want one for my programs (without having to port my code back to 6502 assembler). (via waxy whose return from pneumonia is greatly welcomed)
3. Me and Belle du Jour -- interesting story from a UK blog master who guessed her identity but kept it secret, creating a googlewhacked page as a tripwire to let him know when someone else guessed. He tipped her off that her cover was blown. (via waxy again)
4. The Hail Mary Cloud -- the world's slowest yet effective brute force attack. If you publish your user name and password, somebody who is not you will use it, sooner or later. A botnet is brute-force trying every known username and password combination against every known ssh server. Each attempt in theory has monumental odds against succeeding, but occasionally the guess will be right and they have scored a login. As far as we know, this is at least the third round of password guessing from the Hail Mary Cloud (see the archives for earlier postings about slow bruteforcers), but there could have been earlier rounds that escaped our attention.

The War For the Web

by Tim O'Reilly | @timoreilly | comments: 61

On Friday, my latest tweet was automatically posted to my Facebook news feed, as always. But this time, Tom Scoville noticed a difference: the link in the posting was no longer active.

It turns out that a lot of other people had noticed this too. Mashable wrote about the problem on Saturday morning: Facebook Unlinks Your Twitter Links.

if you’re posting web links (Bit.ly, TinyURL) to your Twitter feed and using the Twitter Facebook app to share those updates on Facebook too, none of those links are hyperlinked. Your friends will need to copy and paste the links into a browser to make them work.

If this is a design decision on Facebook’s part, it’s an extremely odd one: we’d like to think it’s an inconvenient bug, and we have a mail in to Facebook to check. Suffice to say, the issue is site-wide: it’s not just you.

As it turns out, it wasn't just links imported from Twitter. All outbound links were temporarily disabled, unless users explicitly added them as links via an "attach" dialogue. I went to Facebook, and tried posting a link to this blog directly in my status feed, and saw the same behavior: links were no longer automatically made clickable. You can see that in the image that is the destination of the first link in this piece.

The problem was quickly fixed, with URLs in status updates automatically now linkified again. The consensus was that it was in fact a bug, but it's little surprise that people suspected otherwise, given the increasing amount of effort Facebook puts into warning people that they are leaving Facebook for the big bad unsafe Internet:

All of this is well-intentioned, I'm sure. After all, Facebook is attempting to put in place privacy controls that allow its users to manage the visibility of their information -- and the Web's expectation of universal visibility is not necessarily the best default for much of the information posted on Facebook. But let's not kid ourselves: Facebook is a new kind of web site (or an old kind redux), a world of its own, playing by different rules.

But this isn't just about Facebook.

The Apple iPhone is the hottest web access device around, and like Facebook, while it connects to the web, it plays by a different set of rules. Anyone can put up a website, or launch a new Windows or Mac OS X or Linux application, without anyone's permission. But put an app onto the iPhone? That requires Apple's blessing.

There is one glaring loophole: anyone can create a web application, which any user can save as clickable application on their phone. But these web applications have limits - there are key capabilities of the phone that are not accessible to web applications. HTML 5 can introduce all the new application-like features it wants, but they will work only for web applications, and can't access key aspects of the phone with Apple's permission. And as we saw earlier this year with Apple's rejection of the Google Voice application, Apple isn't shy about blocking applications that it considers threatening to their core business, or that of their partners.

And now, of course, we see the latest salvo in the war against the accepted rules of interoperability on the web: Rupert Murdoch's threat to take the Wall Street Journal out of the Google search index. While most people have repeated the existing wisdom that to do so would be suicide for the Journal, a few contrarian observers have noted the leverage Murdoch holds. Mark Cuban argues that Twitter now trumps search engines when it comes to breaking news. Even more provocatively, Jason Calacanis suggested, a few weeks before Murdoch's announcement, that all big media companies need to do to cut Google off at the knees would be to block Google, while cutting an exclusive deal with Bing to be found only in Microsoft's search index.

Of course, Google wouldn't take that lying down, and would likely make its own exclusive deals, leading to a showdown that would make the browser wars of the 90s seem tame.

I'm not saying that News Corp and other mainstream media publications would adopt Jason's suggested strategy, or that it would work if they did, but it is becoming clear to me that we are heading into a bloody period of competition that could be extremely unfriendly to the interoperable web as we know it today.

If you've followed my thinking about Web 2.0 from the beginning, you know that I believe we are engaged in a long term project to build an internet operating system. (Check out the program for the first O'Reilly Emerging Technology Conference in 2002 (pdf).) In my talks over the years, I've argued that there are two models of operating system, which I have characterized as "One Ring to Rule Them All" and "Small Pieces Loosely Joined," with the latter represented by a routing map of the Internet.

The first is the winner-takes-all world that we saw with Microsoft Windows on the PC, a world that promises simplicity and ease of use, but ends up diminishing user and developer choice as the operating system provider.

The second is an operating system that works like the Internet itself, like the web, and like open source operating systems like Linux: a world that is admittedly less polished, less controlled, but one that is profoundly generative of new innovations because anyone can bring new ideas to the market without having to ask permission of anyone.

I've outlined a few of the ways that big players like Facebook, Apple, and News Corp are potentially breaking the "small pieces loosely joined" model of the Internet. But perhaps most threatening of all are the natural monopolies created by Web 2.0 network effects.

One of the points I've made repeatedly about Web 2.0 is that it is the design of systems that get better the more people use them, and that over time, such systems have a natural tendency towards monopoly.

And so we've grown used to a world with one dominant search engine, one dominant online encyclopedia, one dominant online retailer, one dominant auction site, one dominant online classified site, and we've been readying ourselves for one dominant social network.

But what happens when a company with one of these natural monopolies uses it to gain dominance in other, adjacent areas? I've been watching with a mixture of admiration and alarm as Google has taken their dominance in search and used it to take control of other, adjacent data-driven applications. I noted this first with speech recognition, but it's had the biggest business impact so far in location-based services.

A few weeks ago, Google offered free turn-by-turn directions for Android phones. This is awesome news for consumers, who previously could get this only in dedicated GPS devices or with high-priced iPhone apps. But it's also a sign just how competitive the web is getting, and just how powerful Google is getting, because they understand that "data is the Intel Inside" of the next generation of computer applications.

Nokia paid $8 billion for NavTeq, the leading provider of such turn-by-turn directions. GPS-maker TomTom paid $3.7 billion for TeleAtlas, the #2 provider in the market. Google quietly built an equivalent service, and is now giving it away for free -- but only to their own business partners. Everyone else still has to pay high fees to NavTeq and TeleAtlas. What's more, Google upped the ante by adding in such features as Street View.

Most interestingly, this move sets the stage for the future competition between Google and Apple. (Bill Gurley's analysis is an essential read.) Apple controls access to the dominant device of the mobile web; Google controls access to one of the most important mobile applications, and so far, is making it available for free only on Android. Google's prowess is not just in search, but in mapping, speech recognition, automated translation, and other applications driven by huge, intelligent databases that only a few providers can offer. Microsoft and Nokia control comparable assets, but they too are Apple competitors, and unlike Google, their business model depends on selling access to those assets, not giving them away for free.

It could be that everyone will figure out how to play nicely with each other, and we'll see a continuation of the interoperable web model we've enjoyed for the past two decades. But I'm betting that things are going to get ugly. We're heading into a war for control of the web. And in the end, it's more than that, it's a war against the web as an interoperable platform. Instead, we're facing the prospect of Facebook as the platform, Apple as the platform, Google as the platform, Amazon as the platform, where big companies slug it out until one is king of the hill.

And it's time for developers to take a stand. If you don't want a repeat of the PC era, place your bets now on open systems. Don't wait till it's too late.

P.S. One prediction: Microsoft will emerge as a champion of the open web platform, supporting interoperable web services from many independent players, much as IBM emerged as the leading enterprise backer of Linux.

I'll be speaking on this topic in my keynote at the Web 2.0 Expo in New York on Tuesday. I'll look forward to seeing many of you there.

Four short links: 9 November 2009

Moth Mind Readers, Shiny UI Futures, Usable Newspapers, Hardware Testing

by Nat Torkington | @gnat | comments: 0

1. A Battery-Free Implantable Neural Sensor (MIT Tech Review) -- Electrical engineers at the University of Washington have developed an implantable neural sensing chip that needs less power. Uses RFID's induction technology which means the power source can be up to a meter away. Proof of concept was implanted in a moth to sense central nervous system activity.
2. New Microsoft Interface Technology -- videos from Craig Mundie (Chief Research and Strategy Officer) on the MS Campus Tour talking about the future of UI using a sexy glass prototype that features tablet PC, gesture, speech recognition, and even eye tracking. Lustable.
3. Adding Usability to Print -- detailed description of a failed pitch to reinvent a newspaper, to bring web sensibility to print. Make the paper more usable, think cross media instead of separate media, while using the strength of the paper (pictures, info graphics, nice text) to the max… Make a product that people want to buy because it is more usable that the competitor, not because it wins graphic design prizes. (via Evolving Newsroom)
4. StressAppTest -- Google-created open source project to pound the living crap out of hardware by maximising random traffic to memory from processor and I/O, with the intent of creating a realistic high load situation in order to test the existing hardware devices in a computer.

Three Paradoxes of the Internet Age - Part Two

by Joshua-Michéle Ross | @jmichele | comments: 18

Individual perception of increased choice can occur while the overall choice pool is getting smaller

This gem from Whimsley makes the point - with extensive statistical modeling supporting the argument - that our algorithm-obsessed, long tail merchants are actually depleting the overall choice pool despite the fact that as individuals we may be experiencing a sense of more choice through recommendations engines...

Online merchants such as Amazon, iTunes and Netflix may stock more items than your local book, CD, or video store, but they are no friend to "niche culture". Internet sharing mechanisms such as YouTube and Google PageRank, which distil the clicks of millions of people into recommendations, may also be promoting an online monoculture. Even word of mouth recommendations such as blogging links may exert a homogenizing pressure and lead to an online culture that is less democratic and less equitable, than offline culture.

In short, the long tail has gangrene at its extremity - the niche. More disarming is the conclusion that it isn't just the output of our recommendation algorithms that is leading to what the author calls "monopoly populism"and the end of niche culture:

"The recommender "system" could be anything that tends to build on its own popularity, including word of mouth...Our online experiences are heavily correlated, and we end up with monopoly populism...A "niche", remember, is a protected and hidden recess or cranny, not just another row in a big database. Ecological niches need protection from the surrounding harsh environment if they are to thrive. Simply putting lots of music into a single online iTunes store is no recipe for a broad, niche-friendly culture.

The network effects that so characterize Internet services are a positive feedback loop where the winners take all (or most). The issue isn't what they bring to the table, it is what they are leaving behind.

here is a link to yesterday's post: More access to information doesn’t bring people together, often it isolates us.

Tomorrow: The myth of personal empowerment takes root amidst a massive loss of personal control.

Navigating the Future: Take Me to Bob

by Brady Forrest | @brady | comments: 13

Google has just announced a free turn-by-turn navigation app for Android 2.0 in the US (Radar post). Google Maps Navigation relies on Google's own mapping for routing you. As with many navigation devices you can search Business Listings. However, they are also including data not traditionally available to navigators. In the promo video Google demonstrates that you can ask to be taken to "The King Tut exhibit". GMN will determine that it's in Golden Gate Park and route you. This is "because it is connected to the internet it is using all of the latest information on the internet."

This is huge. To be able to request implicit destinations based off of realtime information is something that has never been available before. What new queries will be available to us because of this? Google has a lot of data. How much of it can be assigned a location? Lots. There are millions of KML files out on the internet. Here are some of the useful queries

"Take me to Bob Smith" - If Bob is your friend on Latitude then Google Maps Navigation can take you to him. If Bob moves then GMN could even re-route you. I wonder if they will enable the chase scenario.

"Drop me off in time for the #48 bus" - Google knows the public transit schedule. So not only can it drop you off at the nearest stop, it could drop you off at the stop that will ensure the shortest multi-modal trip.

"Show me homes under 500K in Capitol Hill" - Via Google Base, Google has real estate information (it has had neighborhood data for quite sometime).

"Take me to my next appointment" - If you use Google Calendar and you accurately fill out the location field then this is a snap.

"Take me to the nearest Winter Coat Sale" - Using Adsense for Google Maps, GMN can easily lead you to local sales.

"Take me to the bar my friends go to the most" - Using Social Graph API and the new, experimental Social Search to tap into Foursquare, GMN can determine where you friends go, aggregate their destinations and lead you to their favorite watering hole.

"Take me to the largest event" - Using a combination of Latitude and its new access to the Twitter Firehose (which will soon include location - Radar post), Google can determine where people are.

"Take me on a tour of the top 10 historical sites here" - Using Wikipedia Google can determine what the sites are and where you should be taken. Alternately, Google could take you on user-generated tour.

"Take me to the most picturesque place near here" - Several years ago Google bought Panoramio, a location-based photo site. Google can determine which place nearby has had the most photos of it taken.

"Take me on a tour of the site from Around the World in 80 Days" - Google already geoparses many of the books it scans (just see this map). This routing is quite possible.

"Take me to the EPA's protected sites" - Government data is becoming more available. This is just one possible governmental query. You could also ask to go on a tour of TARP fund recipients or Democratic donors.

Obviously not all of them will be enabled, but I bet that within a year some of them will be. What other scenarios can or should they implement?

Four short links: 28 October 2009

Great Mail Feature, Speed Talks, Virtualisation History, Science Literacy

by Nat Torkington | @gnat | comments: 2

1. GMail Labs: Got The Wrong Bob? -- When's the last time you got an email from a stranger asking, "Are you sure you meant to send this to me?" and promptly realized that you didn't? Looks at the clusters of CCs you send and, if you normally send to Bob X but are trying to send it to Bob Y, asks you "did you mean Bob X?". This might be the best thing to happen to email since webmail and full-text search--it's ridiculous how little innovation is happening in email given how widely and heavily it is used.
2. Speedgeeks LA at Shopzilla -- eight talks about making websites faster. Latency Improvements for PicasaWeb - Gavin Doughtie (Google) - Great tips from a web guru about what makes PicasaWeb fast. Watch for when the slides to more talks become available.
3. 10 Years of Virtual Machine Performance Semi-Demystified -- fascinating history of virtualisation from someone who worked for VMware. Since 2005, VMware and Xen have gradually reduced the performance overheads of virtualization, aided by the Moore’s law doubling in transistor count, which inexorably shrinks overheads over time. AMD’s Rapid Virtualization Indexing (RVI - 2007) and Intel’s Extended Page Tables (EPT - 2009) substantially improved performance for a class of recalcitrant workloads by offloading the mapping of machine-level pages to Guest OS “physical” memory pages, from software to silicon. In the case of operations that stress the MMU—like an Apache compile with lots of short lived processes and intensive memory access—performance doubled with RVI/EPT. (Xen showed similar challenges prior to RVI/EPT on compilation benchmarks.)
4. Pew Research Science Quiz -- To test your knowledge of scientific concepts and recent scientific findings and events, we invite you to take this 12-question science knowledge quiz. Then see how you did in comparison with the 1,005 randomly sampled adults asked the same questions.

Why Google and Bing's Twitter Announcement is Big News

Tweets will finally become first class web citizens

by James Turner | comments: 11

Lurking innocently on Google's blog this afternoon, like many of their big announcements, was the bombshell that they have reached an agreement with Twitter to make all tweets searchable. This followed an earlier announcement at the Web 2.0 conference by Microsoft that Bing has also arranged to make tweets searchable.

This is not only a huge thing for Twitter, it is also well past due. Until now, Twitter really hasn't been a first class web citizen, because you're not really part of Web 2.0 until you're searchable by Google (and, I suppose, Bing). Sure, you can read someone's tweets from Twitter, or get a thread via a #tag, but the full text searching capabilities that make things really usable on the web, largely powered by Google, have been missing.

Making tweets searchable is a major usability improvement as well. Twitter handles are cute, but sometimes obscure as well. Perhaps people will start using more full names in their tweets in addition to @ references, which would let you find tweets about people without having to know what their handle happened to be.

It appears that Twitter is going out of their way not to play favorites in the search space, by cutting deals with both Microsoft and Google. Microsoft seems to be ahead of the game right now, since they have a live site up, whereas the announcement from Marissa Mayer of Google only hints at things to come over the next few months.

The Bing interface is interesting, it seems to be a hybrid of a web search engine and a twitter search. Typing in a term gets you back both the latest tweets that match the keywords, as well as web pages that more than one tweet share in common that also match the keywords. This is a tacit acknowledgement that a lot of the useful content of Twitter is found in the web pages that are linked from the Tweets.

If I had to guess, I'd say that Tweets will show up more traditionally on Google, as just another kind of search result, that can be narrowed in the same way that you can narrow results to just images or movies. I guess we'll have to wait and see on that.

Four short links: 21 October 2009

Battlefield Android, DIY Leukemia Hacking, Localisation, Bus Pirates

by Nat Torkington | @gnat | comments: 0

1. Raytheon Sends Android to Battlefield -- Google's OS sees deployment. Using Android software tools, Raytheon ( RTN - news - people ) engineers built a basic application for military personnel that combines maps with a buddy list. [...] Every part of RATS is tailored for use on a battlefield. A soldier could make an unmanned plane a "buddy," for instance, and track its progress on a map using his phone. He could then access streaming video from the plane, giving him a bird's eye view of the area. Soldiers could also use the buddy list to trace the locations of other members of their squad. (via Jim Stogdill)
2. The Kanzius Machine (CBS News, video) -- inventor lost the race against leukemia, but his DIY RF therapy device is being developed "for real". (via Jim Stogdill)
3. Lost in Translation -- Will Shipley shows how to handle internationalisation and localisation. In this post I'm going to explain to you what internationalization and localization are, how Apple's tools handle them by default, and the huge flaws in Apple's approach. Then I'm going to provide you with the code and tools to do localization in a much, much easier way. Then you're going to think, 'That will never work, because of blah!' and I'm going to respond, as if I can read your mind or I've already had this argument with a dozen developers, 'It already did - I used these tools in Delicious Library and Delicious Library 2 and they've won three Apple Design Awards between them. (via migurski on Delicious)
4. The Bus Pirate -- interfaces to a heap of embedded hardware. The ‘Bus Pirate’ is a universal bus interface that talks to most chips from a PC serial terminal, eliminating a ton of early prototyping effort when working with new or unknown chips (via joshua on Delicious)

Life With TED - Micromanaging Your Carbon Footprint

I've spent three days watching my power consumption like a hawk, here's how it's going

by James Turner | comments: 3

I've been interested in having a better handle on my electrical consumption for a long time. Our family regularly goes through 1100-1200 kWh a month, and it's been frustrating that I couldn't really get a grip on where or when the power was really being used. I want to get my power usage under control for three reasons:

1. I want to reduce my $180-a-month-and-climbing power bill. Public Service Company of NH (PSNH) has one of the higher electricity rates in the country (we have a nuke we're still paying off, among other things.)


2. I'm seriously investigating adding solar to the mix, now that a 30% federal tax credit, a $6,000 state rebate, and lower prices for the panels have converged. It would be great to get my usage down into the 600-800 kWh average output I've been told I can expect a month from a system, and zero out my PSNH bill on a yearly basis.


3. I'm a firm believer in reducing carbon emissions, I'd like my 14 year old son to have a world to grow up in. I've already cut my fuel oil use in half (to a still awful 250 gallons a month in the winter, but it's a huge house...) Cutting my electricity is the next low-hanging piece of fruit on the tree.

I had been tracking Google PowerMeter, a Google initiative that lets people monitor their energy usage online, but it was only available to customers of electric providers who were using so-called "Smart Meters". Smart Meters send usage data back to the provider, and PSNH isn't one of them.

Then, this week, Google announced on their blog that normal mortals could now order a device called The Energy Detective (or TED, as he's known by his friends...) TED is made by Energy, Inc. out of South Carolina, and consists of a minimum of two components. The first piece is an inductive current measuring device that lives out in your circuit breaker box. The second is a gateway device that plugs into a wall socket and has an Ethernet jack. Optionally, you can also get a stand-alone display, so that you don't need a computer to view your usage.

Wiring the sensor device into your box is fairly straightforward. You clamp the two sensors around the mains as they come into the box. You also have to wire the device to the two "hot" phases of your 220V service (which requires two free breakers in your box on different phases), and a third wire running to neutral. If you have some basic electrical savvy, you can do it yourself, but I decided to wimp out, since my box is so crowded (after-effects of having a transfer switch put in for a generator...), so I shelled out the $85 to have an electrician put it in.

The gateway unit communicates with the sensor unit via signals sent over the house AC. As with anything using the power lines to communicate, I found the unit was very particularly to which outlet I plugged it into. It really doesn't like to share a circuit with a computer, for example. Neither of the two plugs which was actually next to a network hub would pick up a signal, but one in an adjacent room that happened to have a network jack did.

Once you have the gateway talking to the sensors and plugged into the network (it uses DHCP to get an address), you can surf to it using any browser. I can even get to it using Safari on my iPhone. The "home" screen is a dashboard, showing various statistics about current demand and your daily, weekly and monthly averages. You can view the data in terms of kWh, dollars (once you tell TED how much you pay for power, it can even handle peak period and tiered pricing models), or pounds of CO2.

All of the ranges on the dials and bar-graphs are configurable, so if you want 3kWh to be "red", you can set it up that way. You can also configure refresh rates. Clicking on the "Graphing" tab lets you view your usages second to second, minute by minute, or by daily or weekly aggregates.

It's these graphs that I have found to be most useful. You can start to see all sorts of interesting patterns, like the "heartbeat" of my furnace turning on and off at night, when the rest of the house is otherwise quiet.

I can also see the huge hump when my son wakes up in the morning, and proceeds to turn on every first floor light in the house. I was even able to tell that my wife had turned on the dishwasher before she left for school one morning.

(continue reading)

Random Hacks of Kindness: Disaster Relief Codejam

by Brady Forrest | @brady | comments: 7

Google, Microsoft, Yahoo! and the World Bank are getting together to support disaster relief projects. The first Codejam will be Nov 12-14 i the Bay Area. You can sign-up now. The list of proposed projects is online.

What is Random Hacks of Kindness?
It is an initiative that brings together disaster relief experts and software engineers to work on identifying key challenges to disaster relief, and developing solutions to these critical issues. This Codejam is the first of a series of Random Hacks of Kindness (RHoK) events that will bring the best and brightest together for a "give camp" to solve real world-problems related to Crisis/Disaster Relief.

Objectives:
This event is the first step in building a global community dedicated to solving disaster relief challenges through technology.
At the RHoK Codejam, programmers will partner with subject matter experts to tackle “real world "problems. These challenges have begun to be defined (see preparation), and will continue to be refined during the event.
The software created at this first event will continue to be developed at subsequent RHoK events, and openly shared with the international community. Our hope is that this software will address some of the serious challenges facing the disaster response community, and evolve in response to their needs.

Background:
In May 2009, the first ever Crisis Camp barcamp was held in Washington, DC. During one of the opening sessions an industry panel including representatives from Microsoft, Google and Yahoo! agreed that some matters supersede competitive concerns. We agreed to cooperate to mobilize our developer communities to create interoperable solutions/code that will have real impact in the field. We have partnered with NASA and The World Bank to make this happen.

Organizers:
Microsoft, Google, Yahoo and The World Bank are founding sponsors
NASA-Ames is a co-sponsor

Preparation:
We want our hacks to make an impact. To that end we need the problem definitions as tight as possible before we begin coding on the 12th. The following is a link (see here) to the preliminary project definitions. Please contribute by adding new ideas and/or refining ones that are already there.

Four short links: 13 October 2009

Open Source, Gov 2.0, Gaming, Education

by Nat Torkington | @gnat | comments: 0

1. Our Open Source School -- blog of Albany Senior High School in New Zealand, which only runs open source software.
2. Behind The Scenes at What Do They Know -- interesting post showing details behind the What Do They Know web site. In the last year there have been only seven significant cases where requests have been hidden from public view on the site due to concerns relating to potential libel and defamation. Three of those cases have involved groups of twenty or so requests made by the same one or two users. While actual number of requests we have had to hide is around 70 (0.4% of the total) even this small fraction overstates the situation due to the repetition of the same potentially libelous accusations comments in different requests. In all cases we have kept as much information up on the site as possible. Our policy with respect to all requests to remove information from the site is that we only take down information in exceptional circumstances; generally only when the law requires us to do so.
3. The Complete History of Lemmings -- a must-read for videogamers from the early 90s. Theres been much debate over the choice of colours as well, but the colours were selected, not because they were the easiest to choose, but because of the PC EGA palette. With the limited choice, it was decided the green hair was nicer than blue, and with that, the final Lemming was born. I was actually the next person to code up a demo on the Commodore 64, but I only got so far as having a single Lemming walking over the landscape before Dave put me onto another project.
4. Google Replaces TeleAtlas -- Tele Atlas confirms that Google has decided to stop using Tele Atlas map data for the U.S. Google will now use its own map data. Our relationship with Google for map coverage continues outside of the U.S. in dozens of geographies.

Four short links: 7 October 2009

Ongoing Palm Fail, YouTube Numbers, Plugin Patent Pain, Bivalve-Oriented Architecture

by Nat Torkington | @gnat | comments: 1

1. Followup to jwz's Palm App Store Fiasco -- redux: still nothing concrete from Palm, but they're saying they'll create a second-rate app store into which open source apps will go (along with apps that Palm hasn't reviewed).
2. Schmidt on YouTube -- the interesting bit for me was Every minute, more than 10 hours of video is uploaded to the site.
3. Company that won $585M from Microsoft sues Apple, Google - The infamous '906 patent granted to Eolas and the University of California was one of the first patents to get the young online tech scene going in 1998. The patent addresses third-party browser plug-ins to run various forms of media as an "embedded program object"—essentially a program that runs within another program. Eolas promptly sued Microsoft for its implementation of ActiveX in Internet Explorer, which set in motion a years-long legal battle between the two companies. and won $585M, now they're suing many large Internet companies. (via Hacker News)
4. IBM Uses Mussels as Sensor Network -- Concerned with the environmental and revenue impacts of leaks during oil drilling, StatOil sought an innovative and automated way to detect leaks. They wanted to replace a manual process that included deep sea drivers. StatOil’s innovation, they attached RFID tags to the shells of blue mussels. When the blue mussels sense an oil leak, they close which prompts the RFID tags to emit closure events. In response to the events, the drilling line is automatically stopped. And, in case you are wondering, this is of no harm to the blue mussels. (via monkchips on Twitter)

Four short links: 30 September 2009

Smart Materials, Google OCR API, Teaching Webinar, HistEx

by Nat Torkington | @gnat | comments: 2

1. Smart Materials in Architecture -- Using thermal bimetals can allow architects to experiment with shape-changing buildings, Ritter said. Thermal bimetals include a combination of materials with different expansion coefficients that can cause a change in. Under changing temperatures this can lead one side of a compound to bend more than the other side, potentially creating an entirely different shape, he said. A little impractical at the moment, but think of it as hackers experimenting with what's possible, iterating to find the fit between materials possibility and customer need. (via Liminal Existence)
2. Google OCR API -- The server will attempt to extract the text from the images; creating a new Google Doc for each image. Experimental at this stage, and early users report periodic crashes. Still, it's a useful service. I wonder whether they're seeing how people correct the scan text and using that to train the OCR algorithms. (via Waxy)
3. My O'Reilly Podcast: Dan Meyer -- I'm not pimping this because it's O'Reilly (O'R do heaps of stuff I don't mention) but because it's the astonishingly brilliant Dan Meyer. For everything it does well, the US model of math education conditions students to anticipate narrowly defined problems with narrowly prescribed solutions. This puts them in no place to anticipate the ambiguous, broadly defined, problems they'll need to solve after graduation, as citizens. This webcast will define two contributing factors to this intellectual impatience and then suggest a solution.
4. Inflation Conversion Factors for Dollars 1774 to Estimated 2019 -- in PDF and Excel format. I've wanted such a table in the past for answering those inevitable "... in today's dollars?" historical business questions. (via Schuyler on Delicious)

Four short links: 22 September 2009

Cities, How Things Work, Stylish Google, EC2 Numbers

by Nat Torkington | @gnat | comments: 0

1. The City is a Battlesuit for Surviving the Future (IO9) -- a great essay by Matt Jones, based on his talk at Webstock this year. Urban design is how we created alternate realities before we had iPhones, and the new technology lets us choose which science fiction future we want to inhabit. We are now a predominantly urban species, with over 50% of humanity living in a city. The overwhelming majority of these are not old post-industrial world cities such as London or New York, but large chaotic sprawls of the industrialising world such as the "maximum cities" of Mumbai or Guangzhou. Here the infrastructures are layered, ad-hoc, adaptive and personal - people there really are walking architecture, as Archigram said. Hacking post-industrial cities is becoming a necessity also. [...]
2. How and Why Machines Work (MIT Open Course Ware) -- Subject studies how and why machines work, how they are conceived, how they are developed (drawn), and how they are utilized. Students learn from the hands-on experiences of taking things apart mentally and physically, drawing (sketching, 3D CAD) what they envision and observe, taking occasional field trips, and completing an individual term project (concept, creation, and presentation). Emphasis on understanding the physics and history of machines. (via Hacker News)
3. Google Style Guide -- how Google codes. Useful if you're working on their code, starting a job there, or want to mock them for not specifying K&R braces/four space tabs/<insert One True Way here>. (via Hacker News)
4. EC2 Usage Guessed From Sequential IDs -- The Superseries ID changes so rarely that originally I had assumed it was some kind of checksum. This would have been odd as it limits the total available IDs to 2²⁴ = 16.8 million. Up to very recently, the Superseries ID for all resource types - instances, images, volumes, snapshots, etc. - was 69 (in the us-east-1 region (for eu-west-1 the Superseries ID is 74). These days, new instances use the Superseries ID 68. This subtle change, unnoticed by the industry, may hint at an astonishing achievement: 8.4 million instances launched since EC2’s debut! (Instance IDs are even so 8.4M = 16.8M / 2.) (via mattb on delicious)

Four short links: 21 September 2009

Bad Writing, Tech Immigration, Long Tail Fail?, and The Real McKoi

by Nat Torkington | @gnat | comments: 5

1. Dan Brown's 20 Worst Sentences -- awful awful writing, and glorious glorious mockery of it.

   Deception Point, chapter 8: Overhanging her precarious body was a jaundiced face whose skin resembled a sheet of parchment paper punctured by two emotionless eyes.

   It’s not clear what Brown thinks ‘precarious’ means here.

2. From Australia to the World: The Story of Google Maps and Google Wave (PDF, HTML Cached here) -- history of Google Maps and Wave, from the creator. This particularly struck me: I know few matters more frustrating than finding funding for a start-up. Immigration tops the list.
3. Rethinking The Long Tail: How to Define 'Hits' and 'Niches' -- the argument comes down to absolute vs relative measurements of popularity. Anderson says that relative hides too much, because percentages are meaningless in a world of infinite inventory. Researchers respond that hits and niches are defined in absolute numbers (top 10, bottom 100). The real takeaway is that infinite inventory requires excellent discovery tools drawing upon collective intelligence systems (hence the Netflix recommendation contest). (via timoreilly on Twitter)
4. The Mckoi Database -- MckoiDDB is a database system used by software developers to create applications that store data over a cluster of machines in a network. It is designed to be used in online environments where there are very large sets of both small and big data items that need to be stored, accessed and indexed efficiently in a network cluster. The focus of the MckoiDDB architecture is to support low latency query performance, provide strong data consistency through snapshot transaction isolation, and provide tools to manage logical data models that may change dramatically in physical network environments that may experience similar dramatic change. (via joshua on delicious)

Seeing the Future of Mapping in Crimespotting

by Brady Forrest | @brady | comments: 9

This week Stamen Design released San Francisco Crimespotting. It's a crime map and notification system that allows for time and crime trend analysis. SF Crimespotting has launched just over two years after the release Oakland Crimespotting (Radar post). Stamen had been waiting for crime data all this time and with the launch of DataSF they are able to use an official API for crime data.

SF Crimespotting is very similar to the initial release for Oakland. As I wrote in 2007:

Each type of crime is assigned a color-coded icon with an abbreviation. You can highlight all of a crime type's markers with a mouseover. You can also change the number of days for which crimes are shown. Each crime has a detail page and that crime can then be viewed in context with others. You can also slice the data by day, type and the intersection of the two. You can also subscribe to get email alerts and RSS feeds for a specific place in Oakland.

The latest releases of the Crimespotting platform reflect several important trends in online mapping:

1) Crowdsourced Maps - When Oakland Crimespotting launched it used Microsoft Live maps (which would now be called Bing). They have switched to Cloudmade maps which are based on Open Street Map data. The maps look amazing and at initial glance they appear to be the same as any other major provider's maps. Google's Mapmaker project (Radar posts) has also been seeing more attention and just this week expanded into Mexico (I wonder how long until they bring Mapmaker to the US). Waze (Radar post) is using user-generated traces to create their realtime maps.

2) Temporal Mapping - Time is being added to online maps and other visualizations. As data comes to use in realtime there are new conventions that need to be developed. Stamen, through this project and their work with Trulia Hindsight (Radar post) and MySociety (Radar post), are at the forefront of designing methods of dealing with varying scales and types of time data. In their post The Pie of Time Stamen details their thinking for how to represent hours, days and years in the project. The old Crimespotting did not allow you to navigate to archival data. With the new UI there are now permalinks to all crime reports The hours control is shown to the right. Only the crimes that occurred during the highlighted times will appear on the map. Stamen has included quick links to show specific times like "Commute" and "Nightlife".

The slider and dropdown used to navigate days, months and years are shown above. Each day of the slider shows the total amount of crime that day. The highlighted area dictates the crime shown on the map.

3) Government Data - The new federal administration has shown a renewed interest in releasing data (most of this will have some geocomponent). The 2010 Census is around the corner and that will add to the data flow. As more data is released you can expect an explosion of government mashups. You can also expect more civic minded companies (especially after this week's exit by Everyblock (Radar post)).

4) Geo-Analysis - GIS used within enterprises, governments and universities are designed to take massive geodata sets and simplify them so that decisions can be made. Crimespotting may look like a slick consumer app and that's because it is. However as you manipulate its many controls you'll realize that you can learn a lot about a city and how a time of day or section of the city impacts the likelihood of your being involved in a crime. You can determine if you're more likely to be mugged in the Castro on Thursdays vs. Tuesdays. The only problem is that you are limited to crime data. I'd love to have ability to add other layers like housing prices or average income. Crimespotting has a read API; I hope Stamen adds Write capabilities.

I'd ask the kind folks at Stamen (very nicely) to make a Crimespotting Seattle, but unfortunately we don't publicly release our crime data. Here's to hoping that we get a mayor in this Fall's election who will open the data coffers. Does your city share its data? If so include a link in the comments.

All of these trends are going to be big topics at this year's Where 2.0 (3/31-4/2 in San Jose). Submit your topic now!

APPLE is EVIL, You're All Fanboys and other half-truths

by Mark Sigal | @netgarden | comments: 32

There is a meme afoot. Apple is evil. Its arrogant ways and dependence on the cult of personality are to be its demise. Developers are said to be unhappy. And, Apple Secrecy Doesn’t Scale.

Google-ification is the way, the RIGHT way.

The Apple Way can’t possibly persist ad infinitum.

You Apple fanboys; you just don’t get it. Ol’ Steve (Jobs) is fooling you again into buying his sugar water.

You’re just too dumb to realize it.

But, you know what? It’s a crock of sh-t!

In the here and now, Apple's success is unparalleled, and the engine is humming better than ever on multiple vectors - products, margins, developers, profits and consumer engagement.

Simply put, the goodness of Google-style openness, and the good tidings it provides for consumers and creators, does not in anyway invalidate, lessen or neutralize the effectiveness of Apple's proprietary, integrated, secretive, totalitarian-style approach.

Contrast Apple’s product birthing, operating discipline and market realization process with…ANYONE. That speaks volumes, I think.

That’s why in the burgeoning iPhone, iPod touch and (soon) iPad Tablet mobile broadband device ecosystem (46M units, 65K apps, 1.5B app downloads, 8B song downloads, and counting), unless and until there is a better alternative, the lion's share of developers will bitch in the morning and double down in the afternoon...on all things Apple.

All of that said, a paradox for Apple is this. For Apple, it's never about total units. It’s about value, differentiation, leverage and margins. Let others chase unit counts at all costs.

For developers, however, at a certain point it DOES become about units, if for no other reason than once enough numbers are installed on a given platform, it’s market share that is worth pursuing (by building native offerings for).

The part that is invisible is that at some point an Android gets ready for prime time (John Gruber ponders this one well in his post 'The Android Opportunity'); or a Pre-type of device establishes a real beachhead with developers; or RIM gets a clue in terms of an apps/ecosystem strategy, and all of the sudden, Apple is having to play defense. At the present, it is just running up the score.

We really can’t definitely say WHEN the alarm bell will sound. But, to be sure, it’s a WHEN, not an IF.

Why? One size doesn’t fit all when it comes to mobile broadband.

The day is coming, though, and that is a good thing, inasmuch as lack of competition leads to sloth where product innovation matters are concerned.

Disclaimer: I generally (but not always) prefer the type of integrated, fully formed solution that Apple delivers to what feels like a more 'lowest common denominator' oriented approach by Google. Your mileage may vary.

Related Posts:

1. Apple, the ‘Boomer’ Tablet and the Matrix


2. The Scorpion, the Frog and the iPhone SDK


3. Analysis: Apple June Quarter Earnings Call

Four short links: 13 August 2009

by Nat Torkington | @gnat | comments: 1

1. Under the Hood of App Inventor for Android -- regular readers know I'm a big fan of visual programming language Scratch, and apparently Google are too. They've got twelve university classes testing App Inventor for Android, a visual connect-the-bits programming environment for Android. University classes probably because one of the co-creators is Hal Abelson, coauthor of the definitive programming textbook. Also found online: the PR-type announcement, a Professor using it, and @AppInv (nothing juicy on Twitter--it looks like might be a channel for tech support for the students). (via Hacker News)
2. Google Web Optimizer Case Study (Four Hour Work Week) -- GWO manages A/B tests for you, with a lot of statistical analysis. It's a fascinating read to see how these should be done. Every equation may halve the readership of a book, but every table of numbers and relevancy analysis doubles the value of a post like this. (via Hacker News)
3. Opening Up The BBC's Natural History Archive -- the BBC are releasing programme segments and a whole lot of metadata around their programming. Audio and video segmented, tagged with DBpedia terms, and aggregated into a URI structure based on natural history concepts: species, habitats, adaptations, etc. Gorgeous!
4. Yahoo! Term Extraction API to Close -- Internally, both services share a backend data source that is closing down, so the publicly-facing YDN services will be closing as well. I think it's the most significant casualty of Y! outsourcing search to MSFT, as this API was used by a lot of projects. (via Simon Willison)

Four short links: 14 July 2009

Twenty Questions, CC Pix, INSERT INTO WEB, and Wash Your Hands!

by Nat Torkington | @gnat | comments: 2

1. Twenty Questions about GPLv3 (Jacob Kaplan-Moss) -- twenty very challenging questions about the GPLv3. foo.js is a JavaScript library released under the GPLv3. bar.js is a library with all rights reserved. For performance reasons, I would like to minimize all my site’s JavaScript into a single compressed file called foobar.js. If I distribute this file, must I also distribute bar.js under the GPL?
2. CC Searching within Google Image Search -- what it seems. (via waxy)
3. YQL INSERT INTO -- insert into {table} (status,username,password) values ("new tweet from YQL", "twitterusernamehere","twitterpasswordhere"). That's too cool. (via Simon Willison)
4. CleanWell -- very low-cost recyclable enviro-friendly antimicrobials to battle third-world disease. Met the founder at Sci Foo. He said women wash hands more than men, because women enter bathrooms in pairs. Single easiest way to increase handwashing compliance is to put sinks and basins outside the room, in public view.