Four short links: 16 November 2009

Visualizing Adventures, Droid Deployments, Fly Vision, and Mass Meat For You

1. Choose Your Own Adventure -- numerical and visual analysis of the Choose Your Own Adventure novels. The distinguishing characteristic of My Kind Of People is that they appreciate the quantitative study of the commonplace. (via Bryan O'Sullivan)
2. Tracking Droid Numbers -- uLocate, the makers of the Where app for Android, have been tracking the growth of the Droid phone using the data they get from the Android app store. (via BoyGenius Report)
3. Fly Eyes Makes Better Robot Vision -- to make smaller flying robots, researchers would like to find a simpler way of processing motion. Inspiration has come from the lowly fly, which uses just a relative handful of neurons to maneuver with extraordinary dexterity. And for more than a decade, O’Carroll and other researchers researchers have painstakingly studied the optical flight circuits of flies, measuring their cell-by-cell activity and turning evolution’s solutions into a set of computational principles. [...] Intriguingly, the algorithm doesn’t work nearly as well if any one operation is omitted. The sum is greater than the whole, and O’Carroll and Brinkworth don’t know why. Because the parameters are in constant feedback-driven flux, it produces a cascade of non-linear equations that are difficult to untangle in retrospect, and almost impossible to predict. (via Slashdot)
4. Meat Band Aids and Mass Production of Living Tissue -- Apligraf is a matrix of cow collagen, human fibroblasts and keratinocyte stem cells (from discarded circumcisions), that, when applied to chronic wounds (particularly nasty problems like diabetic sores), can seed healing and regeneration. This Gizmodo Q&A is informative.

Four short links: 5 November 2009

Heat Maps in R, EC2 Blackhat Tricks, Snickersome Unicode, and Decoding Statistics

1. Heat Maps in R -- We used financial data here because it's easier to access than the airline data, but it's actually a pretty interesting way of looking at a financial time series. Weekend and holiday effects are a bit more obvious, and it's a bit like being able to see the daily, weekly, monthly and yearly closes all at once (by scanning your eye over the calendar in different directions). Includes source code. (via migurski on Delicious)
2. BlackHat and EC2 -- Theft of resources is the red-headed step-child of attack classes and doesn't get much attention, but on cloud platforms where resources are shared amongst many users these attacks can have a very real impact. With this in mind, we wanted to show how EC2 was vulnerable to a number of resource theft attacks and the videos below demonstrate three separate attacks against EC2 that permit an attacker to boot up massive numbers of machines, steal computing time/bandwidth from other users and steal paid-for AMIs. (via straup on Delicious)
3. Funny Characters in Unicode -- I never get tired of the wacky stuff in Unicode. I love the thought of a Unicode committee somewhere arguing passionately about the number of buttons on the snowman .... (via Hacker News)
4. Statistics to English Translation -- The terms sensitivity and specificity generally refer to diagnostic or screening procedures, such as an HIV or allergy tests. The sensitivity of a test is its true positive rate; the specificity is its true negative rate, although it can be more intuitive to think of specificity as the complement of the false positive rate. This matters. Bandying around numbers with misleading labels, or misinterpreting numbers that have a precise and defined meaning, does not further understanding. (Said 78.4% of statisticians, with a 20% confidence factor probability of false positives)

Four short links: 23 October 2009

Beautiful Information, Teen Game Designer, Creative Science Writing, Open Source Schools

1. Information is Beautiful -- gorgeous descriptions of the design of infographics. For once, a design discussion that might be useful to mere mortals like me.
2. Australian Teen Crafts "Sneaky" Games -- video interview with a 16 year-old winner of the IFTF, Sun, and BoingBoing Digital Open. Great to see game design, a topic we've followed on Radar, getting uptake by the people about to enter the workforce. "I love index cards," says Harry, "And I was thinking -- hmm, how can I incorporate them into a project?" So he designed and printed these game cards, and "spread the seeds of sneakiness and espionage" into the unsuspecting pockets, math books, binders and bags and jackets of his schoolmates. (via BoingBoing)
3. Science Writing Shortlist -- the Manhire Prize is New Zealand's most prestigious award for creative science writing. The shortlisted entries are available via this link, and make for enlightening reading. Interestingly, there are two prizes awarded: one for fiction and another for non-fiction; New Zealand has a tradition of encouraging interaction between the arts and sciences.
4. Fedena -- an open source school management system, built in India, using Ruby on Rails. (via Brenda Wallace)

Four short links: 19 October 2009

YouTube Bandwidth, RFID Visualization, Social Software Arms Race, Google Voice to the Laptop

1. YouTube's Bandwidth Bill is Zero (Wired) -- they buy dark fibre and peer with the major ISPs.
2. Immaterials: The Ghost in the Text (Vimeo) -- visualising RFID fields. See also the blog post about the work by Timo Arnall from Touch and Jack Schulze from BERG.
3. The Commercial Speech Arms Race (Bruce Schneier) -- Whenever you build a security system that relies on detection and identification, you invite the bad guys to subvert the system so it detects and identifies someone else. Sometimes this is hard ­-- leaving someone else's fingerprints on a crime scene is hard, as is using a mask of someone else's face to fool a guard watching a security camera ­-- and sometimes it's easy. But when automated systems are involved, it's often very easy. It's not just hardened criminals that try to frame each other, it's mainstream commercial interests. Bad actors game systems, and social software is just another system to be gamed. It's very difficult to create a system with no incentive to misbehave or to accuse others of misbehaving.
4. A SIP of the Future (Tim Bray) -- he connected Google Voice with Gizmo5 so his Google Voice number forwards to his laptop. FTW.

Four short links: 1 October 2009

Objectivity Be Gone, Public Screens, Lobbying Patterns, DIY Africa

1. The End of Objectivity, Web2.0 Version -- Our behaviour as journalists is now measurable. And measurability gives the lie to the pretence that journalists behave like scientists, impartially observing the petri dish of society. (via Pia Waugh)
2. Screens in Context -- ideas for the video screens spring up in place of billboards. Whilst the advertising industry has one of the longest histories of trying to understand interaction, it’s a very different set of tools that digitalness brings; ones that designers at the coal face of web and mobile encounter every day. Everything can be considered in context, be timely, reactive, and data-driven. I’m going to try to outline some dimensions to think about, with some incredibly quick, simple, off the cuff dumb ideas [...] The technology to achieve some of these may be over and above what is possible now, but the biggest step - installing powered, networked computers in the real world - is already being taken by advertising media companies.
3. Interactive Network Map of Lobbying Patterns Around Key Senators in Health Care Reform -- fascinating visualization of political activity, via timoreilly on Twitter)
4. The Doers Club -- How DIY design gave a teenager from Malawi electricity, and can help transform Africa.

Four short links: 25 September 2009

On Wheel Reinvention, Research Visualization, New Comments, and Defective Congressional Data

1. Diesel: A Case Study In That Thing I Just Said -- a new asynchronous I/O library in Python, which earned this fabulous review from Glyph Lefkowitz who wrote the granddaddy of all asynch libraries in Python, Twisted. Again, I don't want to dump on Diesel here; for what it is, i.e. an experiment in how to idiomatically structure asynchronous applications, it's all right. For that matter Twisted has its fair share of bugs too, which would be pretty easy to lay out in a similar post; you wouldn't even need to do the research yourself, just go look at our bug tracker. But both Diesel and Tornado make the mistake of attempting to replace the years of trial-and-error, years of testing discipline, and years of portability and feature work that Twisted has accumulated with a few oversimplified, untested hacks.
2. Eigenfactor -- ranking and mapping scientific knowledge. Visualizations and analyses from when geeks attack scientific publishing.
3. Washington Post Develops Visual, Web-like Commenting System -- WebCom displays comments in a dynamic web instead of a traditional list. As new comments come in, the web gets bigger. The web, however, is not organized by chronology. King and his team believe that the most valuable comments are those that are rated highly by peers and those that spur responses. WebCom uses those criteria to organize the web. (via The Evolving Newsroom)
4. Congressional Data is Defective By Design -- You should have better access to this info! You should have — at your fingertips — immediate, unrestricted digital access to the full text of any piece of legislation the very moment it’s released publicly by Congress. This is punishingly ridiculous. Congress could immediately take steps to make all publicly-relevant legislative data comply with the community-derived Eight Principles of Open Government Data.[...] That is to say, bill info from Congress could and should be available today in real time, free of charge, open-source, and licensed openly, via such open-standards technologies as XML, API’s, and regular bulk data downloads. We're entering a time where the tools and methods that make good software can help make good laws. (via timoreilly on Twitter)

Four short links: 17 September 2009

Involuntarily Opened Geodata, Sense Organ, Doc Vis, 3D Open Source Bodies

1. Wikileaks Now Holds UK Postcode Database -- the UK does not have open geodata in the way that we know it. A state-owned enterprise, Ordnance Survey, is responsible for maintaining all sorts of baseline data and they charge (through the nose) for that data. This is the release of 1,841,177 post codes, geographic boundaries, and more. Postcodes in the UK are far more useful than US ZIP codes--they identify a handful of houses, rather than a few thousand houses.
2. My New Sense Organ -- a strap with buzzers and a compass, so you always have physical reminder of orientation. For people like me who can get lost putting on pants in the morning, this would be a godsend. (via Slashdot)
3. Saving is Obsolete -- EtherPad adds a Wave-like replay feature to help you see the history of a document.
4. Open Source 3D People -- incredible software to design realistic 3D faces and bodies. (via glynmoody on Twitter)

Four short links: 16 September 2009

Data Sharing, Health Dashboard, DIY Repairs, Crowdsourcing

1. Data Sharing: Empty Archives (Nature) -- asking and answering the question "why don't researchers share their data?"
2. San Francisco Health Visual Dashboard -- Health Matters in San Francisco is a o­ne-stop source of non-biased data and information about community health in the City, and healthy communities in general. It is intended to help planners, policy makers, and community members learn about issues and identify improvements. (via the blog of the CIO of Beth Israel Deaconess and titine on delicious)
3. iFixit -- information on Mac, iPhone, etc. repair. (via timoreilly on Twitter)
4. Crowdflower -- labour as a service. Love the analytics. Don't miss the TechCrunch 50 demo. (via waxy)

Four Short Links: 25 August 2009

Reverse Search, PDF Stripping, Flash Visualization, Failure

1. Tineye -- reverse search engine; you upload an image and they find you similar images so you know where else it's used. Check out their cool searches.
2. PDF Pirate -- upload a PDF and this web site will give it back to you minus the restrictions on copying/printing/etc.
3. Flare -- an ActionScript library for creating visualizations that run in the Adobe Flash Player. BSD-licensed, modelled on Prefuse. When there's a visualisation library for every platform, will we start to get people who know how to make them?
4. The Importance of Failure (Marco Tabini) -- This is a point that I don't often hear made when people talk about failure; the moral behind a failure-related story is usually about preventing it, or dealing with the aftermath, but not about the fact that sometimes things go bad despite your best efforts, and all the careful risk management and contingency planning won't keep you from going down in flames. This is important, because it forces every person to establish a risk threshold that they are willing to accept in every one of their life efforts.

Four short links: 7 August 2009

Recovery.gov, Meme tracking, RFID Scans, Open Source Search Engines

1. Defragging the Stimulus -- each [recovery] site has its own silo of data, and no site is complete. What we need is a unified point of access to all sources of information: firsthand reports from Recovery.gov and state portals, commentary from StimulusWatch and MetaCarta, and more. Suggests that Recovery.gov should be the hub for this presently-decentralised pile of recovery data.
2. Memetracker -- site accompanying the research written up by the New York Times as Researchers at Cornell, using powerful computers and clever algorithms, studied the news cycle by looking for repeated phrases and tracking their appearances on 1.6 million mainstream media sites and blogs [...] For the most part, the traditional news outlets lead and the blogs follow, typically by 2.5 hours [...] a relative handful of blog sites are the quickest to pick up on things that later gain wide attention on the Web. Confirming that blogs and traditional media have a symbiotic relationship, not a parasitic one. (via Stats article in NY Times)
3. Feds at DefCon Alarmed After RFIDs Scanned (Wired) -- RFID badges make for convenient security, and for convenient attack. Black hats can read your security cards from 2 or 3 feet away, and few in government are aware of the attack vector. To help prevent surreptitious readers from siphoning RFID data, a company named DIFRWear was doing brisk business at DefCon selling leather Faraday-shielded wallets and passport holders lined with material that prevents readers from sniffing RFID chips in proximity cards.
4. A Comparison of Open Source Search Engines and Indexing Twitter -- Detailed write-up of the open source search options and how they stack up on a pile of Tweets. While researching for the Software section, I was quite surprised by the number of open source vertical search solutions I found: Lucene (Nutch, Solr, Hounder), Sphinx, zettair, Terrier, Galago, Minnion, MG4J, Wumpus, RDBMS (mysql, sqlite), Indri, Xapian, grep … And I was even more surprised by the lack of comparisons between these solutions. Many of these platforms advertise their performance benchmarks, but they are in isolation, use different data sets, and seem to be more focused on speed as opposed to say relevance. (via joshua on Delicious)

Four short links: 3 August 2009

Mathematics Collaboration, Risk, Visualisation, and SemWeb

1. Enabling Massively Parallel Mathematics Collaboration -- Jon Udell writes about Mike Adams whose WordPress plugin to grok LaTeX formatting of math has enabled a new scale of mathematics collaboration.
2. 2845 Ways to Spin The Risk -- introduction to the ways in which our perception of risk (and numbers in general) can be distorted by how it is presented. (via titine on Twitter)
3. Logstalgia -- OpenGL app to visualize Apache log files.
4. 4Store -- "scalable RDF storage". 4store was designed by Steve Harris and developed at Garlik to underpin their Semantic Web applications. It has been providing the base platform for around 3 years. At times holding and running queries over databases of 15GT, supporting a Web application used by thousands of people. (via joshua on Delicious)

Four short links: 27 July 2009

1. Ignite OSCON -- 56m of video from Ignite OSCON. They're all great, but Dan Meyer remains the highlight for me.
2. gheat -- a maptile server in Python, delivering heatmaps to be superimposed on Google Maps. Handy for visualization fiends.
3. CaDNAno -- open source software for design of 3-dimensional DNA origami. One of George Church's projects. I love the combination of math, biology, and whimsy in open-source giftwrap. (via timoreilly on Twitter)
4. CommentPress -- an open source theme for the WordPress blogging engine that allows readers to comment paragraph by paragraph in the margins of a text. Annotate, gloss, workshop, debate: with CommentPress you can do all of these things on a finer-grained level, turning a document into a conversation. It can be applied to a fixed document (paper/essay/book etc.) or to a running blog. I'm taking a greater interest in tools that channel and focus participation rather than simply providing "edit this page". (via gov2.net.au's issues paper)

Four short links: 17 July 2009

1. NodeXL: Network Overview, Discovery and Exploration in Excel -- Excel plugin for analysing graph data within Excel. Visualization and data wizardry come to the corporates who live in Excel.
2. Managing the Environmental Crisis -- a comment by Edwin Winge: "Public involvement does offer long-range benefits, the most pragmatic of which is that it results in better decisions. Park Service managers have discovered through experience that when they are willing to modify their professional judgements by considering ideas and opinions (values) of concerned citizens, the final decision that results is not only more acceptable to the public, it is also more satisfying to the Service." A banner quote for Gov 2.0, from the father of O'Reilly's Sara Winge. (via timoreilly on Twitter)
3. Dopplr Social Atlas for iPhone -- an iPhone app that gives you the recommendations by Dopplr users for places to eat, things to do, places to stay around the world.
4. Microformats Dev Camp -- July 25-6 (weekend following OSCON), in San Francisco at the Automattic offices. (via Tantek)

Four short links: 3 July 2009

Stats, Public Domain, Sewers, and Garbage

1. OECD Factbook -- Flash-built impressive data explorer from OECD. Go to Indicators > Load and, in the words of Ben Goldacre, "prepare for nerdgasm". (via bengoldacre on Twitter)
2. James Boyle is on Twitter -- author of the book The Public Domain.
3. Sewers and Startups (Pete Warden) -- designing to last, reminds me of Saul Griffith's heirloom design riff. When I joined Apple back in 2003, the central build farm for all projects had both PowerPC and x86 Darwin boxes, and our code had to compile on both. Steve was playing a long game, years before the Intel switch he was obviously planning for it, (though I only caught the significance in retrospect).
4. Open Data Makes Garbage Collection Sexier, Easier, and Cheaper -- pragmatic use for open government data. For more on the author of this post, see Hello World for Open Data by Tim Bray.

Four short links: 26 June 2009

Biz Numbers, Progress, Curse of the Mummy Tweets, and Crime Viz

1. Size vs Growth vs Acceleration (Rowan Simpson) -- you can tell how well a company is doing by the basis on which they report their progress.
2. Engineers Are The Best Deal, So Stock Up On Them (TechCrunch) -- Software engineers today are about 200-400% more productive than software engineers were 10 years ago because of open source software, better programming tools, common libraries, easier access to information, better education, and other factors. This means that one engineer today can do what 3-5 people did in 1999! (via Simon Willison)
3. Livetweeting a Mummy CT Scan -- this is why I love my Brooklyn Museum's 1stfans membership--I know that I'm supporting the museum with the coolest online outreach.
4. 20 Visualizations to Understand Crime (Flowing Data) -- thoughtful analyis of a set of visualizations of crime statistics.

Four short links: 16 June 2009

1. Dealing with Election Results Data -- taking the raw UK European election data into Google's Fusion Tables to try and make sense of it. More cloud-based tools for the data scientist within. (via Simon Willison)
2. Time for an Open 311 API -- "311" is the US number to call for non-emergency municipal services. There have been a lot of individual projects to hack together web sites that provide the single coherent view of government services that the government itself is unable to offer, but the individual projects have all built their own APIs. SeeClickFix suggest these be unified so tools can be written (e.g., iPhone apps) that run across multiple municipalities. (via timoreilly on Twitter)
3. Shoppers Cars Soon Able to Power Supermarkets (Daily Mail) -- At the Sainsbury's store in Gloucester, kinetic plates, which were embedded in the road yesterday, are pushed down every time a vehicle passes over them. A pumping action is then initiated through a series of hydraulic pipes that drive a generator. The plates are able to produce 30kw of green energy an hour - more than enough to power the store's checkouts. (via Freaklabs)
4. Humans Prefer Cockiness to Expertise (New Scientist) -- the blogosphere explained in one paper. (via Mind Hacks)

Four short links: 10 June 2009

App Wall, Negroponte Switch, Data Exploration, Inadequate Innovation

1. Apple's Cool Matrix-Style App Wall (TechCrunch) -- a huge collection of icons for many of the apps available in the App Store, arranged by color. Apparently, when someone purchased one, that app’s icon would pulsate. An App Store version of Google's search globe. Information visualization makes activities meaningful, beautiful, and useful, but not necessarily all at the same time. (via dubdotdash on Twitter)
2. The New Negroponte Switch -- "Designing things that think they are services, and services that think they are things". Matt Jones presentation gushing with great ideas for the "Web Meets World" change. I love the evolving printed map they made for the British Council at Salone di Mobile. A five course meal with port and insulin shots for thought.
3. Odesi -- web-based data exploration, extraction, and analysis tool. (via scilib on Twitter)
4. The Failed Promise of Innovation (Business Week) -- I have a post building up inside me about how irritatingly of the mark this article is. Until that post erupts, however, you'll have to just read it yourself and form your own view of its flaws. But what if the conventional wisdom is wrong? What if outside of a few high-profile areas, the past decade has seen far too few commercial innovations that can transform lives and move the economy forward? What if, rather than being an era of rapid innovation, this has been an era of innovation interrupted? And if that's true, is there any reason to expect the next decade to be any better?

Four short links: 5 June 2009

Kid Robots, US CTO, SCOTUS CSS, Javascript Infoviz

1. Visual Programming Environments for Kids -- detailed writeup of the research and coding done by Shone Sadler to build a visual programming environment for robots, so simple that kids can use it. (via steveweiss on Twitter)
2. The Nation's CTO Lays Out His Priorities -- it's still not entirely clear how the CTO and CIO's roles differ, as both are focusing on open data and "innovation platforms". CTO explicitly calls out economic growth through technology and innovation, though, which could be promising.
3. Redesigning the Government: The US Supreme Court -- the Sunlight Foundation offer a redesigned home page to the US Supreme Court, showing how it could be more useful. How long until the government's CSS is in a git repository where most people with commit access are outside the beltway?
4. Javascript Infoviz Toolkit -- Treemaps, Radial Layouts, HyperTrees/Graphs, SpaceTree-like Layouts, and more.in this Javascript suite for building data pretties. Higher-level than processing.js. (via chrisblizzard on Twitter)

Four short links: 28 May 2009

Mobile Viruses, Open Data, Twitter Bookmarks, Sexy Geek Skills

1. Viral Epidemics Poised to go Mobile -- Albert-Laszlo Barabasi (author of Linked: How Everything Is Connected To Everything Else) modelled mobile phone virus epidemiology for NSF and concluded that (in accordance with experience) no single OS has critical mass for viruses to break-out. I wonder: will Android or iPhone reach that point first? (via ACM TechNews)
2. Socrata -- formerly "Blist", the first of what will undoubtedly be many startups "refocusing" attempting to profit from the new US administration's fondness for Web 2.0. The business model, however, is "we'll offer your data to citizens in a useful form" and it seems to me that this is a responsibility that Government should embrace rather than outsource. (via Jesse)
3. Tag This -- tweet @tagthis with a link and keywords to post the link as bookmark in your Delicious/Magnolia account.
4. Three Sexy Skills of Geeks -- statistics, data munging, and visualization. I'm reading Visualizing Data right now and expect the universe to bury me in bootie before the day is out. "Processing: it's cheaper than couple's therapy and you can post pictures of it on the Internet without being fired." (via mattb on Twitter)

Four short links: 26 May 2009

Databases, Sensors, Visualization, and Patents

1. Flare -- dynamically partitioning and reconstructing key-value server. Currently built on Tokyo Cabinet, but backend is theoretically pluggable. (via joshua on delicious)
2. Implantable Device Offers Continuous Cancer Monitoring -- the sensor network begins to extend into our bodies. The cylindrical, 5-millimeter implant contains magnetic nanoparticles coated with antibodies specific to the target molecules. Target molecules enter the implant through a semipermeable membrane, bind to the particles and cause them to clump together. That clumping can be detected by MRI (magnetic resonance imaging). The device is made of a polymer called polyethylene, which is commonly used in orthopedic implants. The semipermeable membrane, which allows target molecules to enter but keeps the magnetic nanoparticles trapped inside, is made of polycarbonate, a compound used in many plastics. (via FreakLabs)
3. Visualizing Data source -- the source code to examples in Visualizing Data.
4. The First Software Patent (Wired) -- was issued on this day in 1981, for a complex full-text storage and retrieval system. Tellingly, business strategy of the owner of the first software patent was ... to become a patent lawyer. A day that will linger in irritation, if not live in infamy. (via glynmoody on Twitter)