Story Tools: PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

In Depth

Tech Trends

Crowdsourcing

Got a big job? The web may be able to help

Last Updated October 5, 2007

Fish99 from Calgary thinks a "Mob4Hire" of cellphone users could test new features on their own phones. Jay from Los Angeles is creating online audio tours that tourists can download and play on their iPods while visiting the sites — and he's asking for contributions from people who know the territory.

Those are just a couple of the ideas posted on Cambrian House, a website run by a Calgary company of the same name. Site members post ideas, comment on others' ideas and offer services to the developing ventures. They get stock in Cambrian House and help determine — through periodic "tournaments" — which ideas get funding.

It's called crowdsourcing. The idea is to use the internet to get large numbers of people to help with a task.

They may do it for money — usually not much — or out of interest or simply because it's fun.

Harnessing the horsepower of groups

In September, the Philadelphia-based magazine The Scientist published an article entitled Can YouTube Save the Planet? inviting readers to post videos on the popular YouTube web service documenting environmental damage. As of mid-September, 35 videos had been posted, says Ivan Oransky, deputy editor at The Scientist. Many came from environmental lobby groups, some from individuals.

In 1995, the Seattle-based internet giant Amazon.com launched the Mechanical Turk, a service designed specifically to harness the working potential of the online community. The name refers back to a 18th-century hoax — a mechanical chess-playing machine that actually had a human chess master hiding inside. The point is that humans are still better at some things, like determining which search results are relevant or choosing the best of several pictures.

The Mechanical Turk initiative started with an internal need, explains Peter Cohen, general manager and director of the project. "There are lot of things around Amazon, especially around data cleanup and data optimization, that we just weren't able to get done."

So Amazon employees had an idea, Cohen says. "What if we could break these things up into a lot of little tasks and have a lot of people complete them?"

Reasoning that if they had such a need, others probably did too, the Amazon team turned their idea into an online service. Today, Cohen says, more than 100,000 people — known as "turkers" or "m-turkers" — have completed tens of millions of Human Intelligence Tasks (HITs).

HIT is the word the Mechanical Turk group uses for tasks that are best tackled with some sort of human involvement. A good example is the work that has been done for Snap.com, a California-based startup that displays previews of web pages on other websites that link to them. The startup has used turkers to evaluate more than 150,000 websites, says Paul Angles, Snap's marketing director. "We figure that the m-turkers have saved us six man-months or more."

Other HITs include things such as writing trivia questions, transcribing podcasts and even writing snippets of software code.

Payback

Turkers get paid in real money that can be transferred to a bank account or used to buy merchandise from Amazon. Don't quit your day job, though. Most tasks carry payments ranging from a cent or two to a few dollars.

It doesn't sound like much, but many tasks take little time, Cohen points out, and "they might pay a few pennies but if you do a few thousand of them they add up." Some people make several thousand dollars a year doing Turk tasks, says Cohen.

The trick is that some of those people live in countries where U.S. dollars go a long way. Crowdsourcing can be a way of farming out work to lower-paid overseas workers. Others earn the satisfaction of contributing to a cause they feel strongly about, such as the The Scientist's YouTube video project.

Michael Sikorsky, chief executive of Cambrian House, says the best way to get North American workers involved in crowdsourcing projects is to combine community and money — with the money largely in the form of potential future profits. So Sikorsky positioned Cambrian House as an online technology incubator, where participants collaborate to develop business ideas. An early result is GWABS, a multi-player combat game Cambrian House is commercializing with Vancouver-based Hothead Games.

Luis von Ahn, an assistant professor at Carnegie-Mellon University, is relying on the fun factor instead.

Von Ahn is developing online games that he hopes people will play for fun, but which will also get something useful done at the same time. In 2002 he developed a game called Matchin'. Two online players are shown the same picture, each thinks of words that describe the picture, and players get points when they enter the same words as their partners. Von Ahn says more than 300,000 people played the game when he posted it on the web. Now Google has acquired it and many more are playing — and helping Google index online pictures so that its image search service can produce more relevant results.

Another of von Ahn's ideas is piggybacking something he wants done on top of another task.

To do that, he has expanded on an earlier idea that is familiar to many internet users. When you log on to some websites or create online accounts, you sometimes must read a series of distorted letters or numbers from the screen and type what you read into a box. This is to ensure that you're a person, and not a computer program. Von Ahn invented this gimmick, which he calls a captcha, in 2000. Now he has come up with the recaptcha, which has two words instead of one.

The first word of a recaptcha does what it always did — software checks that you have typed in the right word to make sure you're human. The second word is taken from a book scanned by the Internet Archive, a non-profit project seeking to digitize public-domain books and make them available free online. When Internet Archive's software can't decipher a word that has been scanned from a book, it goes into a recaptcha. As soon as two people solving recaptchas agree on what the word is, the problem is solved and the Internet Archive database is updated.

Anyone who wants to guard against automated "bots" manipulating a website can download a few lines of code from recaptcha.net to put a recaptcha on the site. About 8,000 websites are using them, von Ahn says, digitizing four to five million words a day for the Internet Archive.

Whatever the motivation for using it, Cohen says, "significant amounts of work" will be done through crowdsourcing in future.

"This power of the crowd," Sikorsky concludes, "is going to actually enter into business."

Go to the Top

Story Tools: PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

World »

Canadian patrol captures 2 men in southern Afghanistan
Canadian soldiers patrolling the volatile Panjwaii district of southern Afghanistan captured two Afghan men believed to have handled explosives.
December 22, 2007 | 4:19 PM EST
Turkey launches new attack on Kurdish targets in Iraq
Turkish warplanes bombed Kurdish rebel targets in northern Iraq on Saturday in the third cross-border offensive by Turkish forces in less than a week, the military said.
December 22, 2007 | 3:07 PM EST
Search for clues continues after deadly Pakistan bombing
Police in Peshawar, Pakistan continued their investigation on Saturday to try to identify a suicide bomber who killed at least 50 people during a holiday prayer service.
December 22, 2007 | 12:39 PM EST
more »

Canada »

Fire kills 3 people in early-morning blaze in Toronto
Three people who were all members of the same family died Saturday when fire broke out in a townhouse complex in northwest Toronto.
December 22, 2007 | 4:53 PM EST
Saskatoon police shoot, kill knife-weilding man
Saskatoon's police chief say a man was shot and killed by officers early Saturday morning after he theatened them with knives.
December 22, 2007 | 5:01 PM EST
Go Transit bus drivers, ticket agents set Jan. 7 strike date
GO Transit bus drivers are threatening to pull over and strike on strike Jan. 7.
December 22, 2007 | 4:35 PM EST
more »

Health »

Surgeons fail to discuss reconstruction with breast cancer patients: study
Surgeons frequently fail to discuss breast reconstruction options with women who have undergone surgery for breast cancer, a new U.S. study has found.
December 21, 2007 | 12:33 PM EST
Sleep disorder drug linked to severe allergic reactions: Health Canada
Health Canada has issued a warning about serious skin and allergic reactions related to Alertec, a drug used to relieve excessive sleepiness due to narcolepsy, obstructive sleep apnea and shift-work sleep disorders.
December 21, 2007 | 4:06 PM EST
Improper use of fentanyl pain patches linked to more deaths: FDA
U.S. health officials say improper use of patches that emit the painkiller fentanyl is still killing people.
December 21, 2007 | 12:41 PM EST
more »

Arts & Entertainment»

No insurance on stolen Picasso, Portinari Brazilian museum reveals
Brazil's premiere modern art museum has revealed that it had no insurance on paintings by Pablo Picasso and one of Brazil's best known artists, Candido Portinari, that were stolen Thursday.
December 22, 2007 | 4:09 PM EST
Police didn't follow procedures in Mel Gibson arrest: report
Three members of the sheriff's department in Malibu, Calif., have been disciplined for their handling of the 2006 arrest of actor Mel Gibson for drunk driving.
December 22, 2007 | 12:22 PM EST
Precious da Vinci papers infested with mould
The Codex Atlanticus, the largest collection of drawings and writings by Renaissance master Leonardo da Vinci, is riddled with mould, according to Italian authorities.
December 22, 2007 | 12:12 PM EST
more »

Technology & Science »

Toshiba, Sharp expand LCD TV ties
Japanese electronics rivals Toshiba and Sharp expanded ties in making liquid crystal displays Friday, with competition growing increasingly intense among flat-panel TV producers.
December 21, 2007 | 7:16 PM EST
CRTC gives thumbs-up to telecom complaints agency
The CRTC has approved an industry-sponsored telecommunications complaints agency, giving cellphone and internet customers an official way to resolve their problems with service providers.
December 21, 2007 | 12:49 PM EST
Bell to administer telemarketer do-not-call list
The CRTC has picked Bell Canada to operate the National Do Not Call List, giving the company a five-year mandate to block calls from telemarketers for customers who request the service.
December 21, 2007 | 2:46 PM EST
more »

Money »

2007's winners and losers on the TSX
As 2007 winds down, it's 'woulda, coulda, shoulda' time as investors take a look back to find the stocks they should have bought in bulk at the start of the year.
December 21, 2007 | 5:58 PM EST
RIM rallies as earnings beat street
Shares of Research in Motion shot up by 10 per cent Friday after the maker of the BlackBerry wireless device reported earnings that topped expectations.
December 21, 2007 | 4:14 PM EST
Treasury runs $2.7B deficit in October
The monthly budget surplus that Canada usually records disappeared in October as the tax cuts announced in that month's economic statement were added to the mix.
December 21, 2007 | 12:44 PM EST
more »

Consumer Life »

Bell to administer telemarketer do-not-call list
The CRTC has picked Bell Canada to operate the National Do Not Call List, giving the company a five-year mandate to block calls from telemarketers for customers who request the service.
December 21, 2007 | 2:46 PM EST
Transport Canada issues safety alerts for 3 car seats
Transport Canada has issued recall notices and safety warnings for three models of child restraint systems.
December 21, 2007 | 3:53 PM EST
Holiday shopping to peak Friday
Storekeepers ready your registers, holiday shopping will reach its peak Friday afternoon between 2 and 3 p.m., according to credit and debit card transaction processor Moneris.
December 21, 2007 | 9:33 AM EST
more »

Sports »

Scores: CFL MLB MLS

Leafs lacking offensive spark
In an effort to ignite the offence, Toronto Maple Leafs coach Paul Maurice might juggle his forward lines for Saturday's matchup (CBC, 7 p.m. ET) in Florida against the Panthers.
December 22, 2007 | 11:58 AM EST
Senators welcome Havlat back
After seeing their six-game winning streak snapped, the Ottawa Senators look to get back in the win column when they host Martin Havlat and the Chicago Blackhawks on Saturday (CBC, 7 p.m. ET).
December 22, 2007 | 1:27 PM EST
Final 4 set at curling's National
Defending champion Kevin Martin meets Jeff Stoughton, while top playoff seed Kevin Koe will face Wayne Middaugh in the semifinals of the National after the four skips scored quarter-final victories Saturday in Port Hawkesbury, N.S.
December 22, 2007 | 1:15 PM EST
more »