Blog archives for July, 2007

Fooled by Randomness

Fooled by RandomnessNassim Nicholas Taleb’s Fooled by Randomness explores a quite interesting idea of how frequently we confuse causation with pure randomness exhibited in nature. We tend to rever successful war generals, coaches, and corporate CEOs, studying their strategies in search of recipes for success. Success, as Taleb infers, can frequently be attributed to a totally random sequence of events.

Suppose that you have a group of 1,000 who are ready to play a game of Russian roulette once a year, with their chance of survival at 80%. You would have 800 people left after the first year, 640 after the second year, 512 after the third year, and so on. Sooner or later the randomness of the game would bring you to the point, where you had a dozen or so people left alive. Are they really good at plying Russian roulette? Do they have some winning strategies for beating the game? Should we study their family history and consult with their parents on upbringing, so that we can have more of their type? It’s pretty obvious that their path to success in this case was completely random - someone had to be among the final dozen, given the probabilistic chances of Russian roulette, and it just happened to be them.

Change the rules of the game from Russian roulette to financial markets, and all of a sudden the remaining few are treated as financial geniuses with “proven track record” and unblemished reputation. This is frequently one of the randomness scenarios that human brain tends to attribute to some past events having a historical value on influencing the present status quo.

Not to say that success is completely random. When you look at the world of financial markets, somehow one can bet that a Harvard business graduate with superb math skills and understanding of international markets will do a better job on Wall Street than a bum from Calcutta. It’s also quite expectable that a dental student graduating at top of his class from a top school is most likely to do pretty well (financially) in life. Randomness? Or deterministic behavior? Taleb argues that one can always position himself to get a better head start at an occupation, but unless you’re an Olympic runner, randomness has probably a higher role in determining your success, than skills set.

But the book is not about “defining your future.” It’s more about common misconceptions that we have about success. Most of the actors work as waiters, and most movie script writers work at fast food. Yet the public tends to perceive the job as highly desirable because of the slim majority, who actually reached the top of their profession. Human brain tends to underestimate the chances of success, when the potential payout is so large, that it outshines the rest of the 99.9%.

On dangers of calling someone a nerd

The Globe and Mail is reporting on a feud between two members of a picture-sharing site that motivated one of the opponents to drive down to Texas from Virginia, meanwhile taking photos of his trip and sharing them on aforementioned picture-sharing site, to burn the victim’s house down:

Investigators say Tavares boiled over when Anderson called him a nerd and posted a digitally altered photo making Tavares look like a skinny boy in high-water pants, holding a gun and a laptop under a “Revenge of the Nerds” sign. Tavares obtained Anderson’s real name and hometown from Anderson’s Web page about his Museum of Horrors Haunted House. Tavares took leave from his post as a weapons systems operator at the AEGIS Training and Readiness Center in Dahlgren, Va., and started driving. Investigators say he told them he planned to point a shotgun at Anderson and shoot his computer.

News site visits explored

CNET News.com in an article Daily news lost on Facebook generation refers to a study by Joan Shorenstein Center on the Press, Politics and Public Policy at Harvard University, which reports that the current college generation is losing interest in everyday news:

only a third of teens said they seek out news on the Internet. The other two-thirds of teens said that they read the news when they happen “to come across it.” In other words, if they’re on Facebook and haven’t tailored a real news feed, they’re likely not going to come across it there.

A similar article is in New York Times and The Guardian discussion. Is that so? To find out, I ran a Facebook poll without specific targeting asking the visitors whether they actively visit the news sites out there. As you can see, an exact 33.3% of the 1,000 respondents actually head out to a news site, while 28% are totally indifferent to the online news.

Do you actively visit news sites?

But who’s to blame? Turns out, it’s all women’s fault. 40% of males, but only 26% of females visit the news sites actively. Also, only 24% of males don’t read news at all, while 33% of females responding to the poll admitted no interest.

Gender and age breakdown of news site readers

Not that it’s a bad news, unless you’re in news site business. Spend a few evenings with Fooled by Randomness by Nassim Nicholas Taleb, and you will see how instead of separating the signal from the noise, most of the media out there is in business of just creating more noise, and sensationalizing the non-existing news in case of a slow news day.

Beware of the cat

This is a door on Lombard St. in San Francisco.

Beware of the cat

How do you pronounce char?

I ordered a Facebook poll for Computer Science majors to answer a question that bugged me a lot. As you can see, poll results are not definitive either - there seems to be about an equal divide about proper pronounciation of char.
Char data type proper pronounciation

How Internet is helping us with weather information

It looks like a sunny day in Palo Alto, so how about going to San Francisco for a day trip? Let’s check out the weather before we head out, since two cities are in two totally different galaxies.

Yahoo! Weather optimistically tells us that it’s sunny out there, and the trip is totally worth it.

Yahoo! Weather in San Francisco

Next up is Weather.com, who is less optimistic, and tells us it’s partly cloudy.

Weather.com San Francisco weather

WeatherBug is feeling under the weather, and informs us that it’s actually slightly raining in the city.

WeatherBug San Francisco weather

Stonebraker on possible niches in the database world

The ACM Queue runs an interview of Michael Stonebraker, founder of Ingres, Illustra, Cohera and a bunch of other database companies. He’s interviewed by Margo Seltzer, CTO of Sleepycat Software, the company behind BerkeleyDB. Stonebraker discusses various issues in modern database and data warehousing world, including niche opportunities for new companies in the field (found this linkvia Greg Linden):

Text is the fourth market. None of the big text vendors, such as Google and Yahoo, use databases; they never have. They didn’t start there, because the relational databases were too slow from the get-go. Those guys have all written their own engines. It’s the same case in scientific and intelligence databases. Most of these clients have large arrays, so array data is much more popular than tabular data. If you have array data and use special-purpose technology that knows about arrays, you can clobber a system in which tables are used to simulate arrays.

Building a Linux-based peer-to-peer MMOG

Massively multiplayer online games are always interesting to study as far as network optimizations and data transfer optimizations that they resort two. Researchers from Thailand and China are building a Linux-based peer-to-peer massively multiplayer online game and have published a paper on the problems they encountered:

Building real-time interactive P2P game playing applications in Linux posses many challenges and opens a wide area of research. There have been many implementations of remote interactive servers for game playing in some universities or companies providing collaborative access to the remote services.

Most current systems that provide a collaborative remote game environment either use the (multi) Unicast technique or the Multicast technique to transmit data packets to the participants of the experiment group in the network. Both of these schemes have disadvantages and advantages. In this paper we implement architecture under Linux for real-time multiplayer game application based on XCAST especially for the cases where there exist numerous small collaborative groups. We had provided extension to the Linux kernel and XCAST and show that formation of numerous simultaneous groups, where each group would collaborate for a separate game, is possible. The system proposed is robust in consistently providing group formation and collaboration activities in real time, back-up route or priority queuing, and on time packet delivery with minimum delay in network in the presence of continuous node arrival and departure in the entire game playing procedure. We also show that for data packets of low size, the use of XCAST in the network layer decreases the stress at the sender in each group whereas due to the increased header size of the XCAST packets. Our implementation has shown significant improvements to meet the demands of some real-time game applications.

Secret Mountain Laboratory bike

Every once in a while I see someone driving an aluminum vehicle in downtown Palo Alto. This morning, when I was getting my coffee down at Peet’s, it was this bike from Secret Mountain Laboratory.

Secret Mountain Laboratory bike in downtown Palo Alto

If you go through their site, you will see that they’re creating high MPG vehicles from generic commonly available parts, such as this 100 mpg car with Honda engine.

Dr. Technology bike in downtown Palo Alto