Data Architect, Ph.D, Information Technologist, Gamer
5849 stories

07/21/17 PHD comic: 'Weekend Plans'

1 Share
Piled Higher & Deeper by Jorge Cham
Click on the title below to read the comic
title: "Weekend Plans" - originally published 7/21/2017

For the latest news in PHD Comics, CLICK HERE!

Read the whole story
3 hours ago
Sydney, Australia
Share this story

A 4,000-Word Article About Checkers

1 Share

Marion Tinsley—math professor, minister, and the best checkers player in the world—sat across a game board from a computer, dying.

Tinsley had been the world’s best for 40 years, a time during which he'd lost a handful of games to humans, but never a match. It's possible no single person had ever dominated a competitive pursuit the way Tinsley dominated checkers. But this was a different sort of competition, the Man-Machine World Championship.

His opponent was Chinook, a checkers-playing program programmed by Jonathan Schaeffer, a round, frizzy-haired professor from the University of Alberta, who operated the machine. Through obsessive work, Chinook had become very good. It hadn't lost a game in its last 125—and since they’d come close to defeating Tinsley in 1992, Schaeffer’s team had spent thousands of hours perfecting his machine.

The night before the match, Tinsley dreamt that God spoke to him and said, “I like Jonathan, too,” which had led him to believe that he might have lost exclusive divine backing.

So, they sat in the now-defunct Computer Museum in Boston. The room was large, but the crowd numbered in the teens. The two men were slated to play 30 matches over the next two weeks. The year was 1994, before Garry Kasparov and Deep Blue or Lee Sedol and AlphaGo.

Contemporary accounts played the story as a Man vs. Machine battle, the quick wits of a human versus the brute computing power of a supercomputer. But Tinsley and Schaeffer both agreed: this was a battle between two men, each having prepared and tuned a unique instrument to defeat the other. Having been so dominant against humans for so long, Tinsley seemed to thrill at finally having some entity that could give him a real game. He had volunteered to play friendly matches against the computer in the run-up to their two world championship matches. And Schaeffer, though he was a bull-headed young man, had become the most effective promoter of Tinsley’s prowess and legacy.

But there, in that hall, a quirk of human development was troubling Tinsley. His stomach hurt. The pain was keeping him up all night. After six games—all draws—he needed to see a doctor. Schaeffer took him to the hospital. He left with Maalox. But the next day, an X-ray revealed there was a lump on his pancreas. Tinsley understood his fate.

He withdrew. Chinook became the first computer program in history to win a human world championship. But Schaeffer was crushed. He’d devoted years of his life to creating a program that could beat the best checkers player ever, and just as he was about to realize this dream, Tinsley quit. Seven months later, Tinsley died, never having truly lost a match to Chinook.

And that would lead Schaeffer to undertake a 13-year computational odyssey to exorcise the man’s ghost. With Tinsley gone, the only way to prove that Chinook could have beaten the man was to beat the game itself. The results would be published July 19, 2007, in Science with the headline: Checkers Is Solved.

“From the end of the Tinsley saga in ’94-’95 until 2007, I worked obsessively on building a perfect checkers program,” Schaeffer told me. “The reason was simple: I wanted to get rid of the ghost of Marion Tinsley. People said to me, ‘You could never have beaten Tinsley because he was perfect.’ Well, yes, we would have beaten Tinsley because he was only almost perfect. But my computer program is perfect.”

* * *

Jonathan Schaeffer did not begin his career intending to solve checkers. He was a chess player, first. Good, not great. But he also loved computers—and had done a Ph.D. in computer science, so he decided to build a chess-playing program. He called it Phoenix and it was one of the better chess programs of many that were created in the 1980s. In 1989, he “crashed and burned” at the World Computer Chess Championships, however. At the same time, the team that would form DeepBlue, the chess software that would eventually defeat Kasparov, was coming together. Schaefer realized he would never build the world computer champion.

A colleague suggested that perhaps he should try checkers, and thrillingly, with just a few months of work, his software was good enough to bring to the “Computer Olympiad” in London to compete against other checkers-playing bots. And it was there that he began to hear about Marion Tinsley, the great.

At the highest levels, checkers is a game of mental attrition. Most games are draws. In serious matches, players don’t begin with the standard initial starting position. Instead, a three-move opening is drawn from a stack of approved beginnings, which give some tiny advantage to one or the other player. They play that out, then switch colors. The primary way to lose is to make a mistake that your opponent can jump on.

This would seem to make checkers a game amenable to computer play. That was certainly the idea back in the mid-1950s, when an IBM research scientist named Arthur Samuel began to experiment with getting a checkers-playing program to run on an IBM 704. He worked on the problem for the next 15 years or so, publishing several important papers on what he called—and what we all would now call—“machine learning.”

Machine learning is the underlying concept for the current wave of artificial intelligence. The descendants of that early work now promise to revolutionize whole industries and labor markets. But Samuel’s programs never had much success against actual humans. In May 1958, several members of the Endicott Johnson Corporation Chess and Checkers Club trounced the computer, much to the delight of the Binghamton Press and Sun-Bulletin.

“The human brain, sometimes lost sight of in an age of satellites, frozen foods and electronic data processing machines, returned to former glories early today,” the paper said. “The 704, Dr. Samuel explained, does not think. What it does, he said, is to search its ‘memory,’ stored on tape, of checkerboard situations it has encountered previously. Then it rejects choices which have turned out badly in the past and makes moves which turned out well.”

This still would work pretty well as a description of what’s known as “reinforcement learning,” one of the basket of machine-learning techniques that has revitalized the field of artificial intelligence in recent years. The man who wrote the book Reinforcement Learning, Rich Sutton, called Samuel’s research the “earliest” work that’s “now viewed as directly relevant” to the current AI enterprise. And Sutton also happens to be one of Schaeffer’s colleagues at the University of Alberta, where Google’s DeepMind AI shop recently announced it will set up its first international research office.

While his techniques were groundbreaking, 10 years later Samuel had made, in his own words, “limited progress” on the problem, though he’d kept working at it at IBM, while visiting at MIT, and then with a Department of Defense grant at Stanford. As with so many of the currently hot AI techniques, he just did not have the computational horsepower or datasets that he needed to make the beautiful ideas work.

So when Schaeffer began building his own software, he went straight back to Samuel, and found that he could not exactly follow Samuel’s path. He’d have to build a new system. At first they called it The Beast, but eventually they named it Chinook after the warm winds that sometimes blow through Edmonton.

The work consumed Schaeffer. As he described it in his 1997 book, “Sometimes, when I had difficulty getting to sleep, I would fantasize about the exhilaration that I would experience when CHINOOK finally defeated the Terrible Tinsley.” His wife would interrupt his reveries asking, “You’re thinking about him again, aren’t you?”

As the software developed through the years, it retained two core components. The first is easy to understand: It’s a “book” of complete computations of every possible checkers position with a certain small number of pieces on the board. So, if there were six pieces left—and as time went on, seven, then eight—Schaeffer’s software knew every possible combination. Back in the early ’90s, it took vast amounts of computer time to be able to run all those calculations.  

But as Schaeffer and his team did more and more computation, Chinook got better and better. It started to be able to beat people. But they knew that they couldn’t calculate every possible position.

The rules of checkers are simple, but the number of potential moves is massive—there are 5 x 10^20 possibilities. Schaeffer has an analogy to help people understand how ridiculous that is: Imagine draining the Pacific Ocean and then having to fill it back up with a tiny cup, one at a time. The sea is the number of checkers possibilities. The cup is each calculation.

The second component of the system is a little trickier to grasp. Chinook needed to search through possible moves beginning with the start of a match. Like many similar systems, Chinook would look ahead many possible moves and then try to score each permutation’s desirability. At first, Chinook could only look ahead 14 to 15 moves out, but as computers and the software improved, it could look further and further. “As with chess, deeper was always better,” Schaeffer told me.

In late 1990, the American Checker Federation allowed Chinook to play in the U.S. Championships. The software went undefeated and played Tinsley to a draw six times. That earned the software the right to challenge Tinsley for the world championship.

And after Chinook’s 1990 performance, Tinsley called up Jonathan Schaeffer and asked if he might like to play a few friendly matches.

* * *

From 1950 to 1990, Tinsley had been the world champion of checkers whenever he wanted to be. He’d occasionally retire to work on mathematics or devote himself to religious study, but he’d eventually return, beat everyone and become champion again. In that 40-year span, he lost five total games and never once dropped a match.

Derek Oldbury, probably the second best player of all time, wrote an encyclopedia of checkers. It was effusive in its praise for the master: “Marion Tinsley is to checkers what Leonardo da Vinci was to science, what Michelangelo was to art and what Beethoven was to music.”

Marion Tinsley at Florida A&M in 1974 (Mark Foley / AP)

It’s hard to know what to make of Marion Tinsley from the perspective of the 21st century. He seems otherworldly or, at the very least, othertimely. His life was composed of checkers, mathematics, and his abiding faith. He was kind, by literally every account, and yet his style of play was relentless and aggressive.

It is not uncommon to say that someone lived a “life of the mind,” but in Tinsley’s case both the life and the mind were unusual. For years, as an undergraduate and then graduate student at the Ohio State University, he spent eight hours a day on checkers. He never married. “I haven’t seen a checker marriage that worked out,” he told a reporter. “It is a very rare woman who can be married to a real student of checkers.” His mother lived with him well into the 1980s. A 1993 profile in The Philadelphia Inquirer found Tinsley in a big, blue sweater over a shirt and tie. His lunch was “a jar of milk, half an apple, and a peanut butter sandwich.”

His relationship with the racial dynamics of the South is also fascinating. “I had thought of going to Africa as a self-supporting missionary," he told Sports Illustrated in 1992, "until a sharp-tongued sister pointed out to me that most people who wanted to help blacks in Africa wouldn't even talk to blacks in America.”

Instead, he became a lay minister at a predominantly black church and left Florida State University’s math department to teach at the historically black Florida A&M University. He spent 26 years there. A yearbook from towards the end of his time there showed a deep and lively campus life in which Tinsley might have been the only white person over the age of 40. No contemporary accounts ask any of the black students what they made of their checkers-champion professor, but a colleague was able to describe Tinsley’s role in a local obituary: “At his retirement dinner, literally everybody; young, old, black, white, students, faculty members … gave testimonies about the impact he had had on their lives.” For a man of his time and upbringing in Kentucky, his path seems almost miraculous.

One thing is for sure: Tinsley was a genius. His genius had been refined and whittled into a strange and wonderful shape. He was the very best at this one thing and pretty ordinary in all else. One part of him had become almost like an artificial intelligence—narrow but extraordinarily capable—while the rest of him lived this simple human life.

When a reporter visited him in Tallahassee in 1993, lavender azaleas lined the driveway leading up to his two-story brick house. His home had bare white walls. A room upstairs contained his checkerboard and heavily used checkers books. Tinsley liked to sit in a velour La-Z-Boy. He could never quite explain what checkers meant to him—why he’d pored over sequences of moves for almost his entire life, why he’d kept a magnetic checkerboard by his bedside to work out new combinations. It was something close to godly, though.

“Checkers is a deep, simple, elegant game,” he once said. Playing another human great was “like two artists collaborating on a work of art,” Tinsley said another time.

And then there is his most quotable line: “Chess is like looking out over a vast open ocean; checkers is like looking into a bottomless well.”

It was as if the checker moves were Scriptures that he could endlessly meditate on and understand in new ways. “Out of the clear blue sky an improvement of a published play will just come to mind, as if the subconscious has been working to come to light,” he told the Chicago Tribune in 1985. “A lot of my discoveries come that way, out of the clear blue sky. Some of my insights into the Scriptures come the same way.”

* * *

When Tinsley came to Edmonton in 1991 to play the friendly matches against Chinook, Schaeffer was also blown away that the world champion would agree to play this computer for fun.

The two men sat in his office and began the matches, Schaeffer moving for Chinook and entering changes in the game into the system. The first nine games were all draws. In the tenth game, Chinook was cruising along, searching 16 to 17 moves deep into the future. And it made a move where it thought it had a small advantage. “Tinsley immediately said, ‘You’re gonna regret that.’” Schaeffer said. “And at the time, I was thinking, what the heck does he know, what could possibly go wrong?” But, in fact, from that point forward, Tinsley began to pull ahead.

“In his notes to the game, he later wrote that he had seen all the way to the end of the game and he knew he was going to win,” Schaeffer said.

The computer scientist became fixated on that moment. After the match, he ran simulations to examine what had gone wrong. And he discovered that, in fact, from that move to the end of the game, if both sides played perfectly, he would lose every time. But what he discovered next blew his mind. To see that, a computer or a human would have to look 64 moves ahead.

“I was absolutely stunned,” Schaeffer told me. “How do you compete with somebody whose understanding of the game is so deep that he immediately knows through experience or knowledge or doing some amazing search that he was gonna win that position?”

Schaeffer still struggles to make sense of Tinsley’s incredible skill. When he wrote his book about the saga, One Jump Ahead, Schaeffer received a letter from Tinsley’s academic supervisor. It read, Schaeffer told me, “that he was an exceptionally talented person and he was capable of doing one thing brilliantly. If it wasn’t checkers, he probably would have been a brilliant mathematician.”

When someone’s motivations are not fame or money, we seem to require a higher level of explanation, some emotional engine the rest of us do not possess. The closest Tinsley ever came to describing his motivations came in the 1993 Philadelphia Inquirer feature. He was an introvert who “felt unloved” by his parents, who he thought doted on his sister. To gain their approval, he competed at math and spelling bees. “And as a twig is bent, it grows: As I grew up, I still kept feeling that way.”

* * *

The hunger to excel propelled Tinsley to college at 15, where he really discovered the passion that would dominate his life. He won his first world title in 1955.

And in 1992, he agreed to put his title on the line in the first Man-Machine World Championship against Chinook. The match was sponsored by the computer manufacturer Silicon Graphics and held in London. “I can win,” Tinsley told The Independent. “I have a better programmer than Chinook. His was Jonathan, mine was the Lord.”

For the two weeks leading up to the event, another world-class player, Don Lafferty, trained with him down in Tallahassee, going over their matches and reviewing positions deep into the night.

The 1992 games were held at the Park Lane Hotel, which had hosted world chess championships as well as Computer Olympiad that had been Chinook’s public debut two years earlier. The room was large and two-stories, with a balcony that overlooked the players and the refrigerator-sized computer that was running Chinook.

Schaeffer and Tinsley sat across from each other, and a large screen rendered the movement of the pieces. Tinsley drew first blood, besting Chinook in Game five. But then in Game eight, Chinook delivered a stunning win; it was Tinsley’s sixth loss in 40 years.

Despite the years of toil and dreams of success, Schaeffer felt sadness in that moment. “We’re still members of the human race,” he wrote in his book, “and CHINOOK defeating Tinsley in a single game means that it will only be a matter of time before computers will be supreme in checkers, and eventually in other games like chess.” Schaeffer might have won, but the humans have lost.

After a series of draws, Chinook won again in game 16. No living player had ever defeated Tinsley more than once. Incredibly, almost unbelievably, the software was on top. They were on the verge of making computing history.

Then, in an episode that Schaeffer still finds too painful to describe, Chinook had some sort of error, which forced them to resign the game, tying the match up. “Tinsley viewed it as God helping him out,” Schaeffer said. “It was a religious experience for Tinsley and one of the most devastating experiences of my life.”

Schaeffer and Chinook were never able to get back on top.Tinsley came from behind to win the match, retaining his title.

“I think, if I can keep my health, I don’t believe there will ever be a computer that can beat me,” Tinsley told CNN after the match.

* * *

All of which set the table for the 1994 matchup in Boston.

In the runup, Chinook had played Derek Oldbury and trounced him. Shortly thereafter, Oldbury died. “Chinook plays Oldbury. Chinook beats Oldbury. Oldbury dies,” Tinsley joked with Schaeffer. “He must have died of Chinookitis!”

Schaeffer was not amused. He was a young man programming computers to play an old man’s game. The best players were dying off. And it was, in the eyes of some in the checkers world, a bit untoward for this guy with his fancy machines and code to come around beating up on the frail masters.

As he’s gotten older, Schaeffer has come to wish that he’d appreciated Tinsley more during their entanglement. “I also look back at my time with Marion Tinsley, not realizing how fleeting it would be and how much I appreciated it. I didn’t take advantage of that and reap the benefits of a warm and deep friendship that I had with him,” he told me. “I look back at it and with hindsight; I can say that I am disappointed in myself. I wish I would have done things differently, but at the time, when you’re obsessed, you can only see in one direction.”

Even in his narration of taking Tinsley to the hospital, Schaeffer cannot get over the idea that the older man’s illness might prevent him from having the chance to beat him. Tinsley says, “I’m ready to go,” and Schaeffer acts befuddled. The old man knew he was dying, and the younger didn’t get it.

After Tinsley resigned, Don Lafferty took his spot and dueled with the computer, but Schaeffer’s sights became set on the larger prize of solving checkers. Human checkers players came to despise Schaeffer, by his own telling. They sent him letters trash talking him and his software. He released One Jump Ahead in 1997, and still checkers players kept coming for him.

From 1997 to 2001, he suspended his project to solve the game, which meant creating a computer program that always knew the right move. It would be unbeatable. It would be perfect.  

When he returned, his team expanded the endgame database—Chinook’s perfect knowledge—to any situation where there were 10 pieces or less on the board. That’s 39 trillion positions.

They continued improving Chinook’s “best-first” search strategy, which allowed them to do a fraction of the calculations necessary to compute every single possible play in the game. It took Schaeffer harnessing computers all over the world, drawing on and expanding his expertise in parallel computing. He conscripted machines everywhere from Switzerland to Lawrence Livermore National Laboratory, a major Department of Energy facility that often deals with nuclear weapons.

“There was somebody else there [running a program] called BOMB and I was running checkers programs,” Schaeffer told me. “It was a very strange situation. Security should have been concerned.” And they were. They paid him a visit after discovering gigabytes of data flowing out of a national lab to Edmonton, Alberta.

Through the years, the computers cranked away. As Samuel’s machines had before him. As future DeepMind machines would. This was a narrow kind of intelligence to develop, but it was part of the long arc of the development of artificial intelligence, which is expected to revolutionize the world within this generation.

Schaeffer saw what he was doing as the completion of Samuel’s initial dream. After his team’s success at the 1990 U.S. championships, he reached out to the old IBM man to share the news. The unhappy word came back: Samuel had just died, one of the oldest computer programmers still working. Born in Emporia, Kansas in 1901, his last login to Stanford’s computer network was recorded in February of 1990. He’d seen the diffusion of electricity, the release of the Model T, two world wars, humans on the moon, and the very first glimmers of machine intelligence.

Finally, in 2007, Schaeffer was able to announce in Science that after working on checkers for 19 years, he had solved the game. The forward search had met the endgame database somewhere in the middle, like an AI transcontinental railroad, with the high-profile publication as Schaeffer’s golden spike. His team had figured out the sequences for 19 of the 300 tournament openings, but as it turned out, those 19 were all that were needed to prove that the game, played perfectly, amounts to a draw.  

* * *

The game of checkers grinds on. The sport has been officially conquered by computers, but the wave of artificial intelligence has long moved on to more difficult challenges, leaving the humans to beat up on each other in places like the Honeysuckle Inn and Conference Center in Branson, Missouri. There are still tournaments and champions and even some prize money. There’s a group of young Italians who are challenging for global dominance.

Schaeffer thinks he’s laid checkers to rest himself. He’s working on a book about the history of computer chess that’s coming out later this year. He’s a dean at University of Alberta. “I’ve tried to move on and exorcise some of the ghosts of the story, but it keeps coming back,” he tells me. “I guess it will be part of me until the day I die.”

Before he does, though, he has one more checkers item on his to-do list. “I’d like to make a pilgrimage to Ohio and visit his grave,” Schaeffer said.

The grave is marked by a simple headstone: Marion F. Tinsley. In the upper right corner, there’s a checkerboard. In the upper left, a Scriptural reference, Hebrews 13:1: “Let brotherly love continue.”

Followed by: “Be not forgetful to entertain strangers: for thereby some have entertained angels unawares.” Imagine Schaeffer, once one of those strangers, completing his pilgrimage and looking down at this grave, as if down a well. For Tinsley, the spiritualist, the metaphor of checkers as a well without end was both poetic and true. But Schaeffer, the engineer, knew that no well is bottomless. And humans will always sound the depth.

Read the whole story
3 days ago
Sydney, Australia
Share this story

Google introduces the feed, a personalized stream of news on iOS and Android

1 Comment

Google today is rolling out its take on the news feed, a personalized stream of articles, videos, and other content. The feed will appear in its flagship app for Android and iOS, simply called Google. The feed, which includes items drawn from your search history and topics you choose to follow, is designed to turn Google’s app into a destination for browsing as well as search. Google is hoping you’ll begin opening its app the way you do Facebook or Twitter, checking it reflexively throughout the day for quick hits of news and information.

Google previewed its new feed in December, when it introduced the feature to its Android app. Previously, the space below the search bar was reserved for Google Now, the company’s predictive search...

Continue reading…

Read the whole story
3 days ago
It's like... ::strokes beard:: some prior product. So hard to put my finger on... clearly some prior art here..
Sydney, Australia
Share this story

This Dumb Industry: A Lack of Vision and Leadership

1 Share

In the past I’ve spent a lot of time criticizing the behavior of the big videogame publishers: EA, the Game Division of Microsoft, Ubisoft, and the rest. I’ve criticized their approach to staffing, scheduling game development, marketing and selling products, setting prices, fighting piracy, forging business relationships, and managing creative decisions. I see a lot of problems in all of these areas and I always hope that if I outline their shortcomings in enough detail, using clever enough metaphors, and using interesting enough stock photos, that eventually more people will follow my site and I’ll be able to complain to an even larger audience.

Well, let’s give it another go…

Part 1: Corporations

You`re suggesting this STEAM program thing could ever compete with US?! That`s HILARIOUS!

You`re suggesting this STEAM program thing could ever compete with US?! That`s HILARIOUS!

Whenever I make these complaints, I always try to frame it in terms of the companies making bad decisions and missing out on opportunities. The objections I get from people generally fall into one of two categories:

  1. Corporations exist to make money.
  2. Hey, they’re making money, so they must be doing something right!

The first response incorrectly assumes that I’m making some kind of moral argument. They seem to think that I’m demanding that the leadership of these companies all magically transform their enterprises into utopian non-profit arthouse gaming studios. But I’m not. I know that would be an unreasonable and unrealistic demand. I’m actually saying that even when judged solely on their merits as a money-making enterprise, these companies frequently make horrible decisions that destroy opportunities for profit.

Which brings me to the second response, which is that if they’re making money – and some of these companies are indeed making an amazing amount of money – that they’re doing fine and there’s nothing to criticize. It’s silly for a programmer to question the expertise or actions of a CEO, because these companies wouldn’t do these things if they weren’t a good idea.

This argument is a logical fallacy known as appeal to authority. Sure, a business major is in general more likely to make better business decisions than a programmer, but that does not mean that business majors always make good decisions or that a programmer can’t ever make better ones.

Now, most people arguing on the internet would stop here. You made a logical fallacy, therefore I win the argument LOL. But I respect you too much to dismiss this with such a glib answer, so instead let me give a long, disorganized answer that begins with a tangent talking about…

Part 2: Baseball

Baseball is America`s pastime. At least when America isn`t busy watching football, NASCAR, and the Kardashians.

Baseball is America`s pastime. At least when America isn`t busy watching football, NASCAR, and the Kardashians.

I want to talk about the 2003 book Moneyball by Michael Lewis. And to be clear, I’m really talking about the book and not the 2011 movie based on it. The movie is good, but you need to read the book if you really want to understand what happened to baseball.

Baseball nerds are notoriously obsessed with statistics. Ask one for information on their favorite player, and they’ll send you a spreadsheet so incomprehensible and so filled with inscrutable acronyms, you’ll think it was taken from the back pages of a Dungeon Master’s Guide. It will contain rows and rows of carefully gathered and curated numbers that describe the abilities and performance of the player. These numbers are ostensibly as important as the attributes on a D&D player’s character sheet. It’s a document that clearly defines what they can and can’t do.

Except, Paul DePodesta, assistant general manager of the Oakland A’s, didn’t think this was the case. He suspected that those numbers were wrong. Or if not wrong, they were tracking the wrong things or interpreting the data in the wrong way. He believed that everyone else in baseball was measuring the worth of a player using incorrect statistics and a faulty premise.

Imagine if scouts sought FIFA players by looking for guys who were tall, wore large shoes, had really big foreheads, and could jump really high. Those are all basically good things in the context of the game, but none of them will automatically make you a champion futbol player. None of them are as important as being able to control the ball and having keen situational awareness. DePodesta’s thinking was that this is what baseball scouts were doing. They were fighting over players who might be great sprinters or look great in a baseball uniform, but weren’t necessarily the best baseball players. They might look like baseball players and they might be great athletes, but nobody was paying any attention to the stats that showed how good they were at scoring points and preventing the other team from doing the same.

It’s not that they were recruiting bad players, it’s that they were greatly over-valuing certain attributes and under-valuing (or even outright ignoring) others. DePodesta began looking at things in very practical terms. “Given the stats of this player, how much will we pay for each run we score?” This stripped away decades of tradition, habit, and superstition that had shaped the way players were recruited.

Brad Pitt and Jonah Hill in Moneyball. Brad Pitt`s character is (based on) a real person, but Jonah Hill`s character serves DePodesta`s function without pretending to be DePodesta.

Brad Pitt and Jonah Hill in Moneyball. Brad Pitt`s character is (based on) a real person, but Jonah Hill`s character serves DePodesta`s function without pretending to be DePodesta.

The Oakland A’s began quietly looking for people based on the stats that DePodesta thought mattered. They recruited guys from the farm leagues that nobody else thought was pro material. They found players who were under-valued on other teams and traded for them. They traded away their own players that weren’t performing well in terms of dollars-to-runs, even if they were supposedly the best players on the team according to convential wisdom.

As the new team took shape people began laughing at the A’s and their lineup of mutants. None of these guys had the attributes baseball scouts prized. Some of them were fat. Their pitcher was called “The Creature” for his bizarre throwing style. One guy even had a limp. They were Baseball’s Island of Misfit Toys.

More importantly, Oakland began beating bigger, more well-funded teams. They beat teams that could afford players with supposedly better stats. This happened often enough and went on long enough that it clearly wasn’t a fluke. DePodesta had been right.

My goal here is not to lionize DePodesta. I don’t think he’s some one-of-a-kind super genius. I mean sure, he’s probably smarter than me. But that’s not a very high bar. He didn’t come up with these ideas on his own. This supposedly “new” thinking went all the way back to the 1970’s at least. DePodesta wasn’t the first person to seriously question the system, he was just the first person to question the system who was in a position to do something about it. What’s interesting about this story isn’t DePodesta, it’s everyone else. Because everyone else was wrong.

Even once the new strategy started winning games, other people had trouble believing it wasn’t a fluke, simply because it meant that an entire industry had been wrong for a century. Billions of dollars were misspent by generations of baseball scouts, recruiting players using faulty thinking. Anyone could have come to DePodesta’s conclusions at any time, and yet nobody did. People kept doing things the way they’d always done them.

These teams made money, but they were wrong. These teams won games, while being wrong. These teams grew their fanbase, expanded to new stadiums, made the playoffs, and won the World Series, while the whole time they were wrong about how to measure players and appraise their skills. They won because they were up against teams who were just as wrong as they were. All it took was for one person to be right to upset the entire balance.

And they did upset the balance. When the Oakland A’s rolled out their new strategy, the second-poorest team in baseball was suddenly competitive with the richest teams.

If a large number of baseball experts can be wrong about a century-old game, then certainly it’s plausible that a small number of game publishers could be wrong about this relatively new industry. So claiming “EA is fine because they’re making lots of money” is missing the point.

Part 3: The High Cost of Wrongness

A randomly chosen image from SimCity, which shouldn`t be taken as a metaphor for how EA handled the game. Unless you think the metaphor is clever, in which case you should totally take it that way.

A randomly chosen image from SimCity, which shouldn`t be taken as a metaphor for how EA handled the game. Unless you think the metaphor is clever, in which case you should totally take it that way.

So I imagine your next demand is that I have something to back all of this up. Sure, a bunch of people in Major League Baseball was wrong, but if I’m going to sit here and claim I know better than the titans of the gaming industry then I ought to be able to point to some long-term mistake in gaming. Can I point to an instance where a small underdog might outwit and overpower a gigantic company?

Yes I can. It’s already happened. It’s still happening right now. In fact, it’s been happening for thirteen years. Steam happened.

Back in 2003, Valve was not a gigantic corporation. Sure, they had a really successful game. Half-Life was a popular title and had lots of expansion packs, but Valve was still much smaller and less famous than the likes of Blizzard, BioWare, and iD Software. This was right around the time when lots of medium-sized studios like Valve were being absorbed into big publishers.

But instead of being absorbed, Valve launched their own digital delivery platform. This small company correctly predicted where the market was headed and what the consumer wanted, and they built a platform to meet that demand[3].

The big publishers had no answer to this. Ubisoft had nothing. Microsoft had nothing. Activision had nothing. At the time, EA had their own digital service called EA Downloader. It was dreadful and EA didn’t seem to be inclined to improve on it. Steam began to eat up the digital market and none of the big players even showed up to compete with them.

In less than a decade Valve – who started as a medium-sized game developer with a single hit game – became a multibillion dollar juggernaut. They did this without an infusion of public investment money. They did it without selling themselves to someone larger. As far as I can tell they did it without even acquiring debt. They just understood the market better than the supposed experts. Everyone makes a big deal about how big Wal-Mart is, but today Steam controls the digital PC market more thoroughly than Wal-Mart dominates the retail market[4].

This isn`t what I had in mind when I suggested you guys should compete with Steam.

This isn`t what I had in mind when I suggested you guys should compete with Steam.

Just like the Oakland A’s were able to beat better-funded teams, Valve was able to crush companies many times their size.

I’m not faulting EA and the rest because they didn’t make Steam first. That sort of thing happens all the time. I’m faulting them for not being second or even third. It took Electronic Arts seven years to get around to releasing Origin, their answer to Steam. That’s eons in this industry. And EA was the smart one. Microsoft had Games for Windows LIVE, which was even worse. Ubisoft has Uplay, which I can’t even criticize properly because I can’t tell what they’re trying to do with the platform beyond annoy people. This would be a shameful display if these companies had showed up with this stuff in 2007, much less 2017. The degree to which they have failed to understand and adapt to the market is astounding. Today these companies are at the mercy of Valve. If they want to sell on the PC, they need to hand over a big chunk of their gross income to this new rival.

Just like the baseball leadership was wrong for generations, the publishers have failed to grasp many basic principles of the business.

The publishers claimed you couldn’t make money in Russia because Russians would just pirate games. Then Valve turned around and made money from Russians who were perfectly willing to pay for games if it meant they could enjoy the convenience of Steam over the hassle of torrents.

The publishers insisted the $60 price point was ideal and that AAA games should forever remain there. Valve cleaned up by selling games at a variety of price points, discovering a largely still-ignored source of downmarket sales.

The publishers were sure that the market was cleanly divided into AAA and “casual”, and that the people who bought expensive AAA shooters were unrelated to the people who played cutsy 2D games. The indie revolution showed that us AAA players actually enjoy a good point-and-click or a match-three or a 2D platformer after a hard day of Battlefielding and Grand Theft Autoing. Valve sold indie games and AAA games alike, from the same storefront and to the same people.

Shockingly, it`s possible for a single human being to enjoy both Left 4 Dead AND Plants vs. Zombies. Just, you know, not at the same time.

Shockingly, it`s possible for a single human being to enjoy both Left 4 Dead AND Plants vs. Zombies. Just, you know, not at the same time.

So yeah. It is possible for an entire industry of experienced executives to completely miss the boat and make billion-dollar blunders. It is my belief that the publishers have been led poorly, and continue to be led poorly, because the people in charge do not have a background in gaming and are thus unable to see trends as they form. Instead they can only respond in a reactionary way. Their understanding of the market comes from earnings reports, not from buying and playing games.

The fact that they post profits at the end of the year does nothing to change this. A lot of people were very wrong about digital platforms for a very long time, and so it’s plausible that they might be wrong about other things that are equally important.

I anticipate that now you’re saying to me, “Shamus, I totally buy into your premise that companies can be wrong about stuff. And I think that you – an indie developer and author of very minor renown – are totally qualified to second-guess these executives and explain how their companies should be run. So please tell us what they should be doing differently.”

Well thanks. I appreciate your vote of confidence. Okay then. Next week I’ll talk about how I’d do things if I were elected King of All Videogame Business.

Read the whole story
4 days ago
Sydney, Australia
Share this story

Saturday Morning Breakfast Cereal - Heavenly


Click here to go see the bonus panel!

Secretly, the reader began to suspect that Zach only made Heaven jokes to avoid drawing backgrounds.

New comic!
Today's News:

Just three days left to get ALL of the Bible, ALL of science, AND our new pop sci book for just $30+shipping!

Read the whole story
6 days ago
Sydney, Australia
Share this story

When I’m asked to help with an Access issue.  It’s...

1 Share

When I’m asked to help with an Access issue.  It’s like SQL, right?

Read the whole story
7 days ago
Sydney, Australia
Share this story
Next Page of Stories