Richard Hamming: You and Your Research (1986)

1986 Mar 7 See all posts
Richard Hamming: You and Your Research (1986) @ Satoshi Nakamoto
Author

Dr. Richard W. Hamming

Email

Site

https://satoshinakamoto.network

Preface

Transcription of the
Bell Communications Research Colloquium Seminar
7 March 1986

J. F. Kaiser [1929–2020]
Bell Communications Research
445 South Street
Morristown, NJ 07962-1910
jfk@bellcore.com

At a semi⁣nar in the Bell Com⁣mu⁣ni⁣ca⁣tions Re⁣search Col⁣lo⁣quia Se⁣ries, Dr. Richard W. Hamming [Mac⁣Tu⁣tor], a Profes⁣sor at the Naval Postgrad⁣u⁣ate School in Monterey, Cal⁣i⁣for⁣nia and a retired Bell Labs scien⁣tist, gave a very in⁣ter⁣est⁣ing and stim⁣u⁣lat⁣ing talk, "You and Your Re⁣search" to an overflow au⁣di⁣ence of some 200 Bell⁣core staff mem⁣bers and vis⁣i⁣tors at the Mor⁣ris Re⁣search and En⁣gi⁣neer⁣ing Cen⁣ter on March 7, 1986.

This talk centered on Ham⁣ming's ob⁣ser⁣va⁣tions and re⁣search on the ques⁣tion "Why do so few sci⁣en⁣tists make sign⁣if⁣i⁣cant con⁣tri⁣bu⁣tions and so many are for⁣got⁣ten in the long run?" From his more than 40 years of ex⁣pe⁣ri⁣ence, 30 of which were at Bell Lab⁣o⁣ra⁣to⁣ries, he has made a num⁣ber of di⁣rect ob⁣ser⁣va⁣tions, asked very pointed ques⁣tions of sci⁣en⁣tists about what, how, and why they did things, stud⁣ied the lives of great sci⁣en⁣tists and great con⁣tri⁣bu⁣tions, and has done in⁣tro⁣spec⁣tion and stud⁣ied the⁣o⁣ries of cre⁣ativ⁣ity.

The talk is about what he has learned in terms of the proper⁣ties of the in⁣di⁣vid⁣ual sci⁣en⁣tists, their abil⁣i⁣ties, traits, work⁣ing habits, at⁣ti⁣tudes, and phi⁣los⁣o⁣phy.

In order to make the information in the talk more widely available, the tape recording that was made of that talk was carefully transcribed [in 1986?]. This transcription includes the discussions which followed in the question and answer period.

As with any talk, the transcribed version suffers from translation as all the inflections of voice and the gestures of the speaker are lost; one must listen to the tape recording to recapture that part of the presentation. While the recording of Richard Hamming's talk was completely intelligible, that of some of the questioner's remarks were not. Where the tape recording was not intelligible I [Kaiser] have added in parentheses my impression of the questioner's remarks. Where there was a question and I could identify the questioner, I have checked with each to ensure the accuracy of my interpretation of their remarks.

Introduction of Dr. Richard W. Hamming

by Alan G.Chynoweth

As a speaker in the Bell Communications Research Colloquium Series, Dr. Richard W. Hamming of the Naval Postgraduate School in Monterey, California, was introduced by Alan G. Chynoweth, Vice President, Applied Research, Bell Communications Research.

Alan G. Chynoweth: Greetings colleagues, and also to many of our former colleagues from Bell Labs who, I understand, are here to be with us today on what I regard as a particularly felicitous occasion. It gives me very great pleasure indeed to introduce to you my old friend and colleague from many many years back, Richard Hamming, or Dick Hamming as he has always been known to all of us.

Dick is one of the all time greats in the mathematics and computer science arenas, as I'm sure the audience here does not need reminding. He received his early education at the Universities of Chicago and Nebraska, and got his Ph.D. at Illinois; he then joined the Los Alamos project during the war. Afterwards, in 1946, he joined Bell Labs. And that is, of course, where I met Dick—when I joined Bell Labs in their physics research organization. In those days, we were in the habit of lunching together as a physics group, and for some reason this strange fellow from mathematics was always pleased to join us. We were always happy to have him with us because he brought so many unorthodox ideas and views. Those lunches were stimulating, I can assure you.

While our professional paths have not been very close over the years, nevertheless I've always recognized Dick in the halls of Bell Labs and have always had tremendous admiration for what he was doing. I think the record speaks for itself. It is too long to go through all the details, but let me point out, for example, that he has written 7 books and of those 7 books which tell of various areas of mathematics and computers and coding and information theory, 3 are already well into their second edition. That is testimony indeed to the prolific output and the stature of Dick Hamming.

I think I last met him—it must have been about 10 years ago—at a rather curious little conference in Dublin, Ireland where we were both speakers. As always, he was tremendously entertaining.

☞ Just one more example of the provocative thoughts that he comes up with: I remember him saying, "There are wavelengths that people cannot see, there are sounds that people cannot hear, and maybe computers have thoughts that people cannot think." Well, with Dick Hamming around, we don't need a computer. I think that we are in for an extremely entertaining talk.

You and Your Research

by Richard Hamming

Contents


It's a pleasure to be here. I doubt if I can live up to the Introduction. The title of my talk is, "You and Your Research." It is not about managing research, it is about how you individually do your research. I could give a talk on the other subject—but it's not, it's about you. I'm not talking about ordinary run-of-the-mill research; I'm talking about great research. And for the sake of describing great research I'll occasionally say Nobel Prize-type of work. It doesn't have to gain the Nobel Prize, but I mean those kinds of things which we perceive are significant things. Relativity, if you want, Shannon's information theory, any number of outstanding theories—that's the kind of thing I'm talking about.

Greatness Origins

Now, how did I come to do this study? At Los Alamos I was brought in to run the computing machines which other people had got going, so those scientists and physicists could get back to business. I saw I was a stooge. I saw that although physically I was the same, they were different. And to put the thing bluntly, I was envious. I wanted to know why they were so different from me. I saw Feynman up close. I saw Fermi and Teller. I saw Oppenheimer. I saw Hans Bethe: he was my boss. I saw quite a few very capable people. I became very interested in the difference between those who do and those who might have done.

When I came to Bell Labs, I came into a very productive department. Bode was the department head at the time; Shannon was there, and there were other people. I continued examining the questions, "Why?" and "What is the difference?" I continued subsequently by reading biographies, autobiographies, asking people questions such as: "How did you come to do this?" I tried to find out what are the differences. And that's what this talk is about.

Ambition

Now, why is this talk important? I think it is important because, as far as I know, each of you has one life to live. Even if you believe in reincarnation it doesn't do you any good from one life to the next! Why shouldn't you do significant things in this one life, however you define sign⁣ificant? I'm not going to define it—you know what I mean. I will talk mainly about science because that is what I have studied. But so far as I know, and I've been told by others, much of what I say applies to many fields. Outstanding work is characterized very much the same way in most fields, but I will confine myself to science.

In order to get at you individually, I must talk in the first person. I have to get you to drop modesty and say to yourself, "Yes, I would like to do first-class work." Our society frowns on people who set out to do really good work. You're not supposed to; luck is supposed to descend on you and you do great things by chance. Well, that's a kind of dumb thing to say. I say, why shouldn't you set out to do something significant. You don't have to tell other people, but shouldn't you say to yourself, "Yes, I would like to do something sign⁣ificant."

In order to get to the second stage, I have to drop modesty and talk in the first person about what I've seen, what I've done, and what I've heard. I'm going to talk about people, some of whom you know, and I trust that when we leave, you won't quote me as saying some of the things I said.

Luck

Let me start not logically, but psychologically. I find that the major objection is that people think great science is done by luck. It's all a matter of luck. Well, consider Einstein. Note how many different things he did that were good. Was it all luck? Wasn't it a little too repetitive? Consider Shannon. He didn't do just information theory. Several years before, he did some other good things and some which are still locked up in the security of cryptography. He did many good things.

You see again and again, that it is more than one thing from a good person. Once in a while a person does only one thing in his whole life, and we'll talk about that later, but a lot of times there is repetition. I claim that luck will not cover everything. And I will cite Pasteur who said, "Luck favors the prepared mind."

And I think that says it the way I believe it. There is indeed an element of luck, and no, there isn't. The prepared mind sooner or later finds something important and does it. So yes, it is luck. The particular thing you do is luck, but that you do something is not.

☞ For example, when I came to Bell Labs, I shared an office for a while with Shannon. At the same time he was doing information theory, I was doing coding theory. It is suspicious that the two of us did it at the same place and at the same time—it was in the atmosphere. And you can say, "Yes, it was luck." On the other hand you can say, "But why of all the people in Bell Labs then were those the two who did it?" Yes, it is partly luck, and partly it is the prepared mind; but ‘partly' is the other thing I'm going to talk about. So, although I'll come back several more times to luck, I want to dispose of this matter of luck as being the sole criterion whether you do great work or not. I claim you have some, but not total, control over it. And I will quote, finally, Newton on the matter. Newton said, "If others would think as hard as I did, then they would get similar results." 1

Independence

One of the characteristics you see, and many people have it including great scientists, is that usually when they were young they had independent thoughts and had the courage to pursue them.

For example, Einstein, somewhere around 12 or 14, asked himself the question, "What would a light wave look like if I went with the velocity of light to look at it?" Now he knew that electromagnetic theory says you cannot have a stationary local maximum. But if he moved along with the velocity of light, he would see a local maximum. He could see a contradiction at the age of 12, 14, or somewhere around there, that everything was not right and that the velocity of light had something peculiar. Is it luck that he finally created special relativity? Early on, he had laid down some of the pieces by thinking of the fragments.2 Now that's the necessary but not sufficient condition. All of these items I will talk about are both luck and not luck.

Intelligence

How about having lots of ‘brains?' It sounds good. Most of you in this room probably have more than enough brains to do first-class work. But great work is something else than mere brains. Brains are measured in various ways. In mathematics, theoretical physics, astrophysics, typically brains correlates to a great extent with the ability to manipulate symbols. And so the typical IQ test is apt to score them fairly high.

On the other hand, in other fields it is something different. For example, Bill Pfann, the fellow who did zone melting, came into my office one day. He had this idea dimly in his mind about what he wanted and he had some equations. It was pretty clear to me that this man didn't know much mathematics and he wasn't really articulate. His problem seemed interesting so I took it home and did a little work. I finally showed him how to run computers so he could compute his own answers. I gave him the power to compute. He went ahead, with negligible recognition from his own department, but ultimately he has collected all the prizes in the field. Once he got well started, his shyness, his awkwardness, his inarticulateness, fell away and he became much more productive in many other ways.3 Certainly he became much more articulate.

So I helped Bill Pfann, taught him how to use the computer, how to get numerical solutions to his problems, and let him have all the machine time he needed. It turned out zone melting was just what we needed to purify materials for transistors, for example, and has proved to be essential in many areas of work. He ended up with all the prizes in the field, much more articulate as his confidence grew, and the other day I found his old lab is now a part of a National Monument! Ability comes in many forms, and on the surface the variety is great; below the surface there are many common elements.

And I can cite another person in the same way. I trust he isn't in the audience, i.e. a fellow named [Albert M.] Clogston. I met him when I was working on a problem with John Pierce's group and I didn't think he had much. I asked my friends who had been with him at school, "Was he like that in graduate school?" "Yes", they replied. Well, I would have fired the fellow, but J. R. Pierce was smart and kept him on. Clogston finally did the Clogston cable.4 After that there was a steady stream of good ideas. One success brought him confidence and courage.

Courage

☞ One of the characteristics of successful scientists is having courage. Once you get your courage up and believe that you can do important problems, then you can. If you think you can't, almost surely you are not going to.

Courage is one of the things that Shannon had supremely. You have only to think of his major theorem. He wants to create a method of coding, but he doesn't know what to do so he makes a random code. Then he is stuck. And then he asks the impossible question, "What would the average random code do?" He then proves that the average code is arbitrarily good, and that therefore there must be at least one good code. Who but a man of infinite courage could have dared to think those thoughts?5

That is the characteristic of great scientists; they have courage. They will go forward under incredible circumstances; they think and continue to think.6

Life-Cycle Effects

Age is another factor which the physicists particularly worry about. They always are saying that you have got to do it when you are young or you will never do it. Einstein did things very early, and all the quantum mechanic fellows were disgustingly young when they did their best work. Most mathematicians, theoretical physicists, and astrophysicists do what we consider their best work when they are young. It is not that they don't do good work in their old age but what we value most is often what they did early. On the other hand, in music, politics and literature, often what we consider their best work was done late. I don't know how whatever field you are in fits this scale, but age has some effect.

But let me say why age seems to have the effect it does. In the first place if you do some good work you will find yourself on all kinds of committees and unable to do any more work. You may find yourself as I saw Brattain when he got a Nobel Prize. The day the prize was announced we all assembled in Arnold Auditorium; all 3 winners [Shockley, Bardeen, & Brattain] got up and made speeches. The third one, Brattain, practically with tears in his eyes, said, "I know about this Nobel-Prize effect and I am not going to let it affect me; I am going to remain good old Walter Brattain." Well, I said to myself, "That is nice." But in a few weeks I saw it was affecting him. Now he could only work on great problems.

Fame and Working Conditions

☞ When you are famous it is hard to work on small problems. This is what did Shannon in. After information theory, what do you do for an encore?

The great scientists often make this error. They fail to continue to plant the little acorns from which the mighty oak trees grow. They try to get the big thing right off. And that isn't the way things go. So that is another reason why you find that when you get early recognition it seems to sterilize you. In fact I will give you my favorite quotation of many years. The Institute for Advanced Study in Princeton, in my opinion, has ruined more good scientists than any institution has created, judged by what they did before they came and judged by what they did after. Not that they weren't good afterwards, but they were superb before they got there and were only good afterwards.7

This brings up the subject, out of order perhaps, of working conditions. What most people think are the best working conditions, are not. Very clearly they are not because people are often most productive when working conditions are bad. One of the better times of the Cambridge Physical Laboratories was when they had practically shacks—they did some of the best physics ever.

Challenge or Opportunity?

I give you a story from my own private life. Early on it became evident to me that Bell Laboratories was not going to give me the conventional acre of programming people to program computing machines in absolute binary [ie. not even assembly language]. It was clear they weren't going to. But that was the way everybody did it. I could go to the West Coast and get a job with the airplane companies without any trouble, but the exciting people were at Bell Labs and the fellows out there in the airplane companies were not. I thought for a long while about, "Did I want to go or not?" and I wondered how I could get the best of two possible worlds.

I finally said to myself, "Hamming, you think the machines can do practically everything. Why can't you make them write programs?" What appeared at first to me as a defect forced me into automatic programming very early. What appears to be a fault, often, by a change of viewpoint, turns out to be one of the greatest assets you can have. But you are not likely to think that when you first look the thing and say, "Gee, I'm never going to get enough programmers, so how can I ever do any great programming?" And there are many other stories of the same kind; Grace Hopper has similar ones.

I think that if you look carefully you will see that often the great scientists, by turning the problem around a bit, changed a defect to an asset. For example, many scientists when they found they couldn't do a problem finally began to study why not. They then turned it around the other way and said, "But of course, this is what it is" and got an important result.

So ideal working conditions are very strange. The ones you want aren't always the best ones for you.

Conscientiousness

☞ Now for the matter of drive. You observe that most great scientists have tremendous drive. I worked for 10 years with John Tukey at Bell Labs. He had tremendous drive. One day about 3 or 4 years after I joined, I discovered that John Tukey was slightly younger than I was. John was a genius and I clearly was not.

Well, I went storming into Bode's office and said, "How can anybody my age know as much as John Tukey does?" He leaned back in his chair, put his hands behind his head, grinned slightly, and said, "You would be surprised Hamming, how much you would know if you worked as hard as he did that many years." I simply slunk out of the office!

☞ What Bode was saying was this: "Knowledge and productivity are like compound interest." Given two people of approximately the same ability and one person who works 10% more than the other, the latter will more than twice outproduce the former. The more you know, the more you learn; the more you learn, the more you can do; the more you can do, the more the opportunity—it is very much like compound interest. I don't want to give you a rate, but it is a very high rate. Given two people with exactly the same ability, the one person who manages day in and day out to get in one more hour of thinking will be tremendously more productive over a lifetime.

I took Bode's remark to heart; I spent a good deal more of my time for some years trying to work a bit harder and I found, in fact, I could get more work done.8 I don't like to say it in front of my wife, but I did sort of neglect her sometimes; I needed to study. You have to neglect things if you intend to get what you want done. There's no question about this.

Work Smarter

On this matter of drive Edison says, "Genius is 99% perspiration and 1% inspiration." He may have been exaggerating, but the idea is that solid work, steadily applied, gets you surprisingly far. The steady application of effort with a little bit more work, intelligently applied is what does it.

That's the trouble; drive, misapplied, doesn't get you anywhere. I've often wondered why so many of my good friends at Bell Labs who worked as hard or harder than I did, didn't have so much to show for it. The misapplication of effort is a very serious matter. Just hard work is not enough—it must be applied sensibly.

Uncertainty

There's another trait on the side which I want to talk about; that trait is ambiguity. It took me a while to discover its importance. Most people like to believe something is or is not true. Great scientists tolerate ambiguity very well. They believe the theory enough to go ahead; they doubt it enough to notice the errors and faults so they can step forward and create the new replacement theory. If you believe too much you'll never notice the flaws; if you doubt too much you won't get started. It requires a lovely balance.

But most great scientists are well aware of why their theories are true and they are also well aware of some slight misfits which don't quite fit and they don't forget it. Darwin writes in his autobiography that he found it necessary to write down every piece of evidence which appeared to contradict his beliefs because otherwise they would disappear from his mind.9 When you find apparent flaws you've got to be sensitive and keep track of those things, and keep an eye out for how they can be explained or how the theory can be changed to fit them. Those are often the great contributions.

Great contributions are rarely done by adding another decimal place. It comes down to an emotional commitment. Most great scientists are completely committed to their problem. Those who don't become committed seldom produce outstanding, first-class work.

Subconscious

Now again, emotional commitment is not enough. It is a necessary condition apparently. And I think I can tell you the reason why. Everybody who has studied creativity is driven finally to saying, "creativity comes out of your subconscious." Somehow, suddenly, there it is. It just appears.

Well, we know very little about the subconscious; but one thing you are pretty well aware of is that your dreams also come out of your subconscious. And you're aware your dreams are, to a fair extent, a reworking of the experiences of the day. If you are deeply immersed and committed to a topic, day after day after day, your subconscious has nothing to do but work on your problem. And so you wake up one morning, or on some afternoon, and there's the answer. For those who don't get committed to their current problem, the subconscious goofs off on other things and doesn't produce the big result.

So the way to manage yourself is that when you have a real important problem you don't let anything else get the center of your attention—you keep your thoughts on the problem. Keep your subconscious starved so it has to work on your problem, so you can sleep peacefully and get the answer in the morning, free.

The Importance of Importance

What are the most important problems in your field, and why aren't you working on them?

Now Alan Chynoweth mentioned that I used to eat at the physics table. I had been eating with the mathematicians and I found out that I already knew a fair amount of mathematics; in fact, I wasn't learning much.10 The physics table was, as he said, an exciting place, but I think he exaggerated on how much I contributed. It was very interesting to listen to Shockley, Brattain, Bardeen, J. B. Johnson, Ken McKay and other people, and I was learning a lot. But unfortunately a Nobel Prize came, and a promotion came, and what was left was the dregs. Nobody wanted what was left. Well, there was no use eating with them!

☞ Over on the other side of the dining hall was a chemistry table. I had worked with one of the fellows, Dave McCall; furthermore he was courting our secretary at the time. I went over and said, "Do you mind if I join you?" They can't say no, so I started eating with them for a while. And I started asking, "What are the important problems of your field?" And after a week or so, "What important problems are you working on?" And after some more time I came in one day and said, "If what you are doing is not important, and if you don't think it is going to lead to something important, why are you at Bell Labs working on it?" I wasn't welcomed after that; I had to find somebody else to eat with! That was in the spring.

☞ In the fall, Dave McCall stopped me in the hall and said, "Hamming, that remark of yours got underneath my skin. I thought about it all summer, i.e. what were the important problems in my field. I haven't changed my research", he says, "but I think it was well worthwhile." And I said, "Thank you, Dave", and went on. I noticed a couple of months later he was made the head of the department. I noticed the other day he was a Member of the National Academy of Engineering. I noticed he has succeeded. I have never heard the names of any of the other fellows at that table mentioned in science and scientific circles. They were unable to ask themselves, "What are the important problems in my field?"

Problems With Attacks

☞ If you do not work on an important problem, it's unlikely you'll do important work. It's perfectly obvious. Great scientists have thought through, in a careful way, a number of important problems in their field, and they keep an eye on wondering how to attack them.11 Let me warn you, ‘important problem' must be phrased carefully. The 3 outstanding problems in physics, in a certain sense, were never worked on while I was at Bell Labs. By important I mean guaranteed a Nobel Prize and any sum of money you want to mention. We didn't work on (1) time travel, (2) teleportation, and (3) antigravity.12

They are not important problems because we do not have an attack. It's not the consequence that makes a problem important, it is that you have a reasonable attack. That is what makes a problem important. When I say that most scientists don't work on important problems, I mean it in that sense. The average scientist, so far as I can make out, spends almost all his time working on problems which he believes will not be important and he also doesn't believe that they will lead to important problems.

I spoke earlier about planting acorns so that oaks will grow. You can't always know exactly where to be, but you can keep active in places where something might happen. And even if you believe that great science is a matter of luck, you can stand on a mountain top where lightning strikes; you don't have to hide in the valley where you're safe. But the average scientist does routine safe work almost all the time and so he (or she) doesn't produce much.

It's that simple. If you want to do great work, you clearly must work on important problems, and you should have an idea. 13

Great Thoughts Fridays

☞ Along those lines at some urging from John Tukey and others, I finally adopted what I called "Great Thoughts Time". When I went to lunch Friday noon, I would only discuss great thoughts after that. By great thoughts I mean ones like: "What will be the role of computers in all of AT&T?", "How will computers change science?"

For example, I came up with the observation at that time that 9⁄10 experiments were done in the lab and one in 10 on the computer. I made a remark to the vice presidents one time, that it would be reversed, i.e. 9⁄10 experiments would be done on the computer and one in 10 in the lab. They knew I was a crazy mathematician and had no sense of reality. I knew they were wrong and they've been proved wrong while I have been proved right. They built laboratories when they didn't need them. I saw that computers were transforming science because I spent a lot of time asking "What will be the impact of computers on science and how can I change it?" I asked myself, "How is it going to change Bell Labs?" I remarked one time, in the same address, that more than one-half of the people at Bell Labs will be interacting closely with computing machines before I leave. Well, you all have terminals now.

I thought hard about where was my field going, where were the opportunities, and what were the important things to do. Let me go there so there is a chance I can do important things.

Seizing Opportunity

Most great scientists know many important problems. They have somewhere between 10 and 20 important problems for which they are looking for an attack. And when they see a new idea come up, one hears them say "Well, that bears on this problem." They drop all the other things and get after it.

Now I can tell you a horror story that was told to me but I can't vouch for the truth of it. I was sitting in an airport talking to a friend of mine from Los Alamos about how it was lucky that the fission experiment occurred over in Europe when it did because that got us working on the atomic bomb here in the US. He said "No; at Berkeley we had gathered a bunch of data; we didn't get around to reducing it because we were building some more equipment, but if we had reduced that data we would have found fission." They had it in their hands and they didn't pursue it. They came in second!

The great scientists, when an opportunity opens up, get after it and they pursue it. They drop all other things. They get rid of other things and they get after an idea because they had already thought the thing through. Their minds are prepared; they see the opportunity and they go after it. Now of course lots of times it doesn't work out, but you don't have to hit many of them to do some great science. It's kind of easy. One of the chief tricks is to live a long time!

Open Door Policy

☞ Another trait, it took me a while to notice. I noticed the following facts about people who work with the door open or the door closed. I notice that if you have the door to your office closed, you get more work done today and tomorrow, and you are more productive than most. But 10 years later somehow you don't know quite know what problems are worth working on; all the hard work you do is sort of tangential in importance. He who works with the door open gets all kinds of interruptions, but he also occasionally gets clues as to what the world is and what might be important.

Now I cannot prove the cause and effect sequence because you might say, "The closed door is symbolic of a closed mind." I don't know. But I can say there is a pretty good correlation between those who work with the doors open and those who ultimately do important things, although people who work with doors closed often work harder. Somehow they seem to work on slightly the wrong thing—not much, but enough that they miss fame.

Solving More General Problems

I want to talk on another topic. It is based on the song which I think many of you know, "It ain't what you do, it's the way that you do it."

I'll start with an example of my own. I was conned into doing on a digital computer, in the absolute binary days, a problem which the best analog computers couldn't do.14 And I was getting an answer. When I thought carefully and said to myself, "You know, Hamming, you're going to have to file a report on this military job; after you spend a lot of money you're going to have to account for it and every analog installation is going to want the report to see if they can't find flaws in it." I was doing the required integration by a rather crummy method, to say the least, but I was getting the answer. And I realized that in truth the problem was not just to get the answer; it was to demonstrate for the first time, and beyond question, that I could beat the analog computer on its own ground with a digital machine.

I reworked the method of solution, created a theory which was nice and elegant, and changed the way we computed the answer; the results were no different. The published report had an elegant method which was later known for years as "Hamming's Method of Integrating Differential Equations". It is somewhat obsolete now, but for a while it was a very good method. By changing the problem slightly, I did important work rather than trivial work.

In the same way, when using the machine up in the attic in the early days,15 I was solving one problem after another after another; a fair number were successful and there were a few failures. I went home one Friday after finishing a problem, and curiously enough I wasn't happy; I was depressed. I could see life being a long sequence of one problem after another after another. After quite a while of thinking I decided, "No, I should be in the mass production of a variable product. I should be concerned with all of next year's problems, not just the one in front of my face." By changing the question I still got the same kind of results or better, but I changed things and did important work. I attacked the major problem—How do I conquer machines and do all of next year's problems when I don't know what they are going to be? How do I prepare for it? How do I do this one so I'll be on top of it? How do I obey Newton's rule? He said, "If I have seen further than others, it is because I've stood on the shoulders of giants." These days we stand on each other's feet!

☞ You should do your job in such a fashion that others can build on top of it, so they will indeed say, "Yes, I've stood on so-and-so's shoulders and I saw further."16 The essence of science is cumulative. By changing a problem slightly you can often do great work rather than merely good work. Instead of attacking isolated problems, I made the resolution that I would never again solve an isolated problem except as characteristic of a class.

Now if you are much of a mathematician you know that the effort to generalize often means that the solution is simple. Often by stopping and saying, "This is the problem he wants but this is characteristic of so-and-so. Yes, I can attack the whole class with a far superior method than the particular one because I was earlier embedded in needless detail." The business of abstraction frequently makes things simple. Furthermore, I filed away the methods and prepared for the future problems.

To end this part, I'll remind you, "It is a poor workman who blames his tools—the good man gets on with the job, given what he's got, and gets the best answer he can." And I suggest that by altering the problem, by looking at the thing differently, you can make a great deal of difference in your final productivity because you can either do it in such a fashion that people can indeed build on what you've done, or you can do it in such a fashion that the next person has to essentially duplicate again what you've done. It isn't just a matter of the job, it's the way you write the report, the way you write the paper, the whole attitude. It's just as easy to do a broad, general job as one very special case. And it's much more satisfying and rewarding!

Selling Science

☞ I have now come down to a topic which is very distasteful; it is not sufficient to do a job, you have to sell it. ‘Selling' to a scientist is an awkward thing to do. It's very ugly; you shouldn't have to do it. The world is supposed to be waiting, and when you do something great, they should rush out and welcome it.

But the fact is everyone is busy with their own work. You must present it so well that they will set aside what they are doing, look at what you've done, read it, and come back and say, "Yes, that was good." I suggest that when you open a journal, as you turn the pages, you ask why you read some articles and not others. You had better write your report so when it is published in the Physical Review, or wherever else you want it, as the readers are turning the pages they won't just turn your pages but they will stop and read yours. If they don't stop and read it, you won't get credit.

There are 3 things you have to do in selling. You have to learn to write clearly and well so that people will read it, you must learn to give reasonably formal talks, and you also must learn to give informal talks. We had a lot of so-called ‘back room scientists'. In a conference, they would keep quiet. 3 weeks later after a decision was made they filed a report saying why you should do so-and-so. Well, it was too late. They would not stand up right in the middle of a hot conference, in the middle of activity, and say, "We should do this for these reasons." You need to master that form of communication as well as prepared speeches.

When I first started, I got practically physically ill while giving a speech, and I was very, very nervous. I realized I either had to learn to give speeches smoothly or I would essentially partially cripple my whole career. The first time IBM asked me to give a speech in New York one evening, I decided I was going to give a really good speech, a speech that was wanted, not a technical one but a broad one, and at the end if they liked it, I'd quietly say, "Any time you want one I'll come in and give you one." As a result, I got a great deal of practice giving speeches to a limited audience and I got over being afraid. Furthermore, I could also then study what methods were effective and what were ineffective.

While going to meetings I had already been studying why some papers are remembered and most are not. The technical person wants to give a highly limited technical talk. Most of the time the audience wants a broad general talk and wants much more survey and background than the speaker is willing to give.17 As a result, many talks are ineffective. The speaker names a topic and suddenly plunges into the details he's solved. Few people in the audience may follow.

You should paint a general picture to say why it's important, and then slowly give a sketch of what was done. Then a larger number of people will say, "Yes, Joe has done that", or "Mary has done that; I really see where it is; yes, Mary really gave a good talk; I understand what Mary has done." The tendency is to give a highly restricted, safe talk; this is usually ineffective. Furthermore, many talks are filled with far too much information. So I say this idea of selling is obvious.

Success Summary

Let me summarize. You've got to work on important problems. I deny that it is all luck, but I admit there is a fair element of luck. I subscribe to Pasteur's "Luck favors the prepared mind."

I favor heavily what I did. Friday afternoons for years—great thoughts only—means that I committed 10% of my time trying to understand the bigger problems in the field, i.e. what was and what was not important.

I found in the early days I had believed ‘this' and yet had spent all week marching in ‘that' direction. It was kind of foolish. If I really believe the action is over there, why do I march in this direction? I either had to change my goal or change what I did. So I changed something I did and I marched in the direction I thought was important. It's that easy.

Bureaucracy

Fake Deadlines

Now you might tell me you haven't got control over what you have to work on. Well, when you first begin, you may not. But once you're moderately successful, there are more people asking for results than you can deliver and you have some power of choice, but not completely.

I'll tell you a story about that, and it bears on the subject of educating your boss. I had a boss named [Sergei] Schelkunoff; he was, and still is, a very good friend of mine. Some military person came to me and demanded some answers by Friday. Well, I had already dedicated my computing resources to reducing data on the fly for a group of scientists; I was knee deep in short, small, important problems. This military person wanted me to solve his problem by the end of the day on Friday. I said, "No, I'll give it to you Monday. I can work on it over the weekend. I'm not going to do it now." He goes down to my boss, Schelkunoff, and Schelkunoff says, "You must run this for him; he's got to have it by Friday." I tell him, "Why do I?"; he says, "You have to." I said, "Fine, Sergei, but you're sitting in your office Friday afternoon catching the late bus home to watch as this fellow walks out that door." I gave the military person the answers late Friday afternoon. I then went to Schelkunoff's office and sat down; as the man goes out I say, "You see, Schelkunoff, this fellow has nothing under his arm; but I gave him the answers." On Monday morning Schelkunoff called him up and said, "Did you come in to work over the weekend?" I could hear, as it were, a pause as the fellow ran through his mind of what was going to happen; but he knew he would have had to sign in, and he'd better not say he had when he hadn't, so he said he hadn't. Ever after that Schelkunoff said, "You set your deadlines; you can change them."

One lesson was sufficient to educate my boss as to why I didn't want to do big jobs that displaced exploratory research and why I was justified in not doing crash jobs which absorb all the research computing facilities. I wanted instead to use the facilities to compute a large number of small problems.

Lobbying

Again, in the early days, I was limited in computing capacity and it was clear, in my area, that a "mathematician had no use for machines." But I needed more machine capacity. Every time I had to tell some scientist in some other area, "No, I can't; I haven't the machine capacity", he complained. I said "Go tell your Vice President that Hamming needs more computing capacity." After a while I could see what was happening up there at the top; many people said to my Vice President, "Your man needs more computing capacity." I got it!

I also did a second thing. When I loaned what little programming power we had to help in the early days of computing, I said, "We are not getting the recognition for our programmers that they deserve. When you publish a paper you will thank that programmer or you aren't getting any more help from me. That programmer is going to be thanked by name; she's worked hard."

I waited a couple of years. I then went through a year of BSTJ articles [the in-house journal Bell Labs Technical Journal] and counted what fraction thanked some programmer. I took it into the boss and said, "That's the central role computing is playing in Bell Labs; if the BSTJ is important, that's how important computing is." He had to give in.

You can educate your bosses. It's a hard job. In this talk I'm only viewing from the bottom up; I'm not viewing from the top down. But I am telling you how you can get what you want in spite of top management. You have to sell your ideas there also.

Is Greatness Worth It?

Well, I now come down to the topic, "Is the effort to be a great scientist worth it?" To answer this, you must ask people. When you get beyond their modesty, most people will say, "Yes, doing really first-class work, and knowing it, is as good as wine, women and song put together", or if it's a woman she says, "It is as good as wine, men and song put together." And if you look at the bosses, they tend to come back or ask for reports, trying to participate in those moments of discovery. They're always in the way. So evidently those who have done it, want to do it again.

But it is a limited survey. I have never dared to go out and ask those who didn't do great work how they felt about the matter. It's a biased sample, but I still think it is worth the struggle. I think it is very definitely worth the struggle to try and do first-class work because the truth is, the value is in the struggle more than it is in the result. The struggle to make something of yourself seems to be worthwhile in itself. The success and fame are sort of dividends, in my opinion. 18

Causes of Failure

I've told you how to do it. It is so easy, so why do so many people, with all their talents, fail? For example, my opinion, to this day, is that there are in the mathematics department at Bell Labs quite a few people far more able and far better endowed than I, but they didn't produce as much. Some of them did produce more than I did; Shannon produced more than I did, and some others produced a lot, but I was highly productive against a lot of other fellows who were better equipped.

Why is it so? What happened to them? Why do so many of the people who have great promise, fail?

Lack of Conscientiousness

Well, one of the reasons is drive and commitment. The people who do great work with less ability but who are committed to it, get more done that those who have great skill and dabble in it, who work during the day and go home and do other things and come back and work the next day. They don't have the deep commitment that is apparently necessary for really first-class work. They turn out lots of good work, but we were talking, remember, about first-class work. There is a difference. Good people, very talented people, almost always turn out good work. We're talking about the outstanding work, the type of work that gets the Nobel Prize and gets recognition.

Inability to Delegate

The second thing is, I think, the problem of personality defects.

Now I'll cite a fellow whom I met out in Irvine. He had been the head of a computing center and he was temporarily on assignment as a special assistant to the president of the university. It was obvious he had a job with a great future.

He took me into his office one time and showed me his method of getting letters done and how he took care of his correspondence. He pointed out how inefficient the secretary was. He kept all his letters stacked around there; he knew where everything was. And he would, on his word processor, get the letter out. He was bragging how marvelous it was and how he could get so much more work done without the secretary's interference.

Well, behind his back, I talked to the secretary. The secretary said, "Of course I can't help him; I don't get his mail. He won't give me the stuff to log in; I don't know where he puts it on the floor. Of course I can't help him."

So I went to him and said, "Look, if you adopt the present method and do what you can do single-handedly, you can go just that far and no farther than you can do single-handedly. If you will learn to work with the system, you can go as far as the system will support you."

And, he never went any further. He had his personality defect of wanting total control and was not willing to recognize that you need the support of the system.

Fighting the System

You find this happening again and again; good scientists will fight the system rather than learn to work with the system and take advantage of all the system has to offer. It has a lot, if you learn how to use it. It takes patience, but you can learn how to use the system pretty well, and you can learn how to get around it. After all, if you want a decision ‘No', you just go to your boss and get a ‘No' easy. If you want to do something, don't ask, do it. Present him with an accomplished fact. Don't give him a chance to tell you ‘No'. But if you want a ‘No', it's easy to get a ‘No'.

Personal Attire

☞ Another personality defect is ego assertion and I'll speak in this case of my own experience. I came from Los Alamos and in the early days I was using a machine in New York at 590 Madison Avenue where we merely rented time. I was still dressing in western clothes, big slash pockets, a bolo and all those things. I vaguely noticed that I was not getting as good service as other people. So I set out to measure. You came in and you waited for your turn; I felt I was not getting a fair deal. I said to myself, "Why? No Vice President at IBM said, ‘Give Hamming a bad time'. It is the secretaries at the bottom who are doing this. When a slot appears, they'll rush to find someone to slip in, but they go out and find somebody else. Now, why? I haven't mistreated them."

Answer, I wasn't dressing the way they felt somebody in that situation should. It came down to just that—I wasn't dressing properly. I had to make the decision—was I going to assert my ego and dress the way I wanted to and have it steadily drain my effort from my professional life, or was I going to appear to conform better? I decided I would make an effort to appear to conform properly. The moment I did, I got much better service. And now, as an old colorful character, I get better service than other people.

You should dress according to the expectations of the audience spoken to. If I am going to give an address at the MIT computer center [MIT Lincoln Laboratory?], I dress with a bolo and an old corduroy jacket or something else. I know enough not to let my clothes, my appearance, my manners get in the way of what I care about. An enormous number of scientists feel they must assert their ego and do their thing their way. They have got to be able to do this, that, or the other thing, and they pay a steady price.

John Tukey almost always dressed very casually. He would go into an important office and it would take a long time before the other fellow realized that this is a first-class man and he had better listen. For a long time John has had to overcome this kind of hostility. It's wasted effort! I didn't say you should conform; I said "The appearance of conforming gets you a long way." If you chose to assert your ego in any number of ways, "I am going to do it my way", you pay a small steady price throughout the whole of your professional career. And this, over a whole lifetime, adds up to an enormous amount of needless trouble.

And I think John Tukey paid a terrible price needlessly. He was a genius anyhow, but I think it would have been far better, and far simpler, had he been willing to conform a little bit instead of ego asserting. He is going to dress the way he wants all of the time. It applies not only to dress but to a thousand other things; people will continue to fight the system. Not that you shouldn't occasionally!

Making Friends

By taking the trouble to tell jokes to the secretaries and being a little friendly, I got superb secretarial help. For instance, one time for some idiot reason all the reproducing services at Murray Hill [ie. the main Bell Labs facility] were tied up. Don't ask me how, but they were. I wanted something done. My secretary called up somebody at Holmdel, hopped the company car, made the hour-long trip down and got it reproduced, and then came back.

It was a payoff for the times I had made an effort to cheer her up, tell her jokes and be friendly; it was that little extra work that later paid off for me. By realizing you have to use the system and studying how to get the system to do your work, you learn how to adapt the system to your desires. Or you can fight it steadily, as a small undeclared war, for the whole of your life.

When they moved the library from the middle of Murray Hill to the far end, a friend of mine put in a request for a bicycle. Well, the organization was not dumb. They waited awhile and sent back a map of the grounds saying, "Will you please indicate on this map what paths you are going to take so we can get an insurance policy covering you." A few more weeks went by. They then asked, "Where are you going to store the bicycle and how will it be locked so we can do so-and-so." He finally realized that of course he was going to be red-taped to death so he gave in. He [Ian Ross?] rose to be the President of Bell Laboratories.

Hills To Die On

Barney Oliver was a good man. He wrote a letter one time to the IEEE. At that time the official shelf space at Bell Labs was so much and the height of the IEEE Proceedings at that time was larger; and since you couldn't change the size of the official shelf space he wrote this letter to the IEEE Publication person saying, "Since so many IEEE members were at Bell Labs and since the official space was so high the journal size should be changed." He sent it for his boss's signature. Back came a carbon with his signature, but he still doesn't know whether the original was sent or not. I am not saying you shouldn't make gestures of reform. I am saying that my study of able people is that they don't get themselves committed to that kind of warfare. They play it a little bit and drop it and get on with their work.

Many a second-rate fellow gets caught up in some little twitting of the system, and carries it through to warfare. He expends his energy in a foolish project. Now you are going to tell me that somebody has to change the system. I agree; somebody has to. Which do you want to be? The person who changes the system or the person who does first-class science? Which person is it that you want to be? Be clear, when you fight the system and struggle with it, what you are doing, how far to go out of amusement, and how much to waste your effort fighting the system. My advice is to let somebody else do it and you get on with becoming a first-class scientist. Very few of you have the ability to both reform the system and become a first-class scientist.

On the other hand, we can't always give in. There are times when a certain amount of rebellion is sensible. I have observed almost all scientists enjoy a certain amount of twitting the system for the sheer love of it. What it comes down to basically is that you cannot be original in one area without having originality in others. Originality is being different. You can't be an original scientist without having some other original characteristics.

But many a scientist has let his quirks in other places make him pay a far higher price than is necessary for the ego satisfaction he or she gets. I'm not against all ego assertion; I'm against some.

Anger, Negativity, & Self-Delusion

Anger. Another fault is anger. Often a scientist becomes angry, and this is no way to handle things. Amusement, yes, anger, no. Anger is misdirected. You should follow and cooperate rather than struggle against the system all the time.

Positivity. Another thing you should look for is the positive side of things instead of the negative. I have already given you several examples, and there are many, many more; how, given the situation, by changing the way I looked at it, I converted what was apparently a defect to an asset. I'll give you another example. I am an egotistical person; there is no doubt about it. I knew that most people who took a sabbatical to write a book, didn't finish it on time. So before I left, I told all my friends that when I come back, that book was going to be done! Yes, I would have it done—I'd have been ashamed to come back without it! I used my ego to make myself behave the way I wanted to.

Arrogance. I bragged about something so I'd have to perform. I found out many times, like a cornered rat in a real trap, I was surprisingly capable. I have found that it paid to say, "Oh yes, I'll get the answer for you Tuesday", not having any idea how to do it. By Sunday night I was really hard thinking on how I was going to deliver by Tuesday. I often put my pride on the line and sometimes I failed, but as I said, like a cornered rat I'm surprised how often I did a good job. I think you need to learn to use yourself. I think you need to know how to convert a situation from one view to another which would increase the chance of success.

Now self-delusion in humans is very, very common. There are enumerable ways of you changing a thing and kidding yourself and making it look some other way. When you ask, "Why didn't you do such-and-such", the person has a thousand alibis. If you look at the history of science, usually these days there are 10 people right there ready, and we pay off for the person who is there first. The other 9 fellows say, "Well, I had the idea but I didn't do it and so on and so on." There are so many alibis. Why weren't you first? Why didn't you do it right? Don't try an alibi. Don't try and kid yourself. You can tell other people all the alibis you want. I don't mind. But to yourself try to be honest.

Harnessing the Defilements

If you really want to be a first-class scientist you need to know yourself, your weaknesses, your strengths, and your bad faults, like my egotism. How can you convert a fault to an asset? How can you convert a situation where you haven't got enough manpower to move into a direction when that's exactly what you need to do?

I say again that I have seen, as I studied the history, the successful scientist changed the viewpoint and what was a defect became an asset.

Failure Summary

In summary, I claim that some of the reasons why so many people who have greatness within their grasp don't succeed are: they don't work on important problems, they don't become emotionally involved, they don't try and change what is difficult to some other situation which is easily done but is still important, and they keep giving themselves alibis why they don't. They keep saying that it is a matter of luck.

I've told you how easy it is; furthermore I've told you how to reform. Therefore, go forth and become great scientists!

(End of the formal part of the talk.)

Discussion: Questions and Answers

(End of the General Research Colloquium Talk.)


Other versions

Paul Graham version: http://www.paulgraham.com/hamming.html

Sam Altman version: https://blog.samaltman.com/you-and-your-research

Gwern.net version: https://gwern.net/doc/science/1986-hamming

Hakcer News discussions: https://news.ycombinator.com/item?id=35778036


Footnotes


  1. This quote appears to be apocryphal. It does not sound at all like Isaac Newton, and I am unable to find any original.

    This may be a distant descendant of more famous quotes about Newton's approach to long-term concentration & visualization, eg. his description:

    I keep the subject constantly before me, and wait 'till the first dawnings open slowly, by little and little, into a full and clear light.

    or Keynes's:

    His peculiar gift was the power of holding continuously in his mind a purely mental problem until he had seen straight through it. I fancy his pre-eminence is due to his muscles of intuition being the strongest and most enduring with which a man has ever been gifted...I believe that Newton could hold a problem in his head for hours and days and weeks until it surrendered to him its secret. Then being a supreme mathematical technician he could dress it up, how you will, for the purposes of exposition, but it was his intuition that was pre-eminently extraordinary.

    ↩︎
  2. Hamming1993:

    Many times a discussion with a person who has just done something important will produce a description of how they were led, almost step by step, to the result. It is usually based on things they had done, or intensely thought about, years ago. You succeed because you have prepared yourself with the necessary background long ago, without, of course, knowing then that it would prove to be a necessary step to success.

    ...Thus, among other things, it was Feynman's energy and his constantly trying new things that made one think he would succeed.

    This trait must be coupled with emotional commitment. Perhaps the ablest mathematician I have watched up close seldom, if ever, seemed to care deeply about the problem he was working on. He has done great deal of first class work, but not of the highest quality. Deep emotional commitment seems to be necessary for success. The reason is obvious. The emotional commitment keeps you thinking about the problem morning, noon and night, and that tends to beat out mere ability.

    While I was at Los Alamos after the war, I got to thinking about the famous Buffon needle problem where you can calculate the probability of a needle tossed at random of crossing one of a series of equally spaced parallel lines. I asked myself if it was essential that the needle be a straight line segment (if I counted multiple crossing)? No. Need the parallel lines be straight? No. Need they be equally spaced or is it only the average density of the lines on the plane?

    Is it surprising that some years later at Bell Labs when I was asked by some metallurgists how to measure the amount of grain boundary on some micro photographs, I simply said, "Count the crossings of a random line of fixed length on the picture?" I was led to it by the previous, careful thought about an interesting, and I thought important, result in probability. The result is not great, but illustrates the mechanisms of preparation and emotional involvement.

    ↩︎
  3. Hamming1997 expansion:

    So I helped Bill Pfann, taught him how to use the computer, how to get numerical solutions to his problems, and let him have all the machine time he needed. It turned out zone melting was just what we needed to purify materials for transistors, for example, and has proved to be essential in many areas of work. He ended up with all the prizes in the field, much more articulate as his confidence grew, and the other day I found his old lab is now a part of a National Monument! Ability comes in many forms, and on the surface the variety is great; below the surface there are many common elements.

    Even longer version in 1995 lecture:

    He wanted to do Zone Melting. With zone melting you have a bar, and you have a coil round it which you heat by induction to melt the metal. You move it down slowly. If the impurities stay in solution you drag the impurities down. If impurities try to drop out, they're pushed out the other side. Many, many passes removed the impurities from the middle of bar.

    He had some equations. I put some algebra on it and some calculus and got some partial answers but I could see that he needed computing. I went around to his department and asked about him. They didn't think much of them. I went back to my office. I thought he had a good idea. I had resolved to work with important people. I wanted to do important work, and work with important people. Here was my chance to contribute to a really good idea, if it were good, but his department didn't think much of him.

    ...that success with Zone Melting was his one great idea, but it was what Bell Labs needed. We needed to be able to make germanium [silicon transistors came later] without very many impurities. Then we needed to be able to put as many [impurities] as we wanted in [to make semiconductors] because if you now take the same zone and drag it down, you can drag down impurities about the density you want in them. You have remarkable control with zone melting. You make a thousand passes or something—that's why you can't do it numerically other than with a computing machine because the thousand passes have end effects and they bounce around.

    So, I was right that time. I guessed the man had something important. I worked with him and I was part of something important.

    ↩︎
  4. NAS: "During his time in the electronics area Al acquired several patents on electronic devices, but his major contribution there was the"Clogston cable", which had a laminated central conductor that much reduced microwave system losses. On the strength of this achievement Al was promoted to department head, and in 1953, in their search for managers knowledgeable in quantum physics, the Bell leadership appointed him department head in the burgeoning area of quantum solid-state physics." (eg. Vaage1953, Morgan1952a/⁣⁣Morgan1952b)↩︎

  5. The Hamming1993 version includes another Shannon anecdote:

    Courage is another attribute of those who do great things. Shannon is a good example. For some time he would come to work at about 10:00am, play chess until about 2:00pm and go home.

    The important point is how he played chess. When attacked he seldom, if ever, defended his position, rather he attacked back. Such a method of playing soon produces a very interrelated board. He would then pause a bit, think and advance his queen saying, "I ain't afraid of nothin'." It took me a while to realize that of course that is why he was able to prove the existence of good coding methods. Who but Shannon would think to average over all random codes and expect to find that the average was close to ideal? I learned from him to say the same to myself when stuck, and on some occasions his approach enabled me to get significant results.

    Without courage you are unlikely to attack important problems with any persistence, and hence not likely to do important things. Courage brings self-confidence, an essential feature of doing difficult things. However, it can border on over-confidence at time which is more of a hindrance than a help.

    1995 lecture:

    Now I'll tell you another story. For about a year, he [Claude Shannon] came in about ten o'clock, played chess till about 2:00, and went home. At the end of year, the company gave him a salary raise. That's all you could see he was doing, but at home he was creating information theory. The way he played chess, is the following...

    When you get attacked in chess you could either defend yourself or you attack back. Shannon never defended himself. He attacked back. And the game would get tied up more, more, more, and more complex. Finally he would stop and think for a long while, grab his Queen, and say, "I ain't scared nuthin". Bing. The whole game would collapse then because he finally precipitated all pending operations and either won or lost. I learned that expression, "I ain't scared of nothing." I've used this several times on myself, when I was stuck and I didn't know what on earth to do. I said it's good for Shannon, it's good enough for Hamming. "I ain't scared of nothing, let's go ahead and see what happens." Sometimes by copying his style I came through to success. I deliberately copied his style.

    And on Hamming himself (Kilbane2011):

    "I always remember, he would come into my office and try to solve a problem", said [Bruce MacLennan, who was also a professor at NPS when Hamming was there]. "I had a very big blackboard, and he'd start on one side, write down some integral, say, ‘I ain't afraid of nothin'‘, and start working on it. So, now, when I start a big problem, I say, 'I ain't afraid of nothin'', and dive into it."

    ↩︎
  6. Hamming1997 and others includes a ‘drunken sailor' discussion here about the value of consistency as opposed to an incoherent random walk:

    The desire for excellence is an essential feature for doing great work. Without such a goal you will tend to wander like a drunken sailor. The sailor takes one step in one direction and the next in some independent direction. As a result the steps tend to cancel each other, and the expected distance from the starting point is proportional to the square root of the number of steps taken. With a vision of excellence, and with the goal of doing significant work, there is tendency for the steps to go in the same direction and thus go a distance proportional to the number of steps taken, which in a lifetime is a large number indeed. As noted before, Chapter 1, the difference between having a vision and not having a vision, is almost everything, and doing excellent work provides a goal which is steady in this world of constant change.

    ↩︎
  7. Hamming1995 amends this criticism slightly by noting some exceptions like John von Neumann:

    You'll have to get a wide feeling for what is going on and the supreme example of this [door] closure is the Institute for Advanced Study in Princeton. They take in people who've done something great, they give them the luxury of a beautiful office, a beautiful restaurant to dine in, wonderful grounds and everything else. They have adequate salary to live on. No cares, no worries, no nothing. You're freed for life of anything at all. What happens? The bulk of them continue working on the problem they made that made them famous. They keep on elaborating on that. They've already made it famous. It doesn't need to be added to. They got the thing going. Rarely do they change.

    von Neumann was different. He was at the Institute and he did go out in reality. He turned up in Washington and in other places. He traveled widely and was receptive of new ideas. But the bulk of the people got to a point the Institute for Advanced Study don't keep the door open on life as it were. They don't do anything comparable to what they had done before. They are very able people but the Institute in my opinion sterilized them a great extent. So what you think are the ideal working conditions, are not.

    Other criticisms include J. Robert Oppenheimer (letter to Frank Oppenheimer1935-01-11, pg 190–192 of Robert Oppenheimer: Letters and Recollections 1980):

    I had a good day at Columbia, but was glad, after talking with him, that you were not committed to Dunning—not a bad egg, but you would not like him. [John R. Dunning was an instructor in physics at Columbia.] Bacher went down & back with me to Princeton, kept talking of the Picasso. Princeton is a madhouse: its solipsistic luminaries shining in separate & helpless desolation. Einstein is completely cuckoo; Dirac was still in Georgia [on vacation?]. I could be of absolutely no use at such a place, but it took a lot of conversation & arm waving to get Weyl to take a no.

    ...Asked years later to comment on the description of Princeton and its solipsistic luminaries, Frank Oppenheimer smiled. "It's a kind of youthful cockiness", he said, "and some of it stayed with my brother a little longer than it should have." [interview with Frank Oppenheimer, April 14, 1976 [by Alice Kimball Smith & Charles Weiner]] Robert [Oppenheimer] expressed a more considered view in a 1939 radio talk celebrating Einstein's 60th birthday, lauding his contributions to science and "those personal qualities that are the counterpart of great work: selflessness, humor, and a deep kindness."38

    Richard Feynman (his Surely You're Joking, Mr. Feynman! draws its title from a stuffy Princeton don) where in "Part 4: From Cornell to Caltech, With a Touch of Brazil", he writes (in part to explain why he turned down a second IAS offer):

    The Dignified Professor: I don't believe I can really do without teaching. The reason is, I have to have something so that when I don't have any ideas and I'm not getting anywhere I can say to myself, "At least I'm living; at least I'm doing something; I'm making some contribution"–it's just psychological.

    When I was at Princeton in the 1940s I could see what happened to those great minds at the Institute for Advanced Study, who had been specially selected for their tremendous brains and were now given this opportunity to sit in this lovely house by the woods there, with no classes to teach, with no obligations whatsoever. These poor bastards could now sit and think clearly all by themselves, OK? So they don't get any ideas for a while: They have every opportunity to do something, and they're not getting any ideas. I believe that in a situation like this a kind of guilt or depression worms inside of you, and you begin to worry about not getting any ideas. And nothing happens. Still no ideas come.

    Nothing happens because there's not enough real activity and challenge: You're not in contact with the experimental guys. You don't have to think how to answer questions from the students. Nothing!...The questions of the students are often the source of new research.

    Freeman Dyson apparently criticized IAS (according to chemist & science writer Ashutosh Jogalekar who knew him):

    With his lack of a PhD and his disdain for a system that forces both students and professors to spend years working on a problem, Dyson the frog clearly realized that he wasn't suited to a conventional academic career. But it also made him reassess what his particular strengths were. His great accomplishment had given him an enviable lifetime appointment at the Institute for Advanced Study in Princeton; Robert Oppenheimer who was the director had himself sung Dyson's praises. For the next seven decades Dyson would become one of the most famous residents of the institute, but even his home institution was not spared from his contrarian take. He always thought the institute was too ivory tower and too much like an alien transplant in America—in contrast Ithaca and Cornell where he had lived before were the real American deal. He also disdained the tribalism among the institute's mathematicians and their successful efforts to shut down John von Neumann's computer project, a project which if it had been supported would have put the IAS on the map in the annals of modern computing.

    ↩︎
  8. The 1995 lecture is more specific about the hard work:

    ...When I was home I thought, "Frankly I am not working really as hard as I could. I'll never be able to work as hard as John does. I haven't got the psychic energy, but I can work a hell of a lot harder than I have been. Let me reorganize my life. Let me quit spending my time and reading nonsense magazines and thumbing through newspapers. They're not very important to my career; let's spend my time studying things in my career. For example, I got appointed very deliberately as a book review editor. There's always a book on my coffee table waiting to be read and reviewed. When a review is written by me, I set it aside for about a week and ask myself afterwards, is that a good review? Does that really digest the book? If it doesn't, you're rereading the book or writing a better review.

    This way I forced myself to get a lot wider acquaintance in computer science. Being a book review editor, I got to review the books I wanted. This was a device. Now it's true I quit reading The New Yorker. I quit reading magazines. My wife complained occasionally that all I looked in at The New Yorker were the jokes. She was right. I didn't have time to do everything. I wasn't a first-class genius. I had to work hard. So I simply set aside other things and did that. It's not hard to do. You just do it.

    ↩︎
  9. The passage:

    I had, also, during many years followed a golden rule, namely, that whenever a published fact, a new observation or thought came across me, which was opposed to my general results, to make a memorandum of it without fail and at once; for I had found by experience that such facts and thoughts were far more apt to escape from the memory than favourable ones. Owing to this habit, very few objections were raised against my views which I had not at least noticed and attempted to answer.

    ↩︎
  10. The later 1995 lecture offers a ruder account of "wasn't learning much":

    Another example, I hope most [of these] people are dead, I guess they aren't but they probably won't hear this. I was in a math department and we used to go to lunch together. They played games, threw boomerangs, flew kites, and played this-and-that and they'd fiddle around. I wanted to succeed, and I said to myself, "I can't afford to waste lunch time", so I went around to the physics table where I'd written a paper with one of the physicists [on nuclear magnetic resonance] and asked if I could join them.

    ↩︎
  11. Cf. Rota's "Feynman method". 1995 lecture version:

    When you're learning things, I told you that you need to put hooks on ideas so they can be recovered widely. That was the thing that John Tukey could do and I couldn't for so long. He could dredge up almost any kind of information. After he told me, I could see the what he said was true but I couldn't think of it first. So I started doing what he did. When I got new piece of information, I turned it around many ways until it was connected with many pieces of information so that in various situations that idea would become available, and it has worked out fairly well.

    You're likely to saying to yourself, "you haven't got the freedom to work." I didn't either when I began. I had to do more with less respect. When you hire a plumber to fix the plumbing, you expect them to be already trained. You expect them to be able. You don't give a person a big lovely chance to do something great when they have not already demonstrated greatness. The onus is on you to demonstrate greatness and then you'll get the opportunities. It's not the other way around. It was beautifully put by an instructor when I was at Nebraska: the instructor went to the head of the Department and said "I want to be relieved of some teaching so I can do some research." The Department head said, "when you've done the research, I'll relieve you of the teaching." You have to demonstrate your ability first and then you'll have the freedom to do it. Otherwise, no—I had to do error correcting codes at home on my own time. After I became more able, management left me alone. In fact, the management clearly had to believe the more we left Hamming alone the more he'd worry about what should be done, the more likely he's going to do the right thing. That applied to a guy like Hamming who had a conscience and was worried. It doesn't apply to some people. Some people, you give them freedom, they'll do nothing. But I was compulsive and I was worried about doing a great job, so I did.

    ↩︎
  12. Hamming1993 adds in Einstein's quest for a unified theory as a cautionary example:

    You are aware that frequently more than one person starts working on the same problem at about the same time. In biology, both Darwin and Wallace had the idea of evolution at about the same time. In the area of special relativity, many people besides Einstein were working on it, including Poincaré. However, Einstein worked on the idea in the right way.

    The first person to produce definitive results generally gets all the credit. Those who come in second are soon forgotten. Thus working on the problem at the right time is essential. Einstein tried to find a unified theory, spent most of his later life on it, and died in a hospital still working on it with no significant results. Apparently, he attacked the problem too early, or perhaps it was the wrong problem.

    There are a pair of errors that are often made when working on what you think is the right problem at the right time. One is to give up too soon, and the other is to persist and never get any results. The second is quite common. Obviously, if you start on a wrong problem and refuse to give up, you are automatically condemned to waste the rest of your life (see Einstein above). Knowing when you persist is not easy—if you are wrong then you are stubborn; but if you turn out to be right, then you are strong willed.

    ↩︎
  13. "Ed Boyden on Minding your Brain (Ep. 64)":

    BOYDEN: ...One idea is, how do we find the diamonds in the rough, the big ideas but they're kind of hidden in plain sight? I think we see this a lot. Machine learning, deep learning, is one of the hot topics of our time, but a lot of the math was worked out decades ago—backpropagation, for example, in the 1980s and 1990s. What has changed since then is, no doubt, some improvements in the mathematics, but largely, I think we'd all agree, better compute power and a lot more data.

    So how could we find the treasure that's hiding in plain sight? One of the ideas is to have sort of a SWAT team of people who go around looking for how to connect the dots all day long in these serendipitous ways.

    ...COWEN: Two last questions. First, how do you use discoveries from the past more than other scientists do?

    BOYDEN: One way to think of it is that, if a scientific topic is really popular and everybody's doing it, then I don't need to be part of that. What's the benefit of being the 100,000th person working on something?

    So I read a lot of old papers. I read a lot of things that might be forgotten because I think that there's a lot of treasure hiding in plain sight. As we discussed earlier, optogenetics and expansion microscopy both begin from papers from other fields, some of which are quite old and which mostly had been ignored by other people.

    I sometimes practice what I call ‘failure rebooting'. We tried something, or somebody else tried something, and it didn't work. But you know what? Something happened that made the world different. Maybe somebody found a new gene. Maybe computers are faster. Maybe some other discovery from left field has changed how we think about things. And you know what? That old failed idea might be ready for prime time.

    With optogenetics, people were trying to control brain cells with light going back to 1971. I was actually reading some earlier papers. There were people playing around with controlling brain cells with light going back to the 1940s. What is different? Well, this class of molecules that we put into neurons hadn't been discovered yet.

    ↩︎
  14. 1995 lecture:

    Another example is slightly different. When I was doing this 28 simultaneous [first order differential] equation I told you about the Navy intercept plane, I was solving it on a digital machine because the analog machine outside of Philadelphia couldn't do the job. No analogue machine at that time could do it because they didn't have the required accuracy.

    I was using a variation of Mill's method which was pretty crummy. I'd found Mill's method was unstable and had patched it up a little bit. One day I realized I was going to have to fill in a report of what I did because government contracts always require reports. Everybody who had analog computers was going to try and pick flaws and what I did because I was really showing that a digital machine could beat the analog on his own home ground. That's really what I was doing, not getting the answer a problem. I was really demonstrating something much more important.

    I promptly started deriving a better method of integrating the differential equations. I finally used a method which for some years was known as "Hamming's method". I don't recommend it now but it was very suitable for the machines as they were.

    So I had the girl programmer change a few of the instructions, run a trajectory once more to check the new program got the same as the old answers, and then went ahead. Thus, this report has a very jazzy method of solving differential equation instead of a very crummy method. Both are equally effective, but one was defensible and one was not.

    I changed the nature of the problem. I saw that the problem although originally was, "Get the answers of these trajectories." In fact, it was something else. It was proving that a digital machine could beat the analog machine on its own home ground of differential equations. I redefined the problem and made it a success.

    I would not have found the Hamming method if I had not realized that the method I was using which was adequate for me and we were all going to see if we're getting right answer, but it was not nice. It was not clean and as simple. It was rather ugly. So I changed the problem.

    ↩︎
  15. I am not sure what this refers to; my best guess is that it refers to the development of UNIX, given A. Michael Noll's memoir where he notes of the Murray Hill building that (emphasis added):

    ...Bell Labs believed that time-shared computing was the future. A project was initiated to create a time-shared computer facility with terminals in laboratories. It was believed that IBM was not up to the challenge, and therefore a project, named MULTICS (Multiplexed Information and Computing Service), was initiated, with GE to supply the computer hardware (GE 645), MIT the system software, and BTL [Bell Telephone Laboratories] the systems integration. The MULTICS project was initiated around 1964. Although GE had not up-to-then made a large mainframe machine, it did deliver its GE-645 to Bell Labs as a replacement for the IBM 7094.

    It became apparent that the system overhead for time-shared computing was substantial, and the project seemed doomed to failure. BTL abandoned its involvement around 1969. IBM then supplied its IBM-360 mainframe computer to BTL to replace the GE machine. The failure of MULTICS ultimately led to Unix and C. I recall the software researchers working in the attic of Building 2 on what would become the Unix operating system—from failure came a great success. The Executive Director of computing research was Edward E. David Junior In 1970, he left BTL to become Science Advisor to President Nixon. I would leave Bell Labs to join his staff in mid-1971.

    My department head, Peter B. Denes, wisely doubted that a single central computer would be able to serve hundreds of research labs. Around 1965, he therefore obtained his own dedicated laboratory computer; initially a DDP-124 that was then upgraded to a DDP-224 (initially made by the Computer Control Company and later Honeywell). The computer system was primarily used for speech research, but was also used for computer music by Max V. Mathews and various visiting composers, such as Emmanuel Ghent and Laurie Spiegel. The lab in which it was used had a raised floor for all the cables. There was a large hard disk drive with removable disk packs; a head crash was a disaster, destroying the disks and generating a horrible screech and odor.

    ↩︎
  16. Hamming1997:

    Again, you should do your job in such a fashion others can build on top of it. Do not in the process try to make yourself indispensable; if you do then you cannot be promoted because you will be the only one who can do what you are now doing! I have seen a number of times where this clinging to the exclusive rights to the idea has in the long run done much harm to the individual and to the organization. If you are to get recognition then others must use your results, adopt, adapt, extend, and elaborate them, and in the process give you credit for it. I have long held the attitude of telling every one freely of my ideas, and in my long career I have had only one important idea "stolen" by another person. I have found people are remarkably honest if you are in your turn.

    ↩︎
  17. cf. "Explainers Shoot High. Aim Low!"↩︎

  18. 1995 lecture expansion:

    Well, let me come down now to a saying of Socrates, who lived about 470–399 BC and in Greece. He said, "the unexamined life is not worth living." I heard it while I was crossed first time I heard while crossing the campus at Yale behind a professor and a student, before we could turn, the student again said "the unexamined life is not worth living.", and before we crossed the whole quad, he recited three times "the unexamined life is not worth living".

    You should examine your life. You've only got one life to lead as far as any of us know. Why shouldn't it be the life you want to have instead of whatever happens to you? To come down the back end and say, "Well, I didn't do any harm, I had an enjoyable life"—is that what you want to say your old age? You just had a good time in life? Or do you want to say, you know, "I did something was important at least something that I thought was important."

    That's your problem therefore, to pick these things up and do it, if you want to have a happy life in the back end.

    ↩︎
  19. I agree: Shannon did his best work when forced to publish, and tenure simply freed him to not publish anything (even though he had a great deal of interesting things he could've published, and some trickled out anyway).↩︎