Big Tech Is Testing You – The New Yorker
Posted: February 26, 2020 at 4:46 pm
Dr. John Haygarth knew that there was something suspicious about Perkinss Metallic Tractors. Hed heard all the theories about the newly patented medical deviceabout the way flesh reacted to metal, about noxious electrical fluids being expelled from the body. Hed heard that people plagued by rheumatism, pleurisy, and toothache swore the instrument offered them miraculous relief. Even George Washington was said to own a set. But Haygarth, a physician who had pioneered a method of preventing smallpox, sensed a sham. He set out to find the evidence.
The year was 1799, and the Perkins tractors were already an international phenomenon. The device consisted of a pair of metallic rodsrounded on one end and tapering, at the other, to a point. Its inventor, Elisha Perkins, insisted that gently stroking each tractor over the affected area in alternation would draw off the electricity and provide relief. Thousands of sets were sold, for twenty-five dollars each. People were even said to have auctioned off their horses just to get hold of a pair. And, in an era when your alternatives might be bloodletting, leeches, and purging, you could see the appeal.
Haygarth had a pair of dummy tractors created, carved carefully from wood and painted to resemble the originals. They were to be used on five unsuspecting patients at Bath General Hospital, in England, each suffering from chronic rheumatism. Using the lightest of touches, the fakes were drawn over the affected areas, with remarkable results. Four of the five patients declared that their pain was relieved. One reported a tingling sensation that lasted for two hours. Another regained the ability to walk.
The following day, Haygarth repeated his test using the true metallic tractors, with the same results. Other physicians soon followed his lead, using increasingly elaborate fakes of their own: nails, pencils, even old tobacco pipes in place of the tractors. Each brought the truth more clearly into focus: the tractors were no better than make-believe.
This humble experiment wasnt the only one of its kind. By the start of the nineteenth century, experimentation had already driven two centuries of significant changes in science. The Royal Society of London, the scientific academy of which Haygarth was an elected fellow, began insisting that all claims needed to be verified and reproduced before they could be accepted as scientific fact. A shakeup was under way. Astronomy had split off from astrology. Chemistry had become disentangled from alchemy. The motto of the society neatly encapsulated the new spirit of inquiry: Nullius in Verba. Translation: Take nobodys word for it.
Physics, chemistry, and medicine have had their revolution. But now, driven by experimentation, a further transformation is in the air. Thats the argument of The Power of Experiments (M.I.T.), by Michael Luca and MaxH. Bazerman, both professors at the Harvard Business School. When it comes to driving our decisions in a world of data, they say, the age of experiments is only beginning.
In fact, if youve recently used Facebook, browsed Netflix, or run a Google search, you have almost certainly participated in an experiment of some kind. Google alone ran fifteen thousand of them in 2018, involving countless unsuspecting Internet users. We dont want high-level executives discussing whether a blue background or a yellow background will lead to more ad clicks, Hal Varian, Googles chief economist, tells the authors. Why debate this point, since we can simply run an experiment to find out?
Luca and Bazerman focus on a new breed of large-scale social experiments, the power of which has already been demonstrated in the public sector. As they note, governments have used experiments to find better ways to get their citizens to pay taxes on time, say, or to donate organs after death. N.G.O.s have successfully deployed experiments in developing countries to test the effects of everything from tampons to textbooks. The impact of a simple experiment can be dramatic, particularly in monetary terms.
A few years ago, if you searched for eBay on Google, the top two results would take you directly to the auction sites home page. The second one was produced organically by the Google algorithm; the first was an advertisement, paid for by eBay and meant to pop up whenever its name appeared as a keyword in someones search.
Steve Tadelis, a professor of economics at the University of California, Berkeley, was spending a year at eBay at the time, and was suspicious about the value of placing such ads. Wouldnt people get to eBay anyway if they were searching for it, without the sponsored results? But, as Luca and Bazerman recount, eBays marketing group defended the millions of dollars spent on the ads each year, noting that many people who clicked on them ended up buying things on eBay.
An experiment was in order. By turning Google ads on and off, Tadelis and his research team tracked the traffic coming to their site and discovered thatas Tadelis had suspectedmuch of the money eBay had been shelling out was wasted. The marketing team had an exaggerated notion of how valuable those ads were: without the sponsored result, searchers would simply click on the free organic links instead. The company could (and did) save itself millions.
Theres an important point in all of this: instead of going by our possibly unreliable intuition, we can, in a range of cases, know for sure whether an intervention has an effect by running a trial and collecting the evidence. Its a step that Esther Duflo, who shared a Nobel Prize in Economics for her work using experiments to study how global poverty can be alleviated, makes a particularly strong case for. Without gathering and analyzing the evidence, she has said, we are not any better than the medieval doctors and their leeches.
The most reliable way to test an intervention is by using a type of experiment known as a randomized controlled trial (R.C.T.). You randomly assign subjects to groups and then treat each group differently. One group will receive the intervention, while another, the control group, will not. Control here is key. The aim is to make the groups as similar as possible, to constrain as many variables as you can manage, because if the only thing allowed to change freely is the intervention itself you can study its true effect. In the tech world, the intervention might simply be a different Web-page layout or a new pricing plan. Here, the usual term is A/B testing, but the objective is the same: to create some basis for comparison.
Such studies tell you whether something works, though not why. Haygarths experiment wasnt a randomized trial by modern standards, but he nonetheless proved the power of experimenting: by directly comparing the experiences of patients on the day they got treated with the tractors with their experiences on the day they were treated with the fakes, he could show that the tractors were duds. The second set of observations served as a kind of control group.
Without a properly randomized control group, there is no real way to measure whether something is working. Take the case of the Scared Straight program, developed in the United States to discourage at-risk kids from choosing a life of crime. The theory seemed sound. By taking young offenders on organized visits to prison and allowing them to meet murderers and armed robbers, theyd see the terrifying consequences of breaking the law, and be less likely to do so themselves in the future.
Read the original post:
Big Tech Is Testing You - The New Yorker
- What Is a Hormone Doctor? | eHow [Last Updated On: May 4th, 2015] [Originally Added On: May 4th, 2015]
- Learn About Hormone Replacement Therapy [Last Updated On: May 4th, 2015] [Originally Added On: May 4th, 2015]
- Bioidentical Hormone Doctors, Thyroid Disorders, Lyme ... [Last Updated On: May 4th, 2015] [Originally Added On: May 4th, 2015]
- Natural Bioidentical Hormone Replacement Therapy (HRT ... [Last Updated On: May 4th, 2015] [Originally Added On: May 4th, 2015]
- What Is a Hormone Doctor? | eHow StemCell Doctors [Last Updated On: June 4th, 2015] [Originally Added On: June 4th, 2015]
- Hormone Replacement Therapy in NYC | NYC Hormone ... [Last Updated On: June 24th, 2015] [Originally Added On: June 24th, 2015]
- Endocrinology - Wikipedia, the free encyclopedia [Last Updated On: September 21st, 2015] [Originally Added On: September 21st, 2015]
- AAG Health - Hormone Replacement Therapy | HGH & Testosterone [Last Updated On: September 25th, 2015] [Originally Added On: September 25th, 2015]
- Denver Bioidentical Hormone Therapy Clinic - Biovive Medicine [Last Updated On: September 25th, 2015] [Originally Added On: September 25th, 2015]
- Naturopathic Doctor Phoenix | Weight Loss Clinic ... [Last Updated On: September 25th, 2015] [Originally Added On: September 25th, 2015]
- What is an Endocrinologist? What does an Endocrinologist ... [Last Updated On: September 25th, 2015] [Originally Added On: September 25th, 2015]
- HRT | Hormone Replacement Therapy | Testosterone [Last Updated On: September 25th, 2015] [Originally Added On: September 25th, 2015]
- Endocrine disease - Wikipedia, the free encyclopedia [Last Updated On: September 29th, 2015] [Originally Added On: September 29th, 2015]
- Hormone Replacement Therapy - Ideal Physician Weight Loss [Last Updated On: October 21st, 2015] [Originally Added On: October 21st, 2015]
- Hormone Replacement | Fred Bloem, MD Holistic Physician ... [Last Updated On: October 24th, 2015] [Originally Added On: October 24th, 2015]
- How to Find a Bioidentical Hormone Doctor [Last Updated On: November 1st, 2015] [Originally Added On: November 1st, 2015]
- Neal Rouzier, MD The Hormone Doctor [Last Updated On: January 27th, 2016] [Originally Added On: January 27th, 2016]
- Hypothyroidism Diagnosis, Symptoms, and Treatment [Last Updated On: February 2nd, 2016] [Originally Added On: February 2nd, 2016]
- A Natural Progesterone Cream by Resonance Direct [Last Updated On: March 1st, 2016] [Originally Added On: March 1st, 2016]
- Network Of Doctors - Renew Man [Last Updated On: March 21st, 2016] [Originally Added On: March 21st, 2016]
- Dr. Komer, MD - Your Temporary Index [Last Updated On: March 25th, 2016] [Originally Added On: March 25th, 2016]
- Dr. Komer The Komer Clinics - Treatment, Education ... [Last Updated On: March 28th, 2016] [Originally Added On: March 28th, 2016]
- Atlantic Age Management - New Jersey Hormone Doctor ... [Last Updated On: April 3rd, 2016] [Originally Added On: April 3rd, 2016]
- Growth Hormone Treatment [Last Updated On: April 8th, 2016] [Originally Added On: April 8th, 2016]
- Information on Thyroid Disorders | Hormone Health Network [Last Updated On: May 11th, 2016] [Originally Added On: May 11th, 2016]
- Transgender hormone therapy Clinic [Last Updated On: June 8th, 2016] [Originally Added On: June 8th, 2016]
- DIM for Hormone Balance - Healthy by Nature [Last Updated On: June 30th, 2016] [Originally Added On: June 30th, 2016]
- MedHelp - Health community, health information, medical ... [Last Updated On: July 2nd, 2016] [Originally Added On: July 2nd, 2016]
- Hormone Replacement Therapy - WebMD [Last Updated On: July 23rd, 2016] [Originally Added On: July 23rd, 2016]
- Hormone Replacement Therapy Boca Raton - Hormone Doctor ... [Last Updated On: July 23rd, 2016] [Originally Added On: July 23rd, 2016]
- How to Balance Hormones Naturally | Wellness Mama [Last Updated On: July 24th, 2016] [Originally Added On: July 24th, 2016]
- Integrative Medicine Denver | Hormone Replacement Therapy [Last Updated On: August 28th, 2016] [Originally Added On: August 28th, 2016]
- HGH.com - Natural Human Growth Hormone Supplements [Last Updated On: September 5th, 2016] [Originally Added On: September 5th, 2016]
- The Physician Assistant Life - Essay [Last Updated On: September 24th, 2016] [Originally Added On: September 24th, 2016]
- Man vs. Estrogen: It's Not Just A Woman Thing! | Seasons ... [Last Updated On: September 28th, 2016] [Originally Added On: September 28th, 2016]
- Bioidentical Hormones: Dr. John R. Lee's Three Rules for BHRT [Last Updated On: October 5th, 2016] [Originally Added On: October 5th, 2016]
- Endocrinology - Wikipedia [Last Updated On: October 25th, 2016] [Originally Added On: October 25th, 2016]
- TODAY Video - Latest TODAY show clips, news & video ... [Last Updated On: November 11th, 2016] [Originally Added On: November 11th, 2016]
- Hormonal Imbalance Anxiety a Precursor to Other Health ... [Last Updated On: December 7th, 2016] [Originally Added On: December 7th, 2016]
- DIM for Hormone Balance - blog.healthybynaturehwc.com [Last Updated On: December 7th, 2016] [Originally Added On: December 7th, 2016]
- Medicine - Wikipedia [Last Updated On: January 8th, 2017] [Originally Added On: January 8th, 2017]
- Steroid - Wikipedia [Last Updated On: January 8th, 2017] [Originally Added On: January 8th, 2017]
- Thyroid Disease Manager : Diagnosis and Treatment of Graves [Last Updated On: January 13th, 2017] [Originally Added On: January 13th, 2017]
- Dr. Brian Irwin: BPH is a common but uncomfortable disorder - Conway Daily Sun [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Hospital adds doctors at Dove's Landing - Oroville Mercury Register [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Veracyte (VCYT) Enters Agreement with Quest Diagnostics (DGX) to Expand Patient Access to GEC - StreetInsider.com [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Dear Dr. Roach: Elevated calcium level may signal excess hormone - Herald & Review [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Endocrine disease - Wikipedia [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- What causes infertility and how can it be treated? - WRDW-TV [Last Updated On: February 8th, 2017] [Originally Added On: February 8th, 2017]
- Doctor's Tip: What is the safest cookware? - Glenwood Springs Post Independent [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Nonbinary students confront surgery challenges - Yale Daily News (blog) [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Human Growth Hormone - Rejuvalife Vitality Institute [Last Updated On: February 10th, 2017] [Originally Added On: February 10th, 2017]
- Shed pounds to lower the risk - Times of India [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Colorado House panel rejects three GOP abortion bills - The Denver Post [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- Dems defeat anti-choice bills - Pueblo Chieftain [Last Updated On: February 11th, 2017] [Originally Added On: February 11th, 2017]
- People get test results, have more tests done at Live Healthy 2017 Health Fair - Grand Island Independent [Last Updated On: February 12th, 2017] [Originally Added On: February 12th, 2017]
- Physicians' Education Resource Plans Most Impactful Miami ... - PR Web (press release) [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- Windsor doctor penalized for 'reckless' narcotics prescribing - Windsor Star [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- 'Bathroom Bill' is discrimination - Emporia Gazette [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- What's in store: Chronos - bestofneworleans.com [Last Updated On: February 13th, 2017] [Originally Added On: February 13th, 2017]
- A lot of blood, for no reason? Common, costly clot test has few benefits - Knowridge Science Report [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Ask the Doctor: Dizziness, Graves' disease, herbal remedies - WNDU-TV [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- The Thyroid Problem: How you can identify thyroid issues and free your health - Black Hills Pioneer [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- 5 Reasons Real Women Chart Their Menstrual Cycle - Verily [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- Holistic Medicine Doctor in Dever, Colorado | BioViveMD [Last Updated On: February 15th, 2017] [Originally Added On: February 15th, 2017]
- With health care repeal looming, women turn to IUDs and other long-term birth control - Kansas City Star [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Older women reduce their endometrial cancer risk with weight loss - Fox News [Last Updated On: February 17th, 2017] [Originally Added On: February 17th, 2017]
- Chief justice cheers turnout at Longview off-site session - Longview News-Journal [Last Updated On: February 18th, 2017] [Originally Added On: February 18th, 2017]
- What's It Like Getting Health Care As A Black Transgender Person? - BuzzFeed News [Last Updated On: February 19th, 2017] [Originally Added On: February 19th, 2017]
- The Secret Behind Trump's Flowing Locks - eParisExtra.com (blog) [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]
- Family pushes bill expanding medical training in schools - WBIR.com [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]
- Quick fix: Zeman turns last-place Pescara around in 3 days - The Republic [Last Updated On: February 20th, 2017] [Originally Added On: February 20th, 2017]
- Major study finds testosterone therapy is no fountain of youth - Philly.com [Last Updated On: February 21st, 2017] [Originally Added On: February 21st, 2017]
- Perth doctor Amish Dwarka Singh guilty over weight loss, bodybuilding prescriptions - ABC Online [Last Updated On: February 23rd, 2017] [Originally Added On: February 23rd, 2017]
- Introducing Bio-Identical Hormone Replacement Therapy at Young Medical Spa in Center Valley and Lansdale ... - PR Web (press release) [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]
- Is testosterone-replacement therapy good or bad? One man suffering from low levels searches for answers. - Men's Fitness [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]
- Area doctor to launch book on women's health during menopause - Southgate News Herald [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]
- Obesity May Raise Girls' Risk of Asthma, Allergies - WebMD [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]
- Doc: Pill's hormone regulation benefits women with PCOS - The Detroit News [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]
- USMLE Step 1: Postpartum amenorrhea and hormone levels - American Medical Association (blog) [Last Updated On: March 6th, 2017] [Originally Added On: March 6th, 2017]