

Hardcover: 272 pages
Publisher: Crown (September 6, 2016)
Language: English
ISBN-10: 0553418815
ISBN-13: 978-0553418811
Product Dimensions: 5.8 x 1 x 8.6 inches
Shipping Weight: 1.6 pounds (View shipping rates and policies)
Average Customer Review: 4.0 out of 5 stars See all reviews (51 customer reviews)
Best Sellers Rank: #409 in Books (See Top 100 in Books) #1 in Books > Business & Money > Education & Reference > Statistics #2 in Books > Science & Math > Mathematics > Applied > Statistics #2 in Books > Science & Math > Technology

A Harvard Mathematics Ph.D., a "Quant" from the most analytical of Hedge Funds, D.E. Shaw and the first author of an O Reilly book on "Doing Data Science"Doing Data Science: Straight Talk from the Frontline, Cathy O'Neil describes some of the most important Biases in Big Data and their Human Consequences. She emphasizes the source of these biases especially in Human Facing Data Science. These include the Opacity of the Algorithms, which affect many areas of our lives including law enforcement, job placement, insurability, susceptibility to advertising, and eligibility for parole; the use of questionable "Proxies"/surrogates for unavailable or illegal to obtain data, the lack of the continuous Feedback to refine algorithms and machine choice (which in contrast to the human-facing decisions that define this books criticisms of big data are very much applied by Google and ).In the process of telling us of the consequences of these biases in the human and social spheres, Dr. O'Neil gives a tour of many of the main areas of Big Data, Data Science and Machine Learning as well some of the avoidable areas of error. The only type of data that she omits from this survey of Big Data error is Data Science and Machine Learning from Sensors, in Industry, Science and Medicine. Certainly this survey of the sources of Error in Big Data and its real Human Consequences is alarming and very much to the point of our increasingly Data-based Society.I would say her report is slightly biased to areas of Liberal Concern and away from the useful sources of Machine Learning and Data Science in Real-Time Refinement of Science and Industry.
I struggled with the star rating for this book. There are certainly aspects of the work that merit five stars. And it is VERY thought-provoking, like a good book should be. But there are flaws, significant ones, with the biggest flaw being a glaring over-simplification of many of the systems that O'Neil decries in the book. I don't know if O'Neil has personally ever had to take a psychology test to get a job, worked under the Kronos scheduling system, lived in a neighborhood with increased police presence due to crime rates, been victimized by insurance rates adjusted to zip codes, and endured corporate wellness programs. But all of those things have been a part of my life for years, and even I have to admit the many positive aspects of some of these systems. A few examples:--Kronos. Despised by the rank and file of companies that I've worked for, Kronos software contains many aspects and automates things that previously were done by people, mostly managers. I hated it, but I have to admit overall it made things more fair. Why? Well, say you have a workplace policy that mandates chronically-late employees be written up for tardiness and eventually fired if they don't shape up. What tended to happen at multiple companies I worked for was that managers would look the other way when their buddies were tardy, and write up people they didn't like. Kronos changed that, because the system automatically generated write-ups for any employee that clocked in late too many times. Kronos has no buddies. Popular, habitually-late people suffered, but it was more "fair" in the true sense of the word. Some systems, like Kronos, have both aspects that level the playing field and aspects (like increased scheduling "efficiency") that can victimize workers. O'Neil tends to harp on the negative only, and if you have not personally seen both sides of system, you might not realize there was another side at all.--Increased police presence in high-crime areas. This one really grated me the wrong way. O'Neil positions this as something that victimizes the poor. Well I have been poor, or at least this country's version of it, and I have lived in very high crime areas where if you didn't shut your window at night chances were good you would hear a murder. And believe me when I say I was DEEPLY grateful for the increased police presence. But then, I wasn't committing crimes. Now I live in a very wealthy neighborhood (though I am not wealthy) where I have not seen a single police car drive down my street in the past four months. O'Neil argues that many crimes, like drug use by affluent college students, go unpunished because the police are busy in the poorer neighborhoods. I agree, but police resources are limited and for mercy's sake they should be sent where people are being killed, not where a college student is passed out in his living room. My current neighbors many be committing as many crimes as O'Neil implies, but I'm not terrified to walk down the street, so I don't mind the lack of police presence. I know officers have to go deal with the more life-threatening stuff, and I am grateful to them. It all depends on your perspective.--Corporate Wellness programs. These programs have never done anything for me except shower me with gift cards and educate me on behavioral sleep therapy. I love them. But, again, perspective. I am not overweight, I love to work out, and I eat healthy. The programs were a source of income for me and my family when we needed it most. I just would have liked acknowledgement that wellness programs really do have benefits for some people, instead of a chapter painting them as some sort of 1984-style nightmare where we are all forced to be thin. It's more complicated than that.--And the best for last: The psychology tests. Those things are pretty bad. Despite winning multiple Employee and Student of the Year awards in my life, I can't pass those tests. Not to save my life. I didn't think much of it, until I heard about another star employee how couldn't pass them either. Then I met a third star employee (and I am talking about an employee who won two JD Power Awards in two years) who couldn't pass them. Why? Picture holding a hundred quarters in your hands and then throwing them at a wall. Some will go off to one side and some to another, but most will probably cluster in the middle. Those tests keep the quarters in the middle, weeding out people who aren't typical. Sometimes that's good (deadbeats) sometimes that's bad (talented employees that think different). Here O'Neil misses an opportunity to convince owners of companies that the tests can cost them highly desirable employees. Offering real, concrete ideas of how the tests could be improved to benefit both workers and company owners would have been a harder book to write, but a much more useful one.A lot of the ominous implications made in the book have to do with what MIGHT happen in the future, if certain systems become more common. O'Neil often uses blanket statements to imply that certain outcomes are inevitable, but that is far from true. Irritate enough people, and the systems change. Legal challenges are made and won. Some companies, eager to lure star workers, throw out some of the more punishing aspects of commonly-used systems (that happened at a company where I worked, where "life-style" scheduling that forbid clopening and gave you two days off in a row was used in conjunction with Kronos. Worked great, people loved it.). The biggest weapon against abuse is, as O'Neil repeatedly states, transparency. Having been in the industry that creates these algorithms, she is in a unique position to expose the finer details of how they work. But the book is short on the kind of details I personally crave and long on blanket statements and generalizations, the same kind of generalizations she denounces companies for making. Not all automated systems victimize the poor, not even the ones spotlighted in this book. I know because I lived them and I was poor.I hovered on the edge of a four star rating for this book, until a chance conversation with a Japanese woman a couple days ago. Her grandmother had lost most of her possessions and land after World War II because of land redistribution. My friend was not complaining, she thought the reforms overall a good thing, though her family had lost a lot from it. "Something may benefit 99 people of of 100," she told me,"but there's always that one person...". Exactly. There's always that one person. These systems that have come to permeate our culture need to be tweaked to minimize injustice. Unlawful algorithms need to be outlawed. Bad ideas need to be replaced with good ones. And Cathy O'Neil does discuss this, especially in the conclusion, but for me the focus of the book wasn't on target. It was too slanted against systems I have seen both harm AND help. It over-simplified issues, at least for me. It's a mess out there, and solutions that work for everyone wickedly hard to come by.Because there's always that one person.GRADE: B-Interesting side-note: In Greek Mythology, "Kronos" is the name of the Titan who devoured his own children. My co-workers always found that hilarious.
This book has a great concept, and the concept itself is probably worth the book alone--namely, statistics and numbers control behavior and rule our lives. A couple examples include the method Facebook puts up advertisements and, also, how the mythical credit score science drives purchasing behavior, terms, and, really, our economy. Add that to the fact this book has a great title...it spoke to me, and if you look at society's numbers in a jaundiced way, I highly recommend this book.
Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy Data Analytics: What Every Business Must Know About Big Data And Data Science (Data Analytics for Business, Predictive Analysis, Big Data) Data Analytics: Practical Data Analysis and Statistical Guide to Transform and Evolve Any Business. Leveraging the Power of Data Analytics, Data ... (Hacking Freedom and Data Driven) (Volume 2) Money: How the Destruction of the Dollar Threatens the Global Economy - and What We Can Do About It Analytics: Data Science, Data Analysis and Predictive Analytics for Business (Algorithms, Business Intelligence, Statistical Analysis, Decision Analysis, Business Analytics, Data Mining, Big Data) Weapons of Mass Destruction and Terrorism (Textbook) Common Sense on Weapons of Mass Destruction Data Science and Big Data Analytics: Discovering, Analyzing, Visualizing and Presenting Data The Miracle Morning for Writers: How to Build a Writing Ritual That Increases Your Impact and Your Income (Before 8AM) Reengineering Human Resources: Achieving Radical Increases in Service Quality--with 50% to 90% Cost and Head Count Reductions Perfect Mothers Get Depressed: Why trying to be perfect, not speaking up, and always trying to please everyone increases your risk of postpartum depression From Big Data to Big Profits: Success with Data and Analytics Big Data in Practice: How 45 Successful Companies Used Big Data Analytics to Deliver Extraordinary Results Web Data Mining: Exploring Hyperlinks, Contents, and Usage Data (Data-Centric Systems and Applications) Data Science for Business: What You Need to Know about Data Mining and Data-Analytic Thinking Onward Muslim Soldiers: How Jihad Still Threatens America and the West The Euro: How a Common Currency Threatens the Future of Europe Thieves of State: Why Corruption Threatens Global Security Deadly Choices: How the Anti-Vaccine Movement Threatens Us All Doubt is Their Product: How Industry's Assault on Science Threatens Your Health