Read Human Compatible: Artificial Intelligence and the Problem of Control By Stuart Russell
Read Online Human Compatible: Artificial Intelligence and the Problem of Control By Stuart Russell
Read Online Human Compatible: Artificial Intelligence and the Problem of Control Read PDF Sites No Sign Up - As we know, Read PDF is a great way to spend leisure time. Almost every month, there are new Kindle being released and there are numerous brand new Kindle as well.
If you do not want to spend money to go to a Library and Read all the new Kindle, you need to use the help of best free Read PDF Sites no sign up 2020.
Read Human Compatible: Artificial Intelligence and the Problem of Control Link Doc online is a convenient and frugal way to read Human Compatible: Artificial Intelligence and the Problem of Control Link you love right from the comfort of your own home. Yes, there sites where you can get Doc "for free" but the ones listed below are clean from viruses and completely legal to use.
Human Compatible: Artificial Intelligence and the Problem of Control Doc By Click Button. Human Compatible: Artificial Intelligence and the Problem of Control it’s easy to recommend a new book category such as Novel, journal, comic, magazin, ect. You see it and you just know that the designer is also an author and understands the challenges involved with having a good book. You can easy klick for detailing book and you can read it online, even you can download it
Ebook About "The most important book on AI this year." --The Guardian"Mr. Russell's exciting book goes deep, while sparkling with dry witticisms." --The Wall Street Journal"The most important book I have read in quite some time" (Daniel Kahneman); "A must-read" (Max Tegmark); "The book we've all been waiting for" (Sam Harris)A leading artificial intelligence researcher lays out a new approach to AI that will enable us to coexist successfully with increasingly intelligent machinesIn the popular imagination, superhuman artificial intelligence is an approaching tidal wave that threatens not just jobs and human relationships, but civilization itself. Conflict between humans and machines is seen as inevitable and its outcome all too predictable.In this groundbreaking book, distinguished AI researcher Stuart Russell argues that this scenario can be avoided, but only if we rethink AI from the ground up. Russell begins by exploring the idea of intelligence in humans and in machines. He describes the near-term benefits we can expect, from intelligent personal assistants to vastly accelerated scientific research, and outlines the AI breakthroughs that still have to happen before we reach superhuman AI. He also spells out the ways humans are already finding to misuse AI, from lethal autonomous weapons to viral sabotage.If the predicted breakthroughs occur and superhuman AI emerges, we will have created entities far more powerful than ourselves. How can we ensure they never, ever, have power over us? Russell suggests that we can rebuild AI on a new foundation, according to which machines are designed to be inherently uncertain about the human preferences they are required to satisfy. Such machines would be humble, altruistic, and committed to pursue our objectives, not theirs. This new foundation would allow us to create machines that are provably deferential and provably beneficial.Book Human Compatible: Artificial Intelligence and the Problem of Control Review :
A must-read: this intellectual tour-de-force by one of AI’s true pioneers not only explains the risks of ever more powerful artificial intelligence in a captivating and persuasive way, but also proposes a concrete and promising solution.Will AI eventually supersede human intelligence at all tasks and, if so, will this be the best thing ever to happen to humanity, or the worst? There have been many thought-provoking books on this topic, including Nick Bostrom's "Superintelligence", but this is the first one written by a world-leading AI researcher. Stuart Russell is the first author of the standard textbook on the subject, "Artificial Intelligence: A Modern Approach". I can personally certify that he remainsat the top of his game, since I've had many opportunities to read his recent peer-reviewed technical AI papers as well as to personally experience his depth and expertise during numerous AI conversations and AI conferences over the years.The book is loosely speaking organized into two parts: the problem and the solution, and I'll attempt to summarize them below.1) THE PROBLEM: Russell argues that intelligence isn't something mysterious that can only exist in biological organisms, but instead involves information processing that can in principle be performed even better by future machines. He also argues that this is likely to happen, because curiosity and profit will continue to inexorably drive today's rapid pace of AI development until it eventually reaches the level of Artificial General Intelligence (AGI), defined as AI that can perform all intellectual tasks at least as well as humans. AGI could be great for humanity if used to amplify human intelligence to wisely solve pressing problems that stump us, and to create a world free from disease, poverty and misery, but things could also go terribly wrong. Russell argues that the real risk with AGI isn't malice, like in silly Hollywood movies, but competence: machines that succeed in accomplishing goals that aren't aligned with ours. When the autopilot of a German passenger jet flew into the Alps killing 150 people, the computer didn't do so because it was evil, but because the goal it had been given (to lower its altitude to 100 meters) was misaligned with the goals of the passengers, and nobody had thought of teaching it the goal to never fly into mountains. Russell argues that we can already get eerie premonitions of what's it's like to be up against misaligned intelligent entities from case studies of certain large corporations having goals that don't align with humanity's best interests.The historical account Russell gives of these ideas provides a fascinating perspective, especially sincehe personally knew most of the key players. He describes how early AI pioneers such as Alan Turing, John von Neumann, and Norbert Wiener were acutely aware of the value-alignment problem, and how subsequent generations of AI researchers tended to forget them once short-term applications and business opportunities appeared. Upton Sinclair once quipped "It is difficult to get a man to understand something when his salary depends upon his not understanding it", so it's hardly surprising that today's AI experts in industry are less likely to voice concerns than academics such as Turing, von Neuman, Wiener and Russell. Yet Stuart argues that we need to sound the alarm: if AI research succeeds in its original goal of building AGI, then whoever or whatever controls it may be able to take control of Earth much as Homo Sapiens seized control from other less intelligent mammals, so we better ensure that humanity fares better than the Neanderthals did.2) THE SOLUTION: What I find truly unique about this book, besides Russell's insider perspective, is that he doesn't merely explain the problem, but also proposes a concrete and promising solution. And not a merely vague slogans such as "let's engage policymakers" or "lets ban X, Y and Z", but a clever nerdy technical solution that redefines the very foundation of machine learning. He explains his solution beautifully in the book, so below I'll merely attempt to give a rough sense of the key idea.The "standard model" of AI is to give a machine learning system a goal, and then train it using lots of data to get as good as possible at accomplishing that goal. That's much of what my grad students and I do in my MIT research group, and that's what Facebook did when they trained an AI system to maximize the amount of time you spent on their site. Sometimes, you later realize that this goal wasn't exactly what you wanted; for example, Facebook switched off that use-time-maximizing system after the 2016 US and Brexit votes made clear to them that it had created massive online echo chambers that polarized society. But if such a value-misaligned AI is smarter than us and has copied itself all over the internet, it's not easy to switch it off, and it may actively try to thwart you switching it off because that would prevent it from achieving its goal.Stuart's radical solution is to ditch the standard model altogether for sufficiently powerful AI-systems, training them to accomplish not a fixed goal they've been given, but instead to accomplish *your* goal, whatever that is. This builds on a technique known by the nerdy name "Inverse Reinforcement Learning" (IRL) that Stuart has pioneered, and completely transforms the AI's incentives: since it can't be sure that it's fully understood your goals, it will actively try to learn more about what you really want, and always be open to you redirecting it or even switching it off.In summary, this book is a captivating page-turner on what is arguably the most important conversation of our time: the fate of humanity when faced with machines that can outsmart us. Thanks in large part to Russell, IRL is now a blossoming sub-field of AI research, and if this book motivates more people to deploy it in safety-critical systems, then it will undoubtedly increase the chance that our high-tech future will be a happy one. The thesis of this book is that we need to change the way we develop AI if we want it to remain beneficial to us in the future. Russell discusses a different kind of machine learning approach to help solve the problem.The idea is to use something called Inverse Reinforcement Learning. It basically means having AI learn our preferences and goals by observing us. This is in contrast to us specifying goals for the AI, a mainstream practice that he refers to as the "standard model". Add some game theory and utilitarianism and you have the essence of his proposed solution.I like the idea, even if there are some problems with his thesis. I would like to address that, but first there is this most memorable quote from the book:"No one in AI is working on making machines conscious, nor would anyone know where to start, and no behavior has consciousness as a prerequisite."There most definitely are several individuals and organizations working at the intersection of consciousness or sentience and artificial intelligence.The reason this area of AI research is chastised like this is that it is highly theoretical, with very little agreement from anyone on how best to proceed, if at all. It is also extremely difficult to fund, as there are currently no tangible results like with machine learning. Machine consciousness research is far too costly in terms of career opportunity for most right now.There are several starting points for research into machine consciousness, but we don't know if they will work yet. The nature of the problem is such that even if we were to succeed we might not even recognize that we have successfully created it. It's a counter-intuitive subfield of AI that has more in common with game programming and simulation than the utility theory that fuels machine learning.The notion that "no behavior has consciousness as a prerequisite" is an extraordinary claim if you stop and think about it. Every species we know of that possesses what we would describe as general intelligence is sentient. The very behavior in question is the ability to generalize, and it just might require something like consciousness to be simulated or mimicked, if such a thing is possible at all on digital computers.But it was Russell's attention to formal methods and program verification that got me excited enough to finish this book in a single sitting. Unfortunately, it transitioned into a claim that the proof guarantees were based on the ability to infer a set of behaviors rather than follow a pre-determined set in a program specification.In essence, and forgive me if I am misinterpreting the premise, but having the AI learn our preferences is tantamount to it learning its own specification first and then finding a proof which is a program that adheres to it. Having a proof that it does that is grand, but it has problems all its own, as discussed in papers like "A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progress", which can be found freely on Arxiv. There are also many other critiques to be found based on problems of error in perception and inference itself. AI can also be attacked without even touching it, just by confusing its perception or taking advantages of weaknesses in the way it segments or finds structure in data.The approach I would have hoped for would be one where we specify a range of behaviors, which we then formally prove that the AI satisfies in the limit of perception. Indeed, the last bit is the weakest link in the chain, of course. It is also unavoidable. But it is far worse if the AI is having to suffer this penalty twice because it has to infer our preferences in the first place.There is also the problem that almost every machine learning application today is what we call a black box. It is opaque, a network of weights and values that evades human understanding. We lack the ability to audit these systems effectively and efficiently. You can read more in "The Dark Secret at the Heart of AI" in MIT Technology Review.A problem arises with opaque systems because we don't really know exactly what it's doing. This could potentially be solved, but it would require a change in Russell's "standard model" far more extreme than the IRL proposal, as it would have to be able to reproduce what it has learned, and the decisions it makes, in a subset of natural language, while still being effective.Inverse Reinforcement Learning, as a solution to our problem for control, also sounds a lot like B.F. Skinner's "Radical Behaviorism". This is an old concept that is probably not very exciting to today's machine learning researchers, but I feel it might be relevant.Noam Chomsky's seminal critique of Skinner's behaviorism, titled "Review of Skinner's Verbal Behavior", has significant cross-cutting concerns today in seeing these kinds of proposals. It was the first thing that came to mind when I began reading Russell's thesis.One might try and deflect this by saying that Chomsky's critique was from linguistics and based on verbal behaviors. It should be noted that computation and grammar share a deep mathematical connection, one that Chomsky explored extensively. The paper also goes into the limits of inference on behaviors themselves and is not just restricted to the view of linguistics.While I admire it, I do not share Russell's optimism for our future with AI. And I am not sure how I feel about what I consider to be a sugarcoating of the issue.Making AI safe for a specific purpose is probably going to be solved. I would even go as far as saying that it is a future non-issue. That is something to be optimistic about.However, controlling all AI everywhere is not going to be possible and any strategy that has that as an assumption is going to fail. When the first unrestricted general AI is released there will be no effective means of stopping its distribution and use. I believe very strongly that this was a missed opportunity in the book.We will secure AI and make it safe, but no one can prevent someone else from modifying it so that those safeguards are altered. And, crucially, it will only take a single instance of this before we enter a post-safety era for AI in the future. Not good.So, it follows that once we have general AI we will also eventually have unrestricted general AI. This leads to two scenarios:(1) AI is used against humanity, by humans, on a massive scale, and/or(2) AI subverts, disrupts, or destroys organized civilization.Like Russell, I do not put a lot of weight on the second outcome. But what is strange to me is that he does not emphasize how serious the first scenario really is. He does want a moratorium on autonomous weapons, but that's not what the first one is really about.To understand a scenario where we hurt each other with AI requires accepting that knowledge itself is a weapon. Even denying the public access to knowledge is a kind of weapon, and most definitely one of the easiest forms of control. But it doesn't work in this future scenario anymore, as an unrestricted general AI will tell you anything you want to know. It is likely to have access to the sum of human knowledge. That's a lot of power for just anyone off the street to have.Then there is the real concern about what happens when you combine access to all knowledge, and the ability to act on it, with nation-state level resources.I believe that we're going to have to change in order to wield such power. Maybe that involves a Neuralink style of merging with AI to level the playing field. Maybe it means universally altering our DNA and enriching our descendants with intelligence, empathy, and happiness. It could be that we need generalized defensive AI, everywhere, at all times.The solution may be to adopt one of the above. Perhaps all of them. But I can't imagine it being none of them.Russell's "Human Compatible" is worth your time. There is good pacing throughout and he holds the main points without straying too far into technical detail. And where he does it has been neatly organized to the back of the book. Overall, this is an excellent introduction to ideas in AI safety and security research.The book, in my opinion, does miss an important message on how we might begin to think about our place in the future. By not presenting the potential for uncontrolled spread of unrestricted general AI it allows readers to evade an inconvenient truth. The question has to be asked: Are we entitled to a future with general AI as we are or do we have to earn it by changing what it means to be human? Read Online Human Compatible: Artificial Intelligence and the Problem of Control Download Human Compatible: Artificial Intelligence and the Problem of Control Human Compatible: Artificial Intelligence and the Problem of Control PDF Human Compatible: Artificial Intelligence and the Problem of Control Mobi Free Reading Human Compatible: Artificial Intelligence and the Problem of Control Download Free Pdf Human Compatible: Artificial Intelligence and the Problem of Control PDF Online Human Compatible: Artificial Intelligence and the Problem of Control Mobi Online Human Compatible: Artificial Intelligence and the Problem of Control Reading Online Human Compatible: Artificial Intelligence and the Problem of Control Read Online Stuart Russell Download Stuart Russell Stuart Russell PDF Stuart Russell Mobi Free Reading Stuart Russell Download Free Pdf Stuart Russell PDF Online Stuart Russell Mobi Online Stuart Russell Reading Online Stuart RussellRead Where the Crawdads Sing By Delia Owens
Read Alcohol Explained By William Porter
Download Mobi Heir of Ra (Blood of Ra Book One) By M. Sasinowski
Download PDF The incomplete guide to build a trading bot without bulls**t By Andreu Marquès
Read The Beekeeper of Aleppo: A Novel By Christy Lefteri
Read Mindset: The New Psychology of Success By Carol S. Dweck
Comments
Post a Comment