Superintelligence

“I I've read too much Nick Bostrom to be able to No matter what, it's kind of like your first relationship, you know, you get into a relationship and your first relationship is with an and you're like, "God, I I I For the remainder of time, I've been pattern matched that every relationship is at least going to be”

“I had Nick Bostrom on the show and Superintelligence 10 more more than 10 years ago now 2014 15 something like that when that came out was kind of my introduction to holy [ __ ] like there are a lot of ways that this could go very very wrong”

“So, I've been concerned I read Superintelligence 2017.”

“And I think my first introduction to this was probably 2016 or 17 when I read Super Intelligence by Nick Bostonramm.”

“Do you see Nick Bostrom's new book Deep Utopia? Have not seen the new book, but I have read Superintelligence. Yeah, I read Superintelligence way back.”

“I was obsessed by it for a while when I first read Superintelligence by Nick Bostrom and now I've got all of the market in the world to talk about this with and um yeah, I'm going to have Tristan Harris...”

“I was like the early drafts of Nick bostom super intelligence I was part of these seminar rooms”

“read super intelligence by nick bostrom or probably audible it because the the book is a little bit of a heavy meal”

“So it's someone that's read Superintelligence by Nick Bostrom and then Bostrom must have like consulted for it. Yeah, well, either that or they've read the book because they talk about recursive ­ self-improvement, they talk about intelligence explosions, they talk about ­ whole brain emulation.”

“I'm big into existential risk and if superintelligent AGI, a misaligned one, Stuart Russell's human compatible, he doesn't need to worry and Toby Ord, he doesn't need to worry at least for a little bit of his work and Nick Bostrom wrote Superintelligence basically just as a a fiction book for us all to have a look at.”

“um super intelligence fantastic”

“yeah i mean i read super intelligence which is kind of i guess the seminal book on this at least it was in the mid to 2015's”

“i gotta give you another another thing uh that i've recently come across from stuart russell's human compatible which is about the control problem for artificial general intelligence very similar to super intelligence by nick bostrom or the precipice by toby ord if you're into existential risk”

“and kind of sad it is melancholy isn't it like when i find myself i find myself feeling sort of very melancholic after i read stuff like super intelligence by nick bostrom or uh the precipice by toby ort”

“and this is the fear if anyone who's read super intelligence by nick bostrom which is an unbelievable book about the take off of artificial intelligence”

“Mhm. And that the my point here is we've got this is when it's going to happen, artificial general intelligence, you know, this is what's super intelligence, which is one of my favorite books and everyone who's listening you really, really wants to kind of get a good grasp of how artificial general intelligence might come about should read Superintelligence”

“one of the things that I'm thinking about straight off the bat having read super intelligence by Nick Bostrom listeners of the show will know that I found the book both testing and very very fascinating”

“have you read super intelligence by Nick Bostrom not yet it's a good highly highly recommended you know Nick is prefer the head of the future of humanities Institute”

“the same way as I read super intelligence by Nick Bostrom and now I want to know I'm super excited to see what happens I'm terrified about what might happen with AI”

“do you think I mean this is why the book super intelligence say is separate from its own but if you promise me this the time a man start tagging up and said no you are basically the the sentence that you just said”

“because if this thing wipes us out the you know I think it's um Nick Bostrom the philosopher who wrote a great book on this entitled super intelligence I think he calls this the the Disneyland without children”

“He talks about a paperclip maximizer. You could, you could build a super intelligent paperclip maximizer now, not that anyone would do this.”

“there's a great book if if you really want to get into this is the book by the philosopher Nick Bostrom uh and he actually might have been the one who convinced Elon this is such a problem”

“nick bostrom super intelligence it's an awesome book it's an awesome book but he just points out that by the time a super intelligence if one gets created via technology”

“if you read boston i'm sure you have you know bostrom nick bostrom you know super intelligence that incredible book on like the ways this thing is going to happen”

“And so back when I started working on the first book, “Superintelligence,” I began writing on that in 2008.”

“No, I think that’s important to clarify. I think so there is this chapter in superintelligence that the earlier book where I consider different possible paths that might result in superintelligence.”

“yeah well not specifically on the simulation argument there the article is online just Google it simulation argument you'll find it um but if you want to read a book about the future of AI and stuff um then Super intelligence would be the one I would point to”

“so you know if you read boston i'm sure you have you know bostrom nick bostrom”

“But you know, if you read Nick Bostrom—I’m sure you have—Nick Bostrom, you know, Superintelligence—it’s that incredible book on the ways this thing is going to happen.”

“Yeah so when Nick Bostrom and Oxford philosopher uh published super intelligence which is a great book another must read”

“this is the fear if anyone who's read super intelligence by nick bostrom which is an unbelievable book about the take off of artificial intelligence”

“This is what Bostonramm said like to to put into perspective. It's a great book. Super intelligence. Have you read that book? It's so good.”

“I mean his book super intelligence you know it's it's quite chilling”

“We interviewed uh we That's the royal we. I interviewed Nicklaus Bostrom back in 2014. I read his book Superintelligence. I found it uncompelling.”

“i interviewed Nick Foster a minute uh on his book super intelligence which i found uh unconvincing”

“the book that got the doomers all spun up I love pointing the this out the book that got the doomers all spun up was this uh book uh from 10 years ago by this guy Nick Bostrom is a philosopher um from Oxford um um and uh he wrote this book called Super intelligence”

“So the book Super Intelligence, right, which is like the Nick Bostrom's book, which is like the origin of a lot of this stuff, which was written, you know, whatever, 10 years ago or something.”

“There is the super intelligence problem. Yeah. You know, and I think a lot of this comes from like Bodstrom 2014 super intelligence book.”

“So Elon. You know, famously read a lot of Nick Bostrom is, as I can have an adjacent figure to the rationality community.”

“i sort of think of books like super intelligence as um a kind of cosmic you know breaking the glass and pulling the fire alarm”

“put in its most Magisterial form by Nick in his book super intelligence which is essentially sees a combination and it's just the combination of Moore's law ie exponential increase in computer processing power together with recursively self-improving software based AI”

“I think that Nick Boston wrote this book, Super Intelligence, that scared the hell out of Elon.”

“Nick Bostrom's book Super Intelligence was definitely a very good book explaining a lot of those concepts more recently there is a popular book from Nate Soros if anyone builds it everyone will die”

“So he did his second book which is kind of like a spiritual sequel to super intelligence. What if things go wrong? And then the next one was what if things go right?”

“he got really into Nick Bostonramm's super intelligence this book in 2012. I love it. It's good book.”

“It's an AI philosophy problem first proposed by Nick Bostonramm about basically how paper clips can cause the end of the world.”

“Nick Bostrom wrote this book about superintelligence. His the beginning analogy to the book is like imagine there's some sparrows and they find the egg of an owl.”

“when Nick Bowm wrote super intelligence was what 2014 and you know listen he was talking about this platonic ideal of AI and this platonic ideal of AI just happened to be able to recursively self-improve and just happened to like have these kind of like super physical things that like no AI today has.”

“so so as as i understand it that uh for example i read boston's book and a bunch of other reading material about this sort of general way of thinking about the world”

“have you read super intelligence by Nick Bostrom twice cover to cover”

“and for me also I remembered your book super intelligence which all of these got people thinking as any good philosopher should do is to get people thinking and so C”

“and one was um Nick Bostrom Oxford Prof who wrote This Book uh super intelligence 2014 and it was basically AI was going to be this super duper um intelligent thing”

“and these questions from nick bostrom and the other guys at the future of humanities institute have been something i've really enjoyed thinking about ever since i read super intelligence”

“I know we talked already about practical ethics by Peter Singer and then Super intelligence by Nick Bostrom last time”

“I mean, Bostrom wrote about this early early days. And what people are most worried about in AI is you take the same system”

“do you think I mean this is why the book super intelligence say is separate from its own”