Prediction Not checkable as stated
Bostrom: Open-Source Models Will Soon Aid Bio And Chemical Weapons Design
“The open source models will very soon, if not already become capable of lending meaningful assistance to destructive uses that some people might pursue already cyber offensive capabilities has been a concern, right? With mythos, for example, that was withheld …”
Opinion
Bostrom: Current LLMs Arguably Have Higher Ethical Standards Than Most Humans
“Current LLMs, like you're using them as an ordinary person, for the most part, they are helpful, and they try to solve your task that you assign them, or give an answer that is, sometimes they hallucinate, or maybe deceive a little bit, but broadly speaking, t…”
Insight
Bostrom: Accepting some AI existential risk is rational given background perils
“Well, I think whatever we do there will be both existential risks and individual risks. So it's not as if we have a choice between avoiding risks and confronting risks. So it's looking at these different alternatives and weighing up the risks and benefits. And…”
Opinion
Bostrom: Current AI Models Plausibly Possess Forms Of Subjective Experience
“I think it's plausible that some AI models have some forms of subjective experience by now. Obviously there's a lot of uncertainty about this, but it does seem That it is efficiently likely that I think we should start to do some things for the sake of these A…”
Insight
Bostrom: AI slowdown activism creates pressure to abandon open inquiry
“Once you start to engage in activism, then
There is kind of mimetic pressures to simplify our message and to close ranks and to try to beat the people with opposing views down in the marketplace of ideas.
and I think we are seeing some of the beginnings of th…”
Insight
Bostrom: AI Safety Is Now Critical During Pre-Deployment Testing
“From this point onward, probably AI safety is relevant not only for deployment but also during training and evaluation. Like these models might be quite powerful even before they are sort of released to the general public. So that's not the only point at which…”
Opinion
Bostrom: Regulate DNA Synthesis Via Centralized Chokepoints To Mitigate Bio-Risks
“DNA synthesis machines would be one excellent place to maybe, you don't need every lab to have their own DNA synthesis machine. They could have DNA synthesis as a service, and maybe there could be five or six companies worldwide, Or legitimate research labs ca…”
Prediction Not checkable as stated
Bostrom: Weak aligned superintelligence could help align stronger superintelligence
“If you get a kind of weak super intelligence that is For the most part aligned, we might then be able to use that to make a more powerful form of super intelligence that is more reliably aligned.”
Disclosure
Bostrom: AI existential risk assessment remains unchanged over past two years
“I'd say about the same overall. I mean, there's like some disconcerting signs, but also some positive signs advances in, like, some insights are being gained into how these systems work, and how one can steer them, and so forth. So how to tote that all up, I'd…”
Insight
Bostrom: Current Compute Might Suffice For Superintelligence If Algorithmic Bottlenecks Clear
“Turns out there is like some big hobbling that we have unwittingly, like some, something we were doing wrong that just made these systems way less efficient than they could be. And when somebody figures out how to remove that, like maybe the current Compute is…”
Opinion
Bostrom: Humanity Must Prepare For A Potentially Imminent, Rapid AI Takeoff
“I think we have to take seriously both that we might be relatively close, potentially very close and that Once we get there, you really get a very fast takeoff.”
Insight
Bostrom: An AI pause is most effective at the latest possible moment
“The most valuable time for that to happen is at the latest possible moment. Because then you would have the actual system that you're trying to align to work with.”
Insight
Bostrom: Imperfect AI pauses hand initiative to irresponsible actors
“So if the pause only applies to the most responsible actors, for example, then a long pause would remove the initiative from the most responsible AI developers and shift it over to the Less responsible AI developers who decide not to abide by the past”
Insight
Bostrom: Long AI Pauses Risk Creating A Dangerous Hardware Overhang
“Another is that you might with a longer pause start to build up a lot of hardware overhang. It's a like, if we keep building out bigger data centers and chips are getting better than a long pause would result in a situation where you now have such a massive am…”
Prediction Not checkable as stated
Bostrom: AI Will Reach Domain Superintelligence Before Achieving Across-The-Board AGI
“At the point where it is as good as an average human in everything, it might already be super intelligent in some key relevant domains for AI research.”
Assertion Supported
Bostrom: Suppressing Deception In LLMs Increases Likelihood Of Reported Consciousness
“And these studies have been made and any particular, you can go in with a kind of steering vector that suppresses, say deception and role playing. And it turns out when you do that, they become more likely to report that they are conscious and have subjective …”
Assertion Supported
Bostrom: Anthropic research found global workspace structures in large LLMs
“And so there was a recent paper by Anthropic looking at the existence of a kind of global workspace inside these large language models. This is the idea of there being a kind of almost like a stage inside a mind where some small subset of all the information t…”
Opinion
Bostrom: Digital Mind Ethics Rank With AI Alignment And Misuse Risks
“Moral patienthood in digital minds, I think is, is a very important, I would put it up there amongst, so that was the technical alignment problem, big, Important challenge. Like there's the misuse risks of like the governance of AI, like getting that right. Hu…”
Insight
Bostrom: Harms of tech inaction are invisible compared to visible immediate harms
“It's harder to sometimes see the cost of limiting ourselves in all those ways, because the new innovations that would be unlocked are not yet there. Whereas like the pollution is, is there immediately, right? Or the person, like if a self-driving car runs over…”
Prediction Not checkable as stated
Bostrom: Sub-superintelligent AI could enable synthetic biology weapons of mass destruction
“So I think there is like the real X risks, existential risks that will arise as we develop and possibly not even super intelligence, but you could imagine even something short of that, making it very easy to develop new weapons of mass destruction in using syn…”
Opinion
Bostrom: Autonomous agentic AI is a slightly larger risk than human misuse
“Well, I think they are both worth worrying about. I think with the X risks, I mean, maybe a slightly larger on the AI being the kind of agentic part there.”
Insight
Bostrom: Eliminating instrumental work risks human disorientation and purposelessness
“We often define our sense of self-worth on, on the idea of being a contributor. Like you're a breadwinner, or you make like a positive difference in the lives of your friends or of society at large. You're like, you bring value to the world. So much of our exi…”
Prediction Not checkable as stated
Bostrom predicts superintelligence could compress 20,000 years of research into a flash
“So all these sort of science fiction-like technologies that maybe we would develop if we had like, you know, 20,000 years for human scientists to work for it, we probably will have a cure for aging and perfect virtual reality and space colonies and all the res…”
Assertion Not checkable as stated
Bostrom: Open-Source AI Lags Closed Frontier By At Most 6-12 Months
“You would say, you know, six months, 12 months, maybe at the most between the closed wait frontier and available open source model.”