Everything Brandon Duderstadt said on any show that made the record, most notable first. Each card names its show and opens the statement there.
Duderstadt: No top benchmark AI embedding models release their datasets
“And as far as we're aware, none of the other, you know, top models on any of these benchmarks have gone out and released their data sets.”
Duderstadt: Unequal access from market consolidation is the top AI risk
“What I would say the number one risk of this technology is, which is the sort of unequal access element to it. Like the version of the world that I fear most is like, there's two or three mega companies that like lock everything down in like the early days.”
Duderstadt: New York is a strong candidate for global AI nexus
“If I were to bet on where like the global nexus necessarily would be, like if you're accounting for the fact that like, you know, there are things happening outside of the US, I think New York is a very strong candidate.”
Duderstadt: Nomic's enterprise sales funnel is literally Twitter, Discord, then sales
“Our sales funnel is literally like Twitter to discord to enterprise sale.”
Duderstadt: Training data is almost always the secret sauce of AI models
“The data is often the secret sauce. Like when people talk about like, oh, what is the secret sauce of your AI model? It's almost always the data.”
Duderstadt: Separating classical and generative AI engineers is a false dichotomy
“It's a false dichotomy. Yeah. That's a false dichotomy. You need all the above and it's questionable if that's even like a distinction that should be made.”
Duderstadt: Dataset curation unlocks AI model utility in high-stakes domains
“When you're working in these domains that are, you know, like defense and medicine and finance, where it's like super high impact and you really have a vested interest in your models being right, you start to learn very quickly that a lot of the A lot of the u…”
Duderstadt: GPU scarcity in academia is driving talent flight to industry
“And even nowadays, like, you know, it's increasingly hard to get those GPUs in academic positions. And so it's making increasing amounts of sense for, I think the flight that we're seeing from academia to industry.”
Duderstadt: Spatial scatter plots excel at AI debugging because errors cluster spatially
“What we found is this sort of layout is particularly useful for debugging AI models because their errors tend to pop up in like localized regions of it.”
Duderstadt: Nomic releases Nomic Embed model weights and curated training dataset
“Is we're not just releasing the model weights. We're releasing the data set that Zach spent all of his time curating.”
Duderstadt: Mistral 7B 4-bit fine-tuned on OpenOrca is GPT4All's top model
“I think the most popular model right now is Mistral-Seven-B quantized to four-bit precision fine-tuned on the open ORCA dataset set..”
Duderstadt: Nomic AI hires full-time staff to work on llama.cpp
“We've been able to actually, like, bring staff on full time to work on things like improving lawless CPP.”
Duderstadt: Nomic AI recruits heavily directly from its open-source Discord community
“And also we hire a lot out of open source. And so if people want to get involved, like, you know, we hired Zach out of open source you know, a couple of people that we picked up during the big hiring spree after we raised our A. You know Adam, Aaron Jared. The…”