synthetic data

“I think I'm not that worried about Coming up with data and I feel like we could probably like just generate some more with the AI.”

“Whereas like with vision, at least you can like make a robot that just like travels down the street and like just keeps taking pictures of everything. You can get like infinite training data with vision, but it might be trickier to like sort of filter and clea…”

“The number of cheap available tokens on the internet we have used, and now we have to go figure out how to go get more, collect more in the world, or more likely, like, you know or in combination with generating synthetic data. That still feels like a bits not…”

“So I think basically synthetic data is absolutely the future. We're not going to run out of data, is my impression. I just think you have to be careful.”

“When we're generating synthetic data there is the only scalable path is really reinforcement learning.”

“Like we use it like a ton ourselves in order to supplement what the humans do.”

“I think one of the things that people really underestimate is how it is, how complicated it is that you can't just synthetically generate it.”