why aren't all 12 resolved? a statement only gets an assessment when the public
record can support or contradict it. opinions and what-ifs never can, and 0 checkable
ones are still open, waiting for their date. predictions held up or didn't;
assertions are supported or contradicted. on every card:
▮▮▮▮▮ certainty ·
▮▮▮▮▮ debate potential. speakers are clickable
Opinion
Suhail Doshi: Midjourney is currently the best image generation model
“We, you know, we have, everyone has to acknowledge that Midjourney is very good. You know, they're, they are the best at this thing. We would, I would happily, I'm happy to admit that.”
Opinion
Doshi: Image Generative AI Is Stuck in a 'GPT-2 Moment'
“So I think that we continue to feel like graphics and these foundation models for anything really related to pixels, but also definitely images continues to be very under invested. It feels a little like graphics is in like this GPT two moment, right? Like eve…”
Insight
Suhail Doshi: AI builders should benchmark against market leaders, not outdated baselines
“I think it's incumbent on us to try to compare ourselves to the thing that's best, even if we lose. Even if we're not the best. Right. And you know, at some point, if we are able to surpass my journey, then we, you know, we only have ourselves to compare ourse…”
Opinion
Doshi: Fréchet Inception Distance Is a Bad Metric for Image Models
“Fit is generally a bad metric. You know, it's good up to a point, and then it kind of like is irrelevant.”
Opinion
Doshi: Ideogram Bests DALL-E at Text Synthesis in Image Models
“Ideogram has done a good job of maybe the best job. Dolly kind of has like a, it has like a hit rate.”
Disclosure
Doshi: Playground filters NSFW images from training data to ease runtime filtering
“Yeah, I mean, we personally, we filter out NSFW type of images in our dataset, so that it's, you know, so our safety filter stuff doesn't have to work as hard.”
Assertion Contradicted
Doshi Claims Playground AI Was First to Ship LCM Preview Feature
“I think we were the first company to integrate it... I think we were the first company to actually ship a quick LCM thing.”
Assertion Not checkable as stated
Doshi: Playground Users Generate Millions of Images Every Day
“One benefit of Playground is that we have users making millions of images every single day, and so we can just ask them.”
Disclosure
Doshi: Playground AI Plans to Publish an Open Evaluation Benchmark Next Year
“Hopefully next year, I think we will try to publish kind of like a benchmark that anyone could use. That we evaluate ourselves on and that other people can, that we think does a good job of approximating real world performance because we've tried it and done i…”
Disclosure
Playground AI released 256px and 512px pre-trained weights for Playground v2
“And we also gave out pre-trained weights, which is very rare. Usually you just get the aligned model and then you have to like see if you can do anything with it. We actually gave out there's like a two 56 pixel pre-trained stage and a five 12. And we did that…”
Disclosure
Doshi: LoRA Stable Diffusion Creator Simu Works With Playground AI
“The person that brought Laura's to stable diffusion actually works with us on, on some projects. His name is Simu”
Disclosure
Doshi: Playground v2 kept SDXL's exact architecture for tool compatibility
“We kept the playground V two are exactly the same as SD Excel, not because not out of laziness, but just because we wanted, we knew that the community already had tools.”