Brightwave uses composable, context-aware prompting conditioned on retrieved context semantics
Mike Conover · How AI is Eating Finance - with Mike Conover of Brightwave · Jun 11, 2024 · at 35:50
Mike Conover, founder of Brightwave, explains how the platform handles private versus public data retrieval in financial AI systems.
0:00 / 0:31exact quote · 31.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“You can have prompts that are composable and that have different sort of command units that like may or may not be present based on the semantics of the content that is being populated into the rag context window. And so that, that's something we make great use of, which is where Where is this being retrieved from? What does it represent? And what should be in the instruction set in order to treat and respect the underlying contents”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Mike Conover
Conover: AI models outclass human working memory, not core reasoning
“It's not clear that you get superhuman reasoning capabilities from human level demonstrations of skill. And by that, I mean the pre-training corpus, but then additionally, the fine tuning corpuses, I think you largely mimic the demonstrations that are present …”
Conover: Million-token context windows fail to extract deep insights from SEC filings
“It, I think empirically is not the case that you can just throw all of the SEC filings in, you know, a million token context window and get deep insight that is useful out the other end.”
Conover: Push-button automated financial modeling misses the core purpose of modeling
“The other piece of this is that the financial modeling is often very, when we talk to our users, it's very personal. So they have a specific view of how a company is structured. They have the, you know, one key driver of asset performance that they think is re…”
Conover: Investment thesis idea generation is absolutely automatable with AI
“I think that process of idea generation is absolutely automatable.”
Conover: AI model developers are absolutely overfitting to public evaluation benchmarks
“And I think the work around over, you know, overfitting on the test, I think is like that. 100% is happening.”
Conover: Economic incentives to pre-train commodity foundation models from scratch are diminishing
“The incentives, the economic incentives for companies to train their own foundation models, I think, are diminishing. So the, like, window in which you are the dominant pre-train, and let's say that you spend five to forty million dollars, you know, for like a…”