large language model

“I have generally been a bit more skeptical than most, I think, that it would change, fundamentally change at least, the things that I spend my professional time on, which is to say climate tech and energy.”

“A persistent issue in the electricity industry for as long as I've been doing this job is utility tariffs, right? Every utility has some 700 page document that outlines massive The complex nuances of how users will pay for electricity. And we're talking about …”

“Training a large language model is a far better manifestation of that trade where, you know, you can move data across subsea cables to get to a data center based in Iceland. You can run your back propagation and large scale pre-training on significant amounts …”

“Every smaller distilled LLM that is power efficient doing inference is going to launch thousands of queries to bigger, more capable models that can actually reason their way through buying something on Amazon and reason. So it's almost like increasing the worl…”

“When you send a prompt to for processing by a large language model, that prompt is probably handled by one GPU or maybe Eight GPUs inside a single machine. So, and the reason that is, is because the model sits in that machine, the data sits in that machine, an…”

“It, it's, it, a large language model and its training and inference phases are completely opaque. You can't say, why did you give me this solution versus this one? And if I just change a variable slightly, what will be the outcome? Non-reproducible results, no…”