Madaeni: Non-domain engineers miss battery physical constraints just like LLMs do
Seyed Madaeni · AI for climate: a real world test · Jun 15, 2023 · at 25:34
Energy trading expert Seyed Madaeni discusses why ChatGPT omitted basic physical battery constraints during an algorithmic dispatch coding test.
0:00 / 0:20exact quote · 20.8s
720p mp4 · rendered on demand · StarZero watermark
“Batteries can't charge and discharge at the same time, and it's rather obvious to us, but the same applies if we bring a software engineer out of, as an example, out of Uber, where they've never heard about energy problems, can't distinguish between megawatts and megawatt hours. It's not that they're not smart, it's just they're not being exposed to the problem. They're going to miss that too.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Seyed Madaeni
Madaeni: AI will shift software engineering toward prompting, code review, and QA
“At the end of the day, we're flying a plane that's, we're souping up the autopilot system, but I think we still need pilots. And, you know, a pilot with an autopilot system is a different kind of a pilot. So it's mostly about, I wouldn't say essay writing, but…”
Madaeni: LLMs are not equipped to build and train neural nets for forecasting
“But it's clear that I don't think that LLMs are equipped with, you know, building a whole neural net from scratch and training them and do some form of supervised, unsupervised learning for Forecasting.”
Madaeni: Equivalent battery optimization code manually takes two engineers one month
“Once you want to like grab, put some software foundation, what Duncan has presented today, I would say you need two engineers, more like a backend software engineer and an optimization engineer. And depending on how well they get along with each other, because…”
Madaeni: Building automated energy trading software is a year-long endeavor
“You can come up with something over the course of 12 hours, but trust me, it's going to leave a lot of money and value on the table, or you can actually systematically procure software or build software Which is a, in my view, a year endeavor.”
Madaeni: Full-year vs daily analysis makes no difference for 4-hour battery dispatch
“If the battery had enough, you know, energy to kind of cycle for a couple of days, if we're thinking about long duration storage distinguishing between a full year analysis versus a daily analysis is important, but if your battery has four hours, then it reall…”
Madaeni: Building a production battery dispatch optimizer takes a team one year
“If I think about the initial problem, which takes a year for a souped up team to build and productize, I originally reduced the complexity to 50% by ignoring all of the bidding stuff. And from the 50% that was remaining the insular services are probably like 4…”