Madaeni: Engineers with both backend software and optimization expertise are extremely rare
Seyed Madaeni · AI for climate: a real world test · Jun 15, 2023 · at 51:41
Energy trading expert Seyed Madaeni reviews code generated by ChatGPT for wholesale battery storage dispatch optimization.
0:00 / 0:28exact quote · 28.5s
720p mp4 · rendered on demand · StarZero watermark
“Software engineers do a lot of the back-end data engineering, post-processing of results, putting it in the architecture. That's why you go and hire optimization engineers, people with OR backgrounds and math models that can write Optimization level software. Now, I'm looking at this, and I'm realizing, who's this unicorn that not only does back-end stuff, but it's also doing optimization stuff. And literally, those are very hard people to find.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Seyed Madaeni
Madaeni: AI will shift software engineering toward prompting, code review, and QA
“At the end of the day, we're flying a plane that's, we're souping up the autopilot system, but I think we still need pilots. And, you know, a pilot with an autopilot system is a different kind of a pilot. So it's mostly about, I wouldn't say essay writing, but…”
Madaeni: LLMs are not equipped to build and train neural nets for forecasting
“But it's clear that I don't think that LLMs are equipped with, you know, building a whole neural net from scratch and training them and do some form of supervised, unsupervised learning for Forecasting.”
Madaeni: Equivalent battery optimization code manually takes two engineers one month
“Once you want to like grab, put some software foundation, what Duncan has presented today, I would say you need two engineers, more like a backend software engineer and an optimization engineer. And depending on how well they get along with each other, because…”
Madaeni: Building automated energy trading software is a year-long endeavor
“You can come up with something over the course of 12 hours, but trust me, it's going to leave a lot of money and value on the table, or you can actually systematically procure software or build software Which is a, in my view, a year endeavor.”
Madaeni: Non-domain engineers miss battery physical constraints just like LLMs do
“Batteries can't charge and discharge at the same time, and it's rather obvious to us, but the same applies if we bring a software engineer out of, as an example, out of Uber, where they've never heard about energy problems, can't distinguish between megawatts …”
Madaeni: Full-year vs daily analysis makes no difference for 4-hour battery dispatch
“If the battery had enough, you know, energy to kind of cycle for a couple of days, if we're thinking about long duration storage distinguishing between a full year analysis versus a daily analysis is important, but if your battery has four hours, then it reall…”