TensorFlow

“He also implemented the first version of AdWords, built AdSense, rewrote the core search pipeline five times, co-invented and implemented Bigtable MapReduce, TensorFlow, and Gemini.”

“OpenAI switched to use PyTorch fully.”

“So we revolutionized deep learning because of our domain specific library called QDNN. Without QDNN, nobody talks about QDNN because it's one layer underneath PyTorch and, you know, and TensorFlow and back in the old days, CAFE and Theano and now Triton, and t…”

“During that first startup I ended up Being approached by Google to prototype, really, what would a TensorFlow for quantum computing look like? So TensorFlow at the time was the core software framework for Google to do deep learning, and we wanted to extend tha…”

“I don't think they really, I think people tell this, the story of sort of the silver bullet. Of like you know, the eager execution model. But I think the reality is they just built a product with so much more empathy.”

“None of this wouldn't exist if Google hadn't put published transformers and put the paper out there, right? None of this would have existed if Ah, the attention stuff would have been out there if the Anno hadn't been created, if TensorFlow hadn't been created.”

“On the home side, it's a computer, so we use a TensorFlow-based camera to identify, catalog your property so that when you need to make a claim there isn't much of a fuss that's put up by an adjuster.”

“You can sort of, like, you know, you can download TensorFlow, download some data sets, and over the weekend, probably come up with, you know, if you're a good programmer, come up with something that can do, like, 80% accuracy of whatever, let's say OCR or some…”

“TensorFlow is open source, but actually scaling it is not.”

“He bought himself a Raspberry Pi, a couple actuators to push things into boxes. He used TensorFlow to train the AIs to look for the nine grades of cucumbers, and for under 2000 dollars, he automated cucumber sorting.”

“In my opinion, it's one of the top 10 innovations in, in the last 10 years.”

“It's also an HR advantage, because if you are the smartest person from your PhD program at Stanford, and you like machine learning and AI, where do you want to work? Well, you could go work for some startup, where they also downloaded TensorFlow, but they have…”

“So, so essentially becoming a good engineer for our team is much more valuable than, for example, people spending you know, months upon months implementing exotic models in TensorFlow.”

“They have what I've, I would describe as a sandwich problem, which is that you end up sandwiching a lot of system code with user code, and then, like, adding more and more layers of that, and as you've sandwiched, like, you know, seven or eight layers of that,…”

“Second is for the platform companies, I do think there's a less obvious but likely business model as well. Less obvious because unlike the database analogy I provided, it's not immediately clear that there'll be An Oracle or a MySQL, that is to say, a company …”

“One of the really nice things is that a lot of these companies are open sourcing and democratizing these services, so things like TensorFlow from Google, and the result is, you know, we, when we recruit engineers, I mean, even an out-of-school engineer can do …”

“Anybody who believes that it's about getting five good engineers into the basement and we can start hacking away on TensorFlow come Sunday is probably going to be quite surprised.”