Discussion about this post

User's avatar
Arjun Panickssery's avatar

> LLMs are here to stay. I’m increasingly confident that there aren’t any big breakthroughs coming by just throwing more data and computational power at LLMs

It seems true that basic data/compute scaling is showing diminishing returns, but there's still a lot of room for growth in reasoning/agentic models. It's not a coincidence that a bunch of OpenAI execs who left started working in that area.

Expand full comment
Benjamin Riley's avatar

I credit you frequently for the "engage yes, integrate maybe" approach I now promote. I'm curious how much time you spend, if any, explaining how these tools work? I feel like your students, being future engineers from Harvey Mudd, may be coming in with a better basic understanding of this than most? Or not?

Expand full comment
7 more comments...

No posts