One thing I believe might be worrying is that everyone now is following this LLM hype blindly. It's like the solution to any problem can be done by LLMs and RAG. RAG doesn't make sense in a given context? Let's throw it in anyways, adjust a little bit the prompt adding some words to make the model reason better and here we have a new paper saying how amazing LLMs are.
The same (or better) could have been achieved with some SOTA models but instead of improving the SOTA, people just keep going with LLMs.
I think in a few years we'll see if this LLM hype actually led to superhuman models or to a dead end. In the latter case, we may have lost some years in improving the SOTA for (hopefully not) nothing.
The same (or better) could have been achieved with some SOTA models but instead of improving the SOTA, people just keep going with LLMs.
I think in a few years we'll see if this LLM hype actually led to superhuman models or to a dead end. In the latter case, we may have lost some years in improving the SOTA for (hopefully not) nothing.