Is ‘Big AI’ beating 'small AI'—and what does it mean for the military?
Efforts to build giant, power-hungry models may be squeezing out the kind of computing-at-the-edge projects the military actually needs.
Patrick Tucker | October 7, 2024
Artificial Intelligence AI & Autonomy Industry
The prevailing "bigger-is-better" approach to artificial intelligence—ingest more training data, produce larger models, build bigger data centers—might be undermining the kind of research and development the U.S. military actually needs now and in the future.
That’s the argument in "Hype, Sustainability, and the Price of the Bigger-is-Better Paradigm in AI," a new paper that scrutinizes common assumptions driving AI research. Its authors demonstrate that the performance of larger models doesn’t necessarily justify the vastly increased resources needed to build and power them. They also argue that concentrating AI efforts in a relative handful of big tech companies adds geopolitical risks.
Broadly speaking, the Defense Department is pursuing AI along two tracks: large models that require enormous computational resources, and smaller, on-platform AI that can function disconnected from the internet. In some ways, the study validates the second approach. But, the authors note, future research in “small AI” could be limited due to growing influence of large AI providers.
https://www.defenseone.com/technology/2024/10/big-ai-prevailing-over-small-ai-and-what-does-mean-military/400111/?oref=d1-featured-river-secondary
