Links Justin Sends - New Years Edition

Happy New Year -- Here's 2 Trends I'm Excited to See in 2025

Author

Justin Trugman
January 01, 2025

Happy New Year 🥳 

In the first 2025 edition of Links Justin Sends, let’s cover 2 trends I’m excited to see play out this year!

🤖 đź’¬ đź¤– Multi-Agent Systems

In 2024, “Agents” became a mainstream term — in 2025, “Multi-Agent Systems” will follow.

At BetterFutureLabs, we’ve been at the forefront of developing cutting-edge Verticalized Multi-Agent Systems (MAS) since 2023. It’s exciting to witness Agents entering the mainstream conversation in 2024, and we’re gearing up for the surge of interest in MAS that we expect to see in 2025.

🔍 Does Size Matter? Shift to Inference & Smaller Models

What will the impact of OpenAI hard pivoting to inference based cognition and DeepSeek V3’s Combination of Multi-head Latent Attention and Mixture of Experts resulting in a 37 Billion Active Parameter Model be on the GPU market?

DeepSeek (Chinese AI co) making it look easy today with an open weights release of a frontier-grade LLM trained on a joke of a budget (2048 GPUs for 2 months, $6M).

For reference, this level of capability is supposed to require clusters of closer to 16K GPUs, the ones being brought up today are more around 100K GPUs. E.g. Llama 3 405B used 30.8M GPU-hours, while DeepSeek-V3 looks to be a stronger model at only 2.8M GPU-hours (~11X less compute).

My Initial Thoughts

The competitive advantage of large GPU clusters will be less durable initially in 2025 as we can see many startups with sub $10 million training budgets develop competing models to Anthropic, OpenAI, and Llama.

Longer term, I believe rather than putting Nvidia, Anthropic, & OpenAI out of business, this will catalyst the capability and adoption of Small Language Models which can run on everyday Phones, Laptops, and IOT devices (reach out if you’re interested in hearing more about this).

Companies pivoting to inference based cognition is great for startups like Groq and Etched — hoping to a few more major players pop up in this space.

What do you think – anything you’d add to this list? Any trends you see differently? I’d love to hear your take!

Wishing you an amazing start to 2025! 🚀

-Justin

aka the guy with great AI links

Co-founder & Head of Technology @ BetterFutureLabs