- Links Justin Sends
- Posts
- Links Justin Sends 3/7
Links Justin Sends 3/7
Testified about AI to the NJ Senate, Anthropic Raises 3.5 Billion, and many more updates
Justin Trugman
March 07, 2025
Happy Friday!
I had a great time testifying to the NJ State Senate about the intersection of energy and AI earlier this week. Covered an overview of what it takes to bring a model to life and the sectors of industry NJ can or should play a role.
Here’s a brief summary of what I testified 👇️
Phase | Description | Relative Energy Needs |
Pre-training | • Gathering, structuring, and organizing data (human-generated and synthetic) • Preparing data pipelines for model training | • Minimal energy consumption compared to later phases • GPU inference for synthetic data generation here is only a small fraction of the total energy |
Training | • Using massive GPU clusters to train model weights • Processing large volumes of training data | • Extremely high energy demand due to tens of thousands (or over 100,000) of GPUs • Typically located in low-density areas with access to cheap, clean energy and affordable land |
Inference | • Deploying the trained model for on-demand use • Running predictions | • Lower energy per operation than training, though overall consumption remains substantial when scaled |
Happy to deep dive into more of these in a future post and reach out if you have any questions!
Now on to the links 👇️
🧒 New School Meets Old School: Young engineers are pitching VCs about acquiring old school businesses and applying AI to them to get leverage
🧠 Biological Computer: Cortical Labs launches a biological computer that combines stem cells with silicon
🐉 Dragon Copilot: Microsoft launches drag and co-pilot for the clinician market
💰️ Anthropic Raises $3.5 Billion: Huge funding round at a $61.5 billion post money valuation. Hopefully this results in Anthropic diving more into reasoning and multimodal models.
🦙 New Models Available on Ollama: Microsoft's Phi4-mini as well as multimodal models like Granite3.2-vision available to run locally on your laptop using Ollama
🕘️ 96GB VRAM Nvidia 4090: Maybe the rumors are true. 96 GB of VRAM would provide a massive boost to teams who want to run AI locally and affordably
🌉 Agent Exchange: Salesforce launches a marketplace to deploy AI agents.
Have a great weekend!
-Justin
aka the guy with great AI links
Co-founder & Head of Technology @ BetterFutureLabs