Portkey

Last week, we hosted a hackathon, and it was one of those days that reminds you why this ecosystem is fun. A room full of builders, clear problems, fast iteration, and thoughtful conversations. The quality of ideas and execution stood out, especially given how quickly teams moved from concept to working demos. Huge thanks to the HackCulture team for co-hosting and to everyone who showed up ready to build. And a big congratulations to the winners 👏

Unpopular opinion: Most of us aren't spending enough tokens. We just hosted a hackathon this weekend at Portkey. Incredible teams, thoughtful solutions. Participants had unlimited access to the world’s best LLMs. As a judge with access to the backend logs, I found myself obsessively refreshing one metric: Total Tokens Consumed. Many have started to use Gamma, NotebookLM, Claude, and ChatGPT - BUT, when it comes to coding, usage is still abysmally low. So here's a recommendation from someone who's gotten a little comfortable with AI doing most of his work: BURN MORE TOKENS! We'll continue to host more hackathons, so follow Portkey to get notified for the next one! HackCulture

The slowest part of any startup isn't building anymore. It's the back-and-forth after customer calls. "Can you add X?" "We need Y to integrate." "Our compliance team requires Z." What if that call ended with a merged PR - not another doc to write? That’s what we’re building at AltorLab. We turn customer meetings into shipped code. Today, we’re announcing our first design partnership with Portkey - a team that lives and breathes production AI infrastructure. We’ve been embedded with their team for the past few weeks now watching how fast-moving AI companies handle enterprise requests. As Jen Abel says - the unsung startup heroes are enterprise early-adopters. Thanks to Rohit Agarwal and Ayush Garg for taking a bet on us. Congratulations to Portkey for tracking $93M in LLM spend across production workloads. We’re opening a small private beta for teams that: → ship daily → talk to customers constantly → want customer requests → code faster If that’s you, comment “Altor” or DM me - I’ll share early access. Built by engineers from Microsoft and Rubrik Special Thanks to Sanskar Jain Siddharth Goyal Pritam Roy Punit Dhoot Akash Agarwal (AK) for all the help along the way.

There’s a very specific kind of excitement engineers don’t talk about enough. It’s when you realise the thing you built is being used at real scale, and that people genuinely depend on it. Last year, Portkey ended up tracking $93M in LLM spend across production workloads. That number took a second to sink in. It was a feeling mix of disbelief and excitement, enough that I went and sanity-checked it myself, and then just sat with the moment. Because that’s the payoff. Seeing infra you’ve obsessed over quietly doing its job, day after day, for teams shipping real AI products. We decided to publish the data and methodology openly, because this kind of visibility into how LLMs are actually used is rare. Sharing the blog in case it’s useful 👇 https://lnkd.in/g7M82P_g

[ALERT]These models will be deactivated tomorrow.

AI Gateway - Your single gateway to 200+ LLMs Portkey is a fast AI gateway library with integrated Guardrails, designed to simplify AI integration. Why AI Gateway? Universal access: Connect to 200+ LLMs through one unified interface Built-in protection: 50+ AI Guardrails integrated seamlessly Lightweight & open: Minimal footprint (122kb), fully open-source Performance: Sub-millisecond latency (<1ms) for real-time applications Proven at scale: Processing 10B+ tokens daily Enterprise-ready: Enhanced security, scalability, and custom deployment options Simplify your AI infrastructure. One library, endless possibilities. Github: https://lnkd.in/ddeePaqR Book 1:1 on topmate.io: https://lnkd.in/dvWW9c76 #llms #generativeai #nlproc #ai #deeplearning