Praxis Proxy AI Grid: Routing Across Models, Clusters, and Regions
A GPU can be healthy and still be the wrong place for a request. Here is how Praxis and Grid separate identity, eligibility, load, locality, and the actual inference hop.
NetworkStatic
Brent Salisbury's travels in Networking Programming.
Explore the archive →A GPU can be healthy and still be the wrong place for a request. Here is how Praxis and Grid separate identity, eligibility, load, locality, and the actual inference hop.
AI and Networking Bill Gates recently called the development of AI as fundamental of a creation as the microprocessor, the personal computer, the Internet, and the mobile phone. He is most likely right. OpenAI found that …
Getting Started with the Rust Programming Language A programming language that has begun picking up momentum in the community lately is Rust. This is a guide aimed at helping folks get started with the Rust Programming …
Open Source Flow Monitoring and Visualization At the heart of any reasonably sized network, should be a solid strategy around flow collection, querying and visualization. Proper use of flow logs are crucial to …
Measuring Network Bandwidth using Iperf and Docker At the heart of any network engineer’s toolkit, are applications that let you peer into the network for performance, congestion and capacity planning. One of the …
GoBGP - A Control Plane Evolving Software Networking If I have talked to you over the past year or two about networking, odds are I have mentioned a project to you called GoBGP. If we have spoken a lot, you are probably …
Configuring Macvlan and Ipvlan Linux Networking Macvlan and Ipvlan are both Linux type networking interfaces that are both supported by the Linux kernel. They are unique for a few different reasons. One thing that makes …
Time to Ditch the Definition of SDN While at a stoplight looking at the random news feeds on Linkedin I ran across a post of a recent blog post by the ONF and the subsequent conversation where my friend Ivan Pepenlnjak …