Display  a single note   in  inbox news tech tooob

Wednesday, October 06, 07:41PM  by:shuri
Viewable by:

source Why We Moved From Pony To Rust — Wallaroo
Wallaroo delivers pushbutton productionization of ML models today, but that wasn’t always the case. Our new Rust-based platform recently handled millions of inferences a second of a sophisticated ad-targeting model with a median latency of 5 milliseconds, and a yearly infrastructure cost of $130K.