Show HN: An immutable local inference appliance with routing capability
Kaynak: Show HN ·
Hey HN I’ve been working on a little side project after spending a bunch of time customising my inference stack at home. I figured it’d be nice to have something relatively portable, easily maintainable and configurable through a UI. It’s early days, there is built support for Vulkan, HIP and CUDA but I’ve only really tested it on AMD (that’s what I’ve got). So more hardware exposure would be awesome along with feedback and the like. At the moment there is no commercial model. Just wanting to get eyes on it. Thanks Comments URL: https://news.ycombinator.com/item?id=50409129 Points: 1 # Comment
Sıkça Sorulan Sorular
Show HN: An immutable local inference appliance with routing capability nedir?
Show HN: An immutable local inference appliance with routing capability, Araç kategorisinde yer alan ve Show HN üzerinden sunulan bir keşiftir. Hey HN I’ve been working on a little side project after spending a bunch of time customising my inference stack at home. I figured it’d be nice to have something relatively portabl
Nasıl erişebilir veya deneyimleyebilirim?
Bu içeriğe "Aslına Git" butonuna tıklayarak doğrudan orijinal platformunda (Show HN) erişebilirsiniz.
Bu içerik nereden geliyor?
Bu içerik Show HN üzerinden OnSuggest topluluğu ve küratörleri tarafından internetin kaliteli köşelerinden seçilmiştir.
Benzer keşifler
Tüm Geliştirici araçları keşifleri →Show HN: I declared war on every country, one at a time. 77 of 133 survived
We declared war on every country on Earth, one at a time, with every other nation against it. 133 runs of 300 years on the real map: 77 survived, 56 fell.
Show HN: Calibron 12 Puzzle/Solver
I learned about this surprisingly hard puzzle from the curiosity box a while back, and decided to throw together a solver and UI around it, using the generic solver I've built up earlier in golang. This is the result. Stack: golang for solver and webserver, websocket for passing solving progress (see options to toggle that), the usual suspects (HTML/JS/CSS) for the frontend. Comments URL: https://news.ycombinator.com/item?id=50409553 Points: 1 # Comments: 0
Show HN: RenderPixels – Generate images from any AI via MCP, 50 free renders
Ask your AI assistant for an Open Graph image, a favicon set, a logo or a banner. RenderPixels draws it and hands back files ready to use.
Show HN: Models[.]Dev Index on a Globe
Three markers: Labs, where each AI company is based Models, fanned out around their lab Providers, where a model is served. Labs with a release in the last 15 days pulse. Open source--> github --> aunai-org --> modex Disclaimer: Modex is an open-source app built on the models.dev index, provided by opencode. The app itself is not affiliated with opencode, and is not an opencode product. Comments URL: https://news.ycombinator.com/item?id=50408474 Points: 2 # Comments: 0
Show HN: Shelgon: A Framework for Building Interactive REPL Shells in Rust
Contribute to NishantJoshi00/shelgon development by creating an account on GitHub.
Show HN: Yahtzee – Probability Engine / Difficult CPU
Play Yahtzee against a computer that solves every roll with exact probabilities, an exact table for the rest of the game, and a match-aware endgame.