Show HN: An immutable local inference appliance with routing capability
Fonte: Show HN ·
Hey HN I’ve been working on a little side project after spending a bunch of time customising my inference stack at home. I figured it’d be nice to have something relatively portable, easily maintainable and configurable through a UI. It’s early days, there is built support for Vulkan, HIP and CUDA but I’ve only really tested it on AMD (that’s what I’ve got). So more hardware exposure would be awesome along with feedback and the like. At the moment there is no commercial model. Just wanting to get eyes on it. Thanks Comments URL: https://news.ycombinator.com/item?id=50409129 Points: 1 # Comment
Perguntas frequentes
O que é Show HN: An immutable local inference appliance with routing capability?
Show HN: An immutable local inference appliance with routing capability is a ferramenta discovery curated from Show HN. Hey HN I’ve been working on a little side project after spending a bunch of time customising my inference stack at home. I figured it’d be nice to have something relatively portabl
Como posso acessar ou experimentar?
You can experience this content directly on its original host (Show HN) by clicking the "Open Original" button.
De onde vem esse conteúdo?
Curated from Show HN by the OnSuggest team to surface the most interesting and serendipitous content on the web.
Mais como este
Todas as descobertas em Ferramentas para devs →Show HN: I declared war on every country, one at a time. 77 of 133 survived
We declared war on every country on Earth, one at a time, with every other nation against it. 133 runs of 300 years on the real map: 77 survived, 56 fell.
Show HN: Calibron 12 Puzzle/Solver
I learned about this surprisingly hard puzzle from the curiosity box a while back, and decided to throw together a solver and UI around it, using the generic solver I've built up earlier in golang. This is the result. Stack: golang for solver and webserver, websocket for passing solving progress (see options to toggle that), the usual suspects (HTML/JS/CSS) for the frontend. Comments URL: https://news.ycombinator.com/item?id=50409553 Points: 1 # Comments: 0
Show HN: RenderPixels – Generate images from any AI via MCP, 50 free renders
Ask your AI assistant for an Open Graph image, a favicon set, a logo or a banner. RenderPixels draws it and hands back files ready to use.
Show HN: Models[.]Dev Index on a Globe
Three markers: Labs, where each AI company is based Models, fanned out around their lab Providers, where a model is served. Labs with a release in the last 15 days pulse. Open source--> github --> aunai-org --> modex Disclaimer: Modex is an open-source app built on the models.dev index, provided by opencode. The app itself is not affiliated with opencode, and is not an opencode product. Comments URL: https://news.ycombinator.com/item?id=50408474 Points: 2 # Comments: 0
Show HN: Shelgon: A Framework for Building Interactive REPL Shells in Rust
Contribute to NishantJoshi00/shelgon development by creating an account on GitHub.
Show HN: Yahtzee – Probability Engine / Difficult CPU
Play Yahtzee against a computer that solves every roll with exact probabilities, an exact table for the rest of the game, and a match-aware endgame.