跳到内容
onsuggest
登录
工具 en

Show HN: Kiln – A WebGPU alternative to transformers.js, 2.2× faster (median)

来源: Show HN ·

WebGPU-native LLM inference for the browser. Contribute to erdemozkan/kiln development by creating an account on GitHub.

什么是 Show HN: Kiln – A WebGPU alternative to transformers.js, 2.2× faster (median)?

Show HN: Kiln – A WebGPU alternative to transformers.js, 2.2× faster (median) is a 工具 discovery curated from Show HN. WebGPU-native LLM inference for the browser. Contribute to erdemozkan/kiln development by creating an account on GitHub.

如何访问或体验此内容?

You can experience this content directly on its original host (Show HN) by clicking the "Open Original" button.

此内容来源于哪里?

Curated from Show HN by the OnSuggest team to surface the most interesting and serendipitous content on the web.

工具 · 开发者工具

Show HN: Cerulion – ROS 2-compatible robotics runtime with multi-process replay

Hi HN, I'm Lakshay. Raveen and I built Cerulion, an open-source Rust robotics runtime that deterministically replays recorded multi-process runs against new code and runs existing ROS 2 nodes unmodified. Repo: https://github.com/cerulion-inc/cerulion During my MIT PhD in off-road autonomy, a robot with two lidars and six cameras had too much latency between ROS processes. ROS 2's loaned messages need POD data, which rules out the standard sensor types like Image and PointCloud2. We ended up using a single process, which is very brittle. And when it broke, I couldn't reproduce the heisenbug rel

工具 · 开发者工具

Show HN: RealtimeVAD – trading false positives for 110ms earlier end-of-speech

Hey guys. I recently watched the latency reports for my local voice assistant, which show a waveform plus silero probability for voice activity. I noticed silero lags visibly on the speech off signal. There had to be a method to get this signal closer to what I felt is optimal. My idea was to use a 10 ms energy detector with a threshold that adapts to environment or room noise. Which worked amazingly well. It created more false positives but in my speculative generation pipeline that would not matter. If it's wrong and the user continues speaking I can abort the pipeline fast. I benchmarked my

键盘快捷键

上一条发现
←P
下一条发现
→N
喜欢
L
不适合我
X
保存
S
显示此帮助
?
关闭
Esc

快捷键在发现页面上有效。