#inference

Show HN: SIE Serverless – managed inference powered by self-hostable stack

Today we are launching SIE Serverless - a managed inference product focused on small models. It’s useful for spiky workloads on 20+ task specific workloads across Search, OCR and Agentic execution. Sign up for a $500 credits launch grant after making an account :-) It’s powered by our open source inference engine that has received thousands of github stars in the last few months, battle-tested across finance, legal & tech. We believe that self-hosting is going to be critical given all the trust & security issues in AI, but practically there are always workloads where you’d like somebody else t

Show HN · EN

Fast, reliable A2UI, with swappable inference formats

A2UI now supports swappable inference formats, introducing A2UI Express which uses up to 3x fewer tokens and cuts latency by compiling compact Python-style syntax into standard A2UI JSON via Agent SDKs. Developers can also use controlled generation with TypeSafe's Jev system-decision models to render known-shape screens in under 300 ms while smaller models stream text. These updates require no changes to frontend renderers or component catalogs, offering flexible performance levers for generative UI development across Python, TypeScript, and Dart.

Google Developers Blog · EN

Smaller apps and faster GPU inference with LiteRT in Google Play services

LiteRT in Google Play services now offers GPU inference powered by ML Drift, delivering about 1.4x faster performance alongside the new CompiledModel API. Switching from bundled binaries reduces app size by approximately 8 MB while enabling seamless, automatic runtime updates across billions of devices. Developers can easily adopt these updates by updating their dependencies and utilizing the new Android Studio LiteRT skill for automated migration.

Google Developers Blog · EN