DealForge autonomously sources, scores, and writes investment memos on venture deals. Stop manually hunting.
1,180+ deals tracked · 22 AI investment memos · Updated daily
Show HN: QVAC SDK, a universal JavaScript SDK for building local AI applications
Hi folks, today we're launching QVAC SDK [0], a universal JavaScript/TypeScript SDK for building local AI applications across desktop and mobile.<p>The project is fully open source under the Apache 2.0 license. Our goal is to make it easier for developers to build useful local-first AI apps without having to stitch together a lot of different engines, runtimes, and platform-specific integrations. Under the hood, the SDK is built on top of QVAC Fabric [1], our cross-platform inference and fine-tuning engine.<p>QVAC SDK uses Bare [2], a lightweight cross-platform JavaScript runtime that is part of the Pear ecosystem [3]. It can be used as a worker pretty much anywhere, with built-in tooling for Node, Bun and React Native (Hermes).<p>A few things it supports today:<p><pre><code> - Local inference across desktop, mobile and servers - Support for LLMs, OCR, translation, transcription, text-to-speech, and vision models - Peer-to-peer model distribution over the Holepunch stack [4], in a way that is similar to BitTorrent, where anyone can become a seeder - Plugin-based architecture, so new engines and model types can be added easily - Fully peer-to-peer delegated inference </code></pre> We also put a lot of effort into documentation [5]. The docs are structured to be readable by both humans and AI coding tools, so in practice you can often get pretty far with your favorite coding assistant very quickly.<p>A few things we know still need work:<p><pre><code> - Bundle sizes are larger than we want right now because the current packaging of Bare add-ons is not as efficient as it should be yet - Plugin workflow can be simpler - Tree-shaking is already possible, but at the moment it still requires a CLI step, and we'd like to make that more automatic and better integrated into the build process </code></pre> This launch is only the beginning. We want to help people build local AI at a much larger scale. Any feedback is truly appreciated! Full vision is available on the official website [6].<p>References:<p>[0] SDK: <a href="http://qvac.tether.io/dev/sdk" rel="nofollow">http://qvac.tether.io/dev/sdk</a><p>[1] QVAC Fabric: <a href="https://github.com/tetherto/qvac-fabric-llm.cpp" rel="nofollow">https://github.com/tetherto/qvac-fabric-llm.cpp</a><p>[2] Bare: <a href="https://bare.pears.com" rel="nofollow">https://bare.pears.com</a><p>[3] Pear Runtime: <a href="https://pears.com" rel="nofollow">https://pears.com</a><p>[4] Holepunch: <a href="https://holepunch.to" rel="nofollow">https://holepunch.to</a><p>[5] Docs: <a href="https://docs.qvac.tether.io" rel="nofollow">https://docs.qvac.tether.io</a><p>[6] Website: <a href="https://qvac.tether.io" rel="nofollow">https://qvac.tether.io</a>
QVAC SDK targets the high-growth local AI market with a unique P2P distribution model and a custom lightweight runtime. While technically ambitious and backed by the established Holepunch/Tether ecosystem, it faces stiff competition from standard runtimes and significant adoption hurdles.