Changelog

Documentation Index

Fetch the complete documentation index at: https://docs.liquid.ai/llms.txt

Use this file to discover all available pages before exploring further.

​

0.9.x → 0.10.x: Kotlin Multiplatform unification

• Swift Package Manager — Liquid4All/leap-sdk (new repo, for iOS / macOS consumers).
• Maven Central — ai.liquid.leap:* (Android, JVM, and Kotlin/Native targets).

​

Five SPM products / four Maven artifacts

​

Breaking changes for iOS consumers

• SPM URL change. Point your Swift Package Manager dependency at https://github.com/Liquid4All/leap-sdk.git (not the deprecated leap-ios repo).
• CocoaPods removed. The SDK ships exclusively through SPM in v0.10.0 onward.
• Toolchain bump. Xcode 16 and Swift 6.0 are required.
• ModelDownloader → LeapModelDownloader. The downloader class was renamed; update call sites accordingly. See Model Loading for the 0.10.x constructor signature.

​

Major additions since 0.9.x

​

OpenAI-compatible cloud client

​

Voice assistant widget

​

Sideloading models from explicit paths

​

iOS background downloads

​

autoDetectCompanionFiles

​

Swift ergonomics

• Compatibility layer keeps 0.9.x call sites (Leap.load(...), Conversation.generateResponse(...)) compiling on top of the unified KMP surface.
• onEnum(of:) — SKIE-bridged sealed-class switching for Kotlin enums and sealed hierarchies (e.g. MessageResponse).
• ChatMessageContent static factories — .text(...), .image(...), .audio(...) helpers instead of constructor calls.
• Builder-style options — LiquidInferenceEngineOptions.with(cacheOptions:), etc.

​

Memory-mapped model loading by default

• Lower private RSS. mmap’d weights are file-backed pages, not “anonymous private” RSS. iOS’s jetsam and Android’s low-memory killer both score apps primarily by anonymous RSS, so a 1.2B-Q4 model that previously counted as ~700 MB of dirty heap now shows as backing pages the OS may evict for free. Foreground apps are significantly less likely to be terminated under memory pressure.
• Faster cold load. The constructor returns as soon as the file is mapped — typically tens of milliseconds — instead of waiting for the entire model to be read into RAM. The first inference pays the page-in cost incrementally as the engine touches weights.
• Faster warm reloads. After the first load, the kernel’s page cache holds the model’s hot pages. Re-creating a runner on the same model (e.g. after a background termination and relaunch within the same boot) is near-instant — pages stream from the page cache, not disk.
• Multi-model sharing. Two processes (or two runners in one process) loading the same model file share physical pages via the page cache, with no extra RAM cost.
• Graceful memory pressure. When the OS needs RAM for the foreground UI or another app, it can drop read-only model pages without writing them anywhere (they’re backed by the file). The next access re-pages them in. With anonymous heap buffers, the kernel had to choose between swapping (slow) or killing the app (worse).

• First-token latency on cold pages. The first generation against a freshly-mapped model triggers page faults as the engine walks the weights. This adds disk-I/O latency to TTFT on the first call after process start. The KV cache reuse documented above compounds well here: cached prefixes skip both prefill compute and the page-fault cost for weights touched during prefill.
• Storage type matters. On devices with slow eMMC / external SD storage, lazy page-in can be noticeably slower than the old eager-read flow that loaded the whole file once. Internal flash on every shipped iOS device and any modern Android device is fast enough that this isn’t visible in practice.
• Opt-out available since v0.10.5. Pass useMmap = false on ModelLoadingOptions (Kotlin) or LiquidInferenceEngineOptions(useMmap: false) (Swift) to force the legacy full-read loader. Use only when mmap misbehaves on the target filesystem; the default of null/nil keeps the engine default.

​

KV cache reuse across generations

• Multi-turn chat with a long system prompt. Every turn reuses the system prompt and earlier turns.
• RAG / retrieval-augmented generation. Many queries share the retrieved-document preamble.
• Few-shot prompting. A fixed set of examples precedes every request.
• Agent loops. Tool definitions, role instructions, and task scaffold are stable across iterations.
• Voice assistant continuations. Conversation history grows; everything before the latest user turn is cacheable.

// iOS / macOS (v0.10.4.3+)
let cacheDir = FileManager.default.urls(for: .cachesDirectory, in: .userDomainMask)[0]
    .appendingPathComponent("leap-kv-cache")

let options = LiquidInferenceEngineManifestOptions(
    cacheOptions: .enabled(path: cacheDir.path),
    contextSize: 4096
)
let runner = try await Leap.load(url: bundleURL, options: options)

// Android / JVM / KMP (v0.10.5+)
val cacheDir = context.cacheDir.resolve("leap-kv-cache").apply { mkdirs() }

val runner = downloader.loadModel(
    modelName = "LFM2-1.2B",
    quantizationType = "Q5_K_M",
    options = ModelLoadingOptions().apply {
        cacheOptions = ModelLoadingOptions.cacheOptions(path = cacheDir.absolutePath)
    },
)

​

Per-release notes

​

v0.10.6 — 2026-05-12

• loadModel(modelName:, quantizationType:, options:, generationTimeParameters:, forceDownload:, downloadProgress:) — downloads (when needed) and loads in one call. The transfer registers in queryStatus, is cancellable via requestStopDownload, and continues across backgrounding when constructed with sessionConfiguration: .backgroundSessionConfiguration(withIdentifier:).
• loadModel(manifestUrl:, options:, generationTimeParameters:, forceDownload:, downloadProgress:) — same flow keyed by a manifest URL.
• loadSimpleModel(model: ModelSource, options:, generationTimeParameters:, downloadProgress:) — sideload from explicit paths or URLs; HTTPS sources stream through URLSession, local paths pass straight through.
• forceDownload: Bool = false on all three load methods. Resolves the manifest first, then deletes the local cache, then re-downloads — a registry failure on resolve leaves the previously-working cached copy intact.
• Resource-lookup helpers that previously lived only on the cross-platform LeapDownloader: getModelResourceFolder(...), getCachedManifest(...), getCachedFilePath(...), resolve(...), deleteModelFile(...).
• requestDownloadModel(manifestUrl:, forceDownload:) overload for symmetry with removeModel(manifestUrl:) / queryStatus(manifestUrl:).

• Class renamed: LeapModelDownloader → ModelDownloader on iOS / macOS. The Kotlin class still lives in ai.liquid.leap.downloader.LeapModelDownloader and Android consumers are unaffected; a @ObjCName(swiftName = "ModelDownloader") annotation gives the Swift export an unambiguous name distinct from the framework module’s own LeapModelDownloader name. Update Swift call sites:
  - let downloader = LeapModelDownloader()  // was uninstantiable from Swift in 0.10.5 due to the class-vs-module name collision
  + let downloader = ModelDownloader()
  
• Parameter labels renamed across the iOS ModelDownloader surface — model: / quantization: → modelName: / quantizationType: on every method that already existed: downloadModel(...), requestDownloadModel(...), requestStopDownload(...), queryStatus(...), removeModel(...), getModelSize(...). Every loader now uses the same labels across Swift and Kotlin — ModelDownloader (iOS, macOS), LeapModelDownloader (Android), and LeapDownloader (cross-platform) all share modelName: / quantizationType:.
• LeapModelDownloader SPM library product is now single-target. It no longer bundles the LeapSDK target. Apps depending on this product must drop any direct LeapSDK SPM dependency from the same target — import LeapModelDownloader re-exports every LeapSDK Kotlin type (Conversation, ModelRunner, ChatMessage, Leap, the convenience extensions, …). Keeping both library products on the same target double-bundles the inference engine dylibs and triggers a build-time #error from the LMD umbrella header (see “dual-import guard” below); the LeapUI library product still bundles LeapSDK because LeapUI does not re-emit those types in its ObjC binding.
• LeapModelDownloader.xcframework is now a dynamic framework. It was a static archive in 0.10.5. SPM applies Embed & Sign automatically; manual integrators must add the framework with “Embed & Sign” instead of “Do Not Embed”. The shipped XCFramework now also bundles the inference engine dylibs (libinference_engine.dylib, libinference_engine_llamacpp_backend.dylib, libie_zip.dylib) under Frameworks/ with an @loader_path/Frameworks LC_RPATH — consumers using LMD on its own no longer need LeapSDK.framework/Frameworks on their search path.
• Dual-import build-time guard. LMD’s umbrella header carries a __has_include(<LeapSDK/LeapSDK.h>) && !defined(LEAP_DUAL_IMPORT_ALLOW) check that fires #error at the consumer’s preprocessing time when both LeapSDK and LeapModelDownloader frameworks are reachable in the same target. To opt out for legitimate combinations (e.g. transitive linkage via LeapUI), add LEAP_DUAL_IMPORT_ALLOW=1 to OTHER_CFLAGS.

• ModelDownloader(), ModelDownloader(sessionConfiguration:), ModelDownloader(config:) — Kotlin/Native ObjC export strips default-argument metadata, so 0.10.5 forced Swift callers to pass every parameter (and LeapDownloaderConfig has seven). These new SKIE-bundled convenience inits restore the parameterless / single-arg forms.
• LeapDownloaderConfig() parameterless convenience init mirroring the Kotlin defaults (saveDir = "leap_models", validateSha256 = true, etc.). Same rationale — LeapDownloaderConfig is a Kotlin data class with seven defaulted fields that the ObjC export couldn’t carry through.

• requestDownloadModel(forceDownload: false) now short-circuits when a cached manifest already exists and every resource referenced by that manifest is present on disk — matches both the Android downloader’s idempotent-call semantics and what queryStatus(...) already reports. Earlier 0.10.5 builds would short-circuit on the manifest alone, leaving the caller stuck if any resource file had been removed. Pass forceDownload: true to re-download on top of a cache.
• Cached-file lookup uses Ktor URL parsing instead of substring slicing, so URLs with fragments or query strings now produce the same filename the loader expects (getCachedFilePath was previously brittle for those shapes).

• getAvailableDiskSpace() previously returned null on every Apple platform because the internal NSFileManager.attributesOfFileSystem(forPath:)[.systemFreeSize] extraction cast through as? Long (Kotlin) which never matches the bridged NSNumber. Now goes through NSNumber.longLongValue and reports the real free-space figure.

• Options on the new load methods take LiquidInferenceEngineManifestOptions? (the Swift-friendly type already used by Leap.load), with toModelLoadingOptions() / toGenerationTimeParameters() conversion at the boundary — no separate KMP options class needed from Swift.
• Internal: the iOS class uses kotlin.experimental.ExperimentalObjCName (stable in our Kotlin 2.3.20 baseline but still formally experimental).
• No public-API changes for Android or non-Apple Kotlin/Native targets.

​

v0.10.5 — 2026-05-11

• ModelLoadingOptions.cacheDir: String? → cacheOptions: EngineOptions.CacheOptions? — KV cache configuration moves to a bounded-LRU CacheOptions value with explicit enabled master switch, per-tier caps (maxEntriesDisk, maxEntriesMemory, maxBytesMemory), and optional diskDisabled = true for memory-only mode. Migrate via the ModelLoadingOptions.cacheOptions(path = ...) factory (preserves the historical 40-entry disk budget and sets enabled = true). Constructing a raw CacheOptions requires enabled = true to enable the cache — a positive maxEntries alone is no longer sufficient.
• LeapDownloader.loadModel(modelName, quantizationSlug, modelLoadingOptions, …) → loadModel(modelName, quantizationType, options, …) — parameter renames bring LeapDownloader in line with LeapModelDownloader. The same rename applies to loadSimpleModel(model, modelLoadingOptions, …) → loadSimpleModel(model, options, …) and loadModelFromManifestUrl(…). Swift sites that called downloader.loadModel(modelName:, quantizationSlug:, modelLoadingOptions:) need to swap to quantizationType: / options: after upgrading.
• progress is now nullable (progress: ((ProgressData) -> Unit)? = null) — pass null to opt out (was an empty-lambda default).

• ModelLoadingOptions.useMmap: Boolean? = null — exposes the engine’s use_mmap toggle to Kotlin/Swift callers. null (default) defers to the engine default of true. Set false only on filesystems where mmap misbehaves (some Android scoped-storage paths, certain network mounts). On Swift, LiquidInferenceEngineOptions gained a matching .with(useMmap:) builder. Previously mmap could not be disabled from the SDK.
• Leap Model Service (Android) — leap-model-service is a new optional Android service that hosts loaded models in its own process and lets multiple client apps share them. Apps using LeapModelDownloader.loadModel(...) route through the service transparently when it’s installed on the device; otherwise they fall back to in-process loading. Per-UID session quotas, persistent foreground notification, disk-backed KV cache reuse across cold starts, and AIDL-routed registerFunction(s). Pass forceLocal = true on LeapModelDownloader.loadModel(...) to bypass the service for testing. See Model Loading for the routing model.
• Service-side load progress — when routing through the model service, LeapModelDownloader.loadModel’s progress callback now fires for service-side downloads too (was previously local-path-only).

• Apple LeapModelDownloader internal slot names switched from quantizationSlug → quantizationType for consistency. Public Swift label names (model: / quantization:) are unchanged.
• Vendor liquid.h header refresh for Linux/MinGW K/N targets.

​

v0.10.4.5 — 2026-05-08

• Engine pin advanced to v26.02.1-146-g777faf0dbb — fixes a K/N + Linux free(): invalid pointer SIGABRT in liquid_string_destroy (the FFI helper was freeing the wrong pointer slot).
• Linux runtime smoke test now asserts the engine reports failure on a missing model path, guarding against silent-success regressions.
• NativeLibLoader cleanup: stdout warnings moved to System.err; loader stays kotlin-stdlib-only.

​

v0.10.4.4 — 2026-05-07

​

v0.10.4.3 — 2026-05-07

• LiquidInferenceEngineManifestOptions(cacheOptions: ..., contextSize: 4096) now accepts native Swift types (previously the convenience init dropped cacheOptions and forced consumers to the verbose Obj-C designated init).
• New with(cacheOptions:) builders on LiquidInferenceEngineOptions and LiquidInferenceEngineManifestOptions.
• New LiquidCacheOptions.enabled(path:) static factory — Swift analog of ModelLoadingOptions.cacheOptions(path:).

​

v0.10.4.1 — 2026-05-07

​

v0.10.4 — 2026-05-06

• Bounded-LRU CacheOptions API across JVM, Android, Kotlin/Native, Apple, and wasmJs.
• use_mmap=true is now the engine default (via vendored IE pin v26.02.1-79+). Model weights are memory-mapped instead of read(2)-ed into a heap buffer. See Memory-mapped model loading by default above for the mobile performance impact.
• K/N Linux link fix (--allow-shlib-undefined for libinference_engine.so against modern glibc).
• Dynamic vendor pipeline + DT_NEEDED-based shipped-libs verify; inference_engine RUNPATH=$ORIGIN cascade for Linux/Windows shared vendor libs.
• NativeLibLoader cross-platform load fixes (resource extraction + Windows pre-load topo-retry).
• Three release-gate smokes (Linux K/N, Apple SwiftPM consumer, Windows JVM) wired into CI.

​

v0.10.1 — 2026-04-29

• leap-sdk Linux/MinGW K/N artifacts on Maven Central now publish a -natives.zip classifier containing the runtime .so/.dll libraries.
• New ai.liquid.leap.nativelibs Gradle plugin auto-wires the natives ZIP into consumer K/N executables.
• leap-openai-client now publishes Linux/MinGW K/N klibs.

​

v0.10.0 — 2026-04-28