Added ModelLoadingOptions and GenerationOptions for more finegrained control over generation and loading options
Exposed model ID via ModelRunner.modelId
Exposed generation statistics via stats field on MessageResponse.Complete
Added Model Downloader module to simplify model fetching in prototypes and development; see details here
π Bug fixes
Added Proguard rules to preserve inference engine class names and prevent obfuscation issues.
If the generation content hits the maximum context length, finishReason field of MessageResponse.Complete will be EXCEED_CONTEXT. If the prompt exceeds the context length, LeapGenerationPromptExceedContextLengthException will be thrown.
π iOS Edge SDK
Features
Added ModelLoadingOptions and GenerationOptions for more finegrained control over generation and loading options
Exposed model ID via ModelRunner.modelId
Exposed generation statistics via stats field on MessageResponse.Complete
Added LeapModelDownloader module to simplify model fetching in prototypes and development
π Bug fixes
If the generation content hits the maximum context length, finishReason field of MessageResponse.Complete will be EXCEED_CONTEXT. If the prompt exceeds the context length, LeapGenerationPromptExceedContextLengthException will be thrown.