self-hosted AI

imagem 30

Ollama v0.32.14-rc0 Adds WebP Transcoding and Qwen Compatibility Fix

Leave a Comment / AI & Machine Learning /

The latest release candidate for Ollama, v0.32.14-rc0, includes two focused improvements for self-hosted users. First, llama-server now automatically transcodes WebP images before sending them to the model. This means you can use WebP-format images in your prompts without manually converting them, even if the underlying model does not natively support that format. Second, the Qwen […]

Ollama v0.32.14-rc0 Adds WebP Transcoding and Qwen Compatibility Fix Read More »

imagem 5

llama.cpp Update: Upcoming Server Port Change and New Builds (b10240)

Leave a Comment / AI & Machine Learning /

Notice: Upcoming Default Server Port Change The latest llama.cpp release (build b10240) introduces a notice about a planned change to the default server port. Currently set to 8080, the port will move to 9931 in a future update. Self-hosted users who rely on the default configuration should be aware that scripts, clients, and firewall rules

llama.cpp Update: Upcoming Server Port Change and New Builds (b10240) Read More »

imagem 1

Llama.cpp Build b10217 Introduces Tool Calling in Thinking Mode for DeepSeek (DS4)

Leave a Comment / AI & Machine Learning /

The latest llama.cpp release, build b10217, enables tool calling during the thinking phase for DeepSeek (DS4) models in chat mode. This enhancement allows the model to seamlessly invoke external tools while it is still reasoning, producing more coherent and effective multi-step interactions. For self-hosted users running DeepSeek, this means smarter assistant behavior and improved reliability

Llama.cpp Build b10217 Introduces Tool Calling in Thinking Mode for DeepSeek (DS4) Read More »

imagem 50

llama.cpp Release Cleans Up M3 Graph by Replacing Custom CPU Op with Standard Operations

Leave a Comment / AI & Machine Learning /

The latest build of llama.cpp brings a notable refinement to its computation graph. A custom CPU operation that was previously hard-coded for the M3 graph has been eliminated, and its functionality is now expressed using standard, stock operations. This change simplifies the codebase, making it more maintainable and potentially improving compatibility across different hardware backends.

llama.cpp Release Cleans Up M3 Graph by Replacing Custom CPU Op with Standard Operations Read More »

imagem 42

LangChain-Fireworks 1.5.2: Keeping Model Profiles Fresh for Self-Hosted Setups

Leave a Comment / AI & Machine Learning /

The langchain-fireworks package has been bumped to version 1.5.2, bringing a series of behind-the-scenes improvements that matter for anyone running their own AI stack. This release is all about keeping model profile data accurate and current. For self-hosted users, up-to-date profiles mean your integration can correctly leverage the latest capabilities and pricing of models from

LangChain-Fireworks 1.5.2: Keeping Model Profiles Fresh for Self-Hosted Setups Read More »

imagem 37

Llama.cpp Build b10149 Released with Test Suite Refinement and Cross-Platform Binaries

Leave a Comment / AI & Machine Learning /

The latest llama.cpp release, build b10149, has arrived, bringing a modest but meaningful enhancement to the project’s testing infrastructure. The primary change in this version removes an unnecessary synchronization call from the test-save-load-state procedure. While this adjustment doesn’t alter the core functionality for end users, it tidies up the codebase and may contribute to more

Llama.cpp Build b10149 Released with Test Suite Refinement and Cross-Platform Binaries Read More »

imagem 21

LangChain-Anthropic 1.5.0: New Reasoning Control and Tool Recognition Fix

Leave a Comment / AI & Machine Learning /

The latest update to the LangChain-Anthropic integration, version 1.5.0, brings a notable new feature and important fixes for self-hosted users. This release focuses on enhancing model controllability and ensuring smoother tool interactions. Reasoning Effort Control: A new standard parameter, reasoning_effort, has been added to chat models. This allows developers to adjust the depth of reasoning

LangChain-Anthropic 1.5.0: New Reasoning Control and Tool Recognition Fix Read More »

imagem 20

llama-arch Fixes DeepSeek4 APE Tensor Operation for Improved Model Compatibility

Leave a Comment / AI & Machine Learning /

A recent update to llama-arch, a core component of the llamacpp inference engine, addresses a critical bug affecting the APE (Adaptive Positional Encoding) tensor operation used in DeepSeek4 models. This fix ensures accurate computation during model inference, which is essential for developers running DeepSeek4 on self-hosted environments. By resolving this issue, llama-arch improves compatibility and

llama-arch Fixes DeepSeek4 APE Tensor Operation for Improved Model Compatibility Read More »

RSS FEED
RSS FEED