DeepSeek releases DeepInfer code to accelerate and optimize AI model execution
Read more
Olhar Digital
olhardigital.com.br

DeepSeek releases DeepInfer code to accelerate and optimize AI model execution

Last Tuesday (20), DeepSeek made the code for DeepInfer public, a software designed to operate its artificial intelligence (AI) models. This tool was created with the goal of improving processing efficiency and reducing the time required to generate responses.

With the release of the code, developers and corporations have the opportunity to analyze the program's operation and adapt it to various projects, provided they meet the technical requirements and established terms of use. According to DeepSeek itself, this action aims to decrease energy and computational resource consumption, making AI model operation more efficient. However, practical results will depend on usage conditions and available infrastructure.

Currently, DeepInfer is specifically compatible with the DeepSeek-V4.1-Flash model. Although opening the code allows other developers to investigate and use the technology, it is important to note that not the entire company execution system has been made public, as some infrastructure components remain closed.

During his participation in the Olhar Digital News program, physicist Roberto 'Pena' Spinelli, a Machine Learning specialist, commented on this news. The researcher clarified the distinction between providing an AI model and releasing the software responsible for executing it. To explain this difference, he used the analogy of a car.

Pena detailed that simply sharing the model is not equivalent to providing all the necessary tools to operate it effectively. While the model carries the parameters that guide response generation, the inference software groups the mechanisms that enable its functioning. The opening of this code can assist developers who intend to implement their own solutions.

The specialist compared the situation by saying: 'Before, they only shared the engine blueprint, which is the artificial intelligence itself. What they are doing now is delivering the functioning of the entire car. All the software and the mechanism of how they execute the artificial intelligence have been released to the public.'

This comparison helps to understand the difference between the two elements, but there is a caveat: the availability of DeepInfer does not imply that all elements of DeepSeek's infrastructure are accessible. Nevertheless, access to the code allows programmers and researchers to study the execution methodologies employed by the company and evaluate how to apply them in other works.

The initiative may also benefit DeepSeek's commercial strategy. By sharing part of its technology, the company opens avenues for other developers to use it, contribute improvements, and create compatible applications. This adoption can expand the reach of its technology in a highly competitive market, where several companies compete to offer more accessible and efficient models.

Pena added: 'DeepSeek wants to create an ecosystem so that more people and companies start using its products.' He continued: 'By showing how to assemble the complete structure, it encourages the public to abandon more expensive paid platforms. It is a consistent way to assert itself in an extremely contested sector.'

The release of DeepInfer underscores that competition in the field of AI is not limited only to the ability of models to generate responses, but also to the efficiency required to execute them. By sharing part of its technology, DeepSeek increases the options for software use and strengthens its position in the sector. The impact of this measure will depend, among other factors, on the performance achieved in various environments and the adoption by developers and companies.

Similar stories

Dipinder Goyal plans launch of Dark.ai engine focused on AI privacy
Read more
yourstory.com

Dipinder Goyal plans launch of Dark.ai engine focused on AI privacy

Dipinder Goyal, the founder, announced his intention to enter the artificial intelligence (AI) sphere with the Dark.ai platform. This system promises to provide answers while maintaining complete user confidentiality.

Goyal informed shareholders in a letter following the publication of the company's second-quarter results that he aimed to create an AI with which one can converse without fear of judgment or leaving traces. He noted that internal use of Dark over several months allowed him to reveal more information and delve deeper into research because he no longer felt the need to be cautious.

According to Goyal, Dark utilizes state-of-the-art open models that have been fine-tuned and operate within its own infrastructure using end-to-end encryption. He emphasized that even under duress, the company would be unable to read users' conversations, and context is maintained between sessions thanks to a managed encrypted memory layer.

The need for such a solution arose from Goyal's feeling that existing AI models always possess information about people and can predict many events. Dark is being developed for founders, researchers, scientists, enterprises, and governments, as this group values privacy as a key factor in competitiveness.

In addition to ensuring privacy, Goyal stated that their models have been fine-tuned to provide the highest quality of answers, comparable to the best LLMs (benchmarks will be presented soon). He added that their models are trained not to please the user, but to report what they believe to be the truth.

Popular