Doubao Assistant opens screen automation for third-party apps; 151 applications opted out
Read more
Pandaily
pandaily.com

Doubao Assistant opens screen automation for third-party apps; 151 applications opted out

ByteDance's Doubao phone assistant announced on October 14 that the 30-day public notification period for the Screen Automation Execution Protocol (SAEP) has ended, and it will now gradually provide screen automation features for third-party applications.

According to the established rules, applications whose developers have not declared an opt-out will become available for the AI assistant agent to operate on behalf of users. It is important to note that the notification period does not imply a final refusal; developers can apply for an opt-out at any time, and the assistant will promptly disable the relevant operations upon receiving such a request. Applications that have already declared their disagreement will not be managed by the agent.

Along with this announcement, the assistant published an updated list of opting-out applications and stated that this list will be regularly updated. According to National Business Daily, the list includes 151 applications, including 65 from the Tencent ecosystem, such as WeChat, QQ, and Honor of Kings, as well as 23 applications from the Alibaba ecosystem, such as Taobao, Qwen, and Alipay. Other applications on the list include services from Kuaishou, Meituan, PDD, Xiaohongshu, Didi, Kimi, DeepSeek, NetEase Cloud Music, Baidu Maps, three major telecommunication operators, and a number of large banks.

SAEP is a declaration protocol for GUI agents—AI systems that control applications by reading the screen and simulating taps and text input. According to developer documentation, Android applications can specify which pages and actions the agent has access to: this can be the entire application level, a specific page, or a particular business intent, such as blocking input on a login page or prohibiting all operations on a payment confirmation screen.

The final decision for each action is based on the agent's identification and trust status, the system's baseline security level, the application's declared policy, and user authorization. The application policy cannot weaken this baseline level: high-risk actions, such as payments, account authentication, content publishing, deletion, or permission changes, may require user confirmation, acceptance, or task stoppage. Control implementation is carried out at system points for screenshots, accessibility access, taps, and input, and all decisions are logged for auditing by the applications so they can verify what requests the agent made and what happened.

In September, the assistant announced the priority of structured MCP and A2A connections with applications, followed by transitioning to GUI operation in cases where such connections are unavailable. SAEP establishes the rules for this fallback path.

Similar stories

ByteDance's Doubao is developing a personal AI assistant based on the Spell project
Read more
pandaily.com

ByteDance's Doubao is developing a personal AI assistant based on the Spell project

According to reports from Chinese media citing informed sources, ByteDance's AI assistant Doubao is working on creating a standalone product in the form of a personal assistant. Sina Tech reported on September 29 that Doubao began internal testing of a research assistant product codenamed Spell in April. National Business Daily published similar information on the same day.

ByteDance has not yet made an official announcement about the product, its final name, or launch date. According to sources, the Spell project was led by the team responsible for the Doubao phone assistant, and its development was not fully disclosed due to the deadlines for the release of the Doubao phone version.

Sources claim that Doubao now plans to integrate Spell more deeply into its main product. The Spell project team, together with the Doubao chat team, is responsible for the new product, which is expected to be available to users soon. An unverified social media post claimed that the Doubao teams were tasked with creating an internal test version by September 30 during the Mid-Autumn Festival holidays, raising questions among some industry commentators regarding the realism of this deadline.

The proposed product will expand the functionality that Doubao has already implemented on mobile devices. The Doubao phone assistant was presented in a technical preview in December 2025 on a nubia engineering device built using ZTE technologies, and the consumer version was released in mid-September on the nubia NaviX Ultra. It is capable of performing cross-application tasks, such as tracking deliveries and ordering food.

It is noted that Spell represents a shift from a system assistant tied to specific phones to an application that can run on any smartphone. Previously, Doubao released Doubao Work, an agent product for office tasks, at the end of August.

Personal agents that perform tasks rather than just answering questions have attracted significant attention this autumn. Products like Muse and Instinct have gained users worldwide, and Chinese companies are moving in the same direction. At the Apsara Conference on September 22, Alibaba's Qwen announced its intention to accelerate work on a personal agent, and according to reports, Tencent is testing a personal agent called Handy Bot through the WeChat service account.

Commentators point out that personal agents still face open questions regarding the scope of authority users are willing to grant them, as well as whether platforms for shopping, travel, and payments will open their services to third-party agents. How the Doubao product will handle permissions and task execution will only become clear after confirmation from ByteDance.

Popular