Tencent Hunyuan releases technical report on Hy-Nomas and launches Hy-Nomas-Bench benchmark for world models
Read more
Pandaily
pandaily.com

Tencent Hunyuan releases technical report on Hy-Nomas and launches Hy-Nomas-Bench benchmark for world models

Tencent Hunyuan has presented a technical report on Hy-Nomas, its open model for interactive world generation, and released Hy-Nomas-Bench—a test suite for evaluating interactive world video models. The report was posted on arXiv on October 27, following the initial release of the code and weights on October 21.

Hy-Nomas is a world video model based on an 8-billion parameter diffusion core. Users can control it over multiple iterations using free-form text prompts, continuous camera control, or a combination of both methods. The model generates the world segment by segment, ensuring scene consistency over time by conditioning each new segment on the current input and saved history.

According to the report, the key concept involves aligning structured video captions with causal attention that accounts for actions. Descriptive context remains available between segments, while action-related instructions are applied only to the corresponding time window. A vision-and-language-based prompt enhancer transforms user queries and interaction history into structured conditions for the next segment.

The training process follows a multi-stage curriculum. It begins with causal generation, then moves to text interaction and camera control, after which the model trains on histories it generated itself, concluding with a diffusion distillation step. The distilled model requires only four to eight denoising steps. In human evaluations, the team noted that Hy-Nomas surpassed existing world models.

Hy-Nomas-Bench includes 280 test scenarios covering four tasks: multi-turn free-form text interaction, camera navigation, alternating text and camera control, and spatial memory. This suite tests the model's ability to follow sequential instructions, generate physically plausible responses, accurately execute camera movements, and maintain scene consistency when the camera returns to a previously visited location. The kit includes prompts, structured captions, interaction sequences, and reference camera trajectories, and is released under the Apache 2.0 license.

The model itself is also distributed under the Apache 2.0 license. Tencent provides an INT8 configuration that runs on a single RTX 4090 using a sliding window history and CPU offloading, as well as a Diffusers pipeline, LoRA fine-tuning code, and an interactive web demo. Among the released adapters are a cinematic LoRA and a robotics LoRA trained on real data from a two-armed robot.

Developers outside the ecosystem have already integrated support into SGLang, ComfyUI, and WanGP, and one community demo project reported generating 720p in real-time on Google TPUs.

Similar stories

Tencent announces support for visual understanding in future Hy4 and Hy4 flash models
Read more
technode.com

Tencent announces support for visual understanding in future Hy4 and Hy4 flash models

Tencent's Executive Vice President, Dongsong Tang, announced at the Tencent Global Digital Ecosystem Conference on October 29 that the company plans to soon release the Hy4 and Hy4 flash models, adding the function of visual understanding to its lineup of artificial intelligence models.

Compared to the preliminary version of Hy4 presented in August, the full Hy4 model will demonstrate improved performance in tasks requiring extended reasoning and execution, including real productivity workflows. Furthermore, Tencent aims to enhance reasoning efficiency.

The Hy4 flash model will be focused on cost-effectiveness while retaining visual understanding capabilities and AI agent functions. The preliminary Hy4 version has a total of 770 billion parameters, with 49 billion parameters activated during inference, and it supports a context window of one million tokens. Tang noted that Tencent is jointly developing its models and products to improve their efficiency in practical applications.

Tencent Hunyuan releases Hy-SimulMT model for simultaneous speech translation with approximately 3-second delay
Read more
pandaily.com

Tencent Hunyuan releases Hy-SimulMT model for simultaneous speech translation with approximately 3-second delay

Tencent Hunyuan has released and made publicly available the Hy-SimulMT model—a simultaneous translation system that translates Chinese speech to English and vice versa while the speaker is still talking. This model reproduces the speaker's voice in real-time, allowing listeners to hear a translation very close to the original voice.

According to information from IT Home, as well as the project pages on GitHub and Hugging Face, the model is initially available for free in the Hy Translate application. A key parameter is the latency; Tencent measures it using the standard streaming translation metric StreamLAAL and reports a value of about 3 seconds on the long RealSI benchmark, which is the lowest among comparable systems. The project clarifies that StreamLAAL differs from the time required to hear the first translated utterance.

For comparison, IT Home indicates that the typical delay for professional human translators ranges from 4 to 5 seconds. Regarding quality, the GEMBA score of the Hy-SimulMT model in long speeches surpassed open models in comparison and four out of five tested commercial APIs. On short datasets, it achieved results of 90.3 on FLEURS, 75.5 on CoVoST2, 81.2 on ACL6060, and 84.7 on RealSI-Sentence, with the latter being the highest among all listed systems.

The team also conducted a comparison of the model with human translators across 18 recordings, each lasting about six minutes, recorded in September 2026 across 10 different domains. Six translators participated in the study: three held the CATTI Level 1 certificate recognized in China, and three held Level 2, with the best result from each level being used. Tencent calls this a small-scale evaluation. Wang Ziyue, Deputy Dean of the School of Interpretation and Translation Studies at Guangdong University of Foreign Studies, noted in a press release published upon release that the system speaks first and then self-corrects, similar to a human translator, and that AI translation is moving from aiding comprehension to usable communication in low-risk settings.

The released model is a mixture-of-experts type system with 30B-A3B, available in FP8 and GGUF builds, as well as an Interleave variant that also outputs the original transcript. The Hugging Face page specifies the Apache 2.0 license. Tencent provides two tools: SimulInfer, a serving stack built on vLLM with a web interface, WebSocket API, and optional text-to-speech conversion, and SimulTrain for further fine-tuning on domain-specific data. Integration with llama.cpp is not yet complete.

This release follows earlier open translation models from Hunyuan and marks a shift from text format to live speech—an environment where latency is most critical.

Anyverse Dynamics releases MWA-Phoenix, a 7B On-Device World Action Model for robots
Read more
pandaily.com

Anyverse Dynamics releases MWA-Phoenix, a 7B On-Device World Action Model for robots

Anyverse Dynamics, a company specializing in embodied artificial intelligence development, has released and made publicly available the MWA-Phoenix model. This model is a latent-space world action model designed to serve as a foundational model for robotic manipulation. The model is pre-trained, contains 7 billion parameters, and is engineered to run directly on the robot itself. The code is available on GitHub, and a technical report has been published alongside it.

MWA-Phoenix operates exclusively based on input from an RGB camera and does not utilize depth data obtained from truth sources. According to the company, the model achieved first or top rankings in six different tests with varying focuses. It scored 94.63% on LIBERO-Plus, which includes disturbances such as sensor noise, lighting, and camera angle; 66.48% on LIBERO-Pro, which alters targets, object positions, and the objects themselves; 82.67% on RoboCasa GR1 Tabletop, which is 7.5 points higher than the previous WALA model; and 72.42% on the two-armed RoboTwin 2.0 benchmark.

Furthermore, results were presented on the RoboDojo leaderboard for real robots, covering three types of robots and 18 tasks. Perhaps the most significant result is the score on Bench2Dex, which involves 12 combinations of robotic arms and dexterous hands. Phoenix demonstrated an average score of 45.6%, which the company claims exceeds the best baseline pi0.5 by 17.3 points. This absolute score demonstrates that skill transfer between different robots remains a complex challenge.

Technically, the model employs DINOv3 as its visual backbone and extracts knowledge from two teachers: VGGT for geometry and V-JEPA for temporal changes. A causal semantic VAE compresses these features into a compact representation without analyzing future frames. Subsequently, a video expert and an action expert communicate via cross-attention, allowing the model to simultaneously predict scene changes and determine what the robot should do.

Two additional releases aim to bridge the gap between simulation and real hardware. Phoenix-ILA integrates motion and contact into action learning for fine manipulation, while Phoenix-PhysCanvas is an interactive simulated world model where policies can continue to improve in the cloud before deployment. For real-time control, the team implements asynchronous execution so that the next action segment is prepared while the robot is still moving.

The pre-training data was sourced from real robot operation, human videos from an egocentric viewpoint, and UMI captures with manual filming. Anyverse Dynamics states that it possesses over 200,000 hours of multimodal data and is working on training larger models. The company emphasizes that all reported benchmarking metrics are proprietary, and no test data was used during training.

Popular