ASUS IoT Enhances Edge AI Computers with NVIDIA Jetson Orin Super Mode

January 16, 2025

ASUS IoT has recently announced significant advancements in their edge AI computing solutions, focusing on the integration of the NVIDIA Jetson Orin platform and the introduction of the new Super mode. These developments substantially enhance the performance capabilities of ASUS IoT edge AI computers, particularly the models PE1102N, PE1101N, and PE1100N.

Introduction of Super Mode

Unveiling Super Mode

Super mode is a groundbreaking feature activated on the NVIDIA Jetson Orin NX and Orin Nano series, providing up to 2X higher generative AI model performance. This enhancement increases AI TOPS by up to 1.7X and memory bandwidth by up to 1.5X, significantly boosting the processing power of these devices. Specifically, the Jetson Orin NX 16GB modules can deliver up to 157 TOPS (Sparse), making them highly efficient for demanding AI applications. The added processing capacity is a game-changer, allowing for the development and deployment of more complex and precise AI models.

The implications are vast for various industries that rely on rapid AI processing to drive real-time decisions and actions. From traffic management to automated logistics, the enhanced capabilities brought by Super mode can streamline operations, increase efficiency, and reduce costs. This increased performance directly translates to improved service quality and responsiveness, making it possible to handle larger datasets and more complex algorithms without sacrificing speed or accuracy. The introduction of this new feature is poised to set a new standard in edge AI computing, solidifying ASUS IoT’s position as a leader in this evolving field.

Performance Boosts and Capabilities

The introduction of Super mode marks a substantial leap in AI processing capabilities. This feature supports a wide variety of generative AI models, including large language models (LLMs), visual language models (VLMs), and vision transformers (ViTs). These models are instrumental in various applications, from natural language processing to image recognition and beyond. The enhanced performance ensures that these models can run more efficiently, providing faster and more accurate results in real-time applications. This capability is essential for industries that rely on quick decision-making based on data analysis.

For example, in the context of smart transportation, rapid and accurate data processing is crucial for vehicle-to-infrastructure communication, ensuring traffic flows smoothly and safely. Similarly, in smart logistics, the ability to quickly analyze and respond to data can significantly enhance supply chain efficiency. The versatility provided by Super mode ensures that AI models can operate seamlessly across different applications, meeting the diverse needs of various sectors. This capability is a testament to how advanced technology can transform everyday operations, fostering innovation and improving outcomes.

Compatibility and Framework Support

Broad Framework Compatibility

ASUS IoT edge AI computers powered by the NVIDIA Jetson Orin platform are compatible with popular machine learning frameworks such as Hugging Face Transformers, Ollama, llama.cpp, vLLM, MLC, and NVIDIA TensorRT-LLM. This broad compatibility ensures that developers can easily integrate their preferred AI models and frameworks, facilitating a seamless development process. By supporting a wide range of frameworks, ASUS IoT allows developers the flexibility to choose the best tools for their specific needs, enhancing the overall development experience.

This compatibility is crucial for fostering innovation, as it allows for the rapid prototyping and deployment of AI models across various applications. Developers can leverage familiar tools and libraries, reducing the learning curve and accelerating time-to-market for new AI solutions. This flexibility also means that companies can adapt to changing technology landscapes, staying ahead of the curve in an ever-evolving industry. The broad compatibility offered by ASUS IoT’s edge AI computers positions them as versatile and future-proof solutions for AI development.

Enhanced AI Model Support

The support for a diverse range of AI models means that these edge AI computers can handle various applications, from natural language processing to computer vision. This versatility makes them ideal for industries that require sophisticated AI solutions, such as smart cities, smart transportation, and smart logistics. The ability to support various AI models ensures that ASUS IoT edge AI computers can be tailored to meet the unique needs of different sectors, providing customized solutions that drive efficiency and innovation.

For instance, in smart cities, AI models can be used to analyze traffic patterns, optimize public transportation, and enhance public safety through real-time surveillance. In smart logistics, AI can optimize routing, manage inventory, and predict supply chain disruptions. The comprehensive support for different AI models ensures that these edge AI computers can deliver on these capabilities, providing robust solutions that address the specific challenges faced by each industry. This adaptability is a key advantage, enabling the widespread adoption of AI technology across diverse applications.

Enhanced Hardware and Applications

Optimized for Generative AI Workloads

The ASUS IoT edge AI computer models—PE1102N, PE1101N, and PE1100N—are specifically designed to handle generative AI workloads more efficiently. These models are compact, versatile, and feature extensive connectivity options, making them suitable for a wide range of applications. Whether it’s smart parking, traffic analysis, or in-vehicle systems, these devices are equipped to deliver high performance. Their optimized design ensures that they can handle the demands of generative AI workloads, providing reliable and efficient performance in various scenarios.

The enhanced hardware capabilities of these edge AI computers make them ideal for a variety of smart applications. In smart cities, they can be used for real-time traffic analysis and smart parking solutions, ensuring that city infrastructures operate smoothly and efficiently. In smart transportation, these devices can support in-vehicle systems and logistics operations, providing the necessary processing power to handle complex tasks in real time. The optimized design of these edge AI computers ensures that they can deliver superior performance across different applications, meeting the diverse needs of various industries.

Versatility in Smart Applications

The enhanced hardware capabilities of these edge AI computers make them ideal for various smart applications. In smart cities, they can be used for real-time traffic analysis and smart parking solutions. In smart transportation, they can support in-vehicle systems and logistics operations, ensuring efficient and reliable performance in demanding environments. This versatility means that ASUS IoT edge AI computers can be deployed in a wide range of scenarios, providing the necessary processing power and connectivity to drive innovation and efficiency.

For instance, in the context of smart city initiatives, the ability to analyze traffic patterns in real time can lead to more efficient traffic management and reduced congestion. Smart parking solutions can optimize parking space utilization, easing the burden on urban infrastructure. In smart transportation, the real-time data analysis capabilities of these edge AI computers can enhance vehicle safety and efficiency, leading to smoother and more reliable transportation systems. The versatility of these devices ensures that they can meet the diverse needs of different smart applications, providing robust and reliable solutions that drive innovation and efficiency.

Robust Design for Harsh Environments

Rugged Construction

ASUS IoT edge AI computers are built with rugged construction to operate in a wide temperature range, ensuring excellent thermal performance for outdoor usage. This robust design makes them suitable for edge computing environments where reliability and durability are critical. The ability to withstand harsh conditions ensures that these devices can perform consistently, even in challenging environments. This rugged construction is essential for applications that require reliable performance in extreme conditions, such as outdoor surveillance, industrial automation, and remote monitoring.

For example, in outdoor surveillance applications, edge AI computers must operate reliably in varying weather conditions, from extreme heat to freezing temperatures. Similarly, in industrial automation, these devices must withstand vibrations, dust, and other environmental factors. The rugged construction of ASUS IoT edge AI computers ensures that they can meet these demands, providing reliable performance in challenging environments. This robustness is a critical factor in the success of edge AI applications, ensuring that these devices can deliver consistent and reliable performance regardless of the conditions they operate in.

Reliability in Edge Computing

The rugged design of these devices ensures that they can handle the demands of edge computing, where real-time data processing and analysis are crucial. This reliability is essential for applications in smart cities, smart transportation, and other industries that require robust and durable AI solutions. The ability to perform under extreme conditions ensures that these devices can deliver consistent performance, providing the necessary processing power and connectivity to support critical applications.

In the context of smart cities, reliable edge AI computing is essential for applications such as traffic management, public safety, and infrastructure monitoring. In smart transportation, reliable edge AI computing can enhance vehicle safety, optimize routing, and improve overall transportation efficiency. The rugged design of ASUS IoT edge AI computers ensures that these devices can meet the demands of these critical applications, providing robust and reliable solutions that drive innovation and efficiency. This reliability is a key factor in the success of edge AI applications, ensuring that these devices can deliver consistent performance in challenging environments.

Latest NVIDIA JetPack 6.2 SDK

Super Mode Activation

The activation of Super mode requires the latest NVIDIA JetPack 6.2 SDK, which includes several updates and new features. JetPack 6.2 comprises Jetson Linux 36.4.3 with Linux Kernel 5.15 and an Ubuntu 22.04-based root file system. These updates ensure that the edge AI computers can leverage the full capabilities of the NVIDIA Jetson Orin platform, providing enhanced performance and reliability. The latest SDK provides the necessary tools and libraries to activate Super mode, ensuring that developers can utilize the full potential of these edge AI computers.

This comprehensive SDK includes a range of updates designed to enhance AI inference performance, providing the necessary tools to develop and deploy advanced AI models. The latest version of JetPack includes several new features that improve the overall performance and functionality of ASUS IoT edge AI computers. By ensuring compatibility with the latest SDK, ASUS IoT is providing developers with the tools they need to create powerful and efficient AI solutions. This commitment to staying at the forefront of technology ensures that these edge AI computers can deliver superior performance across a range of applications.

Comprehensive AI Stack

The AI stack packaged with JetPack 6.2 includes CUDA 12.6, NVIDIA TensorRT 10.3, NVIDIA cuDNN 9.3, NVIDIA Vision Programming Interface 3.2, NVIDIA Deep Learning Accelerator 3.1, and DLFW 24.0. These components contribute to the enhanced AI inference performance brought by Super mode, ensuring that the edge AI computers can deliver superior performance in various applications. This comprehensive AI stack provides developers with the necessary tools and libraries to create and deploy advanced AI models, facilitating the development process and ensuring that these edge AI computers can meet the demands of various applications.

By providing a comprehensive AI stack, ASUS IoT ensures that developers have access to the latest tools and libraries, enabling them to create powerful and efficient AI solutions. This stack includes all the necessary components to support advanced AI models, from natural language processing to computer vision. The comprehensive AI stack ensures that these edge AI computers can deliver superior performance across a range of applications, providing the necessary processing power and functionality to meet the diverse needs of different industries. This commitment to providing the latest tools and libraries ensures that ASUS IoT edge AI computers remain at the forefront of AI technology.

Overarching Trends

Advancements in AI Hardware

The major trend evident from this announcement is the rapid advancement and optimization of AI hardware to meet the growing demands of sophisticated AI models and applications. ASUS IoT’s collaboration with NVIDIA leverages cutting-edge AI technologies to deliver higher performance, which is essential for real-time data processing and analysis in various smart applications. These advancements in AI hardware are driving innovation and efficiency across various industries, providing the necessary tools to develop and deploy advanced AI solutions.

This trend reflects the growing importance of AI in modern applications, from smart cities to autonomous vehicles. The rapid advancements in AI hardware are enabling the development of more complex and sophisticated AI models, driving innovation and improving outcomes across various industries. By leveraging cutting-edge AI technologies, ASUS IoT is ensuring that their edge AI computers can meet the demands of modern applications, providing the necessary processing power and functionality to support a wide range of use cases. This commitment to innovation and performance ensures that ASUS IoT remains at the forefront of AI technology.

Industry Implications

ASUS IoT has lately revealed notable progress in their edge AI computing solutions by integrating the NVIDIA Jetson Orin platform and unveiling the innovative Super mode. These enhancements significantly boost the performance of ASUS IoT edge AI computers, especially in the PE1102N, PE1101N, and PE1100N models.

The NVIDIA Jetson Orin platform is well-known for its powerful processing capabilities, which enable more robust and efficient solutions for AI applications at the edge. By leveraging this platform, ASUS IoT aims to provide higher computational power and improved energy efficiency for various industrial and commercial uses.

The new Super mode further amplifies these benefits by optimizing system performance to handle more demanding AI workloads. This mode is specifically designed to enhance the operational capacity of ASUS IoT edge AI computers, ensuring they meet the growing demands of modern AI applications. These advancements make ASUS IoT a competitive player in the market, delivering cutting-edge technology to fuel the next generation of AI innovations.

Subscribe to our weekly news digest.

Join now and become a part of our fast-growing community.

Invalid Email Address
Thanks for Subscribing!
We'll be sending you our best soon!
Something went wrong, please try again later