产品简介

[ Robotics RB5 开发平台 ]

机器人RB5开发、学习平台

Robotics RB5平台采用的Qualcomm QRB5165处理器拥有强大的异构计算架构，以及业界领先的第五代Qualcomm®人工智能引擎AI Engine，实现15 TOPS的AI性能，运行复杂的人工智能和深度学习任务。提供高精准度的机器学习（ML）能力、可支持七个并行摄像头的强大ISP、专门面向增强视频分析（EVA）的计算机视觉引擎，以及全新Qualcomm® Hexagon™张量加速器（HTA）。通过配套模组实现对4G和5G的支持

产品标签: 高通865; Robotics RB5; 机器人主板

产品方案详情

应用领域

平台特性

重点优势

强大的异构计算能力

Robotics RB5平台采用的Qualcomm QRB5165处理器集成了八核Qualcomm Kryo 585 CPU、强大的Qualcomm Adreno 650 GPU、多个DSP（包括计算、音频和传感器）和ISP，可以实现强大的计算性能。该平台还包含集成Hexagon张量加速器（HTA）的性能强大的专用AI Engine，以及计算机视觉专用硬件模块——增强视频分析引擎。

尖端的图像能力

集成Qualcomm Spectra™ 480 ISP能够捕捉快速运动、专业级的照片和视频，并支持每秒20亿像素的处理速度。十亿像素级的处理速度可支持一系列出色的拍摄特性，包括拍摄杜比视界（Dolby Vision）视频、录制8K视频（30FPS）和捕捉2亿像素照片，并以零快门延时进行4K HDR视频（120FPS）和6400万像素照片的边录边拍。七个并行摄像头能够支持即时定位与地图构建（SLAM）、物体检测与分类、自动导航与路径规划，从而实现在复杂的室内外环境中高效且安全地执行任务。该平台还利用ISP支持无人机用例。

第五代Qualcomm AI Engine

高性能低功耗、高速连接、安全处理等特性结合Kryo 585 CPU、 Adreno™ 650 GPU、Hexagon 698、 Spectra™ 480 ISP 、Qualcomm sensing hub、安全处理单元、5G连接等综合的第五代AI Engine使得AI性能达到15TOPS的超高算力。通过过配套模块支持基于Qualcomm® Snapdragon™ X55 5G Modem-RF系统的5G频段。使用5G关键技术，可以广泛部署在和具具有低时延的端到端场景。

先进的连接性

平台支持远距离Wi-Fi和Wi-Fi 6（802.11ax）、蓝牙5.1以及4G和5G，提供最高水平的连接技术。

丰富的传感器组件

开发平台包含一个以机器人为中心的开发板，符合96Boards开放式硬件规范，可支持多种扩展板和传感器，如摄像头传感器、飞行时间、多模数字麦克风、GMSL传感器、扩展范围的超声波飞行时间传感器、IMU、压力传感器等。

强大的安全支持

Qualcomm安全处理单元（SPU）能够在不提升功耗的同时提供可靠的安全性。Qualcomm SPU包括安全启动、加密加速器、Qualcomm可信执行环境（TEE）和摄像头安全，并已通过FIPS 140-2认证。更多安全特性包括密钥配置安全、恶意软件防护、Qualcomm内容保护、Qualcomm移动安全、Qualcomm处理器安全和安全密匙，从而实现远程认证和安全终端的配置。此外，该平台还支持指纹、虹膜、语音和面部等生物识别认证，以满足AI和机器学习所需的高安全性。

规格参数

Component		Robotics RB5 Development Platform
SOM Platform		Qualcomm® QRB5165 Qualcomm® Kryo™ 585 Qualcomm® Adreno™ 650 GPU, Adreno™ 665 VPU, Adreno™ 995 DPU Qualcomm® Hexagon™ DSP with quad HVX Qualcomm® Spectra™ 480 image processing
RAM		8GB, LPDDR5 (POP)
Storage		128 GB UFS3.0 Onboard Storage 1 x MicroSD Card Slot
Ethernet		1 x 1GbE Ethernet
Wireless		WLAN 802.11a/b/g/n/ac/ax 2.4/5GHz 2x2 MIMO Bluetooth 5.1, on-Board WLAN/BT Antennas
USB		1 x USB 2.0 Micro B (Debug only) 1 x USB 3.0 Type C (OTG Mode) 2 x USB 3.0 Type A (Host Mode Only)
Display		1 x HDMI 1.4 (Type A - full) on Board Connector
Audio		2 x Class-D on Board Speaker Amplifier, WSA8810 1 x on Board PDM MIC on Mainboard, 4 x on Board PDM MIC on NAV MEZZ
Sensor		Accelerometer + Gyro Sensor (TDK ICM-42688/ ICM-42688-P) Barometric Pressure
Camera	Vision kit	IMX577 l * (only support in Qualcomm® Robotics RB5 Vision Kit.) GMSL l * OV9282 l * (only support in Qualcomm® Robotics RB5 Vision Kit.)
	Accessories	Panasonic® (ToF) – Sensor[MN34906] Intel® RealSense (D435i)
Expansion interfaces		Expansion connectors: HS1:1 x 60 pin high-speed connector (SDC I/F, 1 x 4L MIPI DSI, USB 2.0, CCI I2C x2, 2L+4L-MIPI CSI) HS2:1 x 60 pin high-speed connector (4L-MIPI CSI x 2, SPI x 1, PCIe 3.0 gen3 1L, USB 3.0 x1, GPIO x 8) HS3:1 x 60 pin high-speed connector (4L-MIPI CSI x 2, 4L-MIPI CSI x1(plus 2L CSI in HS1), RF CLK x 2, 2L-PCIe 3.0 x 1, 2L-PCIe 3.0 x 1(plus PCIe 1L in HS2), 4L-MIPI DSI x 1) LS1:1 x 40 pin low-speed connector (UART x 2, SPI, I2S/PCM, I2C x 2, GPIO x 12, DC powers) LS2:1 x 46 pin low-speed connector (Speaker x 2, DMIC I/F x 3, CAN, I2S, GPIOs, PWM, ADC, I2C, DC powers) LS3:1 x 46 pin low-Speed connector (SPI x 2, SSC I2C, sensor interrupt x 5, GPIOs, RTC clock, DC powers)
LED		7 x LED Indicators 4 x User Controllable 2 x For radios (BT and WLAN activity) 1 x Power indicator
Buttons		Power Volume Up/Down Force USB Boot Dip Switch x 2 (6pin+4pin)
Power source		12 V @2.5A adapter with a DC plug inner diameter 1.75mm and outer diameter 4.75mm
Size		85 mm x 54 mm meets the 96boards Hardware Specifications

The Robotics RB5 development Platform includes support for multiple SDKs and tools, including the Qualcomm Neural Processing SDK for AI, Qualcomm Robotics Vision SDK, Qualcomm Computer Vision SDK (FastCV), Hexagon DSP SDK, and Robotics Operating System (RoS).

These SDK's enable developers to implement common robotics features such as:

Object tracking, detection, and classification
Object depth estimation and obstacle avoidance
Visual localization and mapping (vSLAM)
Visual inertial odometry (VIO)
Path planning and 3D map formation
Face detection and recognition
Scene classification and understanding
Gesture and hand tracking
Voice activation and audio classification
Deep learning

Robotics RB5 software is based on Ubuntu, which allows developers to install 3rd party app and libraries to reduce the time-to-market .

The following figure is a block diagram showing the components of the RB5 platform.

The RB5 platform includes the following features:

Multiple multimedia subsystems (display, graphics, audio, video, and camera) that can be accessed from user space
- Qualcomm Technologies GStreamer plugins provide access to video and camera subsystems using the Qualcomm Multimedia Framework (QMMF)
- Qualcomm-customized Pulse GStreamer plugins can be be used for audio functionality
- Display can be Wayland/XOrg. Access is direct through the Wayland protocol for Weston applications.
Support for ROS2.0. The robotics vision modules interact with ROS2.0 per the interface specification of ROS2.0.
Sensor data available through Sensor ROS nodes
Qualcomm Technologies specific AI/ML components
- Qualcomm Neural Processing SDK accessible via a GStreamer plugin
- Support for TFLite and its associated GStreamer plugin. Standard TF Lite applications can be executed in the shell.
- Qualcomm Computer Vision SDK (FastCV) support
- Hexagon DSP support

Since the platform has Ubuntu, the standard Ubuntu application packages can be installed via apt-get.

Additional details are presented in subsequent sections of this document. Qualcomm Multimedia Framework provides access to low level API's using GStreamer elements. It is recommended to use GStreamer to access the multimedia subsystem. Refer to GStreamer documentation for more information.