眼动、面部和手部识别追踪

通过我们全方位的红外线发射器和传感器，实现新一代互动体验。

Powering next generation eye, face and hand tracking 

Eye and face tracking enable natural interaction in virtual and augmented reality systems as well as in smart glasses. Eye gaze becomes a user interface and powers photorealistic avatars, while foveated rendering reduces compute and system power. Face tracking transfers facial expressions for social and professional presence. Critical requirements include high accuracy, fast update rates, minimal power consumption, and tiny form factor. 

How eye tracking works (camera-based) 

Camera-based eye tracking combines infrared (IR) illumination (LED or VCSEL) with a CMOS globalshutter image sensor. Illumination operates in the invisible IR spectrum; reflected light from the eye is captured and processed via pupil/glint detection. Globalshutter sensors avoid rollingshutter artifacts and support ultrashort exposure times for high precision at low motion blur. 

Component examples (camera-based) 

  • MIRA globalshutter image sensors integrated in reflowable, IRenhanced miniature camera modules. 
     
  • IR LEDs for illumination, e.g., SFH4060 Firefly®. 
     
  • AS1181 multichannel LED/VCSEL driver enabling ultrashort pulses for globalshutter sensors and singlefaulttolerant safety monitoring for eye safety under all operating conditions. 

How eye tracking works (photosensor-based)

For ultra-low power, especially in all-day smart glasses, photodiode-based approaches offer advantages. IR LEDs emit short pulses, and photodiodes detect reflections from cornea/sclera. Optical reflection sensors integrate LED, photodiode, LED driver, and analog front end with digital control and readout. 

  • TMD2636 proximity/optical reflection sensing module. 

Architecture at a glance 

  • Camera-based: Highest accuracy and full image information; higher power and compute. 

  • Photosensor-based: Very low power, compact and costefficient; sufficient accuracy for many glasses use-cases.

Face tracking and avatar reconstruction

Face tracking reconstructs facial geometry and expression to drive photorealistic avatars. In VR/AR, high frame rates, low latency, and robust illumination are key to consistent facial expression transfer for social interaction, telepresence, and collaboration. 

Benefits and use cases 

  • Interaction: Eyegaze UI for precise selection and navigation. 

  • Efficiency: Foveated rendering reduces processing and system power. 

  • Safety & comfort: Invisible IR illumination; eyesafety drivers prevent limit violations even under fault conditions. 

  • Extended functions: Eye movements as potential vital signs. 

  • Design: Miniaturized modules for compact headsets and glasses. 

×

Safety & compliance 

IR sources near the eye must operate within defined eyesafety limits.
Multichannel drivers with single-fault-tolerant monitoring ensure compliance even in hardware or software fault scenarios. 

Application block diagram 

The following application block diagram illustrates potential hardware architectures for eye and face tracking in XR devices. Camerabased systems combine infrared illumination (LEDs or VCSELs) with a CMOS globalshutter image sensor to capture detailed eye and facial features. Photosensor-based systems, in contrast, use highly integrated optical reflection (proximity) sensors to enable ultra-low-power gaze detection in compact wearable designs. 

FAQ

What is eye tracking in VR/AR?

Capturing eye gaze vectors using IR illumination and sensors to enable user interfaces, reduce compute via foveated rendering, and support emerging biosignal applications. 

Why globalshutter sensors for eye tracking?

They eliminate rollingshutter artifacts, capture fast eye movements precisely, and support ultrashort exposures synchronized with IR pulse illumination. 

Camera vs. photosensor-based—what’s the difference?

Camerabased delivers maximum accuracy and full image context at higher power; photosensor-based minimizes power and size with adequate tracking performance for many glasses designs. 

How is eye safety ensured?

Multichannel drivers with singlefaulttolerant monitoring limit IR output within regulatory thresholds, maintaining compliance even during faults. 

Which components are suitable?

MIRA globalshutter sensors, SFH4060 Firefly® IR LEDs, AS1181 LED/VCSEL driver, and TMD2636 optical reflection sensor. 

特定产品

艾迈斯 Mira016 CMOS Image Sensor

Mira016是一款紧凑型16万像素(400*400)的近红外增强全局快门图像传感器，专为2D和3D消费级及工业级机器视觉应用设计。该传感器采用2.79微米像元尺寸，借助先进的背照式技术(BSI)实现高灵敏度，并配备MIPI CSI-2接口，可轻松连接各类处理器和FPGA。凭借1.8mm×1.8mm小尺寸、灵活可配置性及可见光与近红外波长区域的高灵敏度，Mira016能完美适配多种2D/3D应用场景，包括ARVR中的眼动追踪。其近红外高灵敏度和低工作功耗特性，可有效扩大测量距离并优化系统整体能耗，这对电池供电的消费类和工业应用具有关键意义。
详情和产品规格书

艾迈斯 Mira050 CMOS图像传感器

Mira050是一款紧凑型0.5MP近红外增强全局快门图像传感器，专为2D和3D消费类和工业机器视觉应用而设计。该传感器的像素尺寸小巧，为2.79 µm，采用最先进的BSI技术，灵敏度高。该传感器具有MIPI CSI-2接口，便于与众多处理器和FPGA轻松连接。由于其尺寸小巧、具有可配置性以及在可见光和近红外方面灵敏度高，Mira050非常适用于2D和3D应用，包括主动立体视觉、结构光视觉和AR/VR。近红外灵敏度高，可扩大测量范围，优化整个系统的功耗，这对电池供电的消费类和工业应用至关重要。
详情和产品规格书

艾迈斯 Mira220

Mira220是一款2.2MP近红外增强全局快门图像传感器，专为2D和3D消费类和工业机器视觉应用而设计。 由于其尺寸小巧、具有可配置性以及在可见光和近红外方面灵敏度高，Mira220非常适用于2D和3D应用，包括主动立体视觉、机器人结构光视觉和AR/VR。 
详情和产品规格书

OSRAM FIREFLY™, SFH 4060

红外线发射器 (850 nm)
详情和产品规格书

艾迈斯 AS1181 8-channel LED and VCSEL driver IC

AS1181 is an 8-channel highly integrated self-contained LED/VCSEL driver for near to eye applications such as Augmented Reality (AR) and Virtual Reality (VR) glasses. This eye-safety LED driver integrates extended safety monitoring functions to ensure eye-safe operation for smart glasses and other AR/VR applications. These safety monitors include LED short detection, LED open detection, LED overcurrent protection, LED on time monitor as well as temperature shutdown and a built-in-self test (BIST). The device is configurable via a serial wire interface (I²C or I3C) with interrupt and provides two Strobe/PWM inputs to synchronize illumination with up to two external cameras for binocular eye tracking systems. The LED current is individually programmable per channel, and it can drive up to 2 IR LEDs per current sink with a minimum ON time of 10μs and a maximum current of 66mA per channel. General purpose LED driving applications can be supported via a direct PWM input applied at the Strobe pin and it can drive RGB or white LEDs considering a maximum forward voltage of 5V. The device comes in a tiny wafer-level-chip-scale package (WLCSP) with 0.4mm pitch and dimensions of 2.9mm x 1 .75mm x 0.5mm (L x W x H).
详情和产品规格书

艾迈斯 TMD2636 红外接近检测模组

TMD2636是一款先进的红外接近传感器模组，适用于近距离接近传感测量检测，采用业界最小尺寸（1.0mm×2.0mm）和薄型（0.35mm）光栅阵列模组，集成940nm红外VCSEL，红外接近检测响应在出厂时接受校准。接近检测功能通过光电二极管检测集成VCSEL发射器发出的反射红外能量来实现接近检测。通过可调节的时序和功率可优化灵敏度、功耗和噪声。检测/释放事件由中断驱动，在接近检测结果超过上下限阈值时启动。接近检测引擎具有先进的串扰噪声消除功能，通过大范围的偏置调整可补偿传感器上不必要的红外能量反射。通过自动环境光削减功能，进一步改善接近检测结果。
详情和产品规格书
\n