Digital photonics: augmenting the value of smart glasses

Safe eye tracking, accurate color sensors and bright micro-displays make new AI and AR glasses designs possible 

Summary

Digital Photonics at a glance

Digital photonics combines light sensors, light emitters, power and logic in highly integrated, application-oriented systems. In smart glasses, these technologies support eye tracking, color sensing and near-to-eye displays, with ams OSRAM providing components and system expertise across the optical stack.

After the smartphone and the smart watch, smart glasses are now many observers’ bet to become the new center of consumers’ digital lives, the device that they use all day to discover, record, and interpret their world. 

To see and understand the world, and render information about it in front of the user’s eyes, smart glasses are using increasingly sophisticated optical technology for sensing, illumination and interfacing. The most exciting advances are in the field of digital photonics, the highly integrated chip-scale systems which combine light sensors, light emitters, power and logic in an application-oriented package. These are core functions of smart glasses, and ams OSRAM provides expertise and technology across the entire optical stack. 

Thanks to our long collaboration with the leading manufacturers of smart glasses and our deep understanding of their designs, we have developed a range of optimized solutions for the next generation of smart glasses. Digital photonics is enabling valuable functions such as safe eye tracking, true-color camera imaging, and bright, high-resolution image output at low power in near-to-eye displays. This advanced optical technology provides a key to the development of new types of smart glasses.
 

Digital photonics technology is at the heart of the functionality of next-generation smart glasses 

AI makes smart glasses smarter

Smart glasses are evolving fast. The first devices operated mainly through a voice interface to answer queries and handle messaging and voice communication. 

Today, the product is morphing into new forms: AI glasses provide an always-on connection to an agentic AI service, with context-aware information voiced in audio and/or rendered as an information overlay on a mono-color or RGB near-to-eye display. Even more sophisticated than this, AR (augmented reality) glasses can do all the above but also generate visual artifacts which can be locked to the real world rather than to the user’s gaze, such as a rendering of a favorite celebrity who remains seated next to the user no matter which part of the room the user is looking at. To enable features such as this, AR glasses include a high-brightness, high-resolution near-to-eye micro-display for the AR graphics, as well as for rendering high-quality photographs and streaming media. 

The requirements for the optical technology embedded in these new products, whether AI or AR glasses, are the same: 

  • To optimize power usage, enabling a smaller, lighter battery to support day‑long operation between charges.  
  • To save space and reduce weight, so that designers can make stylish, comfortable frames without bulky components compromising the look 
  • To attract users with valuable functionality which just works, intuitively and unobtrusively 

One notable example of the potential of digital photonics to improve functionality is safe eye tracking – technology which uses tiny LEDs inside the frame to detect the direction of the user’s gaze. 

How can integrated eye-tracking safety functions save space and simplify design? 

Space saving and user safety are top priorities for smart glasses manufacturers. This makes ams OSRAM’s digital photonics expertise particularly valuable for eye tracking. This is a core function of AI and AR glasses, as it provides: 

  • Premium functionality – eye tracking enables the glasses to determine where the user’s eyes are focused, and to present relevant information which is aware of the context. For instance, when a shopper is looking at a food shelf in a supermarket, the glasses know which product has attracted the user’s interest, and can provide information about its nutritional content. In a restaurant overseas, the glasses can see which part of the menu the user is looking at, and show a translation of just that part. 
  • Power saving – when the glasses know where the user is looking, they can provide a sharp, bright micro-display output in just that part of the in-lens display, decreasing the resolution and dimming the picture at the periphery. This saves energy by reducing the power used to illuminate the display, and by scaling back the work done by the graphics processor to render content on-screen.

Invisible light from low-power infrared LEDs illuminates the eyeballs, allowing their movement to be tracked by an IR camera


Eye tracking works by illuminating the eyeball with multiple low-power infrared LEDs. A camera facing the eye tracks the reflections as the eye moves left and right, and up and down. Algorithms calculate the direction of the user’s gaze from the camera’s output. 

Eye-tracking systems use low-power infrared LEDs and are designed to operate in compliance with international eye-safety standards such as IEC/EN 62471 and IEC 60825-1. Because the emitters are located close to the user's eye, manufacturers must ensure that the optical output remains within defined eye-safety limits under all operating conditions. The standards require consideration of faults, such as failures in the electrical or optical components. 

Manufacturers can comply by implementing a reliable method for limiting the current that can be supplied to the LEDs, and consequently limiting the amount of light that they can emit. A discrete over-current protection (OCP) switch can be inserted between the power supply and the LEDs. If a fault in the power supply lifts the drive current above a safe threshold, the OCP reports the fault to the application processor, which then triggers the OCP to shut off the current, so that the LEDs go dark. 
 

Typical eye safety protection circuit with external, discrete OCP switch 


A more advanced solution now available from ams OSRAM integrates the safety protection function into the LED driver. The AS1181 driver, which provides eight 65mA LED channels, is perfectly matched to ams OSRAM infrared emitters for eye tracking, such as the SFH4030B, simplifying system integration while ensuring reliable and consistent performance. 

Housed in a small 2.85mm x 1.7mm WLCSP package, the AS1181 includes an integrated monitoring circuit which detects fault events such as over-current, open circuit and short circuit. The AS1181’s internal switch shuts off the current to the LEDs on detection of a fault. 
 

The AS1181 integrated safety driver is simpler to integrate and requires fewer components


By using the AS1181 instead of a circuit based on an external OCP device, eye tracking system developers can: 

  • Simplify the system - the AS1181 integrates LED fault monitoring and automatic shutdown, removing the application processor from these protection functions. Integrating these functions can eliminate the need for a discrete OCP switch, reducing component count and board footprint, and simplifying the board layout.  

  • Improve performance and safety – the AS1181 runs a built-in self-test (BIST) routine at each start-up to check for correct operation. It performs continuous monitoring of temperature and LED faults. Monitoring of LED forward voltage at each channel allows the power supply to be adjusted to compensate for voltage drift over time and temperature. This ensures that stable LED brightness is maintained, for consistent eye tracking system performance. 
    These integrated protection functions support system design; compliance with the applicable eye-safety standards must still be assessed for the complete end device. 
     

Design blueprint for immediate implementation 

Smart glasses manufacturers can accelerate the product development process by adopting a ready-made design template for safe eye tracking. Ganzin Technology's Aurora IIS eye tracking reference design combines the AS1181 driver IC with SFH4030B LEDs to enable reliable eye tracking even outdoors in bright daylight. The reference design features synchronized binocular camera driving, complemented by additional driver-based eye safety protection in the AS1181. This solution powers Ganzin's AI glasses reference designs, and is ready to enable next-generation partner platforms, such as those from Ganzin’s ODM partners including Jorjin and Quanta.  

Similarly, SeeTrue Technologies supplies a smart glasses eye-tracking platform based on ams OSRAM infrared illumination technology, showing how miniature IR emitters can enable precise and reliable gaze detection in next-generation AI eyewear.supplies a smart glasses eye-tracking platform based on ams OSRAM infrared illumination technology, showing how miniature IR emitters can enable precise and reliable gaze detection in next-generation AI eyewear. 

How does digital photonics support imaging and displays in smart glasses? 

Besides eye tracking, digital photonics technology supports various other important functions in AI and AR glasses. 

For instance, advanced color sensors, which provide an accurate digital representation of ambient light, can perform tamper detection of the privacy light, helping detect whether it is blocked when the camera is operating. A multi-channel light sensor can detect the color of ambient light, to enable automatic adjustment of the display’s color balance and brightness, as well as the shade of transition lenses when exposed to bright light.  

Flicker and brightness measurement also enables automatic adjustment of camera exposure, while the latest spectral sensors for mobile applications improve image color correction and automatic white balancing,  supporting consistent colors and improved image quality in pictures taken by smart glasses. 

Optical sensors embedded elsewhere in the frame can provide a variety of other useful inputs: biosensors, for instance, can monitor vital signs such as heart rate, and UV sensors can measure exposure to sunlight, while direct time-of-flight sensors can detect user control gestures, and provide wear detection. Miniature optical force sensors turn the surface of the frame into a user control interface, eliminating the need for mechanical buttons. 

High-resolution near-to-eye micro-displays are a central feature of the new AR glasses: micro-emitters for projection displays are emerging as an attractive technology solution. ams OSRAM’s MicroLED technology is designed for efficient power usage, high brightness and precise angular resolution — key requirements for lightweight AR glasses, outdoor use and a natural field of view. MicroLED-based projection light engines from ams OSRAM can therefore support clearer images and longer operating time with a smaller battery. 

Other approaches to projection displays take advantage of ams OSRAM’s miniature integrated RGB LED or laser modules for AR micro-displays, backed by complementary custom driver ICs. 

Digital photonics expertise helps move smart glasses design forward 

ams OSRAM brings digital photonics and systems expertise together to improve the performance and efficiency of optical systems in the next generation of smart glasses. As these devices become more compact and comfortable, with advanced functions that operate longer on battery power, this combined expertise plays an important role in achieving these improvements. 

\n