Along with several of her Rockwell Collins’ colleagues, Emily Flaherty-Woods is attending CES®, the global technology event, January 8-12, in Las Vegas, Nevada. CES is one of the world’s premier events to see, hear and feel how technology is reshaping our world … especially how it’s impacting the aviation and aerospace sectors. Emily is sharing her thoughts on this year’s show in a daily blog for Insights followers.
THURSDAY, JANUARY 11
With the third day of CES drawing to a close, I can officially say my eyes need a break from the bright lights of the Las Vegas strip and inside the Las Vegas Convention Center. As always at CES, the latest and greatest display technologies are showcased in many exhibitors’ booths. Discussed below are some of the most interesting display technologies I observed. I also discuss one of the major technology trends emerging over the past three days: the anticipated arrival of 5G.
8K OLED Displays
Nearly every major display manufacturer features their latest 8K television. The 8K displays offer crisp images, intense color, and stunning contrast. Most 8K manufacturers also place an emphasis on content generation to support the new devices. One manufacturer even claims to be using AI and machine learning to natively upgrade lower resolution video to 8K quality. The company utilizes a proprietary algorithm that learns from itself how to upgrade the resolution of the content it shows. Additionally, 4K technology continues to improve, becoming lighter, thinner, and lower cost. Many companies also feature 4K “Wall-Paper” displays, ultra-thin and ultra-high definition monitors.
3D OLED Displays
Multiple exhibitors featured 3D displays that provide users with a unique visual and operating experience. Many manufacturers took a traditional approach to 3D displays, with the image popping out toward the user. This 3D display method creates a good viewing experience for the user directly in front of the display, but a distorted image for viewers standing off-center from the display. Other manufacturers take a non-traditional approach, layering a transparent OLED display onto a 4K display to create the illusion of depth. This type of display offers a crisp multi-dimensional image, even for users standing off center from the display and is showcased in many automotive concept cars.
The major downside of touch screens in human-machine interface design, is that traditional touch screens do not provide user input feedback. This requires users to go heads down while utilizing the touch screen. To remedy this issue, multiple exhibitors showcase haptic touch screens that provide vibrotactile feedback on touch screen selection. This technology enables operators to navigate touch screens and realize their inputs without having to transition to heads-down operations. If this technology were integrated with touchscreen avionics, pilots would likely experience a reduced workload and extended periods of eyes-forward operations. All of the companies that showcase haptic feedback in their touch displays offer limited information about how the technology is actually implemented, but several companies have developed fairly robust solutions of capacitive touch screens with variable tactile feedback.
The Promise of 5G
It is clear that many companies anxiously await the arrival of 5G. The super-high speeds 5G is expected to offer will enable devices to offload demanding computational tasks that may make products smaller, lighter, faster, and more responsive. Many exhibitors appear to rely on the delivery of 5G to enable key technology capabilities that they promise in future products. For example, nearly every automobile manufacturer expects 5G to enable online voice recognition in future cars. It seems everywhere you look at CES, exhibitors make claims about the technology capability of future products, with the assumption that 5G will be available to enable those future capabilities. Although the arrival of 5G is nearly guaranteed, the question is how long we will wait to get the 5G speed that is needed for many future technology improvements.
Another exciting day at CES has ended! Tomorrow is the last day and this means that will be my last blog. I look forward to sharing my final CES thoughts with you.
WEDNESDAY, JANUARY 10
Today at CES, I explored the North and South Halls of the Las Vegas Convention Center. The North Hall is the main showcase location for most large automotive manufacturers and vehicle technology exhibitors. The South Hall has a wider variety of technology marketplaces, but is the primary location for augmented and virtual reality vendors. Here are some of the major technology trends I observed in each hall.
North Hall – Vehicle Technology
So why is a flight deck systems engineer interested in future automotive technology? Ideas and inspiration! Believe it or not some of the great technology that we see first in cars is, with some tweaks here and there, applicable to aircraft. In fact, automotive designers and engineers face some of the same challenges as aircraft designers and engineers: vibrations/turbulence in the cockpit, human-in-the-loop system design, and durability and robustness requirements.
The North Hall of the CES convention center is packed with major automotive manufacturers and vehicle technology providers showcasing their most innovative concepts and high-tech research products. Companies like Hyundai, Nissan, Mercedes, Toyota, and Honda each have their own futuristic vehicle prototypes on display. Although each of the designs is unique, there is a common thread connecting all the concepts: autonomous vehicle technology.
Most of the companies’ autonomous vehicle prototypes focus on Level 3 and Level 4 autonomy, which will still require drivers to stay in the loop and operate certain parts of the route. Thus, most of the concept vehicles have minimalistic but user-friendly vehicle interfaces incorporating technologies like touch screens, gesture-based controls, and eye tracking or facial recognition systems.
Additionally, most of the designs incorporate some form of “emotion recognition.” Emotion recognition uses big data analytics, artificial intelligence (AI), and operator physiological monitoring to improve the driver’s experience. Physiological information such as facial expressions, voice tone, skin conductance, heart rate, etc. is used to characterize drivers’ emotional responses to certain scenarios. The emotion response data can then be used to train autonomous systems so that they behave in ways that please operators.
One example of an emotion recognition system in action is a scenario in which the autonomous vehicle acts in a way opposite to what the operator expects. For example, if the vehicle accelerates through a yellow light when the operator expects the vehicle to decelerate, it could trigger an adverse reaction from the operator. That emotional response information would then be used to train the vehicle’s AI such that, in the future, the vehicle makes more conservative and pleasing acceleration decisions for the driver.
Emotion recognition systems could also be useful in future aircraft with increasingly autonomous systems. These concepts may be helpful to characterize situations that require more explainable autonomy—providing information as to why the autonomous system is behaving in a certain manner—to build trust amongst the autonomous system and operator.
In addition to the many concept cars and driving technologies, there is an overwhelming amount of vehicle technology showcased concerning smart, vision-based sensors. Many companies showcased intelligent sensors such as LIDAR and radar with built-in AI, for obstacle, landmark, and pedestrian detection and tracking. These vision-based sensors are marketed as high fidelity, low cost, and easy to integrate into exiting autonomous vehicle concepts. These sensors will need to be mounted onboard autonomous vehicles of the future to enable higher-level autonomous operations.
South Hall – Augmented and Virtual Reality
In recent years, a number of high-quality, consumer-ready AR and VR headsets have been productized by large technology giants such as Microsoft, Google, and Oculus. These major AR and VR players have come to market with a complete solution, high-quality optics, head tracker, and a compact head-worn device.
Today, many small- to mid-sized companies showcased and demoed their latest augmented and virtual reality products. However, few of these companies offer a complete solution that will compete with the major AR and VR players. Some of these companies have technology components, such as high-resolution optics, which are comparable to the major players, but are lacking a complete solution to be productized for the consumer market. Developing a complete AR or VR headset is no small feat, and it seems the biggest hurdle for most companies is providing a high-quality, head-tracking solution. In the coming years, as AR and VR become more mainstream, I am sure we will see more small- to mid-size companies revealing complete AR and VR solutions that can compete with today’s technology giants.
Another exciting day at CES! Now, to put my feet up and get a good night’s rest. I cannot wait to discover more technology at CES, and look forward to sharing my thoughts with you tomorrow.
TUESDAY, JANUARY 9
This year I have the fantastic opportunity to attend CES, one of the world’s largest technology showcases. There are more than 4,000 exhibitors ranging from small startups to the biggest technology brands in the business. The technologies showcased at CES cover a wide range of the consumer technology market, including automotive, digital heath, connected home devices, robotics, virtual reality and gaming. However, the focus of my trip, and of my daily summaries, will be on innovative and disruptive technologies that could influence the aviation industry. After just one day scouring the showcase floor, several technology trends have started to emerge: autonomy, artificial intelligence, and augmented (or virtual) reality. It seems wherever you look in the CES exhibition halls there are products addressing the need for future autonomous systems, deep learning techniques, and innovative twists for traditional augmented and virtual reality systems. Discussed below are a few of the most interesting technologies I observed today:
Smart Cockpit Designs
One company features three different concept car cockpits. The first concept car vision is targeted to enter service in 2022. This design features five LED displays, three touch-screen displays in the dashboard, one center touch-infotainment panel, and one rear-view camera display. Perhaps the most interesting feature in this design was the Active Surface Interior Panels, which consists of an OLED, covered by a touch layer, and then finished with a thin wood layer. These panels offer a sleek and clean finish for touch features embedded into the center console.
The second concept car is designed for a 2025, level 3 autonomous system. This design features a narrow panoramic display across the dashboard, a windshield display, a stow-away dashboard display and a gaze detection system. This design incorporates two operating modes—manual and autonomous—and the vehicle automatically configures the displays and content based on the operational mode.
The third design is a concept for a level 5 autonomous vehicle. This concept features an innovative vehicle living space using a variety of advanced technologies such as a retinal scanner to unlock the vehicle, biometric monitoring to automatically adjust the temperature for each passenger, and transparent OLED displays for side windows.
Virtual Reality Headset
Another company is showcasing their latest generation, virtual reality headset, which provides a 210ºx130º field of view and 5K resolution image made using custom, dual, Fresnel lens. The headset is lightweight, offers a three-point head strap, and can support multiple head-tracking solutions. This product is impressive and offers a truly immersive experience. Never have aliens seemed so real as in this demo.
Multiple startup companies are showcasing unique “brain sensing” technologies. Brain sensing seems like a concept straight out of the movies, but at the root of this technology are small physiological sensors that can monitor brain activity, similar to traditional EEG devices. Most companies feature the brain sensing devices as small sensors integrated into lightweight glasses or virtual reality devices. The emergence of lightweight, noninvasive, low-cost brain sensing technologies in the consumer market may open up new opportunities in the aviation industry. Specifically, this technology could provide new methods for actively monitoring a pilot’s physiological conditions in the cockpit.
What a day! I can’t wait to discover more technology at CES tomorrow, and look forward to sharing my thoughts with you throughout my trip.