1. Voice control
In people’s daily communication, speaking is the most commonly used method. If voice interaction is introduced into the wearable field, people will be able to enjoy a more natural and relaxed experience. interactive experience. Voice control allows computing devices to understand what people say and execute corresponding instructions based on what people say. For smart glasses that are small and worn on the body, voice control is an effective interaction method.
Principle of Voice Control
The core part of voice control is speech recognition technology. Bone conduction technology can achieve efficient recognition and transmission of speech, and many smart glasses use this technology. Take Buhel's Sound Glass as an example. Sound Glass is equipped with indirect bone conduction sensors. There is a sound transducer in each of his temples. The sound generated when the transducer vibrates can be transmitted to the inner ear through the bones on the side of the user's head, so that the user can hear the sound. Although voice control is an important part of smart glasses interaction method, but voice control has encountered many problems.
Defects of voice control
First of all, there are many interference factors in the extraction of speech signals, such as vocal differences between individuals and changes in their own intonation, different regions and cultural backgrounds. The differences in the way people speak, the interference of environmental noise on speech signals, etc., these factors will have a negative impact on the extraction of speech signals. Secondly, the efficiency and speed of speech recognition still need to be improved. These two points directly affect the application value of voice control in smart glasses and are important indicators of application value. In addition, users have high expectations for voice control, but the actual situation is that voice control cannot yet meet the needs of users. For example, when a user uses Google Glass to initiate a voice control command, the user must issue it strictly in accordance with the standard method provided by Google Glass. When users want to make a call, they must say ok glass, make a call to..., but the more accustomed method ok glass, call. is completely ineffective.
2. Gesture recognition
Gestures are used as input to complete the interactive functions of smart glasses. The advantage is that it uses a non-contact method. Gesture recognition technology can be divided into three categories from simple and rough to complex and sophisticated: two-dimensional hand shape recognition, two-dimensional gesture recognition, and three-dimensional gesture recognition. The difference between three-dimensional gesture recognition and two-dimensional gesture recognition is that the input information of three-dimensional gesture recognition also contains depth information. Smart glasses using three-dimensional gesture recognition can achieve more and more complex interaction methods.
Gesture recognition principles and sensors
Three-dimensional gesture recognition uses depth information and can recognize various gestures, hand shapes and movements. To obtain depth information, special hardware is required, and with the recognition algorithm, three-dimensional gesture recognition can be achieved. Next, we will introduce several sensors dedicated to gesture recognition: TMG399, which is a non-contact optical IR gesture recognition sensor equipped with a four-in-one sensor module with gesture recognition, ambient light detection, proximity sensing and color sensing; MGC3130, Microchip The 3D gesture recognition chip launched by Technology can sense gestures without contact under the action of its electric field, and can determine the coordinate position with a high precision of 150dpi within a distance of 15cm; MYO, a product of the startup company Thalmic Labs, is a wearable The armband on the arm; 16Lab, a smart ring for gesture control, has a built-in inertial sensor module, processor and low-power Bluetooth module.
Gesture recognition defects
However, gesture recognition also exposes some defects when applied to smart glasses. First of all, the accuracy of gesture recognition is low and the positioning is not accurate enough. Since everyone's hand structure is different, it is difficult to achieve accurate positioning by capturing hand movements.
Secondly, the key to gesture recognition is the extraction of finger features. It is necessary to be able to accurately distinguish the characteristics of the target in a complicated background. However, it is still difficult to overcome the situation when the gesture is blocked or the removal of redundant information. problem.
3. Eye tracking
Eye tracking is the process of measuring the gaze point of the eyes or the movement of the glasses relative to the head. Google Glass can sense the user's emotions through eye-tracking technology to determine the user's reaction to the advertisements they are looking at.
Eye tracking principle
The eye tracking measurement technology used in smart glasses is mainly based on image and video measurement methods. This method includes a variety of measurements that can distinguish eye movement characteristics. Technology, these features include the heterochromatic edges of the sclera and iris, the intensity of light reflected from the cornea, and the appearance of the pupil. Image-based methods that combine pupil shape changes and corneal reflection are widely used to measure the focus of the user's gaze.
Eye tracking flaws
Although the eyes are the most extensive and fastest way to receive information in the body, eye tracking is far from a humanized interaction method. Due to the inherent blinking and jittering characteristics of the eyes, a lot of interference signals will be generated, which may cause data interruption. This will greatly increase the difficulty of extracting accurate data from eye movement information.
What are smart glasses?
Smart glasses, like smart phones, have an independent operating system. Smart glasses can be installed by users with software, games and other programs provided by software service providers.
Smart glasses can complete functions such as adding schedules, map navigation, interacting with friends, taking photos and videos, and making video calls with friends through voice or motion control, and can achieve wireless network access through mobile communication networks. The general term for this type of glasses.
Smart glasses refer to wearable glasses that have an independent operating system like a smartphone and can realize various functions through software installation. It has been proposed in the last few years and is one of the most promising wearable smart devices.
It has the characteristics of being easy to use and small in size. The public generally believes that the emergence of smart glasses will make people's lives easier. Therefore, it has been focused on research and development by Google, Microsoft, etc., and is regarded as a future smart technology product. important growth points.
Xiaomi Smart Glasses Function Description
Xiaomi Smart Glasses Discovery Edition is similar in shape to traditional glasses. The whole machine weighs 51g, but the glasses use MicroLED optical waveguide technology to display. The MicroLED micro display screen is hidden in the frame. Through the refraction and diffusion of the light waveguide lens, the image is instantly presented to the eyes. Compared with other technical solutions, optical waveguide technology only realizes a complex optical structure through a single lens, which can significantly reduce the size and weight of the device. It can be said to be the only technology that can make smart glasses close to the form of traditional glasses.
As for the effect that your eyes see after wearing it, it is similar to what you see in science fiction movies. Although you cannot turn into Ultraman Seven after wearing it, you can see information prompts, time, etc. directly on the lenses. When reading foreign languages, the translation results can also be displayed directly on the lenses.
In terms of functionality, the Xiaomi Smart Glasses Discovery Edition can run the Android system and can be operated independently. It can receive timely notification messages for daily wear and only screen important information to avoid excessive interruption; it can be viewed through the lenses during calls. You can directly see the other party's number and have a clear conversation using the built-in microphone and speaker of the glasses; when navigating, map information is presented in front of you in real time without taking your eyes off the road, which is safe and convenient. At the same time, using the 5-megapixel camera in front of the glasses, the glasses can also realize quick photo taking and picture translation functions. The photo indicator light will light up when the camera is working to remind passers-by to protect their privacy.
Huawei smart glasses function description
Huawei smart glasses support all-weather smart broadcasting, cervical spine health management and many other thoughtful functions that provide convenience to users' lives.
In terms of hardware configuration, Huawei smart glasses are equipped with a 128mm2 speaker inverse field acoustic system and adopts a wired magnetic fast charging solution. It can be charged for 10 minutes and can be listened to for 80 minutes. When fully charged, it supports 16 hours of comprehensive wearing life, IPX4 Waterproof for life.
The all-weather smart broadcast function equipped with Huawei glasses can transmit important information such as WeChat and DingTalk to the glasses at any time. After receiving the message, it will automatically broadcast to remind users not to forget important matters. In addition, the all-weather smart broadcast function is also very effective in daily watching movies, listening to music, playing games and other scenes, and is very practical.
In terms of interaction, Huawei smart glasses have built-in capacitive touch sensing devices on the legs of the glasses on both sides. Most operations can be performed with just a tap, a stroke, or a pinch, providing users with It brings a simple and efficient intelligent interactive experience.
For users who sit for long periods of time, cervical spine health issues cannot be ignored. The all-weather cervical spine health management function of Huawei smart glasses can automatically sense changes in the user's head posture. If the user is in the wrong sitting posture for a long time, the glasses will give an early warning to the user. At the same time, the Cervical Spine Health APP can also provide users with solutions centered on cervical spine health based on the data recorded by Huawei smart glasses, and provide professional interpretation of cervical spine data.
Google Smart Glasses Function Description
Google Project Glass is an augmented reality wearable smart glasses. This pair of glasses will integrate a smartphone, GPS, and camera to display real-time information in front of the user's eyes. With just a blink of an eye, users can take photos, upload photos, send and receive text messages, and check weather and road conditions. Users can surf the Internet or process text messages and emails without using their hands. At the same time, wearing the extended reality glasses, users can use their own voice to control photos, video calls and directions. In terms of compatibility, Google Glass can be synchronized with any smartphone that supports Bluetooth.
The main structure of Google Project Glass includes a camera suspended in front of the glasses and a wide strip of computer processor device located on the right side of the frame. The camera is equipped with 5 million pixels and can shoot 720p video. The lenses feature a tiny head-mounted display that projects data onto a small screen above the user's right eye. The display looks like a 25-inch HD screen from 2.4 meters away.
There is also a parallel nose pad and nose pad sensor that can be placed across the bridge of the nose. The nose pads can be adjusted to suit different face shapes. Capacitors are implanted in the nose pads, which can identify whether glasses are being worn. The battery can support a day of normal use, and can be charged using a Micro USB interface or a specially designed charger. Distance and direction are displayed on the screen based on ambient sounds, and map and navigation information technology products are displayed on two eyepieces respectively.
Google Project Glass weighs only a few dozen grams and has 682MB of memory. The operating system it uses is Android 4.0.4 version number Ice Cream Sandwich, and the CPU it uses is the OMAP 4430 processor produced by Texas Instruments. . This chip was used in two mobile phones produced by Motorola in 2011: Droid Bionic and Atrix 2. The sound system uses bone conduction sensors. Network connectivity supports Bluetooth and Wifi-802.11b/g. Total storage capacity is 16GB, synced with Google Cloud. The accompanying My Glass application requires Android 4.0.3 or higher system version; the MyGlass application needs to turn on the GPS and SMS sending functions.