CN217787508U

CN217787508U - AR equipment capable of capturing facial expressions

Info

Publication number: CN217787508U
Application number: CN202221985433.3U
Authority: CN
Inventors: 不公告发明人
Original assignee: Odin Information Technology Co ltd
Current assignee: Odin Information Technology Co ltd
Priority date: 2022-07-29
Filing date: 2022-07-29
Publication date: 2022-11-11
Anticipated expiration: 2032-07-29

Abstract

According to the utility model discloses, an AR device capable of capturing human facial expressions is provided, which comprises an AR glasses main body, a main control board and a power supply are arranged on the AR glasses main body; a first attachment detachably connected to the AR eyeglass body, located at an upper portion of the AR eyeglass body and provided with at least 2 cameras thereon, lenses of the at least 2 cameras facing around eyes of a person wearing the AR device; a second accessory removably attachable to the AR eyeglass body, extending to a lower portion of the AR eyeglass body and having at least 2 cameras disposed thereon, the lenses of the at least 2 cameras facing around the mouth of the person wearing the AR device. The disclosed AR equipment capable of capturing the facial expressions uses the detachable accessories to realize tracking of the facial expressions, and the control experience of the AR is enhanced.

Description

AR equipment capable of capturing facial expressions

Technical Field

The present disclosure relates to image acquisition and processing, and in particular, to AR devices that can capture facial expressions.

Background

At present, the AR industry does not have a mature face capturing system and cannot accurately track the face. Therefore, when the AR equipment conducts social and expression interactive games, the facial expression of the virtual human is stiff, and actual experience is not ideal. The expression is the main medium for human to transmit emotion, and subtle changes of the expression all participate in emotion transmission, so that the rhythm and amplitude of detail motion of the face are obtained and tracked, and the control fidelity of the virtual human in the AR is directly influenced.

The existing AR equipment has the problems that the facial expression is not vivid enough, not smooth and the like in the game. Therefore, there is a need for an AR device that can implement the functionality of facial capture to capture human facial expressions such as smiling, frowning, lip biting, etc. by recognizing facial muscle actions.

SUMMERY OF THE UTILITY MODEL

In order to solve at least one of the above technical problems, according to an aspect of an embodiment of the present disclosure, there is provided an AR device that can capture a facial expression, including an AR glasses main body on which a main control board and a power supply are disposed; a first attachment detachably connected to the AR eyeglass body, located at an upper portion of the AR eyeglass body and provided with at least 2 cameras thereon, lenses of the at least 2 cameras facing around eyes of a person wearing the AR device; a second accessory removably attachable to the AR eyeglass body, extending to a lower portion of the AR eyeglass body and having at least 2 cameras disposed thereon, the lenses of the at least 2 cameras facing around the mouth of the person wearing the AR device.

According to the AR equipment that can catch facial expression of the embodiment of this disclosure, optionally, be provided with LED light filling banks on first and the second accessory respectively.

According to the AR device capable of capturing facial expressions of the embodiment of the present disclosure, optionally, the cameras disposed on the first accessory and the second accessory include micro infrared cameras, and the LED supplementary lighting lamp set includes micro infrared LED lamps.

According to the AR device capable of capturing the facial expression of the embodiment of the present disclosure, optionally, the main control board of the AR glasses main body is connected to each of the cameras on the first accessory and the second accessory in a wired or wireless manner, and the main control board sends a driving signal for synchronous shooting to each of the cameras and receives shot data from each of the cameras.

According to the AR device capable of capturing the facial expressions, any one or two of the first accessory and the second accessory are optionally connected to the AR glasses body through at least any one of the following modes: the clamping device comprises a buckle connection, a clamping piece connection, a magnetic suction connection and a threaded connection.

According to the AR device capable of capturing the facial expressions, optionally, the first fitting is connected to the upper edge of the AR glasses body and is substantially the same as the length of the glasses frame of the AR glasses body, one end of the second fitting is connected to the glasses frame or one side of the glasses, and the other end of the second fitting extends downwards to substantially face the mouth of a person wearing the AR device.

According to the AR device capable of capturing the facial expressions, at least 4 cameras are arranged on the first accessory, and the frame rate of each camera is not lower than 30 frames per second.

According to the AR device capable of capturing the facial expressions, optionally, 6 cameras are uniformly distributed on the first accessory along the upper edge direction of the AR glasses body, and 4 cameras are uniformly distributed on one end, close to the mouth, of the second accessory.

According to the AR equipment capable of capturing the facial expressions, optionally, a power interface and a signal interface are arranged at the connection positions of the first accessory and the second accessory and the AR glasses body.

The AR equipment capable of capturing the facial expressions provided by the embodiment of the disclosure can install accessories capable of capturing the facial expressions on the AR glasses main body through a specific connecting structure, so that the tracking of the facial expressions is realized, and the control experience of AR is enhanced. In addition, the accessories on the AR glasses can also be removed to be used as conventional AR glasses.

The embodiment of the disclosure can adopt a plurality of high-performance miniature infrared cameras and is matched with a miniature infrared LED light supplementing lamp set, so that the influence of light rays is avoided, the size is small, the weight is light, and more accurate expression tracking can be realized.

It is not necessary for any device embodying the present disclosure to achieve all of the above-described advantages at the same time. Additional features and advantages of the disclosure will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the disclosure. The objects and advantages of the embodiments of the disclosure may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

To more clearly illustrate the technical aspects of the embodiments of the present disclosure, reference will now be made briefly to the accompanying drawings of the embodiments, and it is to be understood that the drawings in the following description relate only to some embodiments of the present disclosure and are not intended to limit the same.

FIG. 1 is a schematic diagram of an AR device that may capture facial expressions according to one embodiment of the present disclosure;

FIG. 2 is a schematic diagram of the AR device shown in FIG. 1 shown from another angle;

FIG. 3 is a schematic diagram of an installation process of a facial expression capture accessory of an AR device capable of capturing facial expressions according to one embodiment of the present disclosure.

Detailed Description

To make the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings of the embodiments of the present disclosure. It is to be understood that the described embodiments are only a few embodiments of the present disclosure, and not all embodiments. Various embodiments may be combined with each other to form other embodiments not shown in the following description. All other embodiments, which can be derived by a person skilled in the art from the described embodiments of the disclosure without any inventive step, are within the scope of protection of the disclosure.

Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and similar terms in the description and claims of this disclosure do not denote any order, quantity, or importance, but rather the terms are used to distinguish one element from another. Also, the use of the terms "a" or "an" and the like do not necessarily denote a limitation of quantity. The word "comprising" or "comprises", and the like, means that the element or item preceding the word comprises the element or item listed after the word and its equivalent, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used only to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.

Fig. 1 is a schematic diagram of an AR device that can capture facial expressions according to one embodiment of the present disclosure, and fig. 2 is a schematic diagram of the AR device shown in fig. 1 shown from another angle. The AR device includes an AR eyeglass body 10, a first attachment 20, and a second attachment 30. The AR glasses main body 10 includes a main control board 40 and a power supply 50 thereon, which may be provided at the temple part. The main control board 40 may include one or more of bluetooth, WIFI, or other wireless transmission modules.

The first fitting 20 may include a first camera array 22 that includes at least 2 cameras table-up to around the wearer's eyes. The first accessory may also include a first LED light bank 24 for supplementing light to the scanned object. The LED lights in the first LED light group 24 may be positioned adjacent to each camera (e.g., one LED light on each side of each camera). The first fitting 20 is located at an upper portion of the AR eyeglass body, which is detachably connected to the AR eyeglass body. The connection between the first fitting 20 and the AR glasses body includes, but is not limited to, a snap connection, a clip connection, a magnetic attraction connection, and a screw connection, and may be one or more of them. When attached to the AR eyeglass body, the position of the first fitting 20 is stable with the camera on the first fitting 20 facing around the wearer's eyes. More specifically, as shown, the first fitting 20 may be attached to the upper edge of the AR eyeglass body and may be substantially the same length as the frame of the AR eyeglass body. Besides the above connection modes, a signal transmission interface, a power interface and the like can be arranged between the two.

The second fitting 30 includes a second camera array 32 that includes at least 2 cameras. The second accessory may also include a second LED light bank 34 for supplementing light to the scanned object. The LED lights in the second LED light group 34 may be positioned adjacent to each camera. The second fitting 30 is located at a lower portion of the AR eyeglass body 10, which is detachably connected to the AR eyeglass body 10, or is integrally connected with the first fitting 20. The connection between the second fitting 20 and the AR glasses body includes, but is not limited to, a snap connection, a clip connection, a magnetic attachment, and a threaded connection, and may be one or more of a variety of connections. As shown, one end of the second fitting 20 may be stably fixed to one side temple of the AR eyeglass body, and the other end provided with the second camera array 32 and the second LED lamp group 34 extends downward to the vicinity of the wearer's mouth. Besides the above connection modes, a signal transmission interface, a power interface and the like can be arranged between the two.

The first camera array 22 and the second camera array 32 may include miniature infrared cameras, or all may employ miniature infrared cameras. The first LED lamp set 24 and the second LED lamp set 34 respectively comprise micro infrared LED lamps, or all of them are micro infrared LED lamps. Therefore, the equipment which is not influenced by ambient light and can still quickly capture the facial expression in a dark environment can be constructed. In addition, the infrared LED lamp set is used for supplementing light, dazzling is avoided, and daily actions of a wearer are not affected. Meanwhile, due to the use of the micro equipment, the size and the weight of the AR glasses cannot be obviously increased, and the use experience of a wearer is enhanced.

First camera array 22 and second camera array 32 each include at least two cameras. They shoot the face at the same time. In order to ensure the precision of synchronous shooting, the main control board 40 may convert pulses with a fixed frame frequency per second into a trigger signal for driving the cameras to shoot each frame, and send the trigger signal to each camera in a wired or wireless manner, so as to synchronously trigger the shooting of each frame.

For better accuracy, the first camera array comprises at least 4 micro infrared cameras. Preferably, the first camera array 22 includes 6 uniformly distributed micro infrared cameras, and the second camera array 32 includes 4 uniformly distributed micro infrared cameras. Further, the first and second camera arrays preferably employ high performance miniature infrared cameras, for example, cameras having a frame rate of not less than 30 frames per second.

The first and second camera arrays may transmit the photographed facial expression information to the main control board. The main control board converts the shot two-dimensional expression information into a corresponding three-dimensional virtual human face expression through algorithm calculation, so that the expression of the wearer is mapped to the expression of the virtual human in the AR scene.

In addition, in order to keep the stability when the camera shoots, the first accessory and the second accessory can be made of rigid materials.

Fig. 3 shows a state diagram before and after installation of a facial expression capturing accessory of an AR device that can capture a facial expression. The first and second fittings are connected to the AR eyeglass body by a specific connection means (such as the connection means described above). When the facial expression does not need to be captured, the accessory is taken down, and the AR glasses can realize conventional functions. The first and second accessories are small in size and light in weight, and do not affect wearing experience.

The device of the above embodiment of the present disclosure can achieve facial expression capture of AR glasses, so that the avatar can more realistically track the facial expression of the wearer. The fittings that catch the expression are detachable, as the independent part of AR glasses for AR glasses is more nimble in the use. Through adopting miniature infrared camera machine and infrared LED banks, this equipment can the various environment of adaptation, even if also can accurately catch facial expression in dark surrounds. In addition, by capturing data around the eyes and mouth using at least two cameras, respectively, accurate capturing of expressions can be achieved.

The above description is intended to be exemplary of the present disclosure, and not to limit the scope of the present disclosure, which is defined by the claims appended hereto.

Claims

1. An AR device capable of capturing facial expressions, comprising

The AR glasses comprise an AR glasses main body, a main control board and a power supply, wherein the main control board and the power supply are arranged on the AR glasses main body;

a first attachment detachably connected to the AR eyeglass body, located at an upper portion of the AR eyeglass body and provided with at least 2 cameras thereon, lenses of the at least 2 cameras facing around eyes of a person wearing the AR device;

and a second fitting detachably connected to the AR eyeglass body, extending to a lower portion of the AR eyeglass body and having at least 2 cameras disposed thereon, lenses of the at least 2 cameras facing around a mouth of a person wearing the AR device.

2. The AR device of claim 1, wherein the first and second fittings are respectively provided with LED fill-in light sets.

3. The AR device of claim 2, wherein the cameras disposed on the first and second fittings comprise micro infrared cameras, and the LED fill light set comprises micro infrared LED lights.

4. The AR device capable of capturing a facial expression according to claim 1 or 3, wherein a main control board of the AR glasses main body is connected to each camera of the first and second accessories by wire or wirelessly, the main control board transmits a driving signal for synchronous shooting to each camera and receives shot data from each camera.

5. The AR device that can capture facial expressions of claim 1, wherein either or both of the first accessory and the second accessory are connected to the AR eyeglass body by at least any one of: the clamping device comprises a buckle connection, a clamping piece connection, a magnetic suction connection and a threaded connection.

6. The AR device of claim 1, wherein the first fitting is attached to the upper edge of the AR glasses body and has a length substantially the same as the length of the frame of the AR glasses body, and the second fitting has one end attached to the frame or a side arm of the AR glasses and another end extending downward to substantially face the mouth of the person wearing the AR device.

7. The AR device capable of capturing facial expressions according to claim 1 or 6, wherein at least 4 cameras are provided on the first accessory, and the frame rate of each camera is not lower than 30 frames per second.

8. The AR device capable of capturing human facial expressions according to claim 6, wherein 6 cameras are uniformly distributed on said first fitting along the upper edge direction of said AR eyeglass body, and 4 cameras are uniformly distributed on the end of said second fitting near the mouth.

9. The AR device of claim 1, wherein a power interface and a signal interface are disposed at the connection of the first accessory and the second accessory to the AR glasses body.