WO2020062106A1

WO2020062106A1 - Device

Info

Publication number: WO2020062106A1
Application number: PCT/CN2018/108492
Authority: WO
Inventors: 林峰
Original assignee: 深圳阜时科技有限公司
Priority date: 2018-09-28
Filing date: 2018-09-28
Publication date: 2020-04-02
Also published as: CN109417579A

Abstract

Disclosed is a device, comprising a display module and a functional module. The functional module is used for implementing an object recognition function. The functional module is capable of transmitting an object recognition signal to a target object and receiving via the display module the object recognition signal at least partly reflected by the target object. The device of the present invention provides some functional modules in a display region, thus reducing the area of a non-display region, enhancing the visual appeal of the device, and improving user experience.

Description

A device

Technical field

The invention relates to the technical field of three-dimensional image sensing, and in particular, to a device with better user experience.

Background technique

With the advancement of technology and the improvement of people's living standards, devices represented by mobile phones, tablets, smart watches, etc. have gradually become an indispensable part of people's lives. At present, devices have the development trend of thin, light and large screens. As the existing devices need to occupy a part of the non-display area due to components such as the front camera, a device with a so-called "Liu Haiping" appears on the market. This non-display area design affects the aesthetics of the device to some extent. And with the gradual popularity of functions such as face recognition, the corresponding object recognition components also need to occupy a part of the non-display area on the front panel of the device. However, more components occupy a larger part of the non-display area, so that the existing devices are not beautiful to the user and the user experience is poor.

Summary of the Invention

An object of the present invention is to provide a device with a better user experience.

An aspect of the present invention discloses a device including a display module and a function module, wherein the function module is used to implement an object recognition function, and the function module is capable of transmitting an object identification signal to a target object and transmitting the signal through the device. The display module receives the object identification signal at least partially reflected by the target object.

Further, the device can obtain 3D depth information of the object through the object recognition signal, which can be used for 3D information recognition of the object.

Further, the display module includes a display screen located in a first area of the device, and the functional module includes a signal transmitter located in a second area of the device and a signal receiver located in the first area.

Further, it further comprises a main body, the display module and the function module are at least partially disposed on the main body, and the signal receiver and the signal transmitter are both disposed in the main body, wherein the signal receiving The device is arranged close to the display module or spaced from the display module.

Further, the object identification signal is infrared light.

Further, the signal receiver includes a sensor and a lens, and infrared light is irradiated to the lens and is focused on the sensor.

Further, the distance between the signal transmitter and the signal receiver is 1mm-200mm.

Further, the signal transmitter light source is a VCSEL.

Further, the first region is a region corresponding to a display screen, and the second region is a portion of the front of the device excluding the first region.

Further, the object identification signal is one or more of a light wave, an electromagnetic wave, a sound wave, or an ultrasonic signal.

Further, the function module further includes a front camera for static or dynamic shooting.

Further, the functional module further includes one or more of a speaker, a microphone, an ambient light sensor, or a flood light transmitter.

Further, the display module is used to display a screen, and an area on the front of the device is defined as a display area, and an area other than the display area on the front of the device is a non-display area. The display module includes a The display screen of the display area, the function module includes a signal transmitter and a signal receiver which are directly opposite to the display area, wherein the signal transmitter is used for transmitting an object identification signal to a target object, and the signal receiver Receiving the object identification signal at least partially reflected by the target object through the display module.

Further, the signal transmitter and the signal receiver are both located below the display screen or inside the display screen, or one of the signal transmitter and the signal receiver is located on the display screen Underneath, the other is located inside the display.

Further, the object recognition signal includes 3D structured light.

Further, the device can obtain the 3D depth information of the target object's face through the object recognition signal, which can be used for 3D facial information recognition of the target object.

Further, the device is one of a smart phone, a tablet computer, a smart watch, an augmented reality / virtual reality device, a self-driving car, or a smart robot.

Another aspect of the present invention discloses a device including a signal receiver, and the signal receiver receives an object identification signal through a component.

Further, a signal transmitter is further included, and the object identification signal is transmitted to the target object by the signal transmitter and reflected, and then passes through the element and is received by the signal receiver.

Further, the object identification signal is infrared light.

Further, the element is an element that can penetrate infrared rays, and the object recognition signal is 3D structured light.

Further, the element is a display screen.

Further, the signal transmitter light source is a VCSEL.

Further, the display screen is an OLED or AMOLED display screen, or a Mini-LED or Micro-LED display screen.

Compared with the prior art, the device of the present invention implements an object recognition function, such as face recognition, by receiving an object recognition signal reflected by an object in a display area. The device of the present invention sets components of some functional modules in the display area, which can reduce the area of the non-display area, making the device look more beautiful, and the user experience is better.

BRIEF DESCRIPTION OF THE DRAWINGS

1 to 4 are schematic diagrams of an embodiment of the device of the present invention;

5 is a schematic diagram of another embodiment of the device of the present invention;

6 is a schematic diagram of another embodiment of the device of the present invention;

7 is a schematic diagram of another embodiment of the device of the present invention;

Fig. 8 is a schematic diagram of another embodiment of the apparatus of the present invention.

detailed description

In the following, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Please refer to FIGS. 1 and 2. In an embodiment of the present invention, the device 10 includes a main body 11, a display module 12 and a function module 13 at least partially disposed on the main body 11. The display module 12 may be used to display a screen or receive a user operation instruction. The function module 13 may be used to implement an object recognition function. The function module 13 can transmit an object identification signal to an external target object, and receive the object identification signal at least partially reflected by the target object through the display module 12.

In this embodiment, the device 10 can obtain three-dimensional (3D) depth information of the object through the object recognition signal, and can be used for 3D information recognition of the object, such as 3D face recognition or 3D object recognition. In other or modified embodiments of the present invention, the device may also obtain and recognize the 2D information of the object through the object recognition signal. In this embodiment, the function module 13 can also be used for still picture or dynamic video shooting.

The display module 12 includes a display screen located in a first area of the device 10, and the function module 13 includes a front camera 14 and a signal transmitter 15 located in a second area of the device 10. The first area and the second area constitute a front side of the device 10, and the front side can be used for reading and operation by a user. The function module 13 further includes a signal receiver 16 located in the first area. The signal transmitter 15 transmits an object identification signal to a target object, such as a human face. The signal receiver 16 receives an object identification signal reflected at least in part from a target object. In this embodiment, the first area is an area for display on the front side of the main body 11, that is, the area corresponding to the display screen, may be referred to as a “display area”; the second area is the front side of the main body 11 The part of the first area may be referred to as a "non-display area". In this embodiment, the second region is located at least partially in the middle of the top of the front surface of the main body 11. The front camera 14 can be used for still picture or dynamic video shooting.

As shown in FIG. 2, the object recognition signal is transmitted from the signal transmitter 15 to a human face, reflected by the human face and passed through the display module 12 to the signal receiver 16 and received by the signal. Receiver 16.

In this embodiment, the signal transmitter 15 is an infrared light transmitter, and the signal receiver 16 is an infrared light receiver. The object identification signal is an infrared light signal, for example, infrared light with a wavelength of 800 nm to 1000 nm, especially 850 nm or 940 nm. The display module 12 has a certain light transmittance, and the infrared light can be received and identified by the signal receiver 16 after passing through the display module 12. In other or modified embodiments of the present invention, the object identification signal may also be a light wave, an electromagnetic wave, a sound wave, or an ultrasonic signal.

In this embodiment, the signal receiver 16 is disposed in the main body 11 and is disposed adjacent to one side of the display module 12. The signal receiver 16 is disposed close to the bottom surface of the display module 12, for example. The signal transmitter 15 and the front camera 14 are disposed in the main body 11. Of course, the signal receiver 16 and the display module 12 may be alternately arranged, and an object identification signal may pass through the display module 12 and be incident on the signal receiver 16.

The display module 12 includes a substrate and a pixel electrode disposed on the substrate. The signal receiver 16 is disposed below the substrate of the display module 12.

In this embodiment, the device 10 has a substantially cubic shape. The display screen of the display module 12 is a touch control display screen, an OLED screen, an AMOLED screen, or the like.

In this embodiment, the light source of the signal transmitter 15 may be a VCSEL (Vertical Cavity Surface Emitting Laser).

In this embodiment, the object recognition signal may be a 3D spatial structured light or a 3D time structured light (for example, using a TOF technology) signal. In other or modified embodiments of the present invention, the functional module 13 may further include a speaker, a microphone, an ambient light sensor, a flood light transmitter, and the like. The device 10 may be a smart phone, a tablet computer, or a smart watch.

Referring to FIG. 3, the signal receiver 16 includes a sensor 161 and a lens 162. The infrared light is irradiated onto the lens 162 and is focused on the sensor 161. Referring to FIG. 4, in this embodiment, the distance between the signal transmitter 15 and the signal receiver 16 is D, and the size is 10mm-100mm.

In other embodiments of the present invention, the signal transmitter and the signal receiver may be respectively disposed at different positions of the first region and the second region. For example, the signal transmitter may be disposed above or below the front camera, or may be disposed at the front. Set the left or right side of the camera, or both at an angle relative to the edge of the device. The signal receiver can be set at any position in the first area. The positions of the first region and the second region may also have different settings. For example, the second region may be at least partially located at any position on the front of the main body, the first region is a region for display, and the second region is The front part is divided by the first area.

Referring to FIG. 5, a device 20 according to another embodiment of the present invention includes a main body 21, a display module 22 and a function module 23 provided on the main body 21. The display module 22 may be used to display a screen or receive a user operation instruction. The function module 23 may be used to implement an object recognition function. The function module 23 can transmit an object identification signal to an external target object, and receive the object identification signal at least partially reflected by the target object through the display module 22.

The display module 22 includes a display screen disposed in a first area on the front of the device 20, and the function module 13 includes a front camera 24 and a signal transmitter 25 disposed in a second area on the front of the device 20. . The function module 23 further includes a signal receiver 26 disposed in the display module 22. The signal transmitter 25 transmits an object identification signal to a target object, such as a human face. The signal receiver 26 receives an object identification signal reflected at least in part from a target object. The object identification signal is transmitted from the signal transmitter 25 to a human face, is reflected by the human face and passes through the display module 22 to reach the signal receiver 26 and is received by the signal receiver 26. In this embodiment, the signal receiver 26 is disposed on a side of the display module 22 adjacent to the main body 21. The signal receiver 26 is disposed close to the bottom surface of the display module 22 or spaced from the display module 22.

Referring to FIG. 6, in another embodiment of the present invention, the device 30 includes a display module 32 and a function module 33. The display module 32 is located in a display area on the front of the device 30. The function module 33 A non-display area located on the front of the device 30. In this embodiment or other modified embodiments, a display area is correspondingly provided with a display screen, and a non-display area is correspondingly provided with a frame and various elements. The portion of the non-display area except the frame is located in the middle of the lower part of the front of the device 30 .

In other embodiments of the present invention, the non-display area may also be set at other positions on the front of the device as needed, for example, on the left, right, or middle of the front of the device.

In this embodiment, the device 30 may be a smart phone, a tablet computer, a smart watch, an augmented reality / virtual reality (AR / VR) device, an autonomous vehicle, or an intelligent robot.

Referring to FIG. 7, in another embodiment of the present invention, the device includes a signal receiver 410. The signal receiver 410 receives an object identification signal through a component 420. The device further includes a signal transmitter 430, and the object identification signal is transmitted to the target object by the signal transmitter 430 and reflected, and then passes through the element and is received by the signal receiver. In this embodiment, the object identification signal is infrared light. The object recognition signal is used to identify object features. For example, the object recognition signal may be 3D structured light, which may be used to recognize a human face or other object. The element is an element that can penetrate infrared rays, and in particular, is a display screen that can penetrate infrared light. In this embodiment, the display screen is an OLED or AMOLED display screen, and the light source of the signal transmitter 430 is a VCSEL.

Compared with the prior art, the device of the present invention implements an object recognition function, such as face recognition, by receiving an object recognition signal reflected by an object in a display area. The device of the present invention sets components of some functional modules in the display area, which can reduce the area of the non-display area, so that the device looks more beautiful and the user experience is better.

In addition to the devices described in the above embodiments, the 3D sensing technology involved in this application can also be applied to other suitable types of devices, such as, but not limited to, smart homes, vehicle electronics, financial terminals, robots, and the like.

In addition, in some embodiments, the signal transmitter may be omitted, and the signal receiver receives an object identification signal for identifying the characteristics of the object through an element. For example, it is also possible for the signal receiver to receive ambient light. The element is, for example, a light-transmissive display screen, such as an OLED display screen, or a Mini-LED or Micro-LED display screen.

Furthermore, the signal transmitters of the foregoing embodiments may also be provided in the display area, for example, on the back or inside of the display screen.

Referring to FIG. 8, in another embodiment of the present invention, the device 50 includes a display screen 52, a front camera 53, a signal transmitter 55 and a signal receiver 56. The signal transmitter 55 and the signal receiver 56 are disposed in the device 50. In this embodiment, the signal transmitter 55 and the signal receiver 56 are disposed on the back of the display screen 52, and are disposed close to or spaced from the display screen 52. In other embodiments, the signal transmitter 55 and the signal receiver 56 are disposed inside the display screen 52.

The device 50 includes a front surface for reading and operation by a user. The display screen 52 occupies a display area of the front surface, and a portion of the front surface except the display area is a non-display area. The front camera 53 is located in a non-display area on the front of the device 50.

The display screen 52 may be used to display an image frame, and the front camera 53 may receive external visible light for imaging. The signal transmitter 55 may be used to transmit an object identification signal through the display screen 52, and the signal receiver 56 may be used to receive an object identification signal reflected by the target object through the display screen 52. By identifying the received object recognition signal, the device 50 can obtain the three-dimensional depth information of the target object, thereby achieving 3D detection and / or recognition of the target object.

In other or modified embodiments of the present invention, the signal transmitter 55 or the signal receiver 56 may further have the following settings: the signal transmitter 55 and the signal receiver 56 are located in the non-display area; the signal transmitter 55 The signal receiver 56 is located in a non-display area; the signal transmitter 55 is located in a display area; and the signal receiver 56 is located in a non-display area.

"Length", "Width", "Top", "Down", "Front", "Rear", "Left", "Right", "Vertical", "Horizontal", "Top" that may appear in the description of the present invention The directions or positional relationships indicated by "", "bottom", "inside", "outside" and the like are based on the positional or positional relationships shown in the drawings, and are only for the convenience of describing the embodiments of the present invention and simplifying the description, rather than indicating or suggesting The device or element referred to must have a specific orientation, be constructed and operate in a specific orientation, and therefore cannot be understood as a limitation on the present invention.

The above are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited to this. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present invention. It should be covered by the protection scope of the present invention. The terms used in the claims should not be construed as limiting the invention to the specific embodiments disclosed in this specification. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

A device includes a display module and a function module. The function module is used to implement an object recognition function. The function module is capable of transmitting an object identification signal to a target object and receiving at least part of the signal through the display module. The object recognition signal reflected by the target object.
The device according to claim 1, wherein the device can obtain 3D depth information of a target object through the object recognition signal, and can be used for 3D information recognition of the target object.
The device according to claim 1, wherein the display module comprises a display screen located in a first area of the device, and the functional module comprises a signal transmitter located in a second area of the device and The signal receiver of the first area is described.
The device according to claim 3, further comprising a main body, wherein the display module and the function module are at least partially disposed on the main body, and the signal receiver and the signal transmitter are both disposed on the main body. The main body, wherein the signal receiver is arranged close to the display module or is spaced from the display module.
The device according to claim 2, wherein the object recognition signal is infrared light.
The device according to claim 5, wherein the signal receiver includes a sensor and a lens, and infrared light is irradiated to the lens and is focused on the sensor.
The device according to claim 3, wherein a distance between the signal transmitter and the signal receiver is 1mm-200mm.
The device according to claim 3, wherein the signal transmitter light source is a VCSEL.
The device according to claim 3, wherein the first area is a corresponding area of a display screen, and the second area is a part of the front of the device excluding the first area.
The device according to claim 2, wherein the object identification signal is one or more of a light wave, an electromagnetic wave, a sound wave, or an ultrasonic signal.
The device according to claim 3, wherein the function module further comprises a front camera for still or dynamic shooting.
The device according to claim 3, wherein the functional module further comprises one or more of a speaker, a microphone, an ambient light sensor, or a flood light transmitter.
The device according to claim 1, wherein the display module is used to display a screen, and defines an area on the front of the device as a display area, and an area other than the display area on the front of the device is a non-display Area, the display module includes a display screen located in the display area, and the function module includes a signal transmitter and a signal receiver which are directly opposite to the display area, wherein the signal transmitter is used for transmitting object identification A signal to a target object, and the signal receiver is configured to receive the object identification signal reflected at least in part by the target object through the display module.
The device according to claim 11, wherein the signal transmitter and the signal receiver are both located below the display screen or inside the display screen, or the signal transmitter and the signal receiver One of the monitors is located below the display screen, and the other is located inside the display screen.
The device according to claim 1, wherein the object recognition signal comprises structured light.
The device according to claim 1, wherein the device can obtain 3D depth information of a target object's face through the object recognition signal, and can be used for 3D facial information recognition of the target object.
The device according to any one of claims 1 to 16, characterized in that the device is one of a smart phone, a tablet computer, a smart watch, an augmented reality / virtual reality device, a self-driving car, or a smart robot.
A device includes a signal receiver, and the signal receiver receives an object identification signal for identifying an object characteristic through a component.
The device according to claim 18, further comprising a signal transmitter, the object identification signal transmitted by the signal transmitter to the target object is reflected, and then passes through the element and is received by the signal Device receiving.
The device according to claim 19, wherein the object recognition signal is infrared light.
The device according to claim 19, wherein the element is an element that can penetrate infrared rays, and the object recognition signal is 3D structured light.
The device according to claim 21, wherein the element is a display screen.
The device according to claim 19, wherein the signal transmitter light source is a VCSEL.
The device according to claim 22, wherein the display screen is an OLED or AMOLED display screen, or a Mini-LED or Micro-LED display screen.