WO2023036131A1 - 图像信息采集模组、信息处理方法、装置和电子设备 - Google Patents

图像信息采集模组、信息处理方法、装置和电子设备 Download PDF

Info

Publication number
WO2023036131A1
WO2023036131A1 PCT/CN2022/117281 CN2022117281W WO2023036131A1 WO 2023036131 A1 WO2023036131 A1 WO 2023036131A1 CN 2022117281 W CN2022117281 W CN 2022117281W WO 2023036131 A1 WO2023036131 A1 WO 2023036131A1
Authority
WO
WIPO (PCT)
Prior art keywords
optical signal
signal receiving
measured object
image information
receiving unit
Prior art date
Application number
PCT/CN2022/117281
Other languages
English (en)
French (fr)
Inventor
成通
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2023036131A1 publication Critical patent/WO2023036131A1/zh

Links

Images

Definitions

  • the application belongs to the technical field of communication, and in particular relates to an image information collection module, an information processing method, device and electronic equipment.
  • 3D technology collects three-dimensional size information by scanning the contour information of the face, which can effectively improve security compared with two-dimensional (2D) face unlocking.
  • TOF Time of Flight
  • the basic principle of TOF is to continuously emit light pulses (generally invisible light) to the object to be observed, then receive the light pulses reflected from the object, and calculate the distance between the measured object and the camera by detecting the flight (round trip) time of the light pulse .
  • the current ToF solution can only realize the collection of 3D size information.
  • 3D face unlocking it can be unlocked by disguising it with a silicone 3D headgear, etc., resulting in the problem of false unlocking and the security risk of payment and unlocking. .
  • the purpose of the embodiments of the present application is to provide an image information collection module, an information processing method, device and electronic equipment, which can solve the problem of risk in the use of existing information processing solutions for object detection.
  • an image information collection module which includes:
  • An optical signal transmitting chip includes a first optical signal transmitting area and a second optical signal transmitting area, the first optical signal transmitting unit in the first optical signal transmitting area can transmit an optical signal of a first wavelength , the second optical signal transmitting area at least includes: a second optical signal transmitting unit and a third optical signal transmitting unit, wherein the optical signals transmitted by the second optical signal transmitting unit and the third optical signal transmitting unit have different wavelengths;
  • An optical signal receiving chip includes a first optical signal receiving area and a second optical signal receiving area, the first optical signal receiving unit in the first optical signal receiving area can receive a fourth optical signal, the The second optical signal receiving area at least includes: a second optical signal receiving unit and a third optical signal receiving unit, the second optical signal receiving unit can receive the fifth optical signal, and the third optical signal receiving unit can receive the fifth optical signal Six-light signal;
  • the fourth optical signal is the first optical signal transmitted by the first optical signal transmitting unit and the optical signal reflected by the measured object
  • the fifth optical signal is transmitted by the second optical signal transmitting unit
  • the second optical signal is the optical signal reflected by the measured object
  • the sixth optical signal is the third optical signal emitted by the third optical signal transmitting unit and the optical signal reflected by the measured object.
  • an embodiment of the present application provides an electronic device, which includes: the image information collection module described in the first aspect.
  • an embodiment of the present application provides an information processing method, which is applied to the above-mentioned electronic device, and the method includes:
  • Image information corresponding to the measured object is obtained according to the fourth light signal, the fifth light signal and the sixth light signal.
  • an embodiment of the present application provides an information processing device, which is applied to the above-mentioned electronic equipment, and the device includes:
  • the first control module is configured to control the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second optical signal the wavelengths of the signal and the third optical signal are different;
  • the first acquisition module is configured to acquire the fourth optical signal received by the first optical signal receiving unit and obtained by reflecting the first optical signal from the measured object, and the second optical signal received by the second optical signal receiving unit a fifth optical signal reflected by the measured object, and a sixth optical signal received by the third optical signal receiving unit and obtained by reflecting the third optical signal from the measured object;
  • the first processing module is configured to obtain image information corresponding to the measured object according to the fourth light signal, the fifth light signal and the sixth light signal.
  • the embodiment of the present application provides an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, and the program or instruction is executed by The processor implements the steps of the method described in the third aspect when executed.
  • an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the third aspect are implemented .
  • the embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions, to achieve the third aspect the method described.
  • a computer program product is provided, the computer program product is stored in a non-transitory storage medium, and the computer program product is executed by at least one processor to implement the method described in the third aspect step.
  • an electronic device configured to perform the steps of the method in the third aspect.
  • the image information acquisition module includes: an optical signal emitting chip, the optical signal emitting chip includes a first optical signal emitting area and a second optical signal emitting area, and the first optical signal emitting area
  • the first optical signal transmitting unit inside can transmit the optical signal of the first wavelength
  • the second optical signal transmitting area at least includes: the second optical signal transmitting unit and the third optical signal transmitting unit, the second optical signal transmitting unit and the second optical signal transmitting unit
  • the wavelengths of the optical signals emitted by the three optical signal transmitting units are different;
  • the optical signal receiving chip, the optical signal receiving chip includes a first optical signal receiving area and a second optical signal receiving area, and the first optical signal receiving area in the first optical signal receiving area
  • An optical signal receiving unit capable of receiving a fourth optical signal, the second optical signal receiving area at least includes: a second optical signal receiving unit and a third optical signal receiving unit, the second optical signal receiving unit capable of receiving a fifth optical signal signal, the third optical signal receiving unit can receive the sixth optical signal; wherein, the fourth optical
  • Fig. 1 is the schematic structural diagram of the image information collection module of the embodiment of the present application.
  • Fig. 2 is a schematic structural diagram of an optical signal receiving chip according to an embodiment of the present application.
  • FIG. 3 is a schematic structural diagram of an optical signal receiving unit according to an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of an optical signal transmitting chip according to an embodiment of the present application.
  • Fig. 5 is a schematic diagram of the emission wavelength characteristic of the division of the optical signal transmitting chip according to the embodiment of the present application.
  • Fig. 6 is a schematic diagram of the use of the image information acquisition module of the embodiment of the present application.
  • FIG. 7 is a schematic flowchart of an information processing method in an embodiment of the present application.
  • FIG. 8 is a schematic structural diagram of an information processing device according to an embodiment of the present application.
  • FIG. 9 is a first structural schematic diagram of an electronic device according to an embodiment of the present application.
  • FIG. 10 is a second structural schematic diagram of an electronic device according to an embodiment of the present application.
  • the embodiment of the present application provides an image information acquisition module, as shown in Figure 1, Figure 2 and Figure 4, including:
  • An optical signal transmitting chip 1 the optical signal transmitting chip 1 includes a first optical signal transmitting area 2 and a second optical signal transmitting area 3, the first optical signal transmitting unit 4 in the first optical signal transmitting area 2 can transmit
  • the optical signal of the first wavelength, the second optical signal transmitting area 3 at least includes: a second optical signal transmitting unit 5 and a third optical signal transmitting unit 6, the second optical signal transmitting unit 5 and the third optical signal transmitting unit 6
  • the wavelengths of the emitted optical signals are different;
  • An optical signal receiving chip 7, the optical signal receiving chip 7 includes a first optical signal receiving area 8 and a second optical signal receiving area 9, the first optical signal receiving unit 10 in the first optical signal receiving area 8 can receive
  • the second optical signal receiving area 9 at least includes: a second optical signal receiving unit 11 and a third optical signal receiving unit 12, the second optical signal receiving unit 11 can receive the fifth optical signal, so The third optical signal receiving unit 12 can receive the sixth optical signal;
  • the fourth optical signal is the first optical signal emitted by the first optical signal transmitting unit 4 and the optical signal reflected by the measured object
  • the fifth optical signal is the optical signal obtained by the second optical signal transmitting unit
  • the sixth optical signal is the third optical signal emitted by the third optical signal transmitting unit 6, and the optical signal reflected by the measured object .
  • the area ratio of the first optical signal emitting region on the optical signal emitting chip may be greater than the area ratio of the second optical signal emitting region on the optical signal emitting chip.
  • the image information acquisition module includes: an optical signal emitting chip, the optical signal emitting chip includes a first optical signal emitting area and a second optical signal emitting area, and the first optical signal emitting area
  • the first optical signal transmitting unit is capable of transmitting an optical signal of a first wavelength
  • the second optical signal transmitting area at least includes: a second optical signal transmitting unit and a third optical signal transmitting unit, a second optical signal transmitting unit and a third optical signal transmitting unit
  • the wavelengths of the optical signals emitted by the optical signal transmitting unit are different;
  • the optical signal receiving chip includes a first optical signal receiving area and a second optical signal receiving area, and the first optical signal receiving area in the first optical signal receiving area
  • the optical signal receiving unit can receive the fourth optical signal
  • the second optical signal receiving area at least includes: a second optical signal receiving unit and a third optical signal receiving unit, and the second optical signal receiving unit can receive the fifth optical signal
  • the third optical signal receiving unit is capable of receiving a sixth optical signal; wherein the fourth optical
  • the optical signal reflected by the object under test can support and realize the acquisition of the measured object through the first optical signal emitting area, the first optical signal receiving area, the second optical signal emitting area and the second optical signal receiving area
  • the optical signal transmitting chip may be a vertical cavity surface emitting laser (Vertical Cavity Surface Emitting Laser, VCSEL) chip; the scheme of the embodiment of the present application can realize that the optical signal no longer needs to pass through the infrared light (Infrared Radiation) before entering the optical signal receiving chip. , IR) filter.
  • VCSEL Vertical Cavity Surface Emitting Laser
  • the optical signal receiving unit 13 includes: a microlens 14, an optical filter 15 and a photodiode 16 stacked in sequence; wherein the optical signal receiving unit 13 It is: the first optical signal receiving unit 10, the second optical signal receiving unit 11 or the third optical signal receiving unit 12; the filter wavelength of the optical filter 15 in each first optical signal receiving unit 10 Similarly, the filter wavelength of the filter 15 in the second optical signal receiving unit 11 is different from the filter wavelength of the filter 15 in the third optical signal receiving unit 12 .
  • the present application puts the optical filter in the optical signal receiving chip. In this way, separate signal transmission of a plurality of transmission and reception areas can be realized.
  • the optical signal receiving unit 13 further includes: a silicon substrate 18 connected to the photodiode 16 through a metal wire 17.
  • the image information collection module further includes: a flexible circuit board 19 ; wherein the optical signal transmitting chip 1 and the optical signal receiving chip 7 are respectively connected to the flexible circuit board 19 .
  • the optical signal transmitting chip 1 is connected to the flexible circuit board 19 through the substrate 20 .
  • the image information acquisition module further includes: a reinforcement board 21 connected to the flexible circuit board 19; wherein, the optical signal transmitting chip 1 and the optical signal receiving chip 7 are respectively
  • the reinforcing plate 21 is connected to the first side of the flexible circuit board 19 and connected to the second side of the flexible circuit board 19, and the second side is the side opposite to the first side.
  • the image information collection module further includes: a lens 23 connected to the optical signal receiving chip 7 through a first support member 22 .
  • the image information collection module further includes: a diffuser and uniform light sheet 25 connected to the optical signal transmitting chip 1 through a second support member 24 .
  • the optical signal can be uniformly diffused to the designed viewing angle.
  • the first wavelength is 850nm or 940nm; and/or, the wavelength of the second optical signal is greater than or equal to 350nm and less than or equal to 1000nm; and/or, the wavelength of the third optical signal Greater than or equal to 350nm and less than or equal to 1000nm.
  • the image information collection module provided in the embodiment of the present application is illustrated below with an example.
  • the embodiment of the present application provides an image information acquisition module, which can be specifically shown in Figure 1; the photosensitive area (including the above-mentioned first optical signal receiving chip 7) of the receiving end image chip (corresponding to the above-mentioned optical signal receiving chip 7)
  • An optical signal receiving area 8 and a second optical signal receiving area 9) are designed as shown in Figure 2 (C in the figure represents the logic circuit area, and 1 ⁇ 9 represent the filter characteristics corresponding to the pixel structures in the B area):
  • the photosensitive (pixel) area of the image chip at the receiving end is divided into an area A (corresponding to the above-mentioned first light signal receiving area 8) and a B area (corresponding to the above-mentioned second light signal receiving area 9).
  • a filter layer (corresponding to the above-mentioned filter 15) is added in the pixel structure of the A region and the B region (corresponding to the above-mentioned optical signal receiving unit 13), and the (pixel) filter layer of the A region and the B region adopts a multi-band Filter channel design, for example, one of the design band distribution methods is shown in Figure 3:
  • 1 ⁇ 9 correspond to each pixel in the area B of the receiving end image chip (corresponding to each optical signal receiving unit included in the second optical signal receiving area, including the second optical signal receiving unit 11 and the third optical signal receiving unit 12 ),
  • the A-band is the filter characteristic of the filter layer structure of the A area (pixel) of the image chip at the receiving end, where the A-band can be the same as one of the filter band spectra from 1 ⁇ 9; the light wavelength in the figure is The wavelength of the above optical signal.
  • the optical signal transmitting chip 1 in Fig. 1 can specifically be a VCSEL chip, which adopts a sub-area design of different wavelengths, and the design schematic diagram (i.e., the VCSEL partition schematic diagram) is shown in Fig. 4; the emission wavelength characteristics of the VCSEL partitions are shown in Fig. 5:
  • the light-emitting holes in the B area of the VCSEL chip (corresponding to the respective optical signal emitting units included in the second optical signal emitting area, including the second optical signal emitting unit 5 and the third optical signal emitting unit 6) emit different wavelengths (the light-emitting holes in the B area Corresponding to 1 ⁇ 9 of the image chip at the receiving end, the light corresponding to the receiving wavelength ⁇ 1 to ⁇ 9) of the image chip at the receiving end is generated, and the light-emitting hole in the A area of the VCSEL chip generates the corresponding image chip at the receiving end, and the corresponding corresponding received by the pixel structure in the A area wavelength ( ⁇ A) light;
  • the A-area pixel structure of the receiver image chip can be used to collect 3D information
  • the B-area pixel structure can be used to collect reflected spectral information and depth information.
  • the multi-band emission module VCSEL chip D emits multiple bands of light, such as 940nm and 840nm; after being reflected by the measurement target E (ie, the measured object), it reaches the lens F, and then enters The image chip G at the receiving end (also can be understood as an image sensor array at the receiving end).
  • this solution adopts the design of partitioned multi-band VCSEL chips and partitioned image sensors (that is, partitioned receiving end image chips), and adjusts the existing ToF module design (cancelling the IR filter and integrating it into the receiving end image chip) Middle); enables ToF to realize two functions of depth information and spectral information detection.
  • the miniaturization of the multi-spectral module can be realized, and the active multi-spectral detection function can be performed; it can be widely used in consumer electronics products that take into account depth and material composition, such as human face Unlocking apps greatly improves app security through double recognition of 3D information and skin texture components.
  • the embodiment of the present application also provides an electronic device, including: the above-mentioned image information collection module.
  • the electronic device provided by the embodiment of the present application can realize the various processes realized by the above embodiment of the image information collection module, and to avoid repetition, details are not repeated here.
  • the embodiment of the present application also provides an information processing method, which is applied to the above-mentioned electronic device, as shown in FIG. 7, the method includes:
  • Step 71 Control the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second optical signal and the third optical signal Optical signals have different wavelengths.
  • the second optical signal or the third optical signal may be a signal having the same wavelength as the first optical signal.
  • Step 72 Obtain the fourth optical signal received by the first optical signal receiving unit and reflected by the first optical signal from the object under test, and the second optical signal received by the second optical signal receiving unit and obtained by the object under test The fifth optical signal obtained by reflection, and the sixth optical signal received by the third optical signal receiving unit and obtained by reflecting the third optical signal from the measured object.
  • the light signals reflected by the object under test are respectively acquired by the first light signal receiving area and the second light signal receiving area.
  • Step 73 Obtain image information corresponding to the measured object according to the fourth light signal, the fifth light signal and the sixth light signal.
  • the image information may include three-dimensional information, spectral information and depth information of the measured object.
  • the obtaining the image information corresponding to the measured object according to the fourth optical signal, the fifth optical signal and the sixth optical signal includes: obtaining the image information corresponding to the measured object according to the fourth optical signal Three-dimensional information in the image information corresponding to the measured object; according to the fifth optical signal and the sixth optical signal, spectral information and depth information in the image information corresponding to the measured object are obtained.
  • the depth information in the image information corresponding to the object under test (which may be referred to as the second depth information) may also be obtained according to the fourth optical signal.
  • the depth information (which may be referred to as the first depth information) obtained from the optical signal is processed to obtain the final depth information, which is used as the target depth information in the image information corresponding to the measured object.
  • the information processing method further includes: performing a first operation according to the three-dimensional information, spectral information, and depth information; wherein, the first operation includes: an unlocking operation.
  • the first operation can be executed more safely and the corresponding function can be realized.
  • the second optical signal transmitting unit by controlling the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second optical signal The wavelengths of the signal and the third optical signal are different; the fourth optical signal received by the first optical signal receiving unit and reflected by the first optical signal from the measured object is obtained, and the fourth optical signal received by the second optical signal receiving unit The fifth optical signal obtained by reflecting the second optical signal from the measured object, and the sixth optical signal received by the third optical signal receiving unit and obtained by reflecting the third optical signal from the measured object; according to the fourth optical signal , the fifth light signal and the sixth light signal to obtain the image information corresponding to the measured object; The signal receiving area obtains various shape information of the measured object, and then obtains more various image information, so as to ensure that the subsequent processing operations based on the image information are more secure and avoid use risks, which is a good solution to the existing
  • the information processing scheme for the detection of the measured object has the problem of using
  • the information processing method provided in the embodiment of the present application may be executed by an information processing device, or a control module in the information processing device for executing the information processing method.
  • the information processing device provided in the embodiment of the present application is described by taking the information processing device executing the information processing method as an example.
  • the embodiment of the present application also provides an information processing device, which is applied to the above-mentioned electronic equipment, as shown in FIG. 8, the device includes:
  • the first control module 81 is configured to control the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second The wavelengths of the optical signal and the third optical signal are different;
  • the first acquisition module 82 is configured to acquire the fourth optical signal received by the first optical signal receiving unit and obtained by reflecting the first optical signal from the measured object, and the second optical signal received by the second optical signal receiving unit a fifth optical signal obtained by reflecting the signal from the measured object, and a sixth optical signal received by the third optical signal receiving unit and obtained by reflecting the third optical signal from the measured object;
  • the first processing module 83 is configured to obtain image information corresponding to the measured object according to the fourth light signal, the fifth light signal and the sixth light signal.
  • the obtaining the image information corresponding to the measured object according to the fourth optical signal, the fifth optical signal and the sixth optical signal includes: obtaining the image information corresponding to the measured object according to the fourth optical signal Three-dimensional information in the image information corresponding to the measured object; according to the fifth optical signal and the sixth optical signal, spectral information and depth information in the image information corresponding to the measured object are obtained.
  • the information processing device further includes: a first execution module, configured to execute a first operation according to the three-dimensional information, spectral information, and depth information; wherein, the first operation includes: an unlocking operation.
  • a first execution module configured to execute a first operation according to the three-dimensional information, spectral information, and depth information; wherein, the first operation includes: an unlocking operation.
  • the second optical signal transmitting unit by controlling the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second optical signal The wavelengths of the signal and the third optical signal are different; the fourth optical signal received by the first optical signal receiving unit and reflected by the first optical signal from the measured object is obtained, and the fourth optical signal received by the second optical signal receiving unit The fifth optical signal obtained by reflecting the second optical signal from the measured object, and the sixth optical signal received by the third optical signal receiving unit and obtained by reflecting the third optical signal from the measured object; according to the fourth optical signal , the fifth light signal and the sixth light signal to obtain the image information corresponding to the measured object; The signal receiving area obtains various shape information of the measured object, and then obtains more various image information, so as to ensure that the subsequent processing operations based on the image information are more secure and avoid use risks, which is a good solution to the existing
  • the information processing scheme for the detection of the measured object has the problem of using
  • the information processing device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal.
  • the device may be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device can be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (Ultra-Mobile Personal Computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant).
  • non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computers (Personal Computer, PC), televisions (Television, TV), teller machines or self-service machines, etc., this application Examples are not specifically limited.
  • Network Attached Storage NAS
  • personal computers Personal Computer, PC
  • televisions Television, TV
  • teller machines self-service machines, etc.
  • the information processing device in the embodiment of the present application may be a device with an operating system.
  • the operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.
  • the information processing device provided in the embodiment of the present application can implement various processes implemented in the method embodiment in FIG. 8 , and details are not repeated here to avoid repetition.
  • the embodiment of the present application also provides an electronic device 90, including a processor 91, a memory 92, and programs or instructions stored in the memory 92 and operable on the processor 91,
  • an electronic device 90 including a processor 91, a memory 92, and programs or instructions stored in the memory 92 and operable on the processor 91,
  • the program or instruction is executed by the processor 91, each process of the above-mentioned information processing method embodiment can be realized, and the same technical effect can be achieved, so in order to avoid repetition, details are not repeated here.
  • the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
  • FIG. 10 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 100 includes, but is not limited to: a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 1010, etc. part.
  • the electronic device 100 can also include a power supply (such as a battery) for supplying power to various components, and the power supply can be logically connected to the processor 1010 through the power management system, so that the management of charging, discharging, and function can be realized through the power management system. Consumption management and other functions.
  • a power supply such as a battery
  • the structure of the electronic device shown in FIG. 10 does not constitute a limitation to the electronic device.
  • the electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange different components, and details will not be repeated here. .
  • the processor 1010 is configured to control the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second The wavelengths of the optical signal and the third optical signal are different;
  • Image information corresponding to the measured object is obtained according to the fourth light signal, the fifth light signal and the sixth light signal.
  • the second optical signal transmitting unit by controlling the first optical signal transmitting unit to transmit the first optical signal, the second optical signal transmitting unit to transmit the second optical signal, and the third optical signal transmitting unit to transmit the third optical signal; the second optical signal The wavelengths of the signal and the third optical signal are different; the fourth optical signal received by the first optical signal receiving unit and reflected by the first optical signal from the measured object is obtained, and the fourth optical signal received by the second optical signal receiving unit The fifth optical signal obtained by reflecting the second optical signal from the measured object, and the sixth optical signal received by the third optical signal receiving unit and obtained by reflecting the third optical signal from the measured object; according to the fourth optical signal , the fifth light signal and the sixth light signal to obtain the image information corresponding to the measured object; The signal receiving area obtains various shape information of the measured object, and then obtains more various image information, so as to ensure that the subsequent processing operations based on the image information are more secure and avoid use risks, which is a good solution to the existing
  • the information processing scheme for the detection of the measured object has the problem of using
  • the obtaining the image information corresponding to the measured object according to the fourth optical signal, the fifth optical signal and the sixth optical signal includes: obtaining the measured image information according to the fourth optical signal Three-dimensional information in the image information corresponding to the object; according to the fifth light signal and the sixth light signal, spectral information and depth information in the image information corresponding to the measured object are obtained.
  • the processor 1010 is further configured to perform a first operation according to the three-dimensional information, spectral information, and depth information; wherein, the first operation includes: an unlocking operation.
  • this solution can realize two functions of depth information and spectral information detection.
  • it is capable of active multispectral detection; it can be widely used in consumer electronics products that take into account both depth and material composition, such as face unlocking applications, which greatly improve application security through dual recognition of 3D information and skin composition.
  • the input unit 104 may include a graphics processing unit (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processing unit 1041 is used by the image capturing device (such as the image data of the still picture or video obtained by the camera) for processing.
  • the display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the user input unit 107 includes a touch panel 1071 and other input devices 1072.
  • the touch panel 1071 is also called a touch screen.
  • the touch panel 1071 may include two parts, a touch detection device and a touch controller.
  • Other input devices 1072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
  • Memory 109 may be used to store software programs as well as various data, including but not limited to application programs and operating systems.
  • Processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1010 .
  • the embodiment of the present application also provides a readable storage medium.
  • the readable storage medium stores programs or instructions.
  • the program or instructions are executed by the processor, the various processes of the above-mentioned information processing method embodiments can be achieved, and the same To avoid repetition, the technical effects will not be repeated here.
  • the processor is the processor in the electronic device described in the above embodiments.
  • the readable storage medium includes computer readable storage medium, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
  • the embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the above information processing method embodiment Each process can achieve the same technical effect, so in order to avoid repetition, it will not be repeated here.
  • chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.
  • the embodiment of the present application also provides a computer program product, which is stored in a readable storage medium.
  • the computer program product is executed by at least one processor to implement the various processes in the above information processing method embodiments, and can achieve the same technical Effect, in order to avoid repetition, will not repeat them here.
  • the term “comprising”, “comprising” or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase “comprising a " does not preclude the presence of additional identical elements in the process, method, article or apparatus comprising that element.
  • the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

Landscapes

  • Investigating Or Analysing Materials By Optical Means (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

本申请公开了一种图像信息采集模组、信息处理方法、装置和电子设备，属于通信技术领域。图像信息采集模组包括：光信号发射芯片和光信号接收芯片，光信号发射芯片中的第一光信号发射区域内的第一光信号发射单元能够发射第一波长的光信号，第二光信号发射区域至少包括：第二光信号发射单元和第三光信号发射单元，第二光信号发射单元和第三光信号发射单元发射的光信号的波长不同；光信号接收芯片中的第一光信号接收区域内的第一光信号接收单元能够接收第四光信号，第二光信号接收区域至少包括：第二光信号接收单元和第三光信号接收单元，第二光信号接收单元能够接收第五光信号，第三光信号接收单元能够接收第六光信号。

Description

图像信息采集模组、信息处理方法、装置和电子设备
相关申请的交叉引用
本申请主张在2021年09月10日在中国提交的中国专利申请No.202111060117.5的优先权，其全部内容通过引用包含于此。
技术领域
本申请属于通信技术领域，具体涉及一种图像信息采集模组、信息处理方法、装置和电子设备。
背景技术
随着电子支付产品技术的发展，三维(3D)人脸解锁技术在手机产品以及刷脸机等产品得到了广泛的应用。3D技术通过对人脸轮廓信息扫描，采集三维尺寸信息，相对二维(2D)人脸解锁可以有效的提升安全性。具体的，主要是应用飞行时间(Time of Flight，TOF)方案来实现。TOF基本原理是通过连续发射光脉冲(一般为不可见光)到被观测物体上，然后接收从物体反射回去的光脉冲，通过探测光脉冲的飞行(往返)时间来计算被测物体离相机的距离。
但是，目前的ToF方案仅能实现3D尺寸信息的采集，对此，在3D人脸解锁等场景下可以通过硅胶3D头套等方式进行伪装以解锁，从而出现误解锁问题导致支付与解锁的安全风险。
由上可知，现有针对被测对象检测的信息处理方案存在使用风险的问题。
发明内容
本申请实施例的目的是提供一种图像信息采集模组、信息处理方法、装置和电子设备，能够解决现有针对被测对象检测的信息处理方案存在使用风险的问题。
第一方面，本申请实施例提供了一种图像信息采集模组，该模组包括：
光信号发射芯片，所述光信号发射芯片包括第一光信号发射区域和第二 光信号发射区域，所述第一光信号发射区域内的第一光信号发射单元能够发射第一波长的光信号，所述第二光信号发射区域至少包括：第二光信号发射单元和第三光信号发射单元，第二光信号发射单元和第三光信号发射单元发射的光信号的波长不同；
光信号接收芯片，所述光信号接收芯片包括第一光信号接收区域和第二光信号接收区域，所述第一光信号接收区域内的第一光信号接收单元能够接收第四光信号，所述第二光信号接收区域至少包括：第二光信号接收单元和第三光信号接收单元，所述第二光信号接收单元能够接收第五光信号，所述第三光信号接收单元能够接收第六光信号；
其中，所述第四光信号为所述第一光信号发射单元发射的第一光信号、经被测对象反射得到的光信号，所述第五光信号为所述第二光信号发射单元发射的第二光信号、经被测对象反射得到的光信号，所述第六光信号为所述第三光信号发射单元发射的第三光信号、经被测对象反射得到的光信号。
第二方面，本申请实施例提供了一种电子设备，该设备包括：第一方面所述的图像信息采集模组。
第三方面，本申请实施例提供了一种信息处理方法，应用于上述的电子设备，该方法包括：
控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；
获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；
根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
第四方面，本申请实施例提供了一种信息处理装置，应用于上述的电子设备，该装置包括：
第一控制模块，用于控制第一光信号发射单元发射第一光信号，第二光 信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；
第一获取模块，用于获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；
第一处理模块，用于根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
第五方面，本申请实施例提供了一种电子设备，该电子设备包括处理器、存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如第三方面所述的方法的步骤。
第六方面，本申请实施例提供了一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如第三方面所述的方法的步骤。
第七方面，本申请实施例提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如第三方面所述的方法。
第八方面，提供了一种计算机程序产品，所述计算机程序产品被存储在非瞬态的存储介质中，所述计算机程序产品被至少一个处理器执行以实现如第三方面所述的方法的步骤。
第九方面，提供了一种电子设备，其中，被配置为执行如第三方面的方法的步骤。
在本申请实施例中，所述图像信息采集模组包括：光信号发射芯片，所述光信号发射芯片包括第一光信号发射区域和第二光信号发射区域，所述第一光信号发射区域内的第一光信号发射单元能够发射第一波长的光信号，所述第二光信号发射区域至少包括：第二光信号发射单元和第三光信号发射单元，第二光信号发射单元和第三光信号发射单元发射的光信号的波长不同；光信号接收芯片，所述光信号接收芯片包括第一光信号接收区域和第二光信号接收区域，所述第一光信号接收区域内的第一光信号接收单元能够接收第 四光信号，所述第二光信号接收区域至少包括：第二光信号接收单元和第三光信号接收单元，所述第二光信号接收单元能够接收第五光信号，所述第三光信号接收单元能够接收第六光信号；其中，所述第四光信号为所述第一光信号发射单元发射的第一光信号、经被测对象反射得到的光信号，所述第五光信号为所述第二光信号发射单元发射的第二光信号、经被测对象反射得到的光信号，所述第六光信号为所述第三光信号发射单元发射的第三光信号、经被测对象反射得到的光信号；能够支撑实现借由第一光信号发射区域、第一光信号接收区域、第二光信号发射区域以及第二光信号接收区域，获取被测对象的多种外形信息，进而得到更多样的图像信息，以保证后续根据该图像信息进行的处理操作更具安全性、避免使用风险，很好的解决了现有针对被测对象检测的信息处理方案存在使用风险的问题。
附图说明
图1是本申请实施例的图像信息采集模组结构示意图；
图2是本申请实施例的光信号接收芯片结构示意图；
图3是本申请实施例的光信号接收单元结构示意图；
图4是本申请实施例的光信号发射芯片结构示意图；
图5是本申请实施例的光信号发射芯片的分区发光波长特性示意图；
图6是本申请实施例的图像信息采集模组使用示意图；
图7是本申请实施例的信息处理方法流程示意图；
图8是本申请实施例的信息处理装置结构示意图；
图9是本申请实施例的电子设备结构示意图一；
图10是本申请实施例的电子设备结构示意图二。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”等所区分的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个，也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”，一般表示前后关联对象是一种“或”的关系。
下面结合附图，通过具体的实施例及其应用场景对本申请实施例提供的图像信息采集模组进行详细地说明。
本申请实施例提供了一种图像信息采集模组，如图1、图2和图4所示，包括：
光信号发射芯片1，所述光信号发射芯片1包括第一光信号发射区域2和第二光信号发射区域3，所述第一光信号发射区域2内的第一光信号发射单元4能够发射第一波长的光信号，所述第二光信号发射区域3至少包括：第二光信号发射单元5和第三光信号发射单元6，第二光信号发射单元5和第三光信号发射单元6发射的光信号的波长不同；
光信号接收芯片7，所述光信号接收芯片7包括第一光信号接收区域8和第二光信号接收区域9，所述第一光信号接收区域8内的第一光信号接收单元10能够接收第四光信号，所述第二光信号接收区域9至少包括：第二光信号接收单元11和第三光信号接收单元12，所述第二光信号接收单元11能够接收第五光信号，所述第三光信号接收单元12能够接收第六光信号；
其中，所述第四光信号为所述第一光信号发射单元4发射的第一光信号、经被测对象反射得到的光信号，所述第五光信号为所述第二光信号发射单元5发射的第二光信号、经被测对象反射得到的光信号，所述第六光信号为所述第三光信号发射单元6发射的第三光信号、经被测对象反射得到的光信号。
第一光信号发射区域在光信号发射芯片上的面积占比可以大于第二光信号发射区域在光信号发射芯片上的面积占比。
本申请实施例提供的所述图像信息采集模组包括：光信号发射芯片，所述光信号发射芯片包括第一光信号发射区域和第二光信号发射区域，所述第 一光信号发射区域内的第一光信号发射单元能够发射第一波长的光信号，所述第二光信号发射区域至少包括：第二光信号发射单元和第三光信号发射单元，第二光信号发射单元和第三光信号发射单元发射的光信号的波长不同；光信号接收芯片，所述光信号接收芯片包括第一光信号接收区域和第二光信号接收区域，所述第一光信号接收区域内的第一光信号接收单元能够接收第四光信号，所述第二光信号接收区域至少包括：第二光信号接收单元和第三光信号接收单元，所述第二光信号接收单元能够接收第五光信号，所述第三光信号接收单元能够接收第六光信号；其中，所述第四光信号为所述第一光信号发射单元发射的第一光信号、经被测对象反射得到的光信号，所述第五光信号为所述第二光信号发射单元发射的第二光信号、经被测对象反射得到的光信号，所述第六光信号为所述第三光信号发射单元发射的第三光信号、经被测对象反射得到的光信号；能够支撑实现借由第一光信号发射区域、第一光信号接收区域、第二光信号发射区域以及第二光信号接收区域，获取被测对象的多种外形信息，进而得到更多样的图像信息，以保证后续根据该图像信息进行的处理操作更具安全性、避免使用风险，很好的解决了现有针对被测对象检测的信息处理方案存在使用风险的问题。
其中，光信号发射芯片可以是垂直腔面发射激光器(Vertical Cavity Surface Emitting Laser，VCSEL)芯片；本申请实施例的方案能够实现不再需要光信号在进入光信号接收芯片之前经过红外光线(Infrared Radiation，IR)滤光片了。
本申请实施例中，如图2和图3所示，所述光信号接收单元13包括：依次层叠设置的微透镜14、滤光片15和光电二极管16；其中，所述光信号接收单元13为：所述第一光信号接收单元10、所述第二光信号接收单元11或所述第三光信号接收单元12；各个第一光信号接收单元10中的滤光片15的滤光波长相同，所述第二光信号接收单元11中的滤光片15的滤光波长、与所述第三光信号接收单元12中的滤光片15的滤光波长不同。
也就是，本申请将滤光片放在了光信号接收芯片内。这样能够实现多个收发区域的分别的信号传输。
如图3所示，所述光信号接收单元13还包括：通过金属线17与所述光 电二极管16连接的硅基板18。
这样能够保证结构的完整性。
如图1所示，所述的图像信息采集模组，还包括：柔性电路板19；其中，所述光信号发射芯片1和光信号接收芯片7分别与所述柔性电路板19相连。
这样能够保证光信号发射芯片和光信号接收芯片的正常通信。具体的，光信号发射芯片1通过基板20与柔性电路板19相连。
进一步的，如图1所示，所述的图像信息采集模组，还包括：与所述柔性电路板19相连的补强板21；其中，所述光信号发射芯片1和光信号接收芯片7分别与所述柔性电路板19的第一侧面相连，所述补强板21与所述柔性电路板19的第二侧面相连，所述第二侧面为与所述第一侧面相对的侧面。
这样能够进一步增加结构强度。
如图1所示，所述的图像信息采集模组，还包括：通过第一支撑件22与所述光信号接收芯片7相连的镜头23。
这样能够实现光线汇聚。
如图1所示，所述的图像信息采集模组，还包括：通过第二支撑件24与所述光信号发射芯片1相连的扩散匀光片25。
这样能够使得光信号均匀扩散到设计的视场角度。
本申请实施例中，所述第一波长为850nm或940nm；和/或，所述第二光信号的波长大于或等于350nm且小于或等于1000nm；和/或，所述第三光信号的波长大于或等于350nm且小于或等于1000nm。
这样能够保证实现距离识别(进而得到三维、深度信息等)、实现光谱识别(进而得到三维、深度+光谱信息等)。
下面对本申请实施例提供的图像信息采集模组进行举例说明。
针对上述技术问题，本申请实施例提供了一种图像信息采集模组，具体可如图1所示；其中的接收端图像芯片(对应于上述光信号接收芯片7)的感光区域(包含上述第一光信号接收区域8和第二光信号接收区域9)设计如图2所示(图中C表示逻辑电路区，①～⑨表示B区域内的像素结构分别对应的滤波特性)：
接收端图像芯片的感光(像素)区域分为A区域(对应于上述第一光信 号接收区域8)和B区域(对应于上述第二光信号接收区域9)，相对常规ToF图像芯片，本申请A区域和B区域的像素结构(对应于上述光信号接收单元13)中均增加滤光层(对应于上述滤光片15)，A区域与B区域的(像素)滤光层采用多波段的滤光通道设计，比如其中一种设计波段分布方式如图3所示：
其中的①～⑨对应接收端图像芯片的B区域各像素(对应于上述第二光信号接收区域所包含的各个光信号接收单元，包括第二光信号接收单元11和第三光信号接收单元12)的滤波特性，A波段为接收端图像芯片的A区域(像素)滤光层结构的滤光特性，其中A波段可以与①～⑨其中一种滤光波段光谱相同；图中的光线波长即上述光信号的波长。
图1中的光信号发射芯片1具体可为VCSEL芯片，采用不同波长的分区域设计，设计示意图(即VCSEL分区示意图)如图4所示；关于VCSEL分区发光波长特性如图5所示：
VCSEL芯片的B区域发光孔(对应于第二光信号发射区域所包含的各个光信号发射单元，包括第二光信号发射单元5和第三光信号发射单元6)发出不同波长(B区域发光孔对应接收端图像芯片的①～⑨，产生对应接收端图像芯片的接收波长λ1至λ9)的光线，VCSEL芯片的A区域发光孔、产生对应接收端图像芯片的、A区域像素结构所接收的对应波长(λA)光线；
ToF应用时，接收端图像芯片的A区域像素结构可用于采集3D信息，B区域像素结构可用于收集反射的光谱信息以及深度信息。
在此说明，如上描述的分区方式和波段信息仅为示意，实际应用方案不局限于上述示意方案；只要ToF通过多种光源检测光谱信息等图像信息均可采用本方案实现。
关于本方案的使用可如图6所示：多波段发射模块VCSEL芯片D发射多种波段光线，比如940nm和840nm；经过测量目标E(即被测对象)的反射后、到达镜头F，再进入接收端图像芯片G(也可理解为接收端图像传感器阵列)。
综上，本方案通过采用分区多波段VCSEL芯片与分区图像传感器(即分区接收端图像芯片)设计，并对现有ToF模组设计进行调整(将IR滤光片取 消，集成到接收端图像芯片中)；使得ToF能够实现深度信息与光谱信息检测两种功能。同时，通过将多光谱光源集成到VCSEL芯片中，可以实现多光谱模组的小型化，且能够进行主动的多光谱检测功能；可以广泛应用于兼顾深度与物质成分的消费电子产品，如人脸解锁应用通过对3D信息以及肤质成分的双重识别大幅度提高应用安全性。
本申请实施例还提供了一种电子设备，包括：上述的图像信息采集模组。
本申请实施例提供的电子设备能够实现上述图像信息采集模组实施例实现的各个过程，为避免重复，这里不再赘述。
本申请实施例还提供了一种信息处理方法，应用于上述的电子设备，如图7所示，该方法包括：
步骤71：控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同。
第二光信号或第三光信号可为与第一光信号波长相同的信号。
步骤72：获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号。
就是借由第一光信号接收区域和第二光信号接收区域分别获取经被测对象反射的光信号。
步骤73：根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
图像信息可以包括被测对象的三维信息、光谱信息和深度信息。
本申请实施例中，所述根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息，包括：根据所述第四光信号，得到所述被测对象对应的图像信息中的三维信息；根据所述第五光信号和第六光信号，得到所述被测对象对应的图像信息中的光谱信息和深度信息。
这样可以精准的获取多种图像信息。本申请实施例中，也可以根据第四光信号得到所述被测对象对应的图像信息中的深度信息(可称为第二深度信 息)，针对该深度信息与根据第五光信号和第六光信号得到的深度信息(可称为第一深度信息)进行处理，得到最终的深度信息，以此作为所述被测对象对应的图像信息中的目标深度信息。
进一步的，所述的信息处理方法，还包括：根据所述三维信息、光谱信息以及深度信息，执行第一操作；其中，所述第一操作包括：解锁操作。
这样能够保证更安全的执行第一操作，实现对应功能。
本申请实施例中，通过控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息；能够实现借由第一光信号发射区域、第一光信号接收区域、第二光信号发射区域以及第二光信号接收区域，获取被测对象的多种外形信息，进而得到更多样的图像信息，以保证后续根据该图像信息进行的处理操作更具安全性、避免使用风险，很好的解决了现有针对被测对象检测的信息处理方案存在使用风险的问题。
需要说明的是，本申请实施例提供的信息处理方法，执行主体可以为信息处理装置，或者该信息处理装置中的用于执行信息处理方法的控制模块。本申请实施例中以信息处理装置执行信息处理方法为例，说明本申请实施例提供的信息处理装置。
本申请实施例还提供了一种信息处理装置，应用于上述的电子设备，如图8所示，该装置包括：
第一控制模块81，用于控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；
第一获取模块82，用于获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第 二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；
第一处理模块83，用于根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
本申请实施例中，所述根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息，包括：根据所述第四光信号，得到所述被测对象对应的图像信息中的三维信息；根据所述第五光信号和第六光信号，得到所述被测对象对应的图像信息中的光谱信息和深度信息。
进一步的，所述的信息处理装置，还包括：第一执行模块，用于根据所述三维信息、光谱信息以及深度信息，执行第一操作；其中，所述第一操作包括：解锁操作。
本申请实施例中，通过控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息；能够实现借由第一光信号发射区域、第一光信号接收区域、第二光信号发射区域以及第二光信号接收区域，获取被测对象的多种外形信息，进而得到更多样的图像信息，以保证后续根据该图像信息进行的处理操作更具安全性、避免使用风险，很好的解决了现有针对被测对象检测的信息处理方案存在使用风险的问题。
本申请实施例中的信息处理装置可以是装置，也可以是终端中的部件、集成电路、或芯片。该装置可以是移动电子设备，也可以为非移动电子设备。示例性的，移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(Ultra-Mobile Personal Computer，UMPC)、上网本或者个人数字助理(Personal Digital Assistant，PDA)等，非移动电子设备可以为服务器、网络附属存储器(Network Attached  Storage，NAS)、个人计算机(Personal Computer，PC)、电视机(Television，TV)、柜员机或者自助机等，本申请实施例不作具体限定。
本申请实施例中的信息处理装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统，可以为ios操作系统，还可以为其他可能的操作系统，本申请实施例不作具体限定。
本申请实施例提供的信息处理装置能够实现图8的方法实施例实现的各个过程，为避免重复，这里不再赘述。
可选地，如图9所示，本申请实施例还提供一种电子设备90，包括处理器91，存储器92，存储在存储器92上并可在所述处理器91上运行的程序或指令，该程序或指令被处理器91执行时实现上述信息处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，本申请实施例中的电子设备包括上述所述的移动电子设备和非移动电子设备。
图10为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备100包括但不限于：射频单元101、网络模块102、音频输出单元103、输入单元104、传感器105、显示单元106、用户输入单元107、接口单元108、存储器109、以及处理器1010等部件。
本领域技术人员可以理解，电子设备100还可以包括给各个部件供电的电源(比如电池)，电源可以通过电源管理系统与处理器1010逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图10中示出的电子设备结构并不构成对电子设备的限定，电子设备可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置，在此不再赘述。
其中，处理器1010，用于控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；
获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；
根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
本申请实施例中，通过控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息；能够实现借由第一光信号发射区域、第一光信号接收区域、第二光信号发射区域以及第二光信号接收区域，获取被测对象的多种外形信息，进而得到更多样的图像信息，以保证后续根据该图像信息进行的处理操作更具安全性、避免使用风险，很好的解决了现有针对被测对象检测的信息处理方案存在使用风险的问题。
可选地，所述根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息，包括：根据所述第四光信号，得到所述被测对象对应的图像信息中的三维信息；根据所述第五光信号和第六光信号，得到所述被测对象对应的图像信息中的光谱信息和深度信息。
可选地，处理器1010，还用于根据所述三维信息、光谱信息以及深度信息，执行第一操作；其中，所述第一操作包括：解锁操作。
综上，本方案能够实现深度信息与光谱信息检测两种功能。同时，能够进行主动的多光谱检测功能；可以广泛应用于兼顾深度与物质成分的消费电子产品，如人脸解锁应用通过对3D信息以及肤质成分的双重识别大幅度提高应用安全性。
应理解的是，本申请实施例中，输入单元104可以包括图形处理器(Graphics Processing Unit，GPU)1041和麦克风1042，图形处理器1041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元106可包括显示面板1061，可以采用液晶显示器、有机发光二极管等形式来配置显示面板1061。用户输入单 元107包括触控面板1071以及其他输入设备1072。触控面板1071，也称为触摸屏。触控面板1071可包括触摸检测装置和触摸控制器两个部分。其他输入设备1072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。存储器109可用于存储软件程序以及各种数据，包括但不限于应用程序和操作系统。处理器1010可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户界面和应用程序等，调制解调处理器主要处理无线通信。可以理解的是，上述调制解调处理器也可以不集成到处理器1010中。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述信息处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述信息处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例还提供了一种计算机程序产品，存储在可读存储介质中，所述计算机程序产品被至少一个处理器执行以实现上述信息处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、 方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。

Claims (19)

  1. 一种图像信息采集模组，包括：
    光信号发射芯片，所述光信号发射芯片包括第一光信号发射区域和第二光信号发射区域，所述第一光信号发射区域内的第一光信号发射单元能够发射第一波长的光信号，所述第二光信号发射区域至少包括：第二光信号发射单元和第三光信号发射单元，第二光信号发射单元和第三光信号发射单元发射的光信号的波长不同；
    光信号接收芯片，所述光信号接收芯片包括第一光信号接收区域和第二光信号接收区域，所述第一光信号接收区域内的第一光信号接收单元能够接收第四光信号，所述第二光信号接收区域至少包括：第二光信号接收单元和第三光信号接收单元，所述第二光信号接收单元能够接收第五光信号，所述第三光信号接收单元能够接收第六光信号；
    其中，所述第四光信号为所述第一光信号发射单元发射的第一光信号、经被测对象反射得到的光信号，所述第五光信号为所述第二光信号发射单元发射的第二光信号、经被测对象反射得到的光信号，所述第六光信号为所述第三光信号发射单元发射的第三光信号、经被测对象反射得到的光信号。
  2. 根据权利要求1所述的图像信息采集模组，其中，所述光信号接收单元包括：依次层叠设置的微透镜、滤光片和光电二极管；
    其中，所述光信号接收单元为：所述第一光信号接收单元、所述第二光信号接收单元或所述第三光信号接收单元；
    各个第一光信号接收单元中的滤光片的滤光波长相同，所述第二光信号接收单元中的滤光片的滤光波长、与所述第三光信号接收单元中的滤光片的滤光波长不同。
  3. 根据权利要求1所述的图像信息采集模组，其中，还包括：柔性电路板；
    其中，所述光信号发射芯片和光信号接收芯片分别与所述柔性电路板相连。
  4. 根据权利要求3所述的图像信息采集模组，其中，还包括：与所述柔性电路板相连的补强板；
    其中，所述光信号发射芯片和光信号接收芯片分别与所述柔性电路板的第一侧面相连，所述补强板与所述柔性电路板的第二侧面相连，所述第二侧面为与所述第一侧面相对的侧面。
  5. 根据权利要求1所述的图像信息采集模组，其中，还包括：通过第一支撑件与所述光信号接收芯片相连的镜头。
  6. 根据权利要求1所述的图像信息采集模组，其中，还包括：通过第二支撑件与所述光信号发射芯片相连的扩散匀光片。
  7. 根据权利要求1所述的图像信息采集模组，其中，所述第一波长为850nm或940nm；和/或，
    所述第二光信号的波长大于或等于350nm且小于或等于1000nm；和/或，
    所述第三光信号的波长大于或等于350nm且小于或等于1000nm。
  8. 一种电子设备，包括：如权利要求1至7任一项所述的图像信息采集模组。
  9. 一种信息处理方法，应用于如权利要求8所述的电子设备，包括：
    控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；
    获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；
    根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
  10. 根据权利要求9所述的信息处理方法，其中，所述根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息，包括：
    根据所述第四光信号，得到所述被测对象对应的图像信息中的三维信息；
    根据所述第五光信号和第六光信号，得到所述被测对象对应的图像信息中的光谱信息和深度信息。
  11. 根据权利要求10所述的信息处理方法，其中，还包括：
    根据所述三维信息、光谱信息以及深度信息，执行第一操作；
    其中，所述第一操作包括：解锁操作。
  12. 一种信息处理装置，应用于如权利要求8所述的电子设备，包括：
    第一控制模块，用于控制第一光信号发射单元发射第一光信号，第二光信号发射单元发射第二光信号，以及第三光信号发射单元发射第三光信号；所述第二光信号和第三光信号的波长不同；
    第一获取模块，用于获取第一光信号接收单元接收的、所述第一光信号经被测对象反射得到的第四光信号，第二光信号接收单元接收的、所述第二光信号经被测对象反射得到的第五光信号，以及第三光信号接收单元接收的、所述第三光信号经被测对象反射得到的第六光信号；
    第一处理模块，用于根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息。
  13. 根据权利要求12所述的信息处理装置，其中，所述根据所述第四光信号、第五光信号和第六光信号，得到所述被测对象对应的图像信息，包括：
    根据所述第四光信号，得到所述被测对象对应的图像信息中的三维信息；
    根据所述第五光信号和第六光信号，得到所述被测对象对应的图像信息中的光谱信息和深度信息。
  14. 根据权利要求13所述的信息处理装置，其中，还包括：
    第一执行模块，用于根据所述三维信息、光谱信息以及深度信息，执行第一操作；
    其中，所述第一操作包括：解锁操作。
  15. 一种电子设备，包括处理器，存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令，其中，所述程序或指令被所述处理器执行时实现如权利要求9-11中任一项所述的信息处理方法的步骤。
  16. 一种可读存储介质，所述可读存储介质上存储程序或指令，其中，所述程序或指令被处理器执行时实现如权利要求9-11中任一项所述的信息处理方法的步骤。
  17. 一种芯片，所述芯片包括处理器和通信接口，其中，所述通信接口和所述处理器耦合，所述处理器用于运行网络设备程序或指令，实现如权利 要求9-11中任一项所述的信息处理方法的步骤。
  18. 一种计算机程序产品，所述计算机程序产品存储在非易失的存储介质中，其中，所述计算机程序产品被至少一个处理器执行以实现如权利要求9-11中任一项所述的信息处理方法的步骤。
  19. 一种电子设备，其中，被配置为执行如权利要求9-11中任一项所述的信息处理方法的步骤。
PCT/CN2022/117281 2021-09-10 2022-09-06 图像信息采集模组、信息处理方法、装置和电子设备 WO2023036131A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111060117.5A CN113743343A (zh) 2021-09-10 2021-09-10 图像信息采集模组、信息处理方法、装置和电子设备
CN202111060117.5 2021-09-10

Publications (1)

Publication Number Publication Date
WO2023036131A1 true WO2023036131A1 (zh) 2023-03-16

Family

ID=78737860

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/117281 WO2023036131A1 (zh) 2021-09-10 2022-09-06 图像信息采集模组、信息处理方法、装置和电子设备

Country Status (2)

Country Link
CN (1) CN113743343A (zh)
WO (1) WO2023036131A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113743343A (zh) * 2021-09-10 2021-12-03 维沃移动通信有限公司 图像信息采集模组、信息处理方法、装置和电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109934137A (zh) * 2019-02-28 2019-06-25 维沃移动通信有限公司 一种光电指纹识别装置、终端及指纹识别方法
WO2020237483A1 (zh) * 2019-05-27 2020-12-03 深圳市汇顶科技股份有限公司 用于人脸识别的光学传感器、装置、方法和电子设备
CN212694034U (zh) * 2020-04-20 2021-03-12 奥比中光科技集团股份有限公司 一种tof深度测量装置及电子设备
CN112954153A (zh) * 2021-01-26 2021-06-11 维沃移动通信有限公司 相机装置、电子设备、景深检测方法及装置
CN113225485A (zh) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 图像采集组件、融合方法、电子设备及存储介质
CN113743343A (zh) * 2021-09-10 2021-12-03 维沃移动通信有限公司 图像信息采集模组、信息处理方法、装置和电子设备

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102317180B1 (ko) * 2017-06-08 2021-10-27 (주)이더블유비엠 3차원 깊이정보 및 적외선정보에 기반하여 생체여부의 확인을 행하는 얼굴인식 장치 및 방법
CN108052878B (zh) * 2017-11-29 2024-02-02 上海图漾信息科技有限公司 人脸识别设备和方法
WO2020237482A1 (zh) * 2019-05-27 2020-12-03 深圳市汇顶科技股份有限公司 用于人脸识别的光学传感器、装置、方法和电子设备
CN111611977B (zh) * 2020-06-05 2021-10-15 吉林求是光谱数据科技有限公司 基于光谱与多波段融合的人脸识别监控系统及识别方法
CN112802068A (zh) * 2020-12-24 2021-05-14 奥比中光科技集团股份有限公司 一种同步获取深度、彩色与光谱图像的装置及识别系统

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109934137A (zh) * 2019-02-28 2019-06-25 维沃移动通信有限公司 一种光电指纹识别装置、终端及指纹识别方法
WO2020237483A1 (zh) * 2019-05-27 2020-12-03 深圳市汇顶科技股份有限公司 用于人脸识别的光学传感器、装置、方法和电子设备
CN212694034U (zh) * 2020-04-20 2021-03-12 奥比中光科技集团股份有限公司 一种tof深度测量装置及电子设备
CN112954153A (zh) * 2021-01-26 2021-06-11 维沃移动通信有限公司 相机装置、电子设备、景深检测方法及装置
CN113225485A (zh) * 2021-03-19 2021-08-06 浙江大华技术股份有限公司 图像采集组件、融合方法、电子设备及存储介质
CN113743343A (zh) * 2021-09-10 2021-12-03 维沃移动通信有限公司 图像信息采集模组、信息处理方法、装置和电子设备

Also Published As

Publication number Publication date
CN113743343A (zh) 2021-12-03

Similar Documents

Publication Publication Date Title
CN109934137B (zh) 一种光电指纹识别装置、终端及指纹识别方法
EP3396516B1 (en) Mobile terminal, method and device for displaying fingerprint recognition region
US20190171877A1 (en) Method and apparatus for iris recognition
WO2019011208A1 (en) IMAGING APPARATUS AND TERMINAL DEVICE
WO2019024652A1 (en) METHOD FOR RECOGNIZING DIGITAL IMPRESSIONS AND RELATED PRODUCTS
US20210135510A1 (en) Wireless energy transmitting apparatus, wireless energy receiving apparatus, wireless energy supply method and system
CN105068732B (zh) 一种电子设备及其控制方法
EP3144748B1 (en) Mobile terminal and method for controlling the same
US20210001235A1 (en) Information display method and apparatus for virtual object, terminal, server, and storage medium
KR102206877B1 (ko) 생체 정보디스플레이 방법 및 장치
WO2020177083A1 (zh) 指纹识别的方法、装置和终端设备
WO2023036131A1 (zh) 图像信息采集模组、信息处理方法、装置和电子设备
TWI488072B (zh) 手勢辨識系統及其手勢辨識方法
US20220367550A1 (en) Mobile terminal and image photographing method
CN111090104B (zh) 成像处理方法和电子设备
US9348438B2 (en) Advanced in-cell touch optical pen
KR20210041012A (ko) Nfv 시준기 및 tft/유기 이미저를 갖는 언더-디스플레이 광학 지문 센서
EP4319138A1 (en) Method for providing image, and electronic device supporting same
CN107782250B (zh) 一种深度信息测量方法、装置和移动终端
CN110826438B (zh) 一种显示方法及电子设备
US11996421B2 (en) Image sensor, mobile terminal, and image capturing method
CN109471119A (zh) 一种控制功耗的方法及终端设备
CN212160703U (zh) 图像传感装置和电子设备
CN113449685A (zh) 光学指纹识别装置、光学指纹识别方法以及电子设备
CN109063620A (zh) 一种身份识别方法及终端设备

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22866594

Country of ref document: EP

Kind code of ref document: A1