CN113777621A - Electronic device, relative position relation detection method and device, and storage medium - Google Patents

Electronic device, relative position relation detection method and device, and storage medium Download PDF

Info

Publication number
CN113777621A
CN113777621A CN202010516726.6A CN202010516726A CN113777621A CN 113777621 A CN113777621 A CN 113777621A CN 202010516726 A CN202010516726 A CN 202010516726A CN 113777621 A CN113777621 A CN 113777621A
Authority
CN
China
Prior art keywords
electronic device
signal
target object
detection
display area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010516726.6A
Other languages
Chinese (zh)
Inventor
张本义
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202010516726.6A priority Critical patent/CN113777621A/en
Publication of CN113777621A publication Critical patent/CN113777621A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/46Indirect determination of position data
    • G01S17/48Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means

Abstract

The present disclosure relates to an electronic device, a relative position relationship detection method, an apparatus, and a storage medium, wherein the electronic device includes: a transmitting unit for transmitting a detection signal; a display area including a plurality of pixel units; the pixel unit is used for generating an electric signal based on the detection signal acting on a reflected signal returned by a target object in a display gap during display or in a non-display period; the output circuit is connected with the display area and used for outputting the electric signals; wherein the electrical signal is used for determining the relative position relationship between the target object and the electronic equipment.

Description

Electronic device, relative position relation detection method and device, and storage medium
Technical Field
The present disclosure relates to the field of electronic technologies, and in particular, to an electronic device, a method and an apparatus for detecting a relative position relationship, and a storage medium.
Background
With the development of electronic technology, in order to sense a distance between an electronic device such as a mobile phone and a tablet computer and a user in real time, a distance sensor capable of implementing a distance detection function is widely applied to the electronic device.
At present, when electronic equipment utilizes a distance sensor to detect distance, the problems of small detection area and low detection accuracy exist. And the arranged distance sensor can occupy the space in the shell of the electronic equipment.
Disclosure of Invention
In view of the above, the present disclosure provides an electronic device, a relative position relationship detection method, an apparatus, and a storage medium.
According to a first aspect of embodiments of the present disclosure, there is provided an electronic device, including:
a transmitting unit for transmitting a detection signal;
a display area including a plurality of pixel units; the pixel unit is used for generating an electric signal based on the detection signal acting on a reflected signal returned by a target object in a display gap during display or in a non-display period;
the output circuit is connected with the display area and used for outputting the electric signals; wherein the electrical signal is used for determining the relative position relationship between the target object and the electronic equipment.
Optionally, the electronic device further comprises:
and the detection module is connected with the output circuit and used for determining the relative position relationship between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal when the electric signal is detected.
Optionally, the detection module is configured to determine the shape of the target object according to positions of a plurality of pixel units generating the electrical signal and a signal value of the electrical signal.
Optionally, the detection module is further configured to determine motion trajectory data of the target object according to a signal value variation trend of the electrical signal generated by the pixel unit.
Optionally, the detection module is further configured to control the electronic device to switch from a screen-off state to a screen-on state when the motion trajectory data represents that the target object is close to the electronic device;
the detection module is further configured to control the electronic device to switch from the screen-on state to the screen-off state when the motion trajectory data represents that the target object is far away from the electronic device.
Optionally, the electronic device comprises:
a structural member having a first opening and a second opening;
wherein the emitting unit is exposed through the first opening, and the detection signal emitted by the emitting unit is transmitted out of the electronic device through the first opening;
the display area is exposed through the second opening, and receives the reflected signal through the second opening.
Optionally, the pixel unit includes: an Organic Light Emitting Diode (OLED) unit;
and/or the presence of a gas in the gas,
the transmitting unit is an infrared signal transmitting unit.
According to a second aspect of the embodiments of the present disclosure, there is provided a relative position relationship detection method applied to an electronic device according to any one of the first aspect of the embodiments of the present disclosure, including:
transmitting a detection signal;
the display area of the electronic equipment generates an electric signal based on the detection signal acting on a reflected signal returned by a target object in a display gap during display or in a non-display period; wherein the display area includes a plurality of pixel units;
outputting the electrical signal through an output circuit of the electronic device; wherein the electrical signal is used for determining the relative position relationship between the target object and the electronic equipment.
Optionally, the method further comprises:
and when the detection module connected with the output circuit detects the electric signal, determining the relative position relationship between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal.
Optionally, the method further comprises:
determining the shape of the target object according to the positions of a plurality of pixel units generating the electric signals and the signal values of the electric signals.
Optionally, the method further comprises:
and determining the motion trail data of the target object according to the signal value variation trend of the electric signals generated by the pixel unit.
Optionally, the method further comprises:
when the motion trail data represent that the target object is close to the electronic equipment, controlling the electronic equipment to be switched from a screen-off state to a screen-on state;
when the motion trail data represent that the target object is far away from the electronic equipment, the electronic equipment is controlled to be switched from the screen-on state to the screen-off state.
According to a third aspect of the embodiments of the present disclosure, there is provided a relative positional relationship detection apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: when executed, implement the steps in the method according to any one of the second aspect of the embodiments of the present disclosure.
According to a fourth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of a relative positional relationship detection apparatus, enable the relative positional relationship detection apparatus to perform the method according to any one of the second aspect of the embodiments of the present disclosure.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
compared with the electronic equipment additionally provided with a receiving unit for receiving the reflected signal of the infrared signal acting on the target object and provided with the opening corresponding to the receiving unit on the shell of the electronic equipment to allow the receiving unit to receive the reflected signal, the embodiment of the disclosure receives the reflected signal by using the pixel unit of the display area, generates the electric signal and determines the relative position relationship between the target object and the electronic equipment according to the electric signal, and a special receiving unit is not required to be arranged in the electronic equipment, so that the hardware cost of the electronic equipment is reduced.
Moreover, since the area of the display area that can receive the reflected signal is larger than the receiving area of the specially-arranged receiving unit, the scheme of the embodiment of the disclosure can expand the range of the detection of the relative position relationship.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
FIG. 1 is a schematic diagram illustrating an electronic device in accordance with an exemplary embodiment.
Fig. 2 is a schematic diagram illustrating a positional relationship between an electronic device and a target object according to an exemplary embodiment.
Fig. 3 is a flowchart illustrating a relative position relationship detection method according to an exemplary embodiment.
Fig. 4 is a block diagram illustrating a relative positional relationship detection apparatus according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the invention, as detailed in the appended claims.
In the related art, in order to implement the distance detection function in the electronic device, two openings are usually disposed in a partial area of the front cover of the electronic device except for the display area, a transmitting unit of the distance sensor is disposed below the first opening, and a receiving unit of the distance sensor is disposed below the second opening. When the distance detection is carried out, the transmitting unit transmits a detection signal through the first opening, detects a reflection signal acting on a target object based on the detection signal through the second opening, and carries out the distance detection according to the detection signal and the reflection signal.
The transmitting unit and the receiving unit need to be disposed in the housing of the electronic device, and therefore occupy the space in the housing of the electronic device, reduce the available space of other functional elements, and are not conducive to the lightness and thinness of the electronic device.
In addition, the first opening and the second opening occupy a certain area on the front cover of the electronic device, so that the occupied area of the display area on the front cover is limited, and the screen occupation ratio of the electronic device is reduced.
Further, because the receiving unit needs just to receive the reflected signal through the second trompil, so in order to guarantee the effect of distance detection, set up to the position of transmitting unit and receiving unit and have higher requirement, and this distance inductor can carry out the working area that the distance detected less, is difficult to guarantee the degree of accuracy and the user experience of distance detection.
FIG. 1 is a schematic diagram illustrating an electronic device 100 in accordance with an example embodiment. Referring to fig. 1, the electronic device 100 includes:
a transmitting unit 120 for transmitting a detection signal;
a display region 130 including a plurality of pixel units; the pixel unit is used for generating an electric signal based on a reflected signal returned by a detection signal acting on a target object in a display gap during display or in a non-display period;
an output circuit 140 connected to the display region 130, for outputting the electric signal; wherein the electrical signal is used to determine the relative positional relationship between the target object and the electronic device 100.
For example, the relative positional relationship between the target object and the electronic device 100 may include: a distance between the target object and the electronic device 100, and/or an angle between a plane in which the target object is located and a plane in which the electronic device 100 is located.
Taking a cylinder as an example of the target object, a relative position relationship between the target object and the electronic device 100 is specifically described. The cylinder includes first surface, second surface and third surface, and first surface and second surface are the circular surface, and the third surface is the annular surface of perpendicular to first surface and second surface respectively.
When the first surface of the cylinder is parallel to the display area 130 of the electronic device 100, the first surface of the cylinder faces the display area 130, and the second surface of the cylinder is away from the display area 130, the relative positional relationship between the cylinder and the electronic device 100 includes a perpendicular distance between the first surface of the cylinder and the display area 130 of the electronic device 100.
When the second surface of the cylinder is parallel to the display area 130 of the electronic device 100, the second surface of the cylinder faces the display area 130, and the first surface of the cylinder is away from the display area 130, the relative positional relationship between the cylinder and the electronic device 100 includes a perpendicular distance between the second surface of the cylinder and the display area 130 of the electronic device 100.
When a first included angle exists between the plane of the second surface of the cylinder and the plane of the display area 130 (that is, the plane of the second surface of the cylinder is not parallel to the plane of the display area 130), the second surface of the cylinder faces the display area 130, and the first surface of the cylinder is far away from the display area 130, the relative positional relationship between the cylinder and the electronic device 100 includes the first included angle between the plane of the second surface of the cylinder and the plane of the display area 130.
When there is relative motion between the cylinder and the electronic device, the relative positional relationship between the cylinder and the electronic device 100 may further include: the cylinder and the electronic device are close to each other, or the cylinder and the electronic device are far from each other, etc.
The transmitting unit 120 is a transmitting unit capable of transmitting an infrared signal. At this time, the detection signal is an infrared signal. Taking the example of the transmitting unit transmitting the infrared signal, the target object located in the field angle range of the transmitting unit 120 can reflect the received infrared signal to generate the reflected signal.
The pixel unit includes: an Organic Light Emitting Diode (OLED) unit.
During display, the pixel units of the display region 130 have an emission period and a display gap. Illustratively, the pixel cell in the emission period generates a light signal according to the driving signal, and the pixel cell in the display gap suspends generating the light signal. It is understood that the display gap is located between two adjacent light emission periods during display.
Due to the persistence of vision, in the display gap between two adjacent light-emitting periods, the visual effect of the optical signal generated by the pixel unit in the previous light-emitting period on the retina of the human eye is still persisted in the brain of the human eye in the display gap, i.e. the user thinks that the display region 130 is still being displayed in the display gap during the display.
Therefore, the pixel unit can generate an electric signal based on the detection signal acting on the reflected signal returned by the target object in the display gap during the display period, so that the electronic device 100 can realize the relative position relation detection function while displaying information.
During the non-display period, the pixel units of the display area 120 do not generate light signals. At this time, the detection signal emitted by the emitting unit 120 acts on the target object, the target object reflects the detection signal, a reflection signal having a propagation direction different from that of the detection signal is generated, and at least a part of the reflection signal propagates toward the display area 130. In the display area 130, the pixel unit receiving the reflection signal generates an electrical signal under the excitation of the reflection signal.
Illustratively, the signal value of the electrical signal may be used to characterize the intensity of the reflected signal received by the pixel cell that generated the electrical signal. Specifically, the signal value of the electrical signal may be positively correlated with the intensity of the reflected signal received by the pixel unit.
Compared with the electronic equipment additionally provided with a receiving unit for receiving the reflected signal of the infrared signal acting on the target object and provided with the opening corresponding to the receiving unit on the shell of the electronic equipment to allow the receiving unit to receive the reflected signal, the embodiment of the disclosure receives the reflected signal by using the pixel unit of the display area, generates the electric signal and determines the relative position relationship between the target object and the electronic equipment according to the electric signal, and a special receiving unit is not required to be arranged in the electronic equipment, so that the hardware cost of the electronic equipment is reduced.
Moreover, since the area of the display area that can receive the reflected signal is larger than the receiving area of the specially-arranged receiving unit, the scheme of the embodiment of the disclosure can expand the range of relative position detection.
In some embodiments, as shown in fig. 2, the electronic device 100 may further include:
and the detection module 150 is connected to the output circuit 140, and is configured to determine a relative positional relationship between the target object and the electronic device 100 according to a position of a pixel unit generating the electrical signal and a signal value of the electrical signal when the electrical signal is detected.
The detecting module 150 may include: the electronic device 100 may be an onboard processor or an additionally provided processor chip. For example, the detecting module 150 may be a Central Processing Unit (CPU) of the electronic apparatus 100.
The position parameters of the pixel units and the transmission lines of the output circuit 140 for transmitting the electrical signals from the pixel units to the detection module 150 may have a corresponding relationship, and the corresponding relationship may be stored in the detection module 150 in advance. When the detection module 150 detects the electrical signal, the detection module 150 can obtain the position parameter of the pixel unit generating the electrical signal according to the transmission line detecting the electrical signal and the corresponding relationship. Here, the position parameter is used to indicate the position of the pixel unit in the display area 130.
The detection module that this disclosed embodiment set up through the position of the pixel element that combines to produce the electric signal and the signal value of electric signal, can improve the degree of accuracy that relative position relation detected.
In some embodiments, the detection module 150 is configured to determine the relative position relationship between the target object and the electronic device 100 according to the position of the electrical signal having the signal value greater than the preset signal value and the pixel unit generating the electrical signal having the signal value greater than the preset signal value.
In the external environment where the electronic apparatus 100 is located, there are generally other objects capable of radiating infrared rays to the outside. When the other object is not the target object and the infrared rays radiated by the other object move to the display area 130, the pixel units of the display area 130 are also excited to generate weak electrical signals, thereby causing interference in detecting the relative position relationship between the target object and the electronic device 100. It will be appreciated that, in general, the signal value of the electrical signal generated by the pixel element when excited by said other object is smaller than the signal value of the electrical signal generated by the pixel element based on said reflected signal.
Therefore, in the present disclosure, the detection module 150 generates the ranging signal according to the electrical signal having the signal value greater than the preset signal value, and can identify the pixel unit generating the electrical signal based on the reflection signal, reduce the interference of the other objects in the external environment on the detection of the relative position relationship between the target object and the electronic device 100, and improve the accuracy of the detection
Fig. 2 shows a positional relationship between a target object and an electronic device. As shown in fig. 2, the pixel units located in the shadow area of the display area 130 receive the reflection signal to generate the signal value of the electrical signal, and the signal value of the electrical signal generated by the pixel units is greater than the preset signal value.
In some embodiments, the detection module 150 is configured to determine the shape of the target object according to the positions of the plurality of pixel units generating the electrical signals and the signal values of the electrical signals.
Take the example that the detection signal is an infrared signal. In the field angle of the infrared signal emitted by the emitting unit 120, the emitted infrared signal has different propagation directions, and therefore, the infrared signals with different propagation directions have different incident angles at the same position of the target object, and therefore, the reflected signals with different reflection angles are generated at the same position of the target object.
The paths of the reflection signals with different reflection angles generated at the same position of the target object moving to the display area are different, so that the reflection signals with different reflection angles generated by the reflection at the same position of the target object are received by different pixel units, and the intensities of the reflection signals with different reflection angles generated by the reflection at the same position of the target object and received by different pixel units are also different. Therefore, the intensity of the reflected signal received by the pixel units at different positions is different, and the signal value of the generated electric signal is also different.
Therefore, the detection module can determine the projection outline of the target object to the display area according to the positions of the pixel units generating the electric signals and the values of the electric signals. Wherein the contour is the same or similar to the actual shape of the target object.
In the embodiment of the disclosure, the detection module 150 may determine the shape of the target object according to the positions of the plurality of pixel units generating the electrical signals and the signal values of the electrical signals, so as to lay a foundation for controlling the electronic device 100 to execute a predetermined function (for example, a function of unlocking the electronic device based on gesture recognition) based on the shape of the target object, and facilitate enrichment of user experience.
The predetermined function may include: the electronic apparatus 100 is switched from the locked state to the unlocked state, or the electronic apparatus 100 is switched from the unlocked state to the locked state.
Illustratively, when the electronic device 100 is in the locked state, the user cannot browse and read data information stored by the electronic device 100. For example, the user cannot browse photos stored by the electronic device 100.
Illustratively, when the electronic device 100 is in the unlocked state, the user may browse and read data information stored by the electronic device 100. For example, the user may browse through photos stored by the electronic device 100.
When the detection module 150 determines that the similarity between the shape of the target object and the first preset shape is greater than the similarity threshold, the detection module 150 controls the electronic device 100 to switch from the locked state to the unlocked state. Here, the first predetermined shape may be pre-stored in the detection module 150, or may be pre-stored in a storage module of the electronic device 100; the target object may be a gesture of the user with a finger, and thus, a function of unlocking the electronic device according to a gesture of the user may be realized.
When the detection module 150 determines that the similarity between the shape of the target object and the first preset shape is smaller than the similarity threshold, the detection module controls the electronic device to keep the current state.
For another example, when the detection module 150 determines that the similarity between the shape of the target object and the second preset shape is greater than the similarity threshold, the detection module 150 controls the electronic device 100 to switch from the unlocked state to the locked state. Here, the second predetermined shape may be pre-stored in the detection module 150, or may be pre-stored in a storage module of the electronic device 100; the target object can be a gesture of the user with fingers, and therefore the function of locking the electronic equipment according to the gesture of the user can be achieved.
When the detection module 150 determines that the similarity between the shape of the target object and the second preset shape is smaller than the similarity threshold, the detection module controls the electronic device to keep the current state.
In some embodiments, the detection module 150 is further configured to determine the motion trajectory data of the target object according to a trend of signal value changes of the electrical signals generated by the pixel units.
Here, the motion trajectory may include: a first trajectory perpendicular to the display area 130 and/or a second trajectory parallel to the display area 130.
For example, when the target object moves, the relative position between the target object and the electronic device 100 changes, and therefore, the distance that the detection signal travels in the space and the distance that the reflection signal travels may both change, and the position of the pixel unit that receives the reflection signal and the intensity of the reflection signal received by the pixel unit may both change.
For example, when the target object approaches the electronic device 100 along the first trajectory and the vertical distance between the target object and the electronic device 100 decreases, the intensity of the reflected signal received by the pixel unit increases, and thus the signal value of the electrical signal generated by the pixel unit gradually increases. Here, the first trajectory may be perpendicular to a plane in which the display area 130 is located.
Similarly, when the target object moves away from the electronic device 100 along the first trajectory and the vertical distance between the target object and the electronic device 100 increases, the intensity of the reflected signal received by the pixel unit decreases, and thus the signal value of the electrical signal generated by the pixel unit gradually decreases.
For example, the detection module 150 may further determine the motion trajectory data of the target object according to a signal value variation trend of the electrical signal generated by the pixel unit and a position of the pixel unit generating the electrical signal.
For example, when the target object moves along the second trajectory, the vertical distance between the target object and the electronic device 100 does not change, but the position of the pixel unit receiving the reflected signal changes, that is, the position of the pixel unit generating the electric signal changes. In particular, the second trajectory may be parallel to a plane in which the display area 130 is located.
As another example, when the target object moves along the third trajectory and the target object gradually approaches the electronic device 100, the position of the pixel generating the electrical signal may change and the signal value of the electrical signal increases. When the target object moves along the third trajectory and the target object is far from the electronic device 100, the position of the pixel generating the electrical signal changes and the signal value of the electrical signal decreases. Here, an included angle exists between a plane where the third track is located and a plane where the display area is located, and the included angle between the plane where the third track is located and the plane where the display area is located is not a right angle.
In the embodiment of the present disclosure, the detection module 150 may determine the motion trajectory data of the target object according to the signal value variation trend of the electrical signal generated by the pixel unit, so as to lay a foundation for controlling the electronic device 100 to execute a predetermined function based on the motion trajectory of the target object, and facilitate enriching the user experience.
Here, the predetermined function may further include: change the volume of the electronic device 100, slide the display interface of the electronic device 100, or the like.
For example, when the electronic device 100 plays a video through the display area 130 and the detection module 150 determines that the motion trajectory data of the target object indicates that the target object moves in the first direction, the volume of the electronic device 100 is increased.
When the electronic device plays a video through the display area 130 and the detection module 150 determines that the motion trajectory data of the target object indicates that the target object moves in the direction opposite to the first direction, the volume of the electronic device 100 is decreased.
The first direction may include: pointing in the direction of the top bezel of the electronic device 100 from the bottom bezel of the electronic device 100.
In some embodiments, the detection module 150 is further configured to control the electronic device 100 to switch from the screen-off state to the screen-on state when the motion trajectory data indicates that the target object is close to the electronic device 100;
the detection module 150 is further configured to control the electronic device 100 to switch from the on-screen state to the off-screen state when the motion trajectory data indicates that the target object is far away from the electronic device 100.
When the electronic device 100 is in the off-screen state, the display area 130 may be black, and the display area 130 stops generating the light signal.
When the electronic device 100 is in the bright screen state, the display area 130 displays. For example, the display area 130 may display the current time.
Taking the target object as the user's finger as an example, when the user's finger is close to the electronic device 100, it may indicate that the user needs to use the electronic device 100. At this time, the electronic device 100 is controlled by the detection module 150 to switch from the off-screen state to the on-screen state, so that the intelligence of the electronic device 100 is improved.
When the user's finger is away from electronic device 100, it may indicate that the user is not temporarily required to use electronic device 100. At this time, the display area 130 is controlled to be switched from the on-screen state to the off-screen state by the detection module 150, which is beneficial to reducing the power consumption of the electronic device 100.
In some embodiments, electronic device 100 may include:
a structural member having a first opening and a second opening;
the emitting unit 120 is exposed through the first opening, and the detection signal emitted by the emitting unit 120 is transmitted out of the electronic device 100 through the first opening;
the display area 130 is exposed through the second opening and receives the reflected signal through the second opening.
Exemplary, the structural member may include: a front cover of the electronic device, or a back case of the electronic device. The structural member is used to house the display area 130.
When the structural member comprises a front cover of the electronic device, the front cover of the electronic device 100 is viewable by a user when the display area 130 is oriented toward the user.
It is noted that when the structural member comprises a rear case of the electronic device, the rear case comprises: the bottom cover and the frame body perpendicular to the plane of the bottom cover. The frame body is distributed on the bottom cover and can form a first opening and a second opening. When the display area 130 faces the user, the frame body and the bottom cover may be located at the back of the display area 130, i.e., the back case of the electronic device 100 is not visible to the user.
The first opening and the second opening are located on the same surface of the structural member. As such, when the second opening is facing the target object, the first opening is also facing the target object. Thus, at least a partial area of the display area 130 can receive a reflected signal generated by the detection signal emitted from the emission unit 120 acting on the target object.
In the related art, when a receiving unit is additionally provided in an electronic device to receive a reflected signal of an infrared signal acting on a target object, an opening corresponding to the receiving unit is generally required to be provided on a housing of the electronic device to allow the receiving unit to receive the reflected signal.
In the embodiment of the disclosure, the display area is used for receiving the reflected signal, and an opening corresponding to the receiving unit does not need to be additionally arranged on the shell of the electronic device, which is beneficial to improving the sealing performance of the electronic device.
Further, in the related art, when the receiving unit and the display area of the distance sensor are disposed on the same surface of the electronic device, the opening is generally required to be disposed at a position corresponding to the receiving unit on the same surface, thereby limiting the development of the entire screen of the electronic device.
In the embodiment of the disclosure, the display area of the electronic device is used for receiving the reflected signal, no additional receiving unit is needed, and no opening corresponding to the receiving unit is needed to be arranged on the surface where the display area is located, so that a foundation is laid for realizing the comprehensive screen design of the electronic device.
Fig. 3 is a flowchart illustrating a relative position relationship detection method according to an exemplary embodiment, and as shown in fig. 3, the method is used in the electronic device 100 provided in the embodiment of the present disclosure, and includes the following steps:
s11: transmitting a detection signal;
s12: the display area of the electronic equipment generates an electric signal based on a reflected signal returned by a detection signal acting on a target object in a display gap during display or in a non-display period; wherein the display area comprises a plurality of pixel units;
s13: outputting the electrical signal through an output circuit of an electronic device; wherein the electrical signal is used for determining the relative position relationship between the target object and the electronic equipment.
Compared with the electronic device additionally provided with a receiving unit for receiving a reflected signal of an infrared signal acting on a target object and provided with an opening corresponding to the receiving unit on the shell of the electronic device to allow the receiving unit to receive the reflected signal, the embodiment of the disclosure receives the reflected signal by using the pixel unit of the display area, generates an electric signal, and performs relative position detection according to the electric signal, and because the area of the display area capable of receiving the reflected signal is larger than the receiving area of the receiving unit, the relative position detection range can be expanded.
In some embodiments, the method may comprise:
when the detection module connected with the output circuit detects the electric signal, the relative position relation between the target object and the electronic equipment is determined according to the position of the pixel unit generating the electric signal and the signal value of the electric signal.
The embodiment of the disclosure generates the ranging signal by combining the position of the pixel unit generating the electric signal and the signal value of the electric signal, and can improve the accuracy of detecting the relative position relationship.
In some embodiments, the method further comprises:
and determining the shape of the target object according to the positions of a plurality of pixel units generating the electric signals and the signal values of the electric signals.
In the embodiment of the disclosure, the shape of the target object is determined according to the positions of the plurality of pixel units generating the electric signals and the signal values of the electric signals, so that a foundation is laid for realizing the function of controlling the electronic device based on the shape of the target object (for example, the function of unlocking the electronic device based on gesture recognition), and the enrichment of user experience is facilitated.
In some embodiments, the method further comprises:
and determining the motion track data of the target object according to the signal value variation trend of the electric signals generated by the pixel units.
In the embodiment of the disclosure, the motion trajectory data of the target object is determined according to the signal value variation trend of the electrical signal generated by the pixel unit, so that a foundation is laid for realizing the function of controlling the electronic device based on the motion trajectory of the target object, and the enrichment of user experience is facilitated.
In some embodiments, the method further comprises:
when the motion trajectory data represent that the target object is close to the electronic equipment, controlling the electronic equipment to be switched from a screen-off state to a screen-on state;
and when the motion trail data represent that the target object is far away from the electronic equipment, controlling the electronic equipment to be switched from the screen-off state to the screen-on state.
Taking the target object as the user's finger as an example, when the user's finger is close to the electronic device, it may indicate that the user needs to use the electronic device. At this moment, switch over to the bright screen state from the state of going out the screen through detecting module control electronic equipment, improved electronic equipment intellectuality.
When the user's finger is away from the electronic device, it may indicate that the user is not temporarily required to use the electronic device. At the moment, the electronic equipment is controlled to be switched from the screen-on state to the screen-off state, so that the power consumption of the electronic equipment is reduced.
Fig. 4 is a block diagram illustrating an apparatus 800 for relative positional relationship detection according to an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 4, the apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power component 806 provides power to the various components of device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 800.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed state of the device 800, the relative positioning of the components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or a component of the apparatus 800, the presence or absence of user contact with the apparatus 800, orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of a relative positional relationship detection apparatus, enable the relative positional relationship detection apparatus to perform the above method provided by an embodiment of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (14)

1. An electronic device, comprising:
a transmitting unit for transmitting a detection signal;
a display area including a plurality of pixel units; the pixel unit is used for generating an electric signal based on the detection signal acting on a reflected signal returned by a target object in a display gap during display or in a non-display period;
the output circuit is connected with the display area and used for outputting the electric signals; wherein the electrical signal is used for determining the relative position relationship between the target object and the electronic equipment.
2. The electronic device of claim 1, further comprising:
and the detection module is connected with the output circuit and used for determining the relative position relationship between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal when the electric signal is detected.
3. The electronic device of claim 2,
and the detection module is used for determining the shape of the target object according to the positions of a plurality of pixel units generating the electric signals and the signal values of the electric signals.
4. The electronic device of claim 2,
the detection module is further used for determining the motion track data of the target object according to the signal value variation trend of the electric signals generated by the pixel units.
5. The electronic device of claim 4,
the detection module is further configured to control the electronic device to switch from a screen-off state to a screen-on state when the motion trajectory data represents that the target object is close to the electronic device;
the detection module is further configured to control the electronic device to switch from the screen-on state to the screen-off state when the motion trajectory data represents that the target object is far away from the electronic device.
6. The electronic device of claim 1, further comprising:
a structural member having a first opening and a second opening;
wherein the emitting unit is exposed through the first opening, and the detection signal emitted by the emitting unit is transmitted out of the electronic device through the first opening;
the display area is exposed through the second opening, and receives the reflected signal through the second opening.
7. The electronic device of claim 1, wherein the electronic device is a mobile phone
The pixel unit includes: an Organic Light Emitting Diode (OLED) unit;
and/or the presence of a gas in the gas,
the transmitting unit is an infrared signal transmitting unit.
8. A relative position relationship detection method applied to the electronic device according to any one of claims 1 to 7, comprising:
transmitting a detection signal;
the display area of the electronic equipment generates an electric signal based on the detection signal acting on a reflected signal returned by a target object in a display gap during display or in a non-display period; wherein the display area includes a plurality of pixel units;
outputting the electrical signal through an output circuit of the electronic device; wherein the electrical signal is used for determining the relative position relationship between the target object and the electronic equipment.
9. The method of claim 8, further comprising:
and when the detection module connected with the output circuit detects the electric signal, determining the relative position relationship between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal.
10. The method of claim 9, further comprising:
determining the shape of the target object according to the positions of a plurality of pixel units generating the electric signals and the signal values of the electric signals.
11. The method of claim 9, further comprising:
and determining the motion trail data of the target object according to the signal value variation trend of the electric signals generated by the pixel unit.
12. The method of claim 11, further comprising:
when the motion trail data represent that the target object is close to the electronic equipment, controlling the electronic equipment to be switched from a screen-off state to a screen-on state;
when the motion trail data represent that the target object is far away from the electronic equipment, the electronic equipment is controlled to be switched from the screen-on state to the screen-off state.
13. A relative positional relationship detection apparatus, characterized by comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: when executed, implement the steps in the method of any one of claims 8 to 12.
14. A non-transitory computer-readable storage medium having instructions stored thereon, which when executed by a processor of a relative positional relationship detection apparatus, enable the relative positional relationship detection apparatus to perform the method of any one of claims 8 to 12.
CN202010516726.6A 2020-06-09 2020-06-09 Electronic device, relative position relation detection method and device, and storage medium Pending CN113777621A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010516726.6A CN113777621A (en) 2020-06-09 2020-06-09 Electronic device, relative position relation detection method and device, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010516726.6A CN113777621A (en) 2020-06-09 2020-06-09 Electronic device, relative position relation detection method and device, and storage medium

Publications (1)

Publication Number Publication Date
CN113777621A true CN113777621A (en) 2021-12-10

Family

ID=78834282

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010516726.6A Pending CN113777621A (en) 2020-06-09 2020-06-09 Electronic device, relative position relation detection method and device, and storage medium

Country Status (1)

Country Link
CN (1) CN113777621A (en)

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014065697A1 (en) * 2012-10-26 2014-05-01 Общество С Ограниченной Ответственностью Инновационное Предприятие "Дисплаир Компани" Method and device for the gesture control of a multimedia display
KR20160031940A (en) * 2014-09-15 2016-03-23 주식회사 와이드벤티지 User input apparatus using location or change thereof
CN107608454A (en) * 2017-08-31 2018-01-19 广东欧珀移动通信有限公司 Display screen and electronic equipment
CN107968883A (en) * 2017-11-22 2018-04-27 广东欧珀移动通信有限公司 Distance state detection method, device, storage medium and electronic equipment
CN108491076A (en) * 2018-03-14 2018-09-04 广东欧珀移动通信有限公司 Display control method and related product
CN109040363A (en) * 2018-08-10 2018-12-18 Oppo广东移动通信有限公司 Display screen, electronic device and three-dimensional feature recognition methods
CN109151348A (en) * 2018-09-28 2019-01-04 维沃移动通信有限公司 A kind of imaging sensor, image processing method and electronic equipment
CN109507686A (en) * 2018-11-08 2019-03-22 歌尔科技有限公司 A kind of control method wears display equipment, electronic equipment and storage medium
CN109508069A (en) * 2018-09-28 2019-03-22 深圳阜时科技有限公司 A kind of equipment
CN208656825U (en) * 2018-07-31 2019-03-26 Oppo广东移动通信有限公司 Display screen component and electronic equipment
CN109755275A (en) * 2017-11-02 2019-05-14 三星显示有限公司 Display device and the method for driving display device
CN208903164U (en) * 2018-11-21 2019-05-24 Oppo广东移动通信有限公司 Electronic equipment
CN109947302A (en) * 2019-03-29 2019-06-28 京东方科技集团股份有限公司 A kind of aerial display device and its control method
WO2020024696A1 (en) * 2018-07-31 2020-02-06 Oppo广东移动通信有限公司 Display screen assembly, electronic device, and control method for electronic device
US20200042109A1 (en) * 2017-06-22 2020-02-06 Tencent Technology (Shenzhen) Company Limited Method and apparatus for dynamically displaying interface content and device thereof
KR20200021708A (en) * 2018-08-21 2020-03-02 한국과학기술연구원 Endoscope apparatus capable of visualizing both visible light and near-infrared light
CN110913040A (en) * 2018-09-15 2020-03-24 华为技术有限公司 Terminal equipment
CN111027982A (en) * 2019-12-26 2020-04-17 北京意锐新创科技有限公司 Non-inductive payment method and device suitable for full-screen

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014065697A1 (en) * 2012-10-26 2014-05-01 Общество С Ограниченной Ответственностью Инновационное Предприятие "Дисплаир Компани" Method and device for the gesture control of a multimedia display
KR20160031940A (en) * 2014-09-15 2016-03-23 주식회사 와이드벤티지 User input apparatus using location or change thereof
US20200042109A1 (en) * 2017-06-22 2020-02-06 Tencent Technology (Shenzhen) Company Limited Method and apparatus for dynamically displaying interface content and device thereof
CN107608454A (en) * 2017-08-31 2018-01-19 广东欧珀移动通信有限公司 Display screen and electronic equipment
CN109755275A (en) * 2017-11-02 2019-05-14 三星显示有限公司 Display device and the method for driving display device
CN107968883A (en) * 2017-11-22 2018-04-27 广东欧珀移动通信有限公司 Distance state detection method, device, storage medium and electronic equipment
CN108491076A (en) * 2018-03-14 2018-09-04 广东欧珀移动通信有限公司 Display control method and related product
WO2020024696A1 (en) * 2018-07-31 2020-02-06 Oppo广东移动通信有限公司 Display screen assembly, electronic device, and control method for electronic device
CN208656825U (en) * 2018-07-31 2019-03-26 Oppo广东移动通信有限公司 Display screen component and electronic equipment
CN109040363A (en) * 2018-08-10 2018-12-18 Oppo广东移动通信有限公司 Display screen, electronic device and three-dimensional feature recognition methods
KR20200021708A (en) * 2018-08-21 2020-03-02 한국과학기술연구원 Endoscope apparatus capable of visualizing both visible light and near-infrared light
CN110913040A (en) * 2018-09-15 2020-03-24 华为技术有限公司 Terminal equipment
CN109508069A (en) * 2018-09-28 2019-03-22 深圳阜时科技有限公司 A kind of equipment
CN109151348A (en) * 2018-09-28 2019-01-04 维沃移动通信有限公司 A kind of imaging sensor, image processing method and electronic equipment
CN109507686A (en) * 2018-11-08 2019-03-22 歌尔科技有限公司 A kind of control method wears display equipment, electronic equipment and storage medium
CN208903164U (en) * 2018-11-21 2019-05-24 Oppo广东移动通信有限公司 Electronic equipment
CN109947302A (en) * 2019-03-29 2019-06-28 京东方科技集团股份有限公司 A kind of aerial display device and its control method
CN111027982A (en) * 2019-12-26 2020-04-17 北京意锐新创科技有限公司 Non-inductive payment method and device suitable for full-screen

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ZHENG XIAO ET AL.: "3D Human Postures Recognition Using Kinect", 2012 4TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), 27 August 2012 (2012-08-27) *
党东妮;高卫;孙奕帆;: "注入式红外捕获跟踪仿真关键技术研究", 激光与红外, no. 08, 31 August 2013 (2013-08-31) *

Similar Documents

Publication Publication Date Title
CN107145856B (en) Organic light emitting diode display module and control method thereof
CN108509083B (en) Display panel and terminal
US20190005915A1 (en) Array substrate and mobile terminal
CN109410833B (en) Ambient light detection method, ambient light detection device, terminal and storage medium
KR101712529B1 (en) Method, device, terminal, program and computer-readable recording medium for controlling flash
KR101314679B1 (en) Mobile terminal and method for operation control
KR20150085402A (en) Mobile terminal and method for controlling the same
CN108255369B (en) Method and device for displaying fingerprint icon in screen and computer readable storage medium
US11087662B2 (en) Display control method for terminal screen, device and storage medium thereof
CN115798365A (en) Display panel, photoelectric detection method, photoelectric detection device and computer-readable storage medium
CN108989494B (en) Electronic equipment
CN108073328B (en) Touch response method and device
CN106919914B (en) Display module and electronic equipment
US10930217B2 (en) Method and apparatus for compensating operating parameter of display circuit
CN111599273A (en) Display screen control method and device, terminal equipment and storage medium
CN110956924B (en) Screen brightness adjusting method and device, electronic equipment and readable storage medium
CN106445122B (en) Equipment state control method and device
CN107153448B (en) Display module, control method thereof, electronic device and computer-readable storage medium
CN110968155A (en) Full-screen terminal, operation execution method and device based on full-screen terminal
CN113777621A (en) Electronic device, relative position relation detection method and device, and storage medium
CN111246012B (en) Application interface display method and device and storage medium
CN112689047B (en) Display control method and device and electronic equipment
CN110971722B (en) Image shooting method and device
CN113727034A (en) Light supplement control method, electronic device and storage medium
CN107506630B (en) Equipment with iris recognition function and iris recognition method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination