CN113777621B - Electronic device, relative position relation detection method, relative position relation detection device and storage medium - Google Patents
Electronic device, relative position relation detection method, relative position relation detection device and storage medium Download PDFInfo
- Publication number
- CN113777621B CN113777621B CN202010516726.6A CN202010516726A CN113777621B CN 113777621 B CN113777621 B CN 113777621B CN 202010516726 A CN202010516726 A CN 202010516726A CN 113777621 B CN113777621 B CN 113777621B
- Authority
- CN
- China
- Prior art keywords
- signal
- electronic device
- target object
- detection
- display area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 111
- 230000033001 locomotion Effects 0.000 claims description 28
- 238000000034 method Methods 0.000 claims description 27
- 230000008859 change Effects 0.000 claims description 11
- 230000006870 function Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 10
- 230000001276 controlling effect Effects 0.000 description 8
- 230000000875 corresponding effect Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 230000007423 decrease Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005284 excitation Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 238000007789 sealing Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/46—Indirect determination of position data
- G01S17/48—Active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Position Input By Displaying (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The disclosure relates to an electronic device, a relative position relation detection method, a relative position relation detection device and a storage medium, wherein the electronic device comprises: a transmitting unit for transmitting a detection signal; a display area including a plurality of pixel units; the pixel unit is used for generating an electric signal based on a reflected signal which is returned by the detection signal acting on the target object in a display gap during display or during non-display; the output circuit is connected with the display area and is used for outputting the electric signals; wherein the electrical signal is used for determining a relative positional relationship between the target object and the electronic device.
Description
Technical Field
The disclosure relates to the field of electronic technology, and in particular, to an electronic device, a method and a device for detecting a relative position relationship, and a storage medium.
Background
With the development of electronic technology, in order to sense a distance between an electronic device such as a mobile phone or a tablet computer and a user in real time, a distance sensor capable of implementing a distance detection function is widely used in the electronic device.
At present, when the electronic equipment utilizes the distance sensor to detect the distance, the problems of small detection area and low detection accuracy exist. And the distance sensor occupies the space in the electronic equipment housing.
Disclosure of Invention
In view of this, the present disclosure provides an electronic device, a relative positional relationship detection method, a relative positional relationship detection device, and a storage medium.
According to a first aspect of embodiments of the present disclosure, there is provided an electronic device, comprising:
a transmitting unit for transmitting a detection signal;
A display area including a plurality of pixel units; the pixel unit is used for generating an electric signal based on a reflected signal which is returned by the detection signal acting on the target object in a display gap during display or during non-display;
the output circuit is connected with the display area and is used for outputting the electric signals; wherein the electrical signal is used for determining a relative positional relationship between the target object and the electronic device.
Optionally, the electronic device further includes:
And the detection module is connected with the output circuit and is used for determining the relative position relation between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal when the electric signal is detected.
Optionally, the detection module is configured to determine a shape of the target object according to positions of a plurality of pixel units generating the electrical signal and signal values of the electrical signal.
Optionally, the detection module is further configured to determine motion trajectory data of the target object according to a signal value variation trend of the electrical signal generated by the pixel unit.
Optionally, the detection module is further configured to control the electronic device to switch from a screen-off state to a screen-on state when the motion trail data indicates that the target object is close to the electronic device;
and the detection module is also used for controlling the electronic equipment to switch from the bright screen state to the off screen state when the motion trail data represent that the target object is far away from the electronic equipment.
Optionally, the electronic device includes:
a structural member having a first opening and a second opening;
the transmitting unit is exposed through the first opening, and the detection signal transmitted by the transmitting unit is transmitted out of the electronic equipment through the first opening;
The display area is exposed through the second opening and receives the reflected signal through the second opening.
Optionally, the pixel unit includes: an Organic Light Emitting Diode (OLED) unit;
And/or the number of the groups of groups,
The transmitting unit is an infrared signal transmitting unit.
According to a second aspect of embodiments of the present disclosure, there is provided a relative positional relationship detection method, applied to the electronic device according to any one of the first aspects of embodiments of the present disclosure, including:
Transmitting a detection signal;
Generating an electric signal in a display gap of the display period or in a non-display period of the display area of the electronic device based on a reflected signal returned by the detection signal acting on the target object; wherein the display area includes a plurality of pixel units;
Outputting the electrical signal through an output circuit of the electronic device; wherein the electrical signal is used for determining a relative positional relationship between the target object and the electronic device.
Optionally, the method further comprises:
when the detection module connected with the output circuit detects the electric signal, the relative position relation between the target object and the electronic equipment is determined according to the position of the pixel unit generating the electric signal and the signal value of the electric signal.
Optionally, the method further comprises:
The shape of the target object is determined based on the positions of a plurality of pixel units generating the electrical signals and the signal values of the electrical signals.
Optionally, the method further comprises:
And determining the motion trail data of the target object according to the signal value change trend of the electric signal generated by the pixel unit.
Optionally, the method further comprises:
When the motion trail data represent that the target object is close to the electronic equipment, controlling the electronic equipment to switch from a screen-off state to a screen-on state;
and when the motion trail data represent that the target object is far away from the electronic equipment, controlling the electronic equipment to switch from the bright screen state to the off-screen state.
According to a third aspect of the embodiments of the present disclosure, there is provided a relative positional relationship detection apparatus including:
A processor;
A memory for storing processor-executable instructions;
wherein the processor is configured to: the steps of the method according to any of the second aspects of the embodiments of the present disclosure are implemented when executed.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium, which when executed by a processor of a relative positional relationship detection apparatus, causes the relative positional relationship detection apparatus to perform the method according to any one of the second aspects of embodiments of the present disclosure.
The technical scheme provided by the embodiment of the disclosure can comprise the following beneficial effects:
Compared with the method that a receiving unit is additionally arranged in the electronic equipment to receive the reflected signal of the infrared signal acting on the target object, and an opening corresponding to the receiving unit is arranged on the shell of the electronic equipment to allow the receiving unit to receive the reflected signal, the embodiment of the disclosure uses the pixel unit of the display area to receive the reflected signal, generate an electric signal, and determine the relative position relationship between the target object and the electronic equipment according to the electric signal, so that a special receiving unit is not required to be arranged in the electronic equipment, and the hardware cost of the electronic equipment is reduced.
Moreover, since the area of the display area where the reflected signal is acceptable is larger than the receiving area of the receiving unit that is specially provided, the scheme of the embodiment of the present disclosure can expand the range of detection of the relative positional relationship.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
Fig. 1 is a schematic diagram of an electronic device, shown according to an example embodiment.
Fig. 2 is a schematic diagram illustrating a positional relationship between an electronic device and a target object according to an exemplary embodiment.
Fig. 3 is a flow chart illustrating a relative positional relationship detection method according to an exemplary embodiment.
Fig. 4 is a block diagram illustrating a relative positional relationship detection apparatus according to an exemplary embodiment.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the invention. Rather, they are merely examples of apparatus and methods consistent with aspects of the invention as detailed in the accompanying claims.
In the related art, in order to implement a distance detection function in an electronic device, two openings are generally provided in a partial area of a front cover of the electronic device except for a display area, a transmitting unit of a distance sensor is disposed under a first opening, and a receiving unit of the distance sensor is disposed under a second opening. When the distance detection is carried out, the transmitting unit transmits a detection signal through the first opening, detects a reflection signal based on the detection signal and applied to the target object through the second opening, and carries out the distance detection according to the detection signal and the reflection signal.
The transmitting unit and the receiving unit need to be arranged in the shell of the electronic equipment, so that the space in the shell of the electronic equipment is occupied, the available space of other functional elements is reduced, and the lightening and thinning of the electronic equipment are not facilitated.
In addition, the first opening and the second opening occupy a certain area on the front cover of the electronic device, so that the occupied area of the display area on the front cover is limited, and the screen occupation ratio of the electronic device is reduced.
Further, since the receiving unit needs to receive the reflected signal through the second opening, in order to ensure the effect of distance detection, a high requirement is provided for the position setting of the transmitting unit and the receiving unit, and the working area of the distance sensor capable of performing distance detection is small, so that the accuracy and the user experience of the distance detection are difficult to ensure.
Fig. 1 is a schematic diagram of an electronic device 100, shown according to an example embodiment. Referring to fig. 1, an electronic device 100 includes:
a transmitting unit 120 for transmitting a detection signal;
A display area 130 including a plurality of pixel units; the pixel unit is used for generating an electric signal based on a reflected signal returned by the detection signal acting on the target object in a display gap during display or during non-display;
an output circuit 140 connected to the display area 130 for outputting the electric signal; wherein the electrical signal is used to determine a relative positional relationship between the target object and the electronic device 100.
Illustratively, the relative positional relationship between the target object and the electronic device 100 may include: the distance between the target object and the electronic device 100, and/or the angle between the plane in which the target object lies and the plane in which the electronic device 100 lies.
Taking a cylinder as a target object as an example, a relative positional relationship between the target object and the electronic apparatus 100 is specifically described. The cylinder comprises a first surface, a second surface and a third surface, wherein the first surface and the second surface are round surfaces, and the third surface is an annular surface perpendicular to the first surface and the second surface respectively.
When the first surface of the cylinder is parallel to the display area 130 of the electronic device 100, the first surface of the cylinder faces the display area 130, and the second surface of the cylinder faces away from the display area 130, the relative positional relationship between the cylinder and the electronic device 100 includes a perpendicular distance of the first surface of the cylinder from the display area 130 of the electronic device 100.
When the second surface of the cylinder is parallel to the display area 130 of the electronic device 100, the second surface of the cylinder is facing the display area 130, and the first surface of the cylinder is distant from the display area 130, the relative positional relationship between the cylinder and the electronic device 100 includes a perpendicular distance of the second surface of the cylinder from the display area 130 of the electronic device 100.
When a first included angle exists between the plane of the second surface of the cylinder and the plane of the display area 130 (i.e., the plane of the second surface of the cylinder is not parallel to the plane of the display area 130), the second surface of the cylinder faces the display area 130, and the first surface of the cylinder is far away from the display area 130, the relative positional relationship between the cylinder and the electronic device 100 includes the first included angle between the plane of the second surface of the cylinder and the plane of the display area 130.
When there is relative motion between the cylinder and the electronic device, the relative positional relationship between the cylinder and the electronic device 100 may further include: the cylinder and the electronic device are close to each other, or the cylinder and the electronic device are far away from each other, etc.
The transmitting unit 120 is a transmitting unit capable of transmitting an infrared signal. At this time, the detection signal is an infrared signal. Taking the example of the transmitting unit transmitting an infrared signal, a target object located within the angle of view of the transmitting unit 120 can reflect the received infrared signal to generate the reflected signal.
The pixel unit includes: an Organic Light Emitting Diode (OLED) unit.
During display, the pixel units of the display area 130 have a light emission period and a display gap. Illustratively, the pixel cells in the light emission period generate light signals according to the driving signals, and the pixel cells in the display gap pause from generating light signals. It will be appreciated that the display gap is located between two adjacent light emission periods during display.
Due to the persistence of vision, in the display gap between two adjacent light-emitting periods, the visual effect of the light signal generated by the pixel unit in the previous light-emitting period on the retina of human eyes remains in the display gap, i.e. the user considers that the display region 130 is still displaying in the display gap during the display period.
Therefore, the pixel unit can generate an electrical signal based on the reflected signal returned by the detection signal acting on the target object in the display gap during the display period, so that the electronic device 100 can realize the relative positional relationship detection function while displaying information.
During the non-display period, the pixel units of the display area 120 do not generate light signals. At this time, the detection signal emitted from the emitting unit 120 acts on the target object, the target object reflects the detection signal, a reflected signal having a propagation direction different from that of the detection signal is generated, and at least a part of the reflected signal propagates toward the display area 130. In the display area 130, the pixel unit receiving the reflection signal generates an electrical signal under the excitation of the reflection signal.
The signal value of the electrical signal may be used, for example, to characterize the intensity of the reflected signal received by the pixel cell that generated the electrical signal. Specifically, the signal value of the electrical signal may be positively correlated with the intensity of the reflected signal received by the pixel cell.
Compared with the method that a receiving unit is additionally arranged in the electronic equipment to receive the reflected signal of the infrared signal acting on the target object, and an opening corresponding to the receiving unit is arranged on the shell of the electronic equipment to allow the receiving unit to receive the reflected signal, the embodiment of the disclosure uses the pixel unit of the display area to receive the reflected signal, generate an electric signal, and determine the relative position relationship between the target object and the electronic equipment according to the electric signal, so that a special receiving unit is not required to be arranged in the electronic equipment, and the hardware cost of the electronic equipment is reduced.
Moreover, since the area of the display area where the reflected signal is acceptable is larger than the receiving area of the receiving unit that is specially provided, the scheme of the embodiment of the present disclosure can expand the range of the relative position detection.
In some embodiments, as shown in fig. 2, the electronic device 100 may further include:
the detection module 150 is connected to the output circuit 140, and is configured to determine, when the electrical signal is detected, a relative positional relationship between the target object and the electronic device 100 according to a position of a pixel unit generating the electrical signal and a signal value of the electrical signal.
The detection module 150 may include: the electronic device 100 may be a self-contained processor, or an additionally provided processor chip. For example, the detection module 150 may be a central processing unit (Central Processing Unit, CPU) of the electronic device 100.
The positional parameter of the pixel unit and the transmission line of the output circuit 140 that transmits the electrical signal from the pixel unit to the detection module 150 may have a correspondence relationship, and the correspondence relationship may be stored in the detection module 150 in advance. When the detection module 150 detects the electrical signal, the detection module 150 may obtain the position parameter of the pixel unit generating the electrical signal according to the transmission line and the corresponding relationship of the detected electrical signal. Here, the position parameter is used to indicate the position where the pixel unit is located in the display area 130.
The detection module provided by the embodiment of the disclosure can improve the accuracy of detecting the relative position relationship by combining the position of the pixel unit generating the electric signal and the signal value of the electric signal.
In some embodiments, the detection module 150 is configured to determine the relative positional relationship between the target object and the electronic device 100 according to the electrical signal with a signal value greater than the preset signal value and the position of the pixel unit that generates the electrical signal with a signal value greater than the preset signal value.
In the external environment in which the electronic device 100 is located, there are typically other objects capable of radiating infrared rays outwards. When the other object is not the target object and the infrared ray radiated by the other object moves to the display area 130, the pixel unit of the display area 130 is also stimulated to generate a weak electric signal, so that interference is caused to the detection of the relative positional relationship between the target object and the electronic device 100. It will be appreciated that in general, the signal value of the electrical signal generated by the other object exciting the pixel cell is smaller than the signal value of the electrical signal generated by the pixel cell based on the reflected signal.
Therefore, the detection module 150 in the present disclosure generates the ranging signal according to the electrical signal with the signal value greater than the preset signal value, so as to identify the pixel unit generating the electrical signal based on the reflected signal, reduce the interference of other objects in the external environment on the detection of the relative positional relationship between the target object and the electronic device 100, and improve the detection accuracy
Fig. 2 shows a positional relationship between a target object and an electronic device. As shown in fig. 2, the pixel units located in the shadow area of the display area 130 receive the reflected signal to generate a signal value of the electrical signal, and the signal value of the electrical signal generated by the pixel units is greater than a preset signal value.
In some embodiments, the detection module 150 is configured to determine the shape of the target object according to the positions of the plurality of pixel units generating the electrical signals and the signal values of the electrical signals.
Take the example that the detection signal is an infrared signal. Within the angle of view of the infrared signal emitted by the emitting unit 120, the emitted infrared signal has different propagation directions, and thus the incident angles of the infrared signals of different propagation directions at the same position of the target object are different, and thus the reflected signals of different reflection angles are generated at the same position of the target object.
The paths of the movement of the reflection signals of different reflection angles generated by the same position of the target object to the display area are different, so that the reflection signals of different reflection angles generated by the reflection of the same position of the target object are received by different pixel units, and the intensities of the reflection signals of different reflection angles generated by the reflection of the same position of the target object received by different pixel units are also different. Therefore, the intensity of the reflected signal received by the pixel units at different positions is different, and the signal value of the generated electric signal is also different.
Therefore, the detection module can determine the projection outline of the target object to the display area according to the positions of the pixel units generating the electric signals and the values of the electric signals. Wherein the contour is the same as or similar to the actual shape of the target object.
In the embodiment of the disclosure, the detection module 150 may determine the shape of the target object according to the positions of the plurality of pixel units generating the electrical signals and the signal values of the electrical signals, which lays a foundation for controlling the electronic device 100 to execute a predetermined function (for example, a function of unlocking the electronic device based on gesture recognition) based on the shape of the target object, and is beneficial to enriching user experience.
The predetermined functions may include: the electronic device 100 is switched from the locked state to the unlocked state, or the electronic device 100 is switched from the unlocked state to the locked state.
Illustratively, when the electronic device 100 is in the locked state, the user cannot browse and read the data information stored by the electronic device 100. For example, a user cannot view photos stored by the electronic device 100.
Illustratively, when the electronic device 100 is in the unlocked state, a user may browse and read data information stored by the electronic device 100. For example, a user may view photos stored by electronic device 100.
When the detection module 150 determines that the similarity of the shape of the target object and the first preset shape is greater than the similarity threshold, the detection module 150 controls the electronic device 100 to switch from the locked state to the unlocked state. Here, the first preset shape may be stored in the detection module 150 in advance, or may be stored in the storage module of the electronic device 100 in advance; the target object can be a gesture put by a user with a finger, so that the function of unlocking the electronic equipment according to the gesture of the user can be realized.
When the detection module 150 determines that the similarity of the shape of the target object and the first preset shape is smaller than the similarity threshold, the detection module controls the electronic device to keep the current state.
For another example, when the detection module 150 determines that the similarity between the shape of the target object and the second preset shape is greater than the similarity threshold, the detection module 150 controls the electronic device 100 to switch from the unlocked state to the locked state. Here, the second preset shape may be stored in the detection module 150 in advance, or may be stored in the storage module of the electronic device 100 in advance; the target object may be a gesture made by a user with a finger, and thus, a function of locking the electronic device according to a gesture of the user may be implemented.
When the detection module 150 determines that the similarity between the shape of the target object and the second preset shape is smaller than the similarity threshold, the detection module controls the electronic device to keep the current state.
In some embodiments, the detection module 150 is further configured to determine motion trajectory data of the target object according to a signal value variation trend of the electrical signal generated by the pixel unit.
Here, the motion trajectory may include: a first trajectory perpendicular to the display area 130 and/or a second trajectory parallel to the display area 130.
For example, when the target object moves, the relative position between the target object and the electronic device 100 changes, so that the distance of transmission of the detection signal in space and the distance of transmission of the reflection signal may change, and the position of the pixel unit receiving the reflection signal and the intensity of the reflection signal received by the pixel unit may change.
For example, when the target object approaches the electronic device 100 along the first trajectory and the vertical distance between the target object and the electronic device 100 decreases, the intensity of the reflected signal received by the pixel unit increases, and thus the signal value of the electric signal generated by the pixel unit gradually increases. Here, the first trajectory may be perpendicular to a plane in which the display area 130 is located.
Similarly, when the target object is far from the electronic device 100 along the first trajectory and the vertical distance between the target object and the electronic device 100 increases, the intensity of the reflected signal received by the pixel unit decreases, and thus the signal value of the electric signal generated by the pixel unit gradually decreases.
The detection module 150 may further determine the motion trajectory data of the target object according to the trend of the signal value of the electrical signal generated by the pixel unit and the position of the pixel unit generating the electrical signal.
For example, when the target object moves along the second trajectory, the vertical distance between the target object and the electronic device 100 is unchanged, but the position of the pixel unit that receives the reflected signal changes, that is, the position of the pixel unit that generates the electric signal changes. Specifically, the second trajectory may be parallel to a plane in which the display area 130 is located.
As another example, as the target object moves along the third trajectory and the target object gradually approaches the electronic device 100, the position of the pixel generating the electrical signal may change and the signal value of the electrical signal increases. When the target object moves along the third trajectory and the target object moves away from the electronic device 100, the positions of the pixels generating the electric signal change and the signal value of the electric signal decreases. Here, an included angle exists between the plane where the third track is located and the plane where the display area is located, and the included angle between the plane where the third track is located and the plane where the display area is located is not a right angle.
In the embodiment of the disclosure, the detection module 150 may determine the motion trail data of the target object according to the signal value variation trend of the electrical signal generated by the pixel unit, so as to lay a foundation for controlling the electronic device 100 to execute the predetermined function based on the motion trail of the target object, which is beneficial to enriching the user experience.
Here, the predetermined function may further include: changing the volume of the electronic device 100, or sliding the display interface of the electronic device 100, etc.
For example, when the electronic device 100 plays a video through the display area 130 and the detection module 150 determines that the motion profile data of the target object indicates that the target object moves along the first direction, the volume of the electronic device 100 is increased.
When the electronic device plays the video through the display area 130 and the detection module 150 determines that the motion trajectory data of the target object indicates that the target object moves in the opposite direction of the first direction, the volume of the electronic device 100 is reduced.
The first direction may include: from the bottom bezel of the electronic device 100 to the top bezel of the electronic device 100.
In some embodiments, the detection module 150 is further configured to control the electronic device 100 to switch from the off-screen state to the on-screen state when the motion trail data indicates that the target object is close to the electronic device 100;
The detection module 150 is further configured to control the electronic device 100 to switch from the on-screen state to the off-screen state when the motion trail data indicates that the target object is far away from the electronic device 100.
When the electronic device 100 is in the off-screen state, the display area 130 may be black, and the display area 130 stops generating the optical signal.
When the electronic device 100 is in the bright screen state, the display area 130 displays. For example, the display area 130 may display the current time.
Taking the target object as a user's finger as an example, when the user's finger is close to the electronic device 100, it may indicate that the user needs to use the electronic device 100. At this time, the detection module 150 controls the electronic device 100 to switch from the off-screen state to the on-screen state, thereby improving the intelligence of the electronic device 100.
When the user's finger is away from the electronic device 100, it may be indicated that the user is temporarily not required to use the electronic device 100. At this time, the detection module 150 controls the display area 130 to switch from the on-screen state to the off-screen state, which is beneficial to reducing the power consumption of the electronic device 100.
In some embodiments, the electronic device 100 may include:
a structural member having a first opening and a second opening;
The transmitting unit 120 is exposed through the first opening, and the detection signal transmitted by the transmitting unit 120 passes through the first opening and out of the electronic device 100;
the display area 130 is exposed through the second opening and receives the reflected signal through the second opening.
Illustratively, the structural member may include: a front cover of the electronic device, or a rear case of the electronic device. The structural members are used to load the display area 130.
When the structure comprises a front cover of the electronic device, the front cover of the electronic device 100 may be viewable by a user when the display area 130 is facing the user.
It is noted that when the structural member includes a rear case of the electronic device, the rear case includes: the bottom cover and the frame body vertical to the plane of the bottom cover. The frame body is distributed on the bottom cover and can form a first opening and a second opening. When the display area 130 is facing the user, the frame and the bottom cover may be positioned at the rear of the display area 130, i.e., the rear case of the electronic device 100 is not visible to the user.
The first opening and the second opening are located on the same surface of the structural member. Thus, when the second opening is oriented toward the target object, the first opening is also oriented toward the target object. In this way, at least a partial area of the display area 130 can receive a reflected signal generated by the detection signal emitted from the emission unit 120 acting on the target object.
In the related art, when a receiving unit is additionally provided in an electronic device to receive a reflected signal of an infrared signal acting on a target object, it is generally necessary to provide an opening corresponding to the receiving unit on a housing of the electronic device to allow the receiving unit to receive the reflected signal.
In the embodiment of the disclosure, the display area is used for receiving the reflected signal, and an opening corresponding to the receiving unit is not required to be additionally arranged on the shell of the electronic device, so that the sealing performance of the electronic device is improved.
Further, in the related art, when the receiving unit and the display area of the distance sensor are disposed on the same surface of the electronic device, the opening is generally required to be disposed on the same surface at a position corresponding to the receiving unit, so as to limit the development of the overall screen of the electronic device.
In the embodiment of the disclosure, the display area of the electronic device is used for receiving the reflected signal, no additional receiving unit is needed, and no opening corresponding to the receiving unit is needed to be arranged on the surface where the display area is located, so that a foundation is laid for realizing the full screen design of the electronic device.
Fig. 3 is a flowchart illustrating a relative positional relationship detection method according to an exemplary embodiment, and as shown in fig. 3, the method is used in the electronic device 100 provided in the embodiment of the disclosure, and includes the following steps:
s11: transmitting a detection signal;
S12: generating an electrical signal based on a reflected signal returned by the detection signal acting on the target object in a display gap during display or during non-display of the display area of the electronic device; wherein the display area comprises a plurality of pixel units;
s13: outputting the electrical signal through an output circuit of an electronic device; the electric signal is used for determining the relative position relationship between the target object and the electronic equipment.
Compared with the method that a receiving unit is additionally arranged in the electronic equipment to receive the reflected signal of the infrared signal acting on the target object, and an opening corresponding to the receiving unit is arranged on the shell of the electronic equipment to allow the receiving unit to receive the reflected signal, the embodiment of the disclosure uses the pixel unit of the display area to receive the reflected signal, generate an electric signal, and detect the relative position relation according to the electric signal, and the area of the display area for receiving the reflected signal is larger than the receiving area of the receiving unit, so that the detection range of the relative position relation can be enlarged.
In some embodiments, the method may include:
when the detection module connected with the output circuit detects the electric signal, the relative position relation between the target object and the electronic equipment is determined according to the position of the pixel unit generating the electric signal and the signal value of the electric signal.
According to the embodiment of the disclosure, the position of the pixel unit generating the electric signal and the signal value of the electric signal are combined to generate the ranging signal, so that the accuracy of detecting the relative position relationship can be improved.
In some embodiments, the method further comprises:
the shape of the target object is determined based on the positions of a plurality of pixel units generating the electrical signals and the signal values of the electrical signals.
In the embodiment of the disclosure, the shape of the target object is determined according to the positions of the pixel units generating the electric signals and the signal values of the electric signals, so that a foundation is laid for realizing the function of controlling the electronic equipment based on the shape of the target object (for example, the function of unlocking the electronic equipment based on gesture recognition), and the user experience is enriched.
In some embodiments, the method further comprises:
And determining the motion trail data of the target object according to the signal value change trend of the electric signal generated by the pixel unit.
In the embodiment of the disclosure, the motion trail data of the target object is determined according to the signal value change trend of the electric signal generated by the pixel unit, so that a foundation is laid for realizing the function of controlling the electronic equipment based on the motion trail of the target object, and the user experience is enriched.
In some embodiments, the method further comprises:
When the motion trail data represent that the target object is close to the electronic equipment, the electronic equipment is controlled to be switched from a screen-off state to a screen-on state;
When the motion trail data represent that the target object is far away from the electronic equipment, the electronic equipment is controlled to be switched from a screen-off state to a screen-on state.
Taking the target object as a user finger as an example, when the user finger approaches the electronic device, it may indicate that the user needs to use the electronic device. At the moment, the detection module is used for controlling the electronic equipment to switch from the screen-off state to the screen-on state, so that the intelligence of the electronic equipment is improved.
When the user's finger is away from the electronic device, it may be indicated that the user is temporarily not required to use the electronic device. At the moment, the electronic equipment is controlled to be switched from the bright screen state to the off screen state, so that the power consumption of the electronic equipment is reduced.
Fig. 4 is a block diagram illustrating an apparatus 800 for relative positional relationship detection, according to an example embodiment. For example, apparatus 800 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, exercise device, personal digital assistant, or the like.
Referring to fig. 4, apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operation of the apparatus 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power component 806 provides power to the various components of the device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 800.
The multimedia component 808 includes a screen between the device 800 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operational mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 814 includes one or more sensors for providing status assessment of various aspects of the apparatus 800. For example, the sensor assembly 814 may detect an on/off state of the device 800, a relative positioning of the components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or one component of the apparatus 800, the presence or absence of user contact with the apparatus 800, an orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the apparatus 800 and other devices, either in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 804 including instructions executable by processor 820 of apparatus 800 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
A non-transitory computer-readable storage medium, which when executed by a processor of a relative positional relationship detection apparatus, enables the relative positional relationship detection apparatus to perform the above-described method provided by embodiments of the present disclosure.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any adaptations, uses, or adaptations of the disclosure following the general principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (10)
1. An electronic device, comprising:
a transmitting unit for transmitting a detection signal;
A display area including a plurality of pixel units; the pixel unit is used for generating an electric signal based on a reflected signal which is returned by the detection signal acting on the target object in a display gap during display or during non-display;
The output circuit is connected with the display area and is used for outputting the electric signals; the electronic device comprises an electronic device, an electronic signal and a target object, wherein the electronic device is used for generating an electronic signal, and the electronic signal is used for determining the relative position relation between the target object and the electronic device, and the relative position comprises an angle between a plane of the target object and a plane of the electronic device;
the detection module is connected with the output circuit and is used for determining the relative position relation between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal when the electric signal is detected;
the detection module is further used for determining movement track data of the target object according to the signal value change trend of the electric signals generated by the pixel units.
2. The electronic device of claim 1, wherein the electronic device comprises a memory device,
The detection module is also used for determining the shape of the target object according to the positions of a plurality of pixel units generating the electric signals and the signal values of the electric signals.
3. The electronic device of claim 1, wherein the electronic device comprises a memory device,
The detection module is further used for controlling the electronic equipment to switch from a screen-off state to a screen-on state when the motion trail data represent that the target object is close to the electronic equipment;
and the detection module is also used for controlling the electronic equipment to switch from the bright screen state to the off screen state when the motion trail data represent that the target object is far away from the electronic equipment.
4. The electronic device of claim 1, wherein the electronic device further comprises:
a structural member having a first opening and a second opening;
the transmitting unit is exposed through the first opening, and the detection signal transmitted by the transmitting unit is transmitted out of the electronic equipment through the first opening;
The display area is exposed through the second opening and receives the reflected signal through the second opening.
5. An electronic device as recited in claim 1, wherein
The pixel unit includes: an Organic Light Emitting Diode (OLED) unit;
And/or the number of the groups of groups,
The transmitting unit is an infrared signal transmitting unit.
6. A relative positional relationship detection method, characterized by being applied to the electronic apparatus as claimed in any one of claims 1 to 5, comprising:
Transmitting a detection signal;
Generating an electric signal in a display gap of the display period or in a non-display period of the display area of the electronic device based on a reflected signal returned by the detection signal acting on the target object; wherein the display area includes a plurality of pixel units;
Outputting the electrical signal through an output circuit of the electronic device; wherein the electrical signal is used for determining a relative positional relationship between the target object and the electronic device;
when the detection module connected with the output circuit detects the electric signal, determining the relative position relation between the target object and the electronic equipment according to the position of the pixel unit generating the electric signal and the signal value of the electric signal;
And determining the motion trail data of the target object according to the signal value change trend of the electric signal generated by the pixel unit.
7. The method of claim 6, wherein the method further comprises:
The shape of the target object is determined based on the positions of a plurality of pixel units generating the electrical signals and the signal values of the electrical signals.
8. The method of claim 6, wherein the method further comprises:
When the motion trail data represent that the target object is close to the electronic equipment, controlling the electronic equipment to switch from a screen-off state to a screen-on state;
and when the motion trail data represent that the target object is far away from the electronic equipment, controlling the electronic equipment to switch from the bright screen state to the off-screen state.
9. A relative positional relationship detecting apparatus, comprising:
A processor;
A memory for storing processor-executable instructions;
wherein the processor is configured to: the steps of the method according to any of claims 6 to 8 are carried out.
10. A non-transitory computer readable storage medium, which when executed by a processor of a relative positional relationship detection apparatus, causes the relative positional relationship detection apparatus to perform the method of any of claims 6 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010516726.6A CN113777621B (en) | 2020-06-09 | 2020-06-09 | Electronic device, relative position relation detection method, relative position relation detection device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010516726.6A CN113777621B (en) | 2020-06-09 | 2020-06-09 | Electronic device, relative position relation detection method, relative position relation detection device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113777621A CN113777621A (en) | 2021-12-10 |
| CN113777621B true CN113777621B (en) | 2024-06-18 |
Family
ID=78834282
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010516726.6A Active CN113777621B (en) | 2020-06-09 | 2020-06-09 | Electronic device, relative position relation detection method, relative position relation detection device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113777621B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108491076A (en) * | 2018-03-14 | 2018-09-04 | 广东欧珀移动通信有限公司 | Display control method and related product |
| CN208656825U (en) * | 2018-07-31 | 2019-03-26 | Oppo广东移动通信有限公司 | Display screen component and electronic equipment |
| CN109947302A (en) * | 2019-03-29 | 2019-06-28 | 京东方科技集团股份有限公司 | A kind of aerial display device and its control method |
| CN110913040A (en) * | 2018-09-15 | 2020-03-24 | 华为技术有限公司 | Terminal equipment |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2012145783A (en) * | 2012-10-26 | 2014-05-10 | Дисплаир, Инк. | METHOD AND DEVICE FOR RIGID CONTROL FOR MULTIMEDIA DISPLAY |
| KR20160031940A (en) * | 2014-09-15 | 2016-03-23 | 주식회사 와이드벤티지 | User input apparatus using location or change thereof |
| CN109117053B (en) * | 2017-06-22 | 2023-03-24 | 腾讯科技（深圳）有限公司 | Dynamic display method, device and equipment for interface content |
| CN107608454B (en) * | 2017-08-31 | 2020-01-14 | Oppo广东移动通信有限公司 | Display screen and electronic equipment |
| KR102510916B1 (en) * | 2017-11-02 | 2023-03-17 | 삼성디스플레이 주식회사 | Display device and method of driving the display device |
| CN107968883B (en) * | 2017-11-22 | 2020-08-14 | Oppo广东移动通信有限公司 | Distance state detection method and device, storage medium and electronic equipment |
| EP3822738B1 (en) * | 2018-07-31 | 2023-12-06 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Display screen assembly, electronic device, and control method for electronic device |
| CN109040363B (en) * | 2018-08-10 | 2024-03-19 | Oppo广东移动通信有限公司 | Display screen, electronic device and three-dimensional feature recognition method |
| KR102112229B1 (en) * | 2018-08-21 | 2020-05-19 | 한국과학기술연구원 | Endoscope apparatus capable of visualizing both visible light and near-infrared light |
| CN109508069A (en) * | 2018-09-28 | 2019-03-22 | 深圳阜时科技有限公司 | A kind of equipment |
| CN109151348B (en) * | 2018-09-28 | 2021-01-08 | 维沃移动通信有限公司 | Image processing method, electronic equipment and computer readable storage medium |
| CN109507686B (en) * | 2018-11-08 | 2021-03-30 | 歌尔光学科技有限公司 | Control method, head-mounted display device, electronic device and storage medium |
| CN208903164U (en) * | 2018-11-21 | 2019-05-24 | Oppo广东移动通信有限公司 | Electronic equipment |
| CN111027982A (en) * | 2019-12-26 | 2020-04-17 | 北京意锐新创科技有限公司 | Non-inductive payment method and device suitable for full-screen |
-
2020
- 2020-06-09 CN CN202010516726.6A patent/CN113777621B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108491076A (en) * | 2018-03-14 | 2018-09-04 | 广东欧珀移动通信有限公司 | Display control method and related product |
| CN208656825U (en) * | 2018-07-31 | 2019-03-26 | Oppo广东移动通信有限公司 | Display screen component and electronic equipment |
| CN110913040A (en) * | 2018-09-15 | 2020-03-24 | 华为技术有限公司 | Terminal equipment |
| CN109947302A (en) * | 2019-03-29 | 2019-06-28 | 京东方科技集团股份有限公司 | A kind of aerial display device and its control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113777621A (en) | 2021-12-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107145856B (en) | Organic light emitting diode display module and control method thereof | |
| CN108509083B (en) | Display panel and terminal | |
| CN110796988B (en) | Backlight adjusting method and device | |
| CN109410833B (en) | Ambient light detection method, ambient light detection device, terminal and storage medium | |
| US10444953B2 (en) | View angle switching method and apparatus | |
| CN115798365A (en) | Display panel, photoelectric detection method, photoelectric detection device and computer-readable storage medium | |
| CN108989494B (en) | Electronic equipment | |
| CN108073328B (en) | Touch response method and device | |
| CN106919914B (en) | Display module and electronic equipment | |
| CN108874450B (en) | Method and device for waking up voice assistant | |
| CN112331158B (en) | Terminal display adjusting method, device, equipment and storage medium | |
| CN111124175B (en) | Terminal, display processing method, device and storage medium | |
| CN108847199B (en) | Brightness determination method and device | |
| CN107153448B (en) | Display module, control method thereof, electronic device and computer-readable storage medium | |
| CN113777621B (en) | Electronic device, relative position relation detection method, relative position relation detection device and storage medium | |
| CN112689047B (en) | Display control method and device and electronic equipment | |
| CN111246012B (en) | Application interface display method and device and storage medium | |
| CN112929516B (en) | Image acquisition module, terminal equipment, image processing method and device | |
| CN109389547B (en) | Image display method and device | |
| CN113727034A (en) | Light supplement control method, electronic device and storage medium | |
| CN110971722B (en) | Image shooting method and device | |
| EP3648089A1 (en) | Display screen and electronic device | |
| CN111343336B (en) | Mode switching method and device, electronic equipment and computer readable storage medium | |
| US11064307B2 (en) | Electronic device and method of outputting audio | |
| CN113453146B (en) | Equipment interaction control method, equipment interaction control device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |