CN114442862A - Interaction control method based on laser induction, intelligent terminal and storage medium - Google Patents
Interaction control method based on laser induction, intelligent terminal and storage medium Download PDFInfo
- Publication number
- CN114442862A CN114442862A CN202011190939.0A CN202011190939A CN114442862A CN 114442862 A CN114442862 A CN 114442862A CN 202011190939 A CN202011190939 A CN 202011190939A CN 114442862 A CN114442862 A CN 114442862A
- Authority
- CN
- China
- Prior art keywords
- laser
- display panel
- display
- spot
- time interval
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000003993 interaction Effects 0.000 title claims abstract description 40
- 230000006698 induction Effects 0.000 title claims abstract description 19
- 230000002452 interceptive effect Effects 0.000 claims abstract description 84
- 230000008859 change Effects 0.000 claims description 31
- 238000013507 mapping Methods 0.000 claims description 27
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000004590 computer program Methods 0.000 description 4
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000003414 extremity Anatomy 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
Abstract
The invention discloses an interaction control method based on laser induction, an intelligent terminal and a storage medium, wherein the method comprises the following steps: the method comprises the steps of obtaining a plurality of laser light spots, and determining display coordinates of each laser light spot on a display panel; according to the display coordinates, determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel; and determining the interactive operation of each laser spot on the display panel according to the position information and the display time interval, and executing the interactive operation. The invention determines different interactive operations of the laser spot on the display panel based on the laser sensing technology and by combining the position information of the laser spot on the display panel and the display time interval, thereby realizing multi-user interactive control under the laser sensing interactive scene.
Description
Technical Field
The invention relates to the technical field of interaction control, in particular to an interaction control method based on laser sensing, an intelligent terminal and a storage medium.
Background
Today, people and various terminal devices such as mobile phones, tablets, computers and televisions are surrounded by people and various terminal devices such as videos and videos in life. These intelligent terminals need to perform interactive control in many application scenarios. At present, near field interaction is limited to single person operation, and application scenes of far field interaction, such as games, demonstrations and the like, require multiple persons to operate simultaneously. However, the existing far-field multi-person interaction is mainly based on wired connection or Bluetooth wireless connection, and no other form of interaction control mode exists.
Thus, there is a need for improvements and enhancements in the art.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide an interaction control method based on laser sensing, an intelligent terminal and a storage medium, aiming at solving the problem that in the prior art, far-field multi-user interaction is mainly based on wired connection or bluetooth wireless connection, and no other form of interaction control mode exists.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
in a first aspect, the present invention provides an interaction control method based on laser sensing, wherein the method includes:
the method comprises the steps of obtaining a plurality of laser light spots, and determining display coordinates of each laser light spot on a display panel;
according to the display coordinates, determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel;
and determining the interactive operation of each laser spot on the display panel according to the position information and the display time interval, and executing the interactive operation.
In one implementation, the acquiring a plurality of laser spots sensed on a laser sensing layer and determining display coordinates of each laser spot on a display panel includes:
when the laser sensing layer receives a plurality of laser light spots emitted by laser remote control equipment, respectively acquiring the light spot coordinates of each laser light spot on the laser sensing layer;
acquiring a coordinate mapping relation between the laser induction layer and the display panel;
and converting the light spot coordinates into the display coordinates of the laser light spots on the display panel according to the coordinate mapping relation, wherein the display coordinates are coordinates of a cursor corresponding to the laser light spots on the display panel.
In one implementation, the obtaining a coordinate mapping relationship between the laser sensing layer and the display panel includes:
respectively acquiring size data of the laser induction layer and the display panel;
and determining a coordinate mapping relation between the laser induction layer and the display panel according to the size data.
In one implementation, the determining a coordinate mapping relationship between the laser sensing layer and the display panel according to the size data includes:
if the size data of the laser sensing layer is the same as that of the display panel, the coordinate mapping relation between the laser sensing layer and the display panel is that the light spot coordinate is the same as that of the display coordinate.
In one implementation, converting the spot coordinates into the display coordinates of the laser spot on the display panel according to the coordinate mapping relationship includes:
and when the coordinate mapping relation is that the coordinates of the light spot and the display coordinates are the same, taking the coordinates of the light spot on the laser sensing layer as the display coordinates of the laser light spot on the display panel.
In one implementation, the determining, according to the display coordinates, position information of each laser spot on the display panel and a display time interval of each laser spot on the display panel includes:
according to the display coordinates, the position of the laser spot corresponding to each display coordinate on the display panel is marked on the display panel respectively, and the position information of each laser spot on the display panel is obtained;
and acquiring time information of a cursor corresponding to the last laser spot on the display panel to obtain the display time interval of each laser spot on the display panel.
In one implementation, the determining, according to the position information and the display time interval, an interactive operation of each laser spot on the display panel includes:
determining position change information of each laser spot on the display panel according to the position information, wherein the position change information is used for reflecting the change information of the position of each laser spot on the display panel at this time relative to the position of each laser spot on the display panel at the last time, and the position change information comprises changed positions and unchanged positions;
determining the key state of the laser remote control equipment according to the display time interval;
and determining the interactive operation of each laser spot on the display panel according to the position change information and the key state information.
In one implementation, the determining the key state of the laser remote control device according to the display time interval includes:
if the display time interval is a first time interval, the key state of the laser remote control equipment is a pressed state;
and if the display time interval is a second time interval, the key state of the laser remote control equipment is a non-pressed state, and the first time interval is smaller than the second time interval.
In one implementation, the determining, according to the position change information and the key state information, an interactive operation of each laser spot on the display panel includes:
if the key state is a pressed state and the position change information is that the position is not changed, determining that the interactive operation of the laser spot on the display panel is to click the position of the laser spot on the display panel;
and if the key state is a non-pressed state and the position change information is that the position is changed, determining that the interactive operation of the laser spot on the display panel is dragging on the display panel.
In one implementation, the determining the key state of the laser remote control device according to the display time interval includes:
and if the display time interval is a third time interval, not displaying the cursor corresponding to the laser light spot on the display panel, wherein the third time interval is greater than the second time interval.
In a second aspect, an embodiment of the present invention further provides an interaction control device based on laser sensing, where the device includes:
the display coordinate acquisition unit is used for acquiring a plurality of laser light spots and determining the display coordinate of each laser light spot on the display panel;
the position and time interval acquisition unit is used for determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinates;
and the interactive operation determining unit is used for determining the interactive operation of each laser spot on the display panel according to the position information and the display time interval and executing the interactive operation.
In a third aspect, an embodiment of the present invention further provides an intelligent terminal, including a memory, and one or more programs, where the one or more programs are stored in the memory, and configured to be executed by one or more processors includes a method for performing any one of the above schemes.
In a fourth aspect, the present invention provides a non-transitory computer-readable storage medium, where instructions of the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method according to any one of the foregoing schemes.
Has the advantages that: compared with the prior art, the interactive control method based on laser sensing is characterized in that a plurality of laser light spots are firstly obtained, the laser light spots sensed by a laser sensing layer are invisible light, and interactive control is realized on a display panel of an intelligent terminal, so that after the laser light spots are sensed on the laser sensing layer, the display coordinates of each laser light spot on the display panel need to be determined, and the display coordinates are the coordinates of a cursor corresponding to the laser light spots on the display panel, so that the invisible laser light spots are reflected on the display panel. Only when the laser light spot is sensed by the laser sensing layer, the display coordinates are displayed on the display panel. Therefore, the invention can determine the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinates. And finally, obtaining the position of each laser spot on the display panel at this time and whether the position of each laser spot on the display panel changes relative to the position of the laser spot on the display panel at the last time according to the position information. The time interval of each laser spot relative to the last display on the display panel can be determined according to the display time interval. Since the position information and the display time interval of each laser spot on the display panel may be different, the interactive operation of each laser spot on the display panel may be determined according to the position information and the display time interval, and the interactive operation, such as a click operation and a drag operation, may be performed, thereby implementing multi-user interactive control and also simplifying the identification process of the interactive operation.
Drawings
Fig. 1 is a flowchart of an embodiment of an interaction control method based on laser sensing according to an embodiment of the present invention.
Fig. 2 is a flowchart of display coordinate acquisition in the laser sensing-based interaction control method according to the embodiment of the present invention.
Fig. 3 is a schematic diagram illustrating positions of a laser sensing layer and a laser spot on a display panel in an interaction control method based on laser sensing according to an embodiment of the present invention.
Fig. 4 is a flowchart of position and time interval acquisition in the laser sensing-based interaction control method according to the embodiment of the present invention.
Fig. 5 is a flowchart of protection operation determination in the laser sensing-based interaction control method according to the embodiment of the present invention.
Fig. 6 is a schematic block diagram of an interaction control device based on laser sensing according to an embodiment of the present invention.
Fig. 7 is a schematic block diagram of an internal structure of an intelligent terminal according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Today, people and various terminal devices such as mobile phones, tablets, computers and televisions are surrounded by people and various terminal devices such as videos and videos in life. These intelligent terminals need to perform interactive control in many application scenarios. Currently, near field interaction is limited to single person operation, such as by a key or touch screen. Application scenes of far-field interaction, such as games, presentations and the like, may require multiple users to operate simultaneously to realize multi-user interaction. However, the existing far-field multi-person interaction is mainly based on wired connection or Bluetooth wireless connection, and no other form of interaction control mode exists. Moreover, the existing wired connection mode is limited by the distance, the Bluetooth wireless connection is not very stable, and the disconnection phenomenon can often occur, so that the interaction is unstable.
In order to solve the problems of the prior art, this embodiment provides an interactive control method based on laser sensing, and with the upgrade method of this embodiment, multi-user interactive control may be implemented, so that interactive stability is ensured, and an identification process of an interactive operation is simplified. Therefore, only when the laser light spot is sensed by the laser sensing layer, the display coordinates are displayed on the display panel. Therefore, the present embodiment can determine the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinates. And finally, according to the position information, the position of each laser spot on the display panel at this time and whether the position of each laser spot on the display panel changes relative to the position of the laser spot on the display panel at the last time can be obtained. The time interval of each laser spot relative to the last display on the display panel can be determined according to the display time interval. Therefore, since the position information and the display time interval of each laser spot on the display panel may not be the same, the interactive operation of each laser spot on the display panel can be determined and the interactive control can be performed according to the position information and the display time interval. Such as click operation and drag operation, so that multi-person interactive control can be realized.
In a specific application, the interaction control method based on laser sensing in this embodiment may be applied to an intelligent terminal, and the intelligent terminal has a display function, so that the intelligent terminal has a display device, such as a television. Since the present embodiment is based on laser sensing to realize interactive control, the display device includes a laser sensing layer for receiving a laser spot emitted by a laser emitting device. The laser emitting device can be set as a laser remote controller, and a user can emit laser light spots through the laser remote controller and receive the laser light spots by a laser induction layer on the display device, so that interactive control between the laser emitting device and the intelligent terminal is realized. Alternatively, the laser emitting device may be a wearable device, such as a portable laser emitting device that can be worn on the wrist or limb of the user, for the convenience of the user. Of course, the display device further includes a display panel, and the display panel is used for displaying contents such as videos or pictures, and also used for displaying the laser light spot sensed by the laser sensing layer on the display panel, so that the user can know the position of the laser light spot emitted by the laser emitting device. The display device in this embodiment can be seen with reference to fig. 3. Specifically, after a user emits a laser spot to a laser sensing layer through a laser emitting device, the laser spot is sensed by the laser sensing layer, and since the laser spot sensed by the laser sensing layer is invisible light, and the realization of interactive control is realized on a display panel of an intelligent terminal, the embodiment can obtain the display coordinate of each laser spot on the display panel after the laser spot is sensed on the laser sensing layer, and then determine the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinate; since the position information and the display time interval of each laser spot on the display panel may not be the same, the present embodiment may determine the interactive operation of each laser spot on the display panel according to the position information and the display time interval, and execute the interactive operation, thereby implementing the interactive control.
For example, if two laser spots, namely a laser spot a and a laser spot B, are sensed by the laser sensing layer, the display coordinates of the laser spot a and the laser spot B on the display panel are determined, and the position information and the display time interval of the corresponding laser spot on the display panel can be determined according to the display coordinates. Specifically, the determined display coordinate a corresponds to the position information of the laser spot a on the display panel, and the determined display coordinate B corresponds to the position information of the laser spot B on the display panel. Further, on the display panel, the display time interval of the laser spot a is T, and the display time interval of the laser spot B is 2T. Therefore, whether the positions of the laser spot A and the laser spot B on the display panel are changed or not can be judged based on the position information of the laser spot A and the laser spot B, and the time interval of displaying the laser spot A and the laser spot B on the display panel can be determined based on the display time interval. Therefore, by combining the position information and the display time interval, the corresponding interactive operation of the laser spot A and the laser spot B on the display panel can be judged, and the interactive operation is executed. Thereby realizing interactive control.
Exemplary method
The interaction control method based on laser sensing provided by the embodiment can be applied to an intelligent terminal, and specifically as shown in fig. 1, the method includes the following steps:
step S100, a plurality of laser light spots are obtained, and display coordinates of each laser light spot on a display panel are determined.
Since the embodiment is based on laser sensing to realize interactive control, the intelligent terminal in the embodiment includes a laser sensing layer for sensing a laser spot sent by the laser remote control device. In order to realize the interactive control through the laser sensing, in this embodiment, a display coordinate of each laser spot on the display panel needs to be determined according to a plurality of laser spots sensed by the laser sensing layer, where the display coordinate is used to reflect a position of the laser spot on the laser sensing layer corresponding to what position is on the display panel, so as to reflect the laser spot that is not visible on the display panel, and facilitate analysis of the display coordinate in subsequent steps.
In one implementation, as shown in fig. 2, the step S100 specifically includes the following steps:
step S101, when the laser sensing layer receives a plurality of laser light spots sent by laser remote control equipment, respectively obtaining the light spot coordinates of each laser light spot on the laser sensing layer;
step S102, obtaining a coordinate mapping relation between the laser induction layer and the display panel;
step S103, converting the light spot coordinates into the display coordinates of the laser light spots on the display panel according to the coordinate mapping relation.
When the intelligent terminal is used for playing a game on the display panel, the laser light spot is sent by the user to realize interactive operation on the display panel, for example, a game character is dragged to move by the sent laser light spot when the game is played on the display panel, so that the advancing direction of the game character is changed; or when the display panel carries out PPT demonstration, the page turning button is clicked by sending the laser spot, so that page turning control is realized. It can be seen that the laser spot is finally for implementing the related interactive operation on the display panel, and therefore, the embodiment needs to associate the laser spot with the display panel. In a specific application, when the laser sensing layer receives a plurality of laser spots emitted from a laser remote control device, the embodiment respectively obtains the spot coordinates of each laser spot on the laser sensing layer, where the spot coordinates are the positions of the laser spots on the laser sensing layer. Then obtaining a coordinate mapping relation between the laser induction layer and the display panel; and finally, converting the light spot coordinates into display coordinates of the laser light spot on the display panel according to the coordinate mapping relation, so that the laser light spot is associated with the display panel. In other words, in this embodiment, after the laser sensing layer senses the laser spot, the coordinates of the spot on the laser sensing layer are converted into the display coordinates on the display panel through the coordinate mapping relationship, the display coordinates are the coordinates of the cursor corresponding to the laser spot on the display panel, and when the method is specifically applied, the cursor may be in the form of a cross-shaped cursor or the like.
In an implementation manner, when obtaining the coordinate mapping relationship between the laser sensing layer and the display panel, the embodiment first obtains size data of the laser sensing layer and the display panel, where the size data is an outline size of the laser sensing layer and an outline data of a display area on the display panel. For example, when the laser sensing layer and the display panel are arranged in a rectangle, the size data set is the length size and the width size of the laser sensing layer and the display panel. Therefore, after the size data of the laser sensing layer and the display panel are acquired, the coordinate mapping relationship between the laser sensing layer and the display panel can be obtained by scaling according to the respective size data, and the coordinate mapping relationship reflects: the coordinate mapping relationship is a proportional relationship between the coordinate of a certain point on the laser sensing layer and the coordinate of a point at the same position on the display panel, and is a proportion converted based on the size data of the laser sensing layer and the display panel. After the coordinate mapping relationship is obtained, the spot coordinates of each laser spot on the laser sensing layer can be installed and converted into the display coordinates of the laser spot on the display panel.
In another implementation manner, if the size data of the laser sensing layer is the same as the size data of the display panel, the coordinate mapping relationship between the laser sensing layer and the display panel is that the coordinates of the light spot coordinate is the same as the coordinates of the display coordinate, that is, the light spot coordinate of the laser light spot on the laser sensing layer is the display coordinate of the laser light spot on the display panel. For example, as shown in fig. 3, the size data of the laser sensing layer and the display panel in the intelligent terminal shown in fig. 3 are the same, and the laser sensing layer and the display panel are stacked front and back (i.e., the display panel is in front of the laser sensing layer is behind the laser sensing layer) and completely coincide with each other, so that when a user uses a laser remote control device to emit a laser spot through the display panel and is received by the laser sensing layer, the spot coordinates of the laser spot on the laser sensing layer can be directly used as the display coordinates of the laser spot on the display panel. In addition, in this embodiment, the laser sensing layer and the display panel are arranged to be stacked front and back and completely overlapped, so that the operation of a user can be facilitated, when the user wants to operate a certain operation button on the display panel, the laser remote control device can be directly used to irradiate the position of the operation button on the display panel, emit a laser spot, be received by the laser sensing layer, and be embodied on the display panel, so as to realize corresponding interactive operation. In this embodiment, the coordinates of the light spots on the laser sensing layer are in one-to-one correspondence with the display coordinates of the laser light spots on the display panel, and even if there are a plurality of laser light spots, the corresponding display coordinates on the display panel can be determined.
For example, as shown in fig. 3, when the laser sensing layer receives the laser spot 1, the laser spot 2, and the laser spot 3, since the laser sensing layer and the display panel are disposed to be overlapped and completely overlapped, the spot coordinates of the laser spot 1, the laser spot 2, and the laser spot 3 can be directly used as the display coordinates of the laser spot 1, the laser spot 2, and the laser spot 3 on the display panel.
Step S200, determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinates.
After obtaining the display coordinates, the present embodiment may obtain the position information of each laser spot on the display panel according to the display coordinates, that is, obtain the position information of each laser spot acting on the display panel. For example, when the laser sensing layer and the display panel are arranged in a front-back overlapping manner and completely overlap, as shown in fig. 3, the spot coordinates of the laser spot on the laser sensing layer can be directly used as the display coordinates of the laser spot on the display panel, and therefore what position on the display panel the user irradiates with the laser remote control device is obtained according to the display coordinates. In addition, the present embodiment may further determine a display time interval of each laser spot on the display panel according to the display coordinates. Because only when laser induction layer senses when the laser spot, just can show display coordinates shows on the display panel, consequently according to display coordinates on the display panel just can know appear on the display panel display coordinates's display time interval can determine that each laser spot is in display time interval on the display panel. The position information and the display time interval may be used in subsequent steps to determine the interaction corresponding to each laser spot.
In one implementation, as shown in fig. 4, the step S200 specifically includes the following steps:
step S201, according to the display coordinates, respectively marking the position of the laser spot corresponding to each display coordinate on the display panel to obtain the position information of each laser spot on the display panel;
step S202, obtaining time information of a cursor corresponding to the last laser spot appearing on the display panel, and obtaining a display time interval of each laser spot on the display panel.
In specific implementation, after the display coordinates of each laser spot on the display panel are determined, the position of the laser spot corresponding to each display coordinate on the display panel is marked on the display panel, so that the position information of each laser spot on the display panel is obtained. Specifically, the marking manner may mark the position of each display coordinate by way of icon drawing. For example, referring to fig. 3 again, when the laser sensing layer and the display panel shown in fig. 3 are arranged to be overlapped front and back and completely overlapped, since the spot coordinates of the laser spot on the laser sensing layer can be directly used as the display coordinates of the laser spot on the display panel, the position information obtained by marking the display coordinates can be represented as the position of the laser spot irradiated by the user aiming at the display panel by using the laser remote control device.
Similarly, since the display coordinates are represented on the display panel only when the laser sensing layer senses the laser spots, after the display coordinates of each laser spot on the display panel are determined, the embodiment can also obtain the time information of the last cursor appearing on the display panel, and further obtain the display time interval of each laser spot on the display panel according to the time information. In this embodiment, each time the laser sensing layer receives the laser spot, the laser spot is displayed on the display panel in the form of a cursor. Therefore, when the display panel displays the cursor corresponding to the laser spot each time, the embodiment can record the time information of displaying the cursor corresponding to the laser spot each time. For example, if the number of times of displaying the cursor on the display panel is two, the embodiment records the time information of displaying the cursor twice, and the time information of displaying the cursor twice on the display panel is different, so that when the display panel displays the cursor for the second time, the time information of displaying the cursor for the first time is obtained, and thus the time interval of displaying the cursor corresponding to the laser spot for the first time and the second time on the display panel, that is, the display time interval of displaying the cursor twice on the display panel is determined according to the time information. For example, the time information of the first time of displaying the cursor corresponding to the laser spot on the display panel is 8: 05, the time information of the cursor corresponding to the laser spot displayed for the second time on the display panel is 8: 06, the display time interval of the cursor corresponding to the laser spot displayed on the display panel is determined to be 1S.
Step S300, according to the position information and the display time interval, determining the interactive operation of each laser spot on the display panel, and executing the interactive operation.
After determining the position information and the display time interval, the present embodiment may obtain, according to the position information, a position of each laser spot on the display panel at this time and whether the position of each laser spot on the display panel changes with respect to a position of the laser spot on the display panel at the last time. The time interval of each laser spot relative to the last display on the display panel can be determined according to the display time interval. Since the position information and the display time interval of each laser spot on the display panel may be different, the interactive operation of each laser spot on the display panel, such as a click operation and a drag operation, may be determined according to the position information and the display time interval, thereby implementing multi-user interactive control and also simplifying the identification process of the interactive operation.
In one implementation, as shown in fig. 5, the step S300 specifically includes the following steps:
step S301, determining position change information of each laser spot on the display panel according to the position information, where the position change information is used to reflect change information of a position of each laser spot on the display panel this time relative to a position of the laser spot on the display panel last time, and the position change information includes a changed position and an unchanged position;
step S302, determining the key state of the laser remote control equipment according to the display time interval;
step S303, determining the interactive operation of each laser spot on the display panel according to the position change information and the key state information.
In a specific implementation, the present embodiment may determine the position change information of each laser spot on the display panel according to the obtained position information, where the position information is obtained according to the display coordinates, and the display coordinates are obtained by converting the spot coordinates of the laser spot on the laser sensing layer, that is, only when the laser sensing layer senses the laser spot, the display coordinates on the display panel exist, and thus the position information exists. Therefore, the position change information in this embodiment reflects the change information of the position where the laser spot is applied to the display panel this time with respect to the position where the laser spot was applied to the display panel last time, that is, whether the position of the display coordinate has changed. Correspondingly, the position change information indicates whether the position of the laser spot on the laser sensing layer is changed. When the laser sensing layer and the display panel are arranged in a front-back overlapping manner and completely coincide with each other as shown in fig. 3, the position change information reflects whether the position of the laser spot irradiated on the display panel changes.
Similarly, after the display time interval is obtained, the time interval at which the laser spot is sensed and received by the laser sensing layer, that is, the time interval at which the laser spot is applied to the display panel for displaying, is determined, and the laser spot is emitted by the laser remote control device, so that the key states of the laser remote control device can be determined according to the display time interval, wherein the key states are a pressed state and a non-pressed state, and therefore, whether the user operates the laser remote control device or not can be determined according to the key states. Specifically, in this embodiment, after the display time interval is obtained, the display time interval is respectively compared with the first time interval, the second time interval, and the third time interval. Wherein the second time interval is greater than the first time interval and the third time interval is greater than the second time interval.
If the display time interval is a first time interval, it indicates that the display coordinates lack a short time on the display panel, for example, the lack time is 1T, and a laser spot generated at the instant of pressing a key of the laser remote control device acts on the laser sensing layer and is reflected on the display panel through the display coordinates. Therefore, when the display coordinates lack a short time on the display panel, that is, the display time interval is short, the state of the key of the laser remote control device is a pressed state, which indicates that the key is a click. If the display time interval is a second time interval, it indicates that the display coordinates lack a long time on the display panel, and if the lack time is 2T, the key state of the laser remote control device is an un-pressed state, that is, it indicates that the key of the laser remote control device is not pressed again within a long time after the laser spot is emitted. If the display time interval is a third time interval, it indicates that the display coordinate lacks a longer time on the display panel, and if the missing time is 3T, this display coordinate is determined to be caused by a key on the laser remote control device being touched by mistake, so that the cursor corresponding to the laser spot is not displayed on the display panel.
In this embodiment, after the position change information and the corresponding key state of each laser spot are obtained, the corresponding interactive operation can be determined according to the position change information and the key state. Specifically, if a key state corresponding to a certain laser spot is a pressed state and the position change information corresponding to the laser spot is that the position is not changed, it indicates that the laser spot is lightly triggered by a key on the laser remote control device, which is equivalent to clicking, and the position of the laser spot is not changed after clicking, so that it is determined that the interactive operation of the laser spot on the display panel is that the position of the laser spot on the display panel is clicked, and the intelligent terminal executes the interactive operation. For example, when the display panel is performing PPT presentation, the page turning button on the display panel is clicked through the above-mentioned interactive operation, so as to implement page turning control. If the key state corresponding to a certain laser spot is a non-pressed state and the position change information corresponding to the laser spot is that the position is changed, it indicates that the laser remote control device is not pressed again after the laser spot is emitted (i.e. the key is pressed), and in combination with the change of the position of the laser spot, it can be determined that the interactive operation of the laser spot on the display panel is dragged on the display panel, so that the intelligent terminal can execute the interactive operation. For example, when a game is played on the display panel, the game character can be dragged to move through the interactive operation, and the advancing direction of the game character is changed. And when the laser light spots are multiple, the interactive operation corresponding to the laser light spots can be analyzed respectively, so that the multi-person interaction is realized.
In summary, in the embodiment, first, a plurality of laser spots sensed on the laser sensing layer are obtained, and since the laser spots sensed by the laser sensing layer are invisible light, and the interactive control is realized on the display panel of the intelligent terminal, after the plurality of laser spots are sensed on the laser sensing layer, the display coordinates of each laser spot on the display panel need to be determined, so as to reflect the invisible laser spots on the display panel. And then determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinates. And finally, according to the position information, the position of each laser spot on the display panel at this time and whether the position of each laser spot on the display panel changes relative to the position of the laser spot on the display panel at the last time can be obtained. The time interval of each laser spot relative to the last display on the display panel can be determined according to the display time interval. Since the position information and the display time interval of each laser spot on the display panel may be different, the interactive operation of each laser spot on the display panel may be determined according to the position information and the display time interval, and the interactive operation, such as a click operation and a drag operation, may be performed, thereby implementing multi-user interactive control and also simplifying the identification process of the interactive operation.
Exemplary device
As shown in fig. 6, an embodiment of the present invention provides an interaction control apparatus based on laser sensing, including: a display coordinate acquisition unit 10, a position and time interval acquisition unit 20, and an interactive operation determination unit 30. Specifically, the display coordinate acquiring unit 10 is configured to acquire a plurality of laser spots and determine display coordinates of each laser spot on the display panel. The position and time interval acquiring unit 20 is configured to determine, according to the display coordinates, position information of each laser spot on the display panel and a display time interval of each laser spot on the display panel. The interactive operation determining unit 30 is configured to determine an interactive operation of each laser spot on the display panel according to the position information and the display time interval, and execute the interactive operation.
Based on the above embodiment, the present invention further provides an intelligent terminal, and a schematic block diagram thereof may be as shown in fig. 7. The intelligent terminal comprises a processor, a memory, a network interface, a display screen and a temperature sensor which are connected through a system bus. Wherein, the processor of the intelligent terminal is used for providing calculation and control capability. The memory of the intelligent terminal comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the intelligent terminal is used for being connected and communicated with an external terminal through a network. The computer program is executed by a processor to implement a laser sensing based interactive control method. The display screen of the intelligent terminal can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor of the intelligent terminal is arranged inside the intelligent terminal in advance and used for detecting the operating temperature of internal equipment.
It will be understood by those skilled in the art that the block diagram of fig. 7 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation to the intelligent terminal to which the solution of the present invention is applied, and a specific intelligent terminal may include more or less components than those shown in the figure, or combine some components, or have different arrangements of components.
In one embodiment, an intelligent terminal is provided that includes a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
the method comprises the steps of obtaining a plurality of laser light spots, and determining display coordinates of each laser light spot on a display panel;
according to the display coordinates, determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel;
and determining the interactive operation of each laser spot on the display panel according to the position information and the display time interval, and executing the interactive operation.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the present invention discloses an interaction control method based on laser sensing, an intelligent terminal and a storage medium, wherein the method comprises: the method comprises the steps of obtaining a plurality of laser light spots, and determining display coordinates of each laser light spot on a display panel; according to the display coordinates, determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel; and determining the interactive operation of each laser spot on the display panel according to the position information and the display time interval, and executing the interactive operation. The invention determines different interactive operations of the laser spot on the display panel based on the laser sensing technology and by combining the position information of the laser spot on the display panel and the display time interval, thereby realizing multi-user interactive control under the laser sensing interactive scene.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (12)
1. An interaction control method based on laser induction is characterized by comprising the following steps:
obtaining a plurality of laser light spots, and determining the display coordinates of each laser light spot on a display panel;
according to the display coordinates, determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel;
and determining the interactive operation of each laser spot on the display panel according to the position information and the display time interval, and executing the interactive operation.
2. The interactive control method based on laser induction according to claim 1, wherein the obtaining a plurality of laser spots induced on the laser induction layer and determining the display coordinates of each laser spot on the display panel comprises:
when the laser sensing layer receives a plurality of laser light spots emitted by laser remote control equipment, respectively acquiring the light spot coordinates of each laser light spot on the laser sensing layer;
acquiring a coordinate mapping relation between the laser induction layer and the display panel;
and converting the light spot coordinates into the display coordinates of the laser light spots on the display panel according to the coordinate mapping relation, wherein the display coordinates are coordinates of a cursor corresponding to the laser light spots on the display panel.
3. The interaction control method based on laser sensing of claim 2, wherein the obtaining of the coordinate mapping relationship between the laser sensing layer and the display panel comprises:
respectively acquiring size data of the laser induction layer and the display panel;
and determining a coordinate mapping relation between the laser induction layer and the display panel according to the size data.
4. The interaction control method based on laser sensing of claim 3, wherein the determining the coordinate mapping relationship between the laser sensing layer and the display panel according to the size data comprises:
if the size data of the laser sensing layer is the same as that of the display panel, the coordinate mapping relation between the laser sensing layer and the display panel is that the light spot coordinate is the same as that of the display coordinate.
5. The laser sensing-based interaction control method according to claim 4, wherein converting the spot coordinates into the display coordinates of the laser spot on the display panel according to the coordinate mapping relationship comprises:
and when the coordinate mapping relation is that the coordinates of the light spot and the display coordinates are the same, taking the coordinates of the light spot on the laser sensing layer as the display coordinates of the laser light spot on the display panel.
6. The interactive control method based on laser induction according to claim 1, wherein the determining the position information of each laser spot on the display panel and the display time interval of each laser spot on the display panel according to the display coordinates comprises:
according to the display coordinates, the position of the laser spot corresponding to each display coordinate on the display panel is marked on the display panel respectively, and the position information of each laser spot on the display panel is obtained;
and acquiring time information of a cursor corresponding to the last laser spot on the display panel to obtain the display time interval of each laser spot on the display panel.
7. The interactive control method based on laser induction according to claim 1, wherein the determining interactive operation of each laser spot on the display panel according to the position information and the display time interval comprises:
determining position change information of each laser spot on the display panel according to the position information, wherein the position change information is used for reflecting the change information of the position of each laser spot on the display panel at this time relative to the position of each laser spot on the display panel at the last time, and the position change information comprises changed positions and unchanged positions;
determining the key state of the laser remote control equipment according to the display time interval;
and determining the interactive operation of each laser spot on the display panel according to the position change information and the key state information.
8. The interaction control method based on laser sensing of claim 7, wherein the determining the key state of the laser remote control device according to the display time interval comprises:
if the display time interval is a first time interval, the key state of the laser remote control equipment is a pressed state;
and if the display time interval is a second time interval, the key state of the laser remote control equipment is a non-pressed state, and the first time interval is smaller than the second time interval.
9. The interaction control method based on laser sensing of claim 8, wherein the determining the interaction operation of each laser spot on the display panel according to the position change information and the key status information comprises:
if the key state is a pressed state and the position change information is that the position is not changed, determining that the interactive operation of the laser spot on the display panel is to click the position of the laser spot on the display panel;
and if the key state is a non-pressed state and the position change information is that the position is changed, determining that the interactive operation of the laser spot on the display panel is dragging on the display panel.
10. The interaction control method based on laser induction as claimed in claim 8, wherein the determining the key state of the laser remote control device according to the display time interval comprises:
and if the display time interval is a third time interval, not displaying the cursor corresponding to the laser spot on the display panel, wherein the third time interval is greater than the second time interval.
11. An intelligent terminal comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory, and wherein the one or more programs being configured to be executed by the one or more processors comprises instructions for performing the method of any of claims 1-10.
12. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method of any of claims 1-10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011190939.0A CN114442862A (en) | 2020-10-30 | 2020-10-30 | Interaction control method based on laser induction, intelligent terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011190939.0A CN114442862A (en) | 2020-10-30 | 2020-10-30 | Interaction control method based on laser induction, intelligent terminal and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114442862A true CN114442862A (en) | 2022-05-06 |
Family
ID=81357120
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011190939.0A Pending CN114442862A (en) | 2020-10-30 | 2020-10-30 | Interaction control method based on laser induction, intelligent terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114442862A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103702151A (en) * | 2013-11-25 | 2014-04-02 | 何文林 | Man-computer interaction remote control device and method for intelligent television and touch control screen |
| CN104166509A (en) * | 2013-05-20 | 2014-11-26 | 华为技术有限公司 | Non-contact screen interaction method and system |
| CN104932757A (en) * | 2014-03-21 | 2015-09-23 | 中兴通讯股份有限公司 | Laser visual touch method and system |
| CN110456952A (en) * | 2019-06-27 | 2019-11-15 | 北京科加触控技术有限公司 | A kind of movement executes method, apparatus and system |
-
2020
- 2020-10-30 CN CN202011190939.0A patent/CN114442862A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104166509A (en) * | 2013-05-20 | 2014-11-26 | 华为技术有限公司 | Non-contact screen interaction method and system |
| CN103702151A (en) * | 2013-11-25 | 2014-04-02 | 何文林 | Man-computer interaction remote control device and method for intelligent television and touch control screen |
| CN104932757A (en) * | 2014-03-21 | 2015-09-23 | 中兴通讯股份有限公司 | Laser visual touch method and system |
| WO2015139427A1 (en) * | 2014-03-21 | 2015-09-24 | 中兴通讯股份有限公司 | Laser virtual touch control method and system |
| CN110456952A (en) * | 2019-06-27 | 2019-11-15 | 北京科加触控技术有限公司 | A kind of movement executes method, apparatus and system |
Non-Patent Citations (1)
| Title |
|---|
| 刘政怡;吴建国;李炜;: "红外激光笔遥指虚拟触摸系统", 计算机工程与设计, no. 05, pages 1 - 5 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2017133572A1 (en) | Method and device for moving target object based on touch control | |
| CN109561271B (en) | Method for guiding terminal operation, first terminal and second terminal | |
| WO2021203724A1 (en) | Handwriting selection method and apparatus, and computer device and storage medium | |
| US20150234566A1 (en) | Electronic device, storage medium and method for operating electronic device | |
| CN108553894B (en) | Display control method and device, electronic equipment and storage medium | |
| CN115174733A (en) | Interface display method, device and equipment | |
| CN110750197A (en) | File sharing method, device and system, corresponding equipment and storage medium | |
| CN111324252B (en) | Display control method and device in live broadcast platform, storage medium and electronic equipment | |
| CN109697004B (en) | Method, device and equipment for writing annotation by touch equipment and storage medium | |
| EP3441865A1 (en) | Electronic device for storing user data, and method therefor | |
| JP2014048976A (en) | Input display control device, thin client system, input display control method and program | |
| CN108693997B (en) | Touch control method and device of intelligent interaction panel and intelligent interaction panel | |
| CN111665984A (en) | Information processing method and device, electronic equipment and readable storage medium | |
| CN111770369A (en) | Remote control method, device, storage medium and terminal | |
| CN113282262B (en) | Control method and device for projection display picture, mobile terminal and storage medium | |
| CN113672290B (en) | File opening method and equipment | |
| CN112416486A (en) | Information guiding method, device, terminal and storage medium | |
| EP4290361A1 (en) | Display control method and apparatus for pointer in window, device, and storage medium | |
| JP6293903B2 (en) | Electronic device and method for displaying information | |
| CN107728898B (en) | Information processing method and mobile terminal | |
| CN114442862A (en) | Interaction control method based on laser induction, intelligent terminal and storage medium | |
| CN113126874B (en) | Control method and control system of terminal equipment | |
| CN114115639A (en) | Interface control method and device, electronic equipment and storage medium | |
| CN112306260A (en) | Interactive method, display terminal, system and computer readable storage medium | |
| CN114035739B (en) | Graph drawing method and device, computer readable storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |