CN112506384A - Interaction method, device and equipment based on laser signal and readable storage medium - Google Patents
Interaction method, device and equipment based on laser signal and readable storage medium Download PDFInfo
- Publication number
- CN112506384A CN112506384A CN202011513718.2A CN202011513718A CN112506384A CN 112506384 A CN112506384 A CN 112506384A CN 202011513718 A CN202011513718 A CN 202011513718A CN 112506384 A CN112506384 A CN 112506384A
- Authority
- CN
- China
- Prior art keywords
- laser
- key
- key state
- laser signal
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 62
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000001960 triggered effect Effects 0.000 claims abstract description 50
- 230000002452 interceptive effect Effects 0.000 claims description 25
- 230000006698 induction Effects 0.000 claims description 20
- 238000013507 mapping Methods 0.000 claims description 7
- 238000005516 engineering process Methods 0.000 abstract description 9
- 230000006870 function Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000005484 gravity Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005034 decoration Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C23/00—Non-electrical signal transmission systems, e.g. optical systems
- G08C23/04—Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses an interaction method, an interaction device, interaction equipment and a readable storage medium based on laser signals, wherein the method comprises the following steps: when a laser signal transmitted by remote control equipment is received, identifying a first laser coordinate of the laser signal on a display panel; when the first laser coordinate is detected to meet the preset condition, determining a key event corresponding to the laser signal; and determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction. According to the invention, the position of the laser signal and the key event triggered at the position are identified, and the corresponding operation of the key event triggered at the position is executed according to the position of the laser signal, so that the display equipment is controlled to realize a specific function through the laser signal and the key event, the display equipment can be conveniently controlled, the technical problem of poor use experience of a user due to the fact that the control requirement of the user is difficult to meet in the existing remote interaction technology is solved, and the use experience of the user is enriched.
Description
Technical Field
The present invention relates to the field of remote interaction technologies, and in particular, to an interaction method, an interaction device, an interaction apparatus, and a readable storage medium based on a laser signal.
Background
The existing remote interaction technology mainly takes infrared remote control, Bluetooth remote control or a flying mouse and other equipment as main parts, and laser induction interaction is taken as a new interaction technology in the remote interaction technology, so that coordinates can be reported in real time, and the position of a cursor can be displayed. However, the current laser sensing interaction technology is only cursor drawing, and the requirement of the user is difficult to meet.
The above is only for the purpose of assisting understanding of the technical aspects of the present invention, and does not represent an admission that the above is prior art.
Disclosure of Invention
The invention mainly aims to provide an interaction method, an interaction device, interaction equipment and a readable storage medium based on laser signals, and aims to solve the technical problem that the existing remote interaction technology is difficult to meet the use requirements of users.
In order to achieve the above object, the present invention provides an interaction method based on laser signals, which includes the following steps:
when a laser signal transmitted by remote control equipment is received, identifying a first laser coordinate of the laser signal on a display panel;
when the first laser coordinate is detected to meet a preset condition, determining a key event corresponding to the laser signal;
and determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction.
Optionally, when it is detected that the first laser coordinate meets a preset condition, the step of determining the key event corresponding to the laser signal includes:
when the first laser coordinate meets a preset condition, acquiring a first key state triggered by the remote control equipment when the laser signal is transmitted;
and determining a key event corresponding to the laser signal according to the first key state.
Optionally, the step of determining the key event corresponding to the laser signal according to the first key state includes:
when the first key state has a corresponding last key state, acquiring a second key state corresponding to the first key state, wherein the second key state is the last key state corresponding to the first key state;
and determining a key event corresponding to the laser signal according to the first key state and the second key state.
Optionally, the step of determining the key event corresponding to the laser signal according to the first key state and the second key state includes:
if the first key state is a bounce state and the second key state is a press state, determining that the key event is a click event;
if the first key state is a no-operation state and the second key state is a pressed state, acquiring a first laser coordinate corresponding to the second key state, and determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state.
Optionally, the step of determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state includes:
comparing a first laser coordinate corresponding to the second key state with a first laser coordinate corresponding to the first key state;
and if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, determining that the key event is a long-press event.
Optionally, the step of determining the key event corresponding to the laser signal according to the first key state includes:
if the first key state does not have the corresponding last key state, storing the first key state, and taking the first key state as a second key state;
and acquiring a next key state corresponding to the second key state, taking the next key state corresponding to the second key state as the first key state, and executing the step of determining the key event corresponding to the laser signal according to the first key state.
Optionally, the step of identifying, when receiving a laser signal transmitted by a remote control device, a first laser coordinate of the laser signal on a display panel includes:
when a laser signal transmitted by remote control equipment is received, identifying a second laser coordinate of the laser signal on a laser induction layer through a laser sensor;
and determining the first laser coordinate of the second laser coordinate on the display panel based on the pixel point mapping relation between the laser induction layer and the display panel, wherein the pixel points of the laser induction layer correspond to the pixel points of the display panel one to one.
In addition, to achieve the above object, the present invention further provides an interaction apparatus based on a laser signal, including:
the identification module is used for identifying a first laser coordinate of a laser signal on a display panel when the laser signal transmitted by remote control equipment is received;
the first determining module is used for determining a key event corresponding to the laser signal when the first laser coordinate is detected to meet a preset condition;
and the second determining module is used for determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate and executing the operation instruction.
In addition, to achieve the above object, the present invention further provides an interaction device based on a laser signal, including: the laser signal-based interaction method comprises a memory, a processor and a laser signal-based interaction program stored on the memory and capable of running on the processor, wherein the laser signal-based interaction program realizes the steps of the laser signal-based interaction method when being executed by the processor.
In addition, to achieve the above object, the present invention further provides a readable storage medium, which stores thereon an interactive program based on laser signals, and when the interactive program based on laser signals is executed by a processor, the steps of the interactive method based on laser signals as described above are implemented.
The method comprises the steps of identifying a first laser coordinate of a laser signal on a display panel when the laser signal transmitted by remote control equipment is received; when the first laser coordinate is detected to meet a preset condition, determining a key event corresponding to the laser signal; and determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction. In this embodiment, by identifying the position of the laser signal and the key event triggered at the position, and according to the position of the laser signal, i.e. the first laser coordinate, executing the operation corresponding to the key event triggered at the position, thereby controlling the display device to realize a specific function through the laser signal and the key event, the display device can be conveniently controlled, the technical problem that the use experience of a user is poor due to the fact that the existing remote interaction technology is difficult to meet the control requirement of the user is solved, and the use experience of the user is enriched.
Drawings
FIG. 1 is a schematic diagram of a laser signal-based interactive device of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart illustrating a first embodiment of a laser signal-based interaction method according to the present invention;
FIG. 3 is a flowchart illustrating a second embodiment of the laser signal-based interaction method according to the present invention;
FIG. 4 is an interaction diagram of a display device and a remote control device according to the interaction method based on laser signals;
fig. 5 is an exemplary process of the laser signal-based interaction method of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of an interactive device based on laser signals in a hardware operating environment according to an embodiment of the present invention.
The interactive device based on the laser signal in the embodiment of the present invention may be a PC, or may be a mobile terminal device having a display function, such as a smart phone, a tablet computer, an electronic book reader, an MP3(Moving Picture Experts Group Audio Layer III, motion video Experts compression standard Audio Layer 3) player, an MP4(Moving Picture Experts Group Audio Layer IV, motion video Experts compression standard Audio Layer 4) player, a portable computer, and the like.
As shown in fig. 1, the laser signal based interactive apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Optionally, the laser signal-based interactive device may further include a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WiFi module, and the like. Such as light sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor that may adjust the brightness of the display screen according to the brightness of ambient light, and a proximity sensor that may turn off the display screen and/or the backlight when the interactive device based on the laser signal is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when the device is stationary, and can be used for identifying applications of the laser signal-based interactive device gesture (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration identification related functions (such as pedometer and tapping), and the like; of course, the laser signal-based interactive device may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which are not described herein again.
Those skilled in the art will appreciate that the laser signal based interaction device configuration shown in fig. 1 does not constitute a limitation of laser signal based interaction devices and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an interactive program based on a laser signal.
In the laser signal-based interactive device shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be used to invoke an interactive program based on the laser signal stored in the memory 1005.
In this embodiment, the laser signal based interactive apparatus includes: a memory 1005, a processor 1001, and an interactive program based on laser signals, which is stored in the memory 1005 and can be executed on the processor 1001, wherein when the processor 1001 calls the interactive program based on laser signals stored in the memory 1005, the following operations are performed:
when a laser signal transmitted by remote control equipment is received, identifying a first laser coordinate of the laser signal on a display panel;
when the first laser coordinate is detected to meet a preset condition, determining a key event corresponding to the laser signal;
and determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction.
Further, the processor 1001 may call the laser signal based interactive program stored in the memory 1005, and further perform the following operations:
when the first laser coordinate meets a preset condition, acquiring a first key state triggered by the remote control equipment when the laser signal is transmitted;
and determining a key event corresponding to the laser signal according to the first key state.
Further, the processor 1001 may call the laser signal based interactive program stored in the memory 1005, and further perform the following operations:
when the first key state has a corresponding last key state, acquiring a second key state corresponding to the first key state, wherein the second key state is the last key state corresponding to the first key state;
and determining a key event corresponding to the laser signal according to the first key state and the second key state.
Further, the processor 1001 may call the laser signal based interactive program stored in the memory 1005, and further perform the following operations:
if the first key state is a bounce state and the second key state is a press state, determining that the key event is a click event;
if the first key state is a no-operation state and the second key state is a pressed state, acquiring a first laser coordinate corresponding to the second key state, and determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state.
Further, the processor 1001 may call the laser signal based interactive program stored in the memory 1005, and further perform the following operations:
comparing a first laser coordinate corresponding to the second key state with a first laser coordinate corresponding to the first key state;
and if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, determining that the key event is a long-press event.
Further, the processor 1001 may call the laser signal based interactive program stored in the memory 1005, and further perform the following operations:
if the first key state does not have the corresponding last key state, storing the first key state, and taking the first key state as a second key state;
and acquiring a next key state corresponding to the second key state, taking the next key state corresponding to the second key state as the first key state, and executing the step of determining the key event corresponding to the laser signal according to the first key state.
Further, the processor 1001 may call the laser signal based interactive program stored in the memory 1005, and further perform the following operations:
when a laser signal transmitted by remote control equipment is received, identifying a second laser coordinate of the laser signal on a laser induction layer through a laser sensor;
and determining the first laser coordinate of the second laser coordinate on the display panel based on the pixel point mapping relation between the laser induction layer and the display panel, wherein the pixel points of the laser induction layer correspond to the pixel points of the display panel one to one.
The invention further provides an interaction method based on the laser signal, and referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the interaction method based on the laser signal.
Step S10, when receiving a laser signal emitted by a remote control device, identifying a first laser coordinate of the laser signal on a display panel;
referring to fig. 4, the interaction method based on laser signals provided by the present invention is applied to a display device and a remote control device, the display device is an electronic device having a display function or capable of being externally connected to display, the display device includes a display screen and a processor, the display screen includes a display panel and a laser sensing layer, wherein the display device may be a terminal device having a display function, such as a smart television, a smart phone, or a computer; the remote control equipment is a wireless transmitting device for remote control, the remote control equipment can comprise a remote controller, a helmet or wearable equipment such as gloves, and the remote control equipment is used for controlling the display equipment so as to realize remote interaction between the remote control equipment and the display equipment. The display panel is used for displaying image information for a user to watch, and the display panel is composed of display units.
The laser response layer is used for discerning laser signal and laser signal position, contains laser sensor on the laser response layer, and laser sensor on the laser response layer is array laser sensor, and array laser sensor comprises a plurality of array element laser sensor, contains a plurality of array element laser sensor on the laser response layer promptly. The laser induction layer and the display panel can be arranged according to different requirements, for example, the laser induction layer can be embedded in the display panel or arranged below the display panel; the shape of the laser sensing layer and the shape of the display panel are not particularly limited in this embodiment, and the shapes of the laser sensing layer and the display panel may be rectangular, oval, or other irregular combined shapes; the position one-to-one of the display unit on the array element laser sensor on the laser induction layer and the display panel, namely the array element laser sensor on the laser induction layer and the display unit of the display panel are correspondingly arranged, the array element laser sensor can be arranged side by side with the display unit, and therefore when the remote control equipment transmits laser signals to the display panel of the display equipment, the laser sensor on the laser induction layer can identify the position of the laser signals.
In this embodiment, the remote control device further includes a laser emission module, where the laser emission module is configured to emit a laser signal, and the remote control device emits the laser signal when receiving a laser emission instruction; when the laser induction layer of the display device identifies the laser signal, the laser induction layer receives the laser signal and identifies the position of the laser signal on the display screen to obtain a first laser coordinate of the laser signal, wherein the first laser coordinate is the position of the laser signal on the display panel. The position coordinates of each unit on the display panel are predetermined, the array element laser sensor corresponding to the display panel receives the laser signal, and the position of the laser signal is the position of the array element laser sensor currently receiving the laser signal.
Step S20, when the first laser coordinate meets the preset condition, determining a key event corresponding to the laser signal;
in this embodiment, the preset condition is within a preset pixel range. After the position of the laser signal on the display panel is identified, that is, the first laser coordinate is obtained, the display device compares the first laser coordinate with a preset pixel point range to detect whether the first laser coordinate is in the preset pixel point range or determine whether the first laser coordinate meets a preset condition. If the first laser coordinate is within the range of the preset pixel point, the first laser coordinate can be determined to meet the preset condition, and the first laser coordinate can be operated on the next step within the legal position range of the first laser coordinate on the display panel. And then, when the first laser coordinate meets the preset condition, determining a key event triggered when the laser signal is triggered according to the key state and/or the laser coordinate corresponding to the currently identified laser signal. The key event represents the state of a key on the remote control device, the key event is a key event triggered by the remote control device when emitting a laser signal, and the key event includes but is not limited to a click event, a long-time press event or a double-click event, etc.
It should be noted that, besides the legal display range, the display panel also includes an illegal display range such as a boundary or a frame that is not used for displaying an image, and the legal coordinate range is a coordinate range used for displaying an image and is within the display range of the display panel; the illegal coordinate range is out of the display range of the display panel, and the illegal coordinate range cannot be used for displaying images, such as a frame or a border, which is commonly used for decoration, and the like.
And step S30, determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction.
In this embodiment, after determining the key event triggered based on the laser signal, an operation instruction triggered based on the laser signal is determined according to the key event corresponding to the laser signal and the first laser coordinate corresponding to the laser signal, where the operation instruction is a computer instruction or instruction for controlling the display device to perform a corresponding operation, and is used to respond to the operation instruction at a position corresponding to the first laser coordinate, so that the display device performs a control operation corresponding to the operation instruction, and the control operation may be a display operation, an application start operation, a close operation, a zoom operation, a slide operation, or the like, and the control operation is not specifically limited in this embodiment.
Further, the specific step of executing the operation triggered by the key event on the first laser coordinate includes: firstly, determining an application program corresponding to a first laser coordinate on a display panel; and determining the function operation corresponding to the key event in the application program, and executing the function operation.
According to the interaction method based on the laser signals, when the laser signals transmitted by the remote control equipment are received, first laser coordinates of the laser signals on the display panel are identified; when the first laser coordinate is detected to meet a preset condition, determining a key event corresponding to the laser signal; and determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction. In this embodiment, by identifying the position of the laser signal and the key event triggered at the position, and according to the position of the laser signal, i.e. the first laser coordinate, executing the operation corresponding to the key event triggered at the position, thereby controlling the display device to realize a specific function through the laser signal and the key event, the display device can be conveniently controlled, the technical problem that the use experience of a user is poor due to the fact that the existing remote interaction technology is difficult to meet the control requirement of the user is solved, and the use experience of the user is enriched.
Based on the first embodiment, a second embodiment of the laser signal-based interaction method of the present invention is proposed, and referring to fig. 3, in this embodiment, the step of S20 includes:
step S21, when detecting that the first laser coordinate meets a preset condition, acquiring a first key state triggered by the remote control device when emitting the laser signal;
and step S22, determining a key event corresponding to the laser signal according to the first key state.
In this embodiment, the preset condition is within a preset pixel range. After the position of the laser signal on the display panel is identified, namely the first laser coordinate is obtained, the display device compares the first laser coordinate with a preset pixel point range to determine whether the first laser coordinate meets a preset condition. If the first laser coordinate is within the range of the preset pixel point, determining that the first laser coordinate meets the preset condition; when the first laser coordinate is detected to meet a preset condition, acquiring a first key state triggered by the remote control equipment when the remote control equipment emits a laser signal; and then, determining a key event triggered when the laser signal is triggered according to the first key state corresponding to the currently identified laser signal. The key state is a corresponding key state when a corresponding key operation is triggered on a key of the remote control device, the key operation triggered on the remote control device comprises a pressing operation, a bouncing operation or no operation, correspondingly, the key state triggered by the remote control device detected by the display device comprises a pressing state, a bouncing state or no operation state, and the first key state is a key state corresponding to the first laser coordinate.
It should be noted that the first key state is derived from the remote control device, and the remote control device transmits the first key state to the display device simultaneously when transmitting the laser signal to the display device, where the first key state corresponds to the laser signal. If the user triggers a pressing operation on a key of the remote control equipment, the remote control equipment transmits a key state corresponding to the pressing operation to the display equipment; similarly, if the user triggers the pop-up operation on the key of the remote control device, the remote control device transmits the pop-up state corresponding to the pop-up operation to the display device; if the key of the remote control device is not operated currently, the display device marks the key state of the remote control device as a non-operation state at intervals of a preset time length, or the remote control device transmits the non-operation state to the display device at intervals of a preset time length.
Further, the step of determining the key event corresponding to the laser signal according to the first key state includes:
step S221, when the first key state has a corresponding last key state, acquiring a second key state corresponding to the first key state, wherein the second key state is the last key state corresponding to the first key state;
step S222, determining a key event corresponding to the laser signal according to the first key state and the second key state.
In this embodiment, it should be noted that the key state is a key state corresponding to when a corresponding key operation is triggered on a key of the remote control device, the key operation triggered on the remote control device includes a pressing operation, a pop-up operation, or no operation, correspondingly, the key state triggered by the remote control device detected by the display device includes a pressing state, a pop-up state, or no operation state, and the second key state is a key state corresponding to the first laser coordinate. When the last key state corresponding to the first key state exists, the last key state corresponding to the first key state is obtained, and the last key state corresponding to the first key state is used as a second key state; and then, judging a key event corresponding to the current laser signal by combining the first key state and the last key state corresponding to the first key state, namely the second key state.
Further, the step of determining the key event corresponding to the laser signal according to the first key state and the second key state includes:
step S223, if the first key state is a pop-up state and the second key state is a pressed state, determining that the key event is a click event;
step S224, if the first key state is a no-operation state and the second key state is a pressed state, obtaining a first laser coordinate corresponding to the second key state, and determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state.
In this embodiment, in order to determine a key event currently triggered by a user on a key of a remote control device, when detecting that a first laser coordinate meets a preset condition, a display device obtains a first key state corresponding to the first laser coordinate, and if the first key state is a bounce state, when the first key state has a corresponding last key state, obtains a last key state corresponding to the first key state within a preset time period, that is, obtains a second key state, and determines a type of the second key state; if the second key state is a pressed state, the key of the remote control equipment is changed from the pressed state to a bounced state, and the currently triggered key event is determined to be a click event; after the type of the key event is determined, the operation triggered by the current key event on the first laser coordinate is determined and executed, namely the operation triggered by the click event on the first laser coordinate is determined and executed.
If the first key state is a no-operation state, when the first key state has a corresponding last key state, acquiring the last key state corresponding to the first key state within a preset time length, namely acquiring a second key state, and determining the type of the second key state; if the second key state is the pressed state, acquiring a first laser coordinate corresponding to the second key state, and then comparing a first laser coordinate corresponding to the second key state with a first laser coordinate corresponding to the first key state, so as to determine that the key event triggered by the laser signal is a long-press event according to the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state.
Further, the step of determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state includes:
step S2241, comparing a first laser coordinate corresponding to the second key state with a first laser coordinate corresponding to the first key state;
step S2242, if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, determining that the key event is a long-press event.
In this embodiment, if the second key state is a pressed state, obtaining a first laser coordinate corresponding to the second key state, and comparing the first laser coordinate corresponding to the second key state with the first laser coordinate corresponding to the first key state, so as to determine the type of the currently triggered key event according to the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state; if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, the positions of the laser signal corresponding to the second key state and the laser signal corresponding to the first key state are unchanged, and the type of the currently triggered key event is determined to be a long-press event; after the type of the key event is determined, the operation triggered by the long-press event on the first laser coordinate is determined and executed.
Further, the step of determining the key event corresponding to the laser signal according to the first key state includes: whether the first key state is a no-operation state, a pressing state or a bounce state, when the first key state does not have the corresponding last key state, storing the first key state, and taking the first key state as a second key state; and then, acquiring a next key state corresponding to the second key state, taking the next key state corresponding to the second key state as the first key state, and executing the step of determining the key event corresponding to the laser signal according to the first key state.
Further, the step of identifying a first laser coordinate of the laser signal on the display panel when receiving the laser signal transmitted by the remote control device comprises:
step S11, when receiving a laser signal emitted by the remote control device, identifying a second laser coordinate of the laser signal on the laser sensing layer through the laser sensor;
step S12, determining the first laser coordinate of the second laser coordinate on the display panel based on the pixel mapping relationship between the laser sensing layer and the display panel, wherein the pixels of the laser sensing layer and the pixels of the display panel are in one-to-one correspondence.
In this embodiment, when the laser sensing layer of the display device identifies a laser signal, the laser signal is received, and the position of the laser signal on the display screen is identified by the laser sensor on the laser sensing layer, the position of the laser signal identified by the laser sensing layer is a second laser coordinate, and then the position coordinate of the laser signal on the laser sensing layer needs to be converted into a position coordinate on the display panel, that is, the position of the second laser coordinate on the display panel is determined according to the pixel point mapping relationship between the laser sensing layer and the display panel, so as to obtain the first laser coordinate. The pixel point mapping relation is a coordinate conversion relation between an array element laser sensor of the laser sensing layer and a display unit of the display panel, and the pixel points of the laser sensing layer and the display unit of the display panel are in one-to-one correspondence, namely the array element laser sensor of the laser sensing layer and the display unit of the display panel are in one-to-one correspondence.
The position coordinates of each unit on the laser sensing layer are predetermined, which array element laser sensor on the laser sensing layer receives the laser signal, and the position of the laser signal is the position of the array element laser sensor currently receiving the laser signal.
According to the interaction method based on the laser signal, when the first laser coordinate is detected to meet the preset condition, a first key state triggered when the remote control device emits the laser signal is obtained; and determining a key event corresponding to the laser signal according to the first key state. In this embodiment, the key event triggered at the position is determined by identifying the position of the laser signal and the key state at the position, so that the key event triggered by the user at the remote control device is identified through the laser signal and the key state, the display device is controlled to realize a specific function through the specific key event, the display device can be conveniently controlled, and the use experience of the user is enriched.
Based on the first embodiment and the second embodiment, referring to fig. 5, an exemplary process of the laser signal-based interaction method of the present invention is provided, which includes the following specific steps:
when the remote control equipment transmits a laser signal to the display equipment, a laser sensor on a laser sensing layer panel of the display equipment identifies a laser coordinate of the laser signal on a laser sensing layer, namely a second laser coordinate;
a digital signal processor FPGA of the display device acquires a second laser coordinate identified by the laser sensor and converts the second laser coordinate into a first laser coordinate which can be processed by the processor, namely the first laser coordinate on the display panel;
the method comprises the steps that a system-on-chip processor SOC of the display device reads a first laser coordinate from an FPGA and detects whether the first laser coordinate is in a pixel point range which can be displayed by a display panel;
if the first laser coordinate is within the range of the pixel point which can be displayed by the display panel, acquiring a first key state triggered by the remote control equipment based on the laser signal;
if the first key state is detected to be the bounce state, acquiring the last key state of the first key state, namely a second key state; if the second key state is a pressed state, the display equipment determines that a key event triggered by the remote control equipment based on the laser signal is a click event;
if the first key state is detected to be a no-operation state, acquiring the last key state of the first key state, namely a second key state; if the second key state is a pressed state, further acquiring a first laser coordinate corresponding to the second key state, comparing the first laser coordinate corresponding to the second key state with the first laser coordinate corresponding to the first key state, and if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, indicating that the current position of the laser signal is not changed, determining that the key event triggered by the remote control device based on the laser signal is a long press event by the display device.
In addition, an embodiment of the present invention further provides an interaction apparatus based on a laser signal, where the interaction apparatus based on a laser signal includes:
the identification module is used for identifying a first laser coordinate of a laser signal on a display panel when the laser signal transmitted by remote control equipment is received;
the first determining module is used for determining a key event corresponding to the laser signal when the first laser coordinate is detected to meet a preset condition;
and the second determining module is used for determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate and executing the operation instruction.
Further, the first determining module is further configured to:
when the first laser coordinate meets a preset condition, acquiring a first key state triggered by the remote control equipment when the laser signal is transmitted;
and determining a key event corresponding to the laser signal according to the first key state.
Further, the first determining module is further configured to:
when the first key state has a corresponding last key state, acquiring a second key state corresponding to the first key state, wherein the second key state is the last key state corresponding to the first key state;
and determining a key event corresponding to the laser signal according to the first key state and the second key state.
Further, the first determining module is further configured to:
if the first key state is a bounce state and the second key state is a press state, determining that the key event is a click event;
if the first key state is a no-operation state and the second key state is a pressed state, acquiring a first laser coordinate corresponding to the second key state, and determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state.
Further, the first determining module is further configured to:
comparing a first laser coordinate corresponding to the second key state with a first laser coordinate corresponding to the first key state;
and if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, determining that the key event is a long-press event.
Further, the first determining module is further configured to:
if the first key state does not have the corresponding last key state, storing the first key state, and taking the first key state as a second key state;
and acquiring a next key state corresponding to the second key state, taking the next key state corresponding to the second key state as the first key state, and executing the step of determining the key event corresponding to the laser signal according to the first key state.
Further, the identification module is further configured to:
when a laser signal transmitted by remote control equipment is received, identifying a second laser coordinate of the laser signal on a laser induction layer through a laser sensor;
and determining the first laser coordinate of the second laser coordinate on the display panel based on the pixel point mapping relation between the laser induction layer and the display panel, wherein the pixel points of the laser induction layer correspond to the pixel points of the display panel one to one.
Furthermore, an embodiment of the present invention further provides a readable storage medium, where a laser signal-based interaction program is stored on the readable storage medium, and the laser signal-based interaction program, when executed by a processor, implements the steps of the laser signal-based interaction method described in any one of the above.
The specific embodiment of the readable storage medium of the present invention is substantially the same as the embodiments of the interaction method based on laser signals, and will not be described in detail herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) as described above and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An interaction method based on laser signals is characterized by comprising the following steps:
when a laser signal transmitted by remote control equipment is received, identifying a first laser coordinate of the laser signal on a display panel;
when the first laser coordinate is detected to meet a preset condition, determining a key event corresponding to the laser signal;
and determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate, and executing the operation instruction.
2. The laser signal-based interaction method according to claim 1, wherein the step of determining the key event corresponding to the laser signal when detecting that the first laser coordinate satisfies a preset condition comprises:
when the first laser coordinate meets a preset condition, acquiring a first key state triggered by the remote control equipment when the laser signal is transmitted;
and determining a key event corresponding to the laser signal according to the first key state.
3. The laser signal-based interaction method of claim 2, wherein the step of determining the key event corresponding to the laser signal according to the first key state comprises:
when the first key state has a corresponding last key state, acquiring a second key state corresponding to the first key state, wherein the second key state is the last key state corresponding to the first key state;
and determining a key event corresponding to the laser signal according to the first key state and the second key state.
4. The laser signal-based interaction method of claim 3, wherein the step of determining the key event corresponding to the laser signal according to the first key state and the second key state comprises:
if the first key state is a bounce state and the second key state is a press state, determining that the key event is a click event;
if the first key state is a no-operation state and the second key state is a pressed state, acquiring a first laser coordinate corresponding to the second key state, and determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state.
5. The laser signal-based interaction method of claim 4, wherein the step of determining that the key event is a long-press event based on the first laser coordinate corresponding to the second key state and the first laser coordinate corresponding to the first key state comprises:
comparing a first laser coordinate corresponding to the second key state with a first laser coordinate corresponding to the first key state;
and if the first laser coordinate corresponding to the second key state is consistent with the first laser coordinate corresponding to the first key state, determining that the key event is a long-press event.
6. The laser signal-based interaction method of claim 2, wherein the step of determining the key event corresponding to the laser signal according to the first key state comprises:
if the first key state does not have the corresponding last key state, storing the first key state, and taking the first key state as a second key state;
and acquiring a next key state corresponding to the second key state, taking the next key state corresponding to the second key state as the first key state, and executing the step of determining the key event corresponding to the laser signal according to the first key state.
7. The laser signal-based interaction method according to any one of claims 1 to 6, wherein the step of identifying a first laser coordinate of the laser signal on the display panel upon receiving the laser signal transmitted by the remote control device comprises:
when a laser signal transmitted by remote control equipment is received, identifying a second laser coordinate of the laser signal on a laser induction layer through a laser sensor;
and determining the first laser coordinate of the second laser coordinate on the display panel based on the pixel point mapping relation between the laser induction layer and the display panel, wherein the pixel points of the laser induction layer correspond to the pixel points of the display panel one to one.
8. An interaction device based on laser signals, characterized in that the interaction device based on laser signals comprises:
the identification module is used for identifying a first laser coordinate of a laser signal on a display panel when the laser signal transmitted by remote control equipment is received;
the first determining module is used for determining a key event corresponding to the laser signal when the first laser coordinate is detected to meet a preset condition;
and the second determining module is used for determining an operation instruction triggered by the laser signal according to the key event and the first laser coordinate and executing the operation instruction.
9. A laser signal based interaction device, comprising: a memory, a processor and a laser signal based interaction program stored on the memory and executable on the processor, the laser signal based interaction program, when executed by the processor, implementing the steps of the laser signal based interaction method according to any one of claims 1 to 7.
10. A readable storage medium, on which a laser signal-based interactive program is stored, which, when executed by a processor, implements the steps of the laser signal-based interactive method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011513718.2A CN112506384B (en) | 2020-12-18 | 2020-12-18 | Interaction method, device and equipment based on laser signals and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011513718.2A CN112506384B (en) | 2020-12-18 | 2020-12-18 | Interaction method, device and equipment based on laser signals and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112506384A true CN112506384A (en) | 2021-03-16 |
| CN112506384B CN112506384B (en) | 2024-07-09 |
Family
ID=74922693
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011513718.2A Active CN112506384B (en) | 2020-12-18 | 2020-12-18 | Interaction method, device and equipment based on laser signals and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112506384B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI772184B (en) * | 2021-09-16 | 2022-07-21 | 友達光電股份有限公司 | Display system and control method |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030030622A1 (en) * | 2001-04-18 | 2003-02-13 | Jani Vaarala | Presentation of images |
| CN1756132A (en) * | 2004-09-29 | 2006-04-05 | 宏碁股份有限公司 | Remote control apparatus and control method thereof |
| DE202007006493U1 (en) * | 2007-05-07 | 2007-07-26 | Dexin Corp., Chung Ho City | Cursor control device for playing multimedia information, has media playing module that reads multimedia information in medium playing mode, where cursor control device is switchable between mouse input mode and media playing mode |
| CN202339632U (en) * | 2011-10-19 | 2012-07-18 | 康佳集团股份有限公司 | Remote controller with virtual keyboard |
| CN102662498A (en) * | 2012-04-16 | 2012-09-12 | 中科华核电技术研究院有限公司 | Wireless control method and system for projection demonstration |
| CN202584030U (en) * | 2012-01-18 | 2012-12-05 | 深圳市中科睿成智能科技有限公司 | Interactive projection system and shooting game equipment |
| CN102968245A (en) * | 2012-10-29 | 2013-03-13 | Tcl集团股份有限公司 | Method and device for cooperatively controlling mouse touch and method and system for smart television interaction |
| CN103092432A (en) * | 2011-11-08 | 2013-05-08 | 深圳市中科睿成智能科技有限公司 | Trigger control method and system of man-machine interaction operating instruction and laser emission device |
| US20130169527A1 (en) * | 1997-08-22 | 2013-07-04 | Timothy R. Pryor | Interactive video based games using objects sensed by tv cameras |
| CN104064022A (en) * | 2014-07-01 | 2014-09-24 | 北京新华春天教育科技有限公司 | Remote control method and system |
| CN104932757A (en) * | 2014-03-21 | 2015-09-23 | 中兴通讯股份有限公司 | Laser visual touch method and system |
| CN108196702A (en) * | 2017-12-27 | 2018-06-22 | 威创集团股份有限公司 | A kind of splicing video wall interactive approach and system, laser pen |
| CN109144375A (en) * | 2018-10-09 | 2019-01-04 | 中天智领（北京）科技有限公司 | A kind of screen control method and device |
| CN110456952A (en) * | 2019-06-27 | 2019-11-15 | 北京科加触控技术有限公司 | A kind of movement executes method, apparatus and system |
-
2020
- 2020-12-18 CN CN202011513718.2A patent/CN112506384B/en active Active
Patent Citations (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130169527A1 (en) * | 1997-08-22 | 2013-07-04 | Timothy R. Pryor | Interactive video based games using objects sensed by tv cameras |
| US20030030622A1 (en) * | 2001-04-18 | 2003-02-13 | Jani Vaarala | Presentation of images |
| CN1756132A (en) * | 2004-09-29 | 2006-04-05 | 宏碁股份有限公司 | Remote control apparatus and control method thereof |
| DE202007006493U1 (en) * | 2007-05-07 | 2007-07-26 | Dexin Corp., Chung Ho City | Cursor control device for playing multimedia information, has media playing module that reads multimedia information in medium playing mode, where cursor control device is switchable between mouse input mode and media playing mode |
| CN202339632U (en) * | 2011-10-19 | 2012-07-18 | 康佳集团股份有限公司 | Remote controller with virtual keyboard |
| US20140247216A1 (en) * | 2011-11-08 | 2014-09-04 | Tencent Technology (Shenzhen) Company Limited | Trigger and control method and system of human-computer interaction operation command and laser emission device |
| CN103092432A (en) * | 2011-11-08 | 2013-05-08 | 深圳市中科睿成智能科技有限公司 | Trigger control method and system of man-machine interaction operating instruction and laser emission device |
| CN202584030U (en) * | 2012-01-18 | 2012-12-05 | 深圳市中科睿成智能科技有限公司 | Interactive projection system and shooting game equipment |
| CN102662498A (en) * | 2012-04-16 | 2012-09-12 | 中科华核电技术研究院有限公司 | Wireless control method and system for projection demonstration |
| CN102968245A (en) * | 2012-10-29 | 2013-03-13 | Tcl集团股份有限公司 | Method and device for cooperatively controlling mouse touch and method and system for smart television interaction |
| CN104932757A (en) * | 2014-03-21 | 2015-09-23 | 中兴通讯股份有限公司 | Laser visual touch method and system |
| CN104064022A (en) * | 2014-07-01 | 2014-09-24 | 北京新华春天教育科技有限公司 | Remote control method and system |
| CN108196702A (en) * | 2017-12-27 | 2018-06-22 | 威创集团股份有限公司 | A kind of splicing video wall interactive approach and system, laser pen |
| CN109144375A (en) * | 2018-10-09 | 2019-01-04 | 中天智领（北京）科技有限公司 | A kind of screen control method and device |
| CN110456952A (en) * | 2019-06-27 | 2019-11-15 | 北京科加触控技术有限公司 | A kind of movement executes method, apparatus and system |
Non-Patent Citations (1)
| Title |
|---|
| 蔡睿妍;: "激光虚拟键盘的设计与实现", 激光与红外, no. 08, 20 August 2012 (2012-08-20) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI772184B (en) * | 2021-09-16 | 2022-07-21 | 友達光電股份有限公司 | Display system and control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112506384B (en) | 2024-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109525874B (en) | Screen capturing method and terminal equipment | |
| CN111107222A (en) | Interface sharing method and electronic equipment | |
| CN109240577B (en) | Screen capturing method and terminal | |
| CN110865758B (en) | Display method and electronic equipment | |
| CN111045344A (en) | Control method of household equipment and electronic equipment | |
| CN108958606B (en) | Split screen display method and device, storage medium and electronic equipment | |
| CN110231972B (en) | Message display method and terminal equipment | |
| CN108874906B (en) | Information recommendation method and terminal | |
| CN108984142B (en) | Split screen display method and device, storage medium and electronic equipment | |
| CN110868633A (en) | Video processing method and electronic equipment | |
| CN110913067A (en) | Information sending method and electronic equipment | |
| CN110825295B (en) | Application program control method and electronic equipment | |
| CN107734172B (en) | Information display method and mobile terminal | |
| CN110703972B (en) | File control method and electronic equipment | |
| CN110225180B (en) | Content input method and terminal equipment | |
| CN107748640A (en) | One kind puts out screen display methods and mobile terminal | |
| CN111274842A (en) | Method for identifying coded image and electronic equipment | |
| CN110795002A (en) | Screenshot method and terminal equipment | |
| KR20140036532A (en) | Method and system for executing application, device and computer readable recording medium thereof | |
| CN109976629A (en) | Image display method, terminal and mobile terminal | |
| CN108287644B (en) | Information display method of application program and mobile terminal | |
| CN108401173B (en) | Mobile live broadcast interactive terminal, method and computer readable storage medium | |
| CN113821417A (en) | Lamp effect adaptation display processing method, intelligent terminal and storage medium | |
| CN110309003B (en) | Information prompting method and mobile terminal | |
| EP4160364A1 (en) | Method, device, and equipment for switching text language types, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |