WO2022017421A1 - 交互方法、显示装置、发射装置、交互系统及存储介质 - Google Patents

交互方法、显示装置、发射装置、交互系统及存储介质 Download PDF

Info

Publication number
WO2022017421A1
WO2022017421A1 PCT/CN2021/107667 CN2021107667W WO2022017421A1 WO 2022017421 A1 WO2022017421 A1 WO 2022017421A1 CN 2021107667 W CN2021107667 W CN 2021107667W WO 2022017421 A1 WO2022017421 A1 WO 2022017421A1
Authority
WO
WIPO (PCT)
Prior art keywords
laser
cursor
information
interaction method
display device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/107667
Other languages
English (en)
French (fr)
Inventor
刘哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to US18/006,109 priority Critical patent/US11989352B2/en
Publication of WO2022017421A1 publication Critical patent/WO2022017421A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present application relates to the field of interaction, and in particular, to an interaction method, a display device, a transmitting device, an interaction system and a storage medium.
  • the current remote manipulation of screen content generally adopts intelligent voice or gesture interaction.
  • the distance of intelligent voice control is generally within 5 to 8 meters, the recognition accuracy is limited, and the response speed is average; the method of using an external camera to capture and sense gestures has high learning costs, low interaction accuracy, and limited range of recognition distance. Therefore, the above-mentioned long-distance interactive control has many limitations in many scenarios. At the same time, as the size of the device screen becomes larger and larger, the cost of the large capacitive touch screen is too high, so it is urgent to have high precision, which can be convenient and efficient at both distance and distance. Complete the interactive form.
  • the main purpose of the present application is to provide an interaction method, a display device, an emission device, an interaction system and a storage medium, aiming at solving how to control a screen with a long-distance laser.
  • the present application provides an interaction method, which is applied to a display device, and the method includes:
  • a corresponding operation is performed according to the operation information and the position information of the laser cursor.
  • the acquiring the operation information transmitted by the transmitting device includes:
  • performing the corresponding operation according to the operation information and the position information of the laser cursor includes:
  • the single-click operation is performed.
  • the laser sensing screen includes an interactive control area and a non-interactive control area
  • the judging whether the duration of the first single operation information in the operation information exceeds the first preset time further includes:
  • the sliding operation before performing the sliding operation, it further includes:
  • a corresponding operation is performed according to the shape of the motion track of the laser cursor or the relative vector of the starting position.
  • performing the corresponding operation according to the shape of the motion trajectory or the relative vector of the starting position includes:
  • the shape of the motion track is deemed to match the preset pattern and a corresponding operation is performed.
  • the preset pattern includes a circular pattern, a cross-shaped pattern, a larger-than-symbol pattern, and a smaller-than-symbol pattern, and the shape of the motion trajectory is deemed to match the preset pattern and perform the corresponding operation.
  • Operations include:
  • the closing operation is performed on the target object
  • performing the corresponding operation according to the shape of the motion trajectory or the relative vector of the starting position further includes:
  • the step of performing the corresponding operation if the relative vector of the motion trajectory satisfies the included angle range with the horizontal line includes:
  • the method further includes:
  • the number of the laser cursors is two or more, select the changes of the two laser cursors in which the vector of the laser cursors changes the most, and execute the corresponding operation.
  • the step of selecting the changes of the two laser cursors with the largest changes in the laser cursor vector and performing corresponding operations includes:
  • the laser signal further includes a laser spot
  • the performing the corresponding operation according to the operation information and the position information of the laser cursor includes:
  • the operation is displayed on the laser sensing screen in a preset corresponding shape of the laser spot, and the content on the laser sensing screen of the display device is controlled to perform the corresponding operation.
  • the method further includes:
  • the feedback information after the operation is completed is transmitted to the transmitting device as a vibration signal, so that the user can perceive the operation result.
  • the present application further provides an interaction method, which is applied to a transmitting device, the transmitting device has a laser transmitting module, and the method includes:
  • the acquired user operation information is converted and loaded into the laser signal and transmitted to the display device, or the acquired user operation information is transmitted to the display device as an infrared coded signal.
  • the method further includes:
  • Corresponding vibration is performed according to the feedback information, so that the user can perceive the operation result.
  • the present application further provides a display device, the display device includes: an interaction program, and the interaction program is configured to implement the steps of the above interaction method.
  • the present application further provides a transmitting device, the transmitting device comprising: an interaction program, the interaction program is configured to implement the steps of the above-mentioned interaction method.
  • the present application further provides an interactive system, including the above display device and the above emission device.
  • the present application further provides a storage medium, where an interactive program is stored on the storage medium, and the interactive program processor implements the steps of the above-mentioned interactive method when executed.
  • An interaction method proposed by an embodiment of the present application by acquiring the operation information transmitted by the transmitting device and the position information of the laser cursor emitted by the transmitting device on the laser sensing interactive screen, and responding according to the operation signal and the position information of the laser cursor
  • the control operation displays and controls the content on the laser sensing screen of the display device with the matching laser spot shape, and the position information of the laser cursor on the laser sensing screen is combined with the laser signal according to the user's operation.
  • the change response control operation through the precise content positioning of the laser signal, improves the accuracy and sensitivity of the control content, thereby realizing the efficient, convenient and accurate interaction at far and near distances.
  • the laser operation trajectory made by the user meets the rules of common touch operations and conforms to the user's cognitive habits, thereby reducing learning costs.
  • FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution according to an embodiment of the present application
  • FIG. 2 is a logic flow diagram of an interaction method based on a display device of the present application
  • Fig. 3 is a logic flow diagram of click, double click, drag, long press and slide interaction in an interaction method of the present application
  • Fig. 5 is the gesture interaction logic flow chart of the relative vector of the starting position of the motion track in a kind of interaction method of the present application
  • FIG. 6 is a logic flow diagram of gesture interaction for moving a fixed trajectory in an interaction method of the present application
  • FIG. 7 is a logic flow chart of an interaction method based on a transmitting device of the present application.
  • the content of the remote control screen in the prior art generally adopts the interactive mode of intelligent voice or gesture
  • the distance of intelligent voice control is generally within 5-8 meters
  • the recognition accuracy is limited, and the response speed is average
  • the method of capturing and sensing gestures has high learning cost, low interaction accuracy, and limited range of recognition distance. Therefore, the above-mentioned long-distance interactive manipulation has many limitations in many scenarios.
  • the present application provides a solution, by acquiring the operation signal transmitted by the transmitting device and the change of the laser cursor emitted by the transmitting device on the laser sensing interactive screen, responding to the corresponding control operation according to the operation signal and the cursor change, and controlling the operation to correspond to the corresponding control operation.
  • the laser spot shape displays and controls the content on the display device's laser-sensing interactive screen, thus solving the technical problems of limited recognition accuracy, average response speed, high learning cost, and limited range of recognition distance during the interaction process.
  • FIG. 1 is a schematic structural diagram of a terminal of a hardware operating environment involved in the solution of the embodiment of the present application.
  • the display device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, and a memory 1004; and a laser sensing module for receiving laser signals, generally a laser sensing display screen, and A processing module for identifying changes in laser position and a control module for information transmission, in which the screen for receiving laser sensing is simulated as a two-dimensional coordinate system, and the bottom left corner is set as the origin (0,0), X axis, Y axis The axes are the lowermost and leftmost ends of the laser-sensing display screen, respectively.
  • the communication bus 1002 is used to realize the connection and communication between these components.
  • the user interface 1003 may be an infrared receiving module for receiving a control instruction triggered by a user through a remote control, and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may include a standard wired interface and a wireless interface (eg, a WI-FI interface).
  • the memory 1004 may be high-speed RAM memory, or may be non-volatile memory, such as disk memory.
  • the memory 1004 may also be a storage device independent of the aforementioned processor 1001 .
  • FIG. 1 does not constitute a limitation to the present application, and may include more or less components than the one shown, or combine some components, or arrange different components.
  • the memory 1004 as a computer storage medium may include an operating system, a network communication module, a user interface module and an interactive program.
  • the user interface 1003 is mainly used to connect to the client (client) and perform data communication with the client; while the processor 1001 can be used to call the interactive program stored in the memory 1004 and perform the following operations :
  • the corresponding operation is performed according to the operation information and the position information of the laser cursor.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the operation signal transmitted by the transmitting device is received.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the duration of the first single operation does not exceed the first preset time, then determine whether there is an adjacent second single operation information acquired within the second preset time of the first single operation;
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the corresponding operation is performed according to the shape of the laser cursor movement track or the relative vector of the starting position.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the shape of the motion track is deemed to match the preset pattern and a corresponding operation is performed.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the pause operation is performed on the target object
  • the corresponding operation is performed on the previous object adjacent to the target object.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the operation is displayed on the laser sensing screen in the corresponding shape of the preset laser spot, and the content on the laser sensing screen of the display device is controlled to perform the corresponding operation.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • the feedback information after the operation is completed is transmitted to the transmitting device as a vibration signal, so that the user can perceive the operation result.
  • the processor 1001 can be used to call the interactive program stored in the memory 1004, and perform the following operations:
  • the acquired user operation information is converted and loaded into the laser signal and transmitted to the display device, or the acquired user operation information is transmitted to the display device as an infrared coded signal.
  • processor 1001 can be used to call the interactive program stored in the memory 1004, and also perform the following operations:
  • Corresponding vibration is performed according to the feedback information, so that the user can perceive the operation result.
  • the present application provides a logic flow diagram of an interaction method based on a display device, which is applied to a display device, and the method includes:
  • Step S10000 receiving the laser signal emitted by the transmitting device, and displaying the laser signal on the laser sensing screen with a laser cursor.
  • the display device in this embodiment also has a laser receiving system for receiving and processing laser signals.
  • the visualization device includes a laser-sensing screen and a receiving module that is paired and connected with the transmitting device.
  • the method includes infrared coding pairing, the transmitting device includes a laser controller, laser pointer and other devices with laser emission function, the display device is a device with a laser sensing module, and the display device includes a laser sensing screen; because the laser has a monochrome color It has the characteristics of good stability, good coherence, good directionality and high brightness. Therefore, the laser can not only be used at a short distance, but also can maintain a certain stability when used at a long distance.
  • the color of the laser can be changed according to actual needs.
  • the laser sensing screen of the display device receives the laser signal emitted by the transmitting device.
  • the laser signal displayed on the laser sensing screen is composed of laser spots with different shapes centered on the laser cursor and surrounding the laser cursor.
  • the laser spots are different from those used in this application. different shapes in different applications or in different scenarios.
  • Step S20000 acquiring position information of the laser cursor on the laser sensing screen.
  • the emitting device changes the emission angle or direction of the laser signal
  • the position of the laser cursor of the laser signal displayed on the sensing screen will also change accordingly
  • the laser sensing module of the display device receives the laser signal and feeds back the laser signal.
  • the coordinate position of the cursor is given to the display device. Therefore, the laser sensing module can timely transmit relevant position information and position changes on the laser sensing module to the processing module of the display device for analysis and processing.
  • Step S30000 acquiring the operation information transmitted by the transmitting device.
  • acquiring the operation information transmitted by the transmitting device includes analyzing the laser signal to obtain the operation signal transmitted by the transmitting device, the user transmits the target operation information through the physical keys of the transmitting device, and the operation signal passes through the receiving module inside the transmitting device and is converted into an electrical signal , and then the electrical signal is recoded to load the operation information into the laser light signal, so that the user's operation signal can be transmitted through the laser.
  • the laser receiving sensor receives the laser signal carrying the operation signal, by analyzing the laser signal, Get the operation signal in it. Real-time transmission of operation signals of user keys is realized, wherein the transmitted operation signals include single-click operation, double-click operation and long-press operation.
  • acquiring the operation information transmitted by the transmitting device further includes receiving the operation signal transmitted by the transmitting device, wherein the transmission of the operation signal is performed by converting the operation signal into an electrical signal through the receiver of the transmitting device and then encoding it first. , and then modulate, infrared modulation or wireless frequency modulation, amplitude modulation, convert it into a wireless signal and send it out, the receiver receives the radio wave carrying the information, amplifies, decodes it, and obtains the original operation signal, which realizes the operation signal of the user's button.
  • Real-time transmission in which the transmitted operation signals include single-click operation, double-click operation and long-press operation.
  • Step S40000 perform a corresponding operation according to the operation information and the position information of the laser cursor.
  • the execution of different operations is realized, wherein different operations correspond to different lasers
  • the shape of the light spot allows users to intuitively understand the specific operation, thereby improving the efficiency of control.
  • an interaction method by acquiring the operation information transmitted by the transmitting device and the position information of the laser cursor emitted by the transmitting device on the laser sensing interactive screen, and responding to the corresponding control operation according to the operation signal and the position information of the laser cursor , the control operation displays and controls the content on the laser sensing screen of the display device with a matching laser spot shape, and the position information of the laser cursor on the laser sensing screen changes according to the user's operation combined with the laser signal.
  • Content positioning improves the accuracy and sensitivity of controlling content, thereby realizing efficient, convenient, and accurate interaction at far and near distances.
  • the present application provides a logic flow diagram of click, double click, drag, long press, and slide interaction in an interaction method. Based on the embodiment shown in FIG. 2 above, according to the operation information and the The corresponding operations performed on the location information include:
  • Step S41000 judging whether the duration of the first single operation information in the operation information exceeds a first preset time.
  • the display device compares the duration of the first single operation obtained in the obtained operation information through the first preset time, and determines the duration of the operation information transmitted in the first single operation information.
  • Step S41200 if the duration of the first single operation does not exceed the first preset time, determine whether there is an adjacent second single operation information acquired within the second preset time of the first single operation. For example, if the first preset time is 1 second, the second preset time is 0.5 seconds, and the duration of the first single operation is 0.6 seconds, then because the 0.6 second of the first single operation is less than the first preset time 1 seconds, then it is further necessary to judge whether a new operation signal is received within the second preset time of 0.5 seconds.
  • Step S41210 if there is an adjacent second single operation information obtained within the second preset time of the first single operation, respond to the double-click operation;
  • the display device receives the double-click operation signal, and then executes the double-click operation in time, wherein the double-click operation is performed in different scenarios There will be some differences. For example, in the wake-up scene, by double-clicking, after the laser-sensing large screen goes to sleep, double-clicking can quickly wake up and activate the large laser screen, so as to achieve normal interaction, and the sleep time can be adjusted according to the actual situation. In zoom scenarios, such as map applications, double-click the map screen to zoom in on the original image scale. For the blank area where the laser cursor is located, the double-click operation feedback is empty, and the display device will still perform the double-click operation.
  • Step S41220 if there is no adjacent second single operation information obtained within the second preset time of the first single operation, execute a single-click operation.
  • no new operation information is obtained within the second preset time after obtaining the first single operation signal, it means that the user only performs a single-click operation, and the display device receives the click operation signal, and can timely Response to realize content selection, confirmation, playback and other operations, according to the matching logic according to different applications, respond to different laser spot shapes, and perform the function of response; under the premise that the laser cursor is displayed on the laser sensing screen, if the blank area where the laser cursor is located is targeted , the click action feedback is empty, and the display device will still respond to the click interaction.
  • This embodiment provides a single-click and double-click interaction method.
  • the laser cursor moves freely on the sensing screen.
  • the control operation is performed according to the user's operation combined with the change of the position information of the laser cursor on the laser sensing screen by the laser signal.
  • the type of operation performed by the user satisfies the rules of common touch operations and conforms to the user's cognitive habits, thereby reducing the cost of learning;
  • the accuracy and sensitivity of the control content are improved. It realizes efficient, convenient and accurate interaction at far and near distances.
  • the display effect of the focus activation state of the interactive space is realized.
  • the display device After the laser cursor is moved to an interactive control, the display device The display content of the display will be enlarged by 25%, and the shape of the light spot will also change to a certain extent.
  • a more intuitive and eye-catching way is used to inform the user of the location of the current interactive focus area, such as the increase of the laser light spot. The more eye-catching color. If it is in the non-interactive control area, the laser signal is only displayed in the form of a cursor on the sensing screen.
  • an interactive embodiment of long pressing, dragging, and sliding in an interaction method of the present application based on the embodiment shown in FIG. 2 , the laser sensing screen includes an interactive control area and a non-interactive control area. Whether the duration of the operation information exceeds the first preset time also includes:
  • Step S41100 if the duration of the operation information exceeds the first preset time, determine whether the position information of the laser cursor changes;
  • Step S41120 if the position information of the laser cursor does not change, perform a long-press operation.
  • the preset first preset time is 1 second
  • the duration of the first single operation exceeds 1 second
  • the outer circle of the laser cursor will be displayed as a preset long-press light spot
  • the inner circle indicated by the cursor will be displayed.
  • the long-press operation can achieve different functions, including arousing the secondary function menu, quick response operations and other functions; in the arousing scene, for example, in the playback map In the screen, long press the operation to open the setting menu item, and perform further operations on the secondary menu such as playback rate, subtitles, screenshots, etc.; in the fast response operation scenario, for example, in the map application, long press the "-" icon , you can quickly zoom out on the map.
  • Step S41110 if the position information of the laser cursor changes, determine whether the position of the laser cursor is in the interactive control area;
  • Step S41111 if the position of the laser cursor is in the interactive control area, perform a drag operation
  • the change of the coordinates of the laser cursor projected on the laser sensing screen is obtained, and when the coordinate position of the projected laser cursor changes, it is further judged whether the position of the laser cursor is within Interactive control area, where the interactive area refers to the display area where interactive controls such as menu interface buttons, tabs, hyperlinks, and clickable interactive icons are located; if the position of the laser cursor changes in the interactive control area, a motion trajectory is generated , by moving the laser coordinates from the initial position to the target position to realize the movement of the target content, for example, drag and drop the application software in the TV menu from one area to another position; drag and drop the frequently concerned pages in the TV interface to the first One-screen display, and the position can be adjusted freely; it can also be used in a device with efficient browsing of 3D content, such as a 3D globe, to simulate rotating the globe and quickly and easily turn to the map information of the target area.
  • 3D content such as a 3D globe
  • Step S41112 if the position of the laser cursor is not in the interactive control area, perform a sliding operation.
  • the change of the laser cursor projected on the laser sensing screen is obtained according to the change of the spatial position information of the transmitting device.
  • the coordinate position of the projected laser cursor changes, that is, the laser cursor is in the non-interactive control area.
  • the movement trajectory is generated by the position change.
  • the position change of the laser cursor in the non-interactive control area produces the displacement operation is defined as: Swipe operation, the functions implemented by the swipe operation in different applications are different, and can include functions such as air drawing and trajectory response. For different applications, corresponding changes will occur. For example, after entering the air drawing app, the response drawing operations; in other applications, perform track operations.
  • This embodiment provides a method for long-pressing, dragging, and sliding interaction, wherein the long-pressing operation realizes functions such as waking up for specific software and quickly executing operations, and the dragging and sliding operations are based on the spatial position of the transmitting device.
  • the change causes the laser cursor to generate a corresponding motion trajectory on the sensing screen, and realizes the effect of moving the target content to the target position.
  • the laser operation made by the user meets the laws of common touch operations and conforms to the user's cognitive habits, thereby reducing Learning cost; and then through the precise content positioning of the laser signal, the accuracy and sensitivity of the control content are improved, thereby realizing the efficient, convenient and accurate interaction at far and near distances.
  • the present application provides a logic flow diagram of gesture interaction in an interaction method. Based on the embodiments shown in FIGS. 2 and 3 , before performing the sliding operation, it further includes:
  • Step S50000 acquiring the number of laser cursors on the laser sensing screen.
  • Step S51000 if the number of laser cursors is 1, determine the shape of the laser cursor movement track and the relative vector of the starting position.
  • Step S51100 perform a corresponding operation according to the shape of the laser cursor movement track or the relative vector of the starting position.
  • a display device with a laser sensing screen can be paired with multiple emitting devices. Therefore, when a control operation needs to be performed through gesture interaction, the laser signal on the laser sensing screen, that is, the number of laser cursors, needs to be acquired. The number of acquired laser cursors is 1. The user long presses the operation button of the transmitting device. When the laser cursor is in the non-interactive control position, the user changes the laser cursor projected on the laser sensing screen by changing the spatial position of the transmitting device.
  • the position, the movement trajectory formed by the movement can be acquired and recognized by the display device, and the specific trajectory type can be determined by judging the shape of the trajectory and the relative vector of the starting position of the laser cursor, and the type of trajectory that can be responded includes a fixed pattern.
  • the movement trajectory and the movement trajectory of the starting direction can realize the corresponding operation with the matching situation of the preset pattern and direction.
  • a gesture interaction method for a single laser controller which determines the specific trajectory type by judging the shape of the trajectory and the relative vector of the starting position of the laser cursor through the motion trajectory generated by the movement of the laser cursor, so as to realize The corresponding operation is realized according to the matching situation of the preset pattern and direction.
  • the present application provides a logic flow diagram of gesture interaction for moving a fixed trajectory in an interaction method. Based on the embodiment shown in FIG. 4 , the corresponding motion is performed according to the shape of the motion trajectory or the relative vector of the starting position. Operations include:
  • Step S51200 judging the matching degree between the shape of the laser motion track and the preset pattern.
  • Step S51210 if the matching degree between the shape of the motion track and the preset pattern is greater than the preset matching threshold, the shape of the motion track is deemed to match the preset pattern and a corresponding operation is performed.
  • the display device will pre-store a circular pattern, a cross-shaped pattern, a larger-than-symbol pattern, and a smaller-than-symbol pattern to respond to the corresponding interaction.
  • the system will pre-determine the pattern of the trajectory and The matching degree of the pre-stored pattern of the display device is obtained by judging the similarity between the pattern of the trajectory and the preset pattern.
  • the preset matching degree is greater than 60%, and the shape of the motion trajectory and the preset pattern are determined.
  • the matching degree is greater than 60%, the corresponding interaction can be realized; in the case of meeting the preset matching degree, the pattern formed by the motion trajectory of the laser cursor will perform corresponding operations, that is, the shape of the motion trajectory matches the fork pattern, then the Closing the target object
  • the closing/enlargement/reduction operations in this embodiment are all performed on the target object, and the target object is the operation object selected by the user in the current display screen, such as a picture, a video being played, and the like. If the shape matching of the motion trajectory is greater than the symbol pattern, the corresponding operation is performed on the next object adjacent to the target object, and the next object adjacent to the target object corresponds to the target object, specifically the next object adjacent to the target object.
  • next object is a video
  • the playback operation of the next video is performed, and when the next object is a picture, the viewing operation is performed; the shape of the motion track matches If it is smaller than the symbol pattern, the corresponding operation is performed on the previous object adjacent to the target object, where the previous object adjacent to the target object can be the previous video, the previous picture, the previous page of the document, etc.
  • the movement trajectory similar to a circle can control whether the target interface is paused or not, the cross-shaped pattern will control whether the target interface is closed or not, and the greater or less than symbol will control the application to select the previous object or the next object, which conforms to the basic operation type.
  • a gesture interaction method for a single laser controller to move a fixed trajectory is provided.
  • the motion trajectory generated by the movement of the laser cursor under the condition that the trajectory is a fixed trajectory, the similarity between the motion trajectory and the preset pattern is compared by comparing the motion trajectory.
  • Matching degree when the preset matching range is met, the corresponding interactive operation is realized, in which the laser operation trajectory made by the user meets the laws of common touch operations and conforms to the user's cognitive habits, thereby reducing the learning cost;
  • the laser signal Precise content positioning improves the accuracy and sensitivity of controlling content, thus realizing efficient, convenient and accurate interaction at far and near distances.
  • the present application provides a gesture interaction logic flow chart of the relative vector of the starting position of the motion track in the interaction method, based on the embodiment of Fig. 4, according to the shape of the motion track or the relative vector of the starting position. Performing corresponding operations also includes:
  • Step S51110 determine whether the relative vector of the starting position of the motion track satisfies the included angle range with the horizontal line.
  • Step S51111 if the relative vector of the motion track satisfies the included angle range with the horizontal direction, perform the corresponding operation.
  • the relative vector of the starting position generated by the motion trajectory of the laser cursor is further determined, wherein
  • the relative vector may include a leftward vector, an upward or downward vector, and a rightward vector, and then a corresponding return operation, an up and down scrolling operation, and a rightward scrolling operation are performed according to the specific relative vector.
  • the specific direction can be determined according to the angle range between the relative vector and the horizontal direction, and different functions are displayed in different scenarios according to the different sliding directions.
  • the preset angle range of the right sliding operation is [0°, 45°] or [315°, 360°].
  • the relative vector of the laser cursor is 40 degrees
  • the right sliding operation is performed. Operation, in the picture application, for viewing the unpreviewed picture, you can scroll to the right to view it, and you can also scroll right in the application displayed on the horizontal screen page to view the page of the same level.
  • the preset angle range of the upward sliding operation is (45°, 135°). For example, when the relative vector angle of the laser cursor is 90 degrees, the upward sliding operation is performed.
  • the preset angle range of the downward sliding operation is (225°, 315°).
  • the relative vector angle of the laser cursor is 270 degrees
  • the downward sliding operation is performed;
  • functions such as page content moving up and down and page turning can be realized.
  • browsing information on a vertical page similar to the mobile phone browsing page, the page can be scrolled up and down through the page turning function.
  • the preset angle range of the left sliding operation is [135°, 225°].
  • the left sliding operation is performed; when sliding left , to realize the function of returning to the upper level of the content in the scene.
  • the relative vector angle of the laser cursor is 220 degrees
  • the left sliding operation is performed; when sliding left , to realize the function of returning to the upper level of the content in the scene.
  • the content of the screen interface is returned to the previous level, thereby realizing the purpose of selecting TV drama programs.
  • each angle may be: 0° ⁇ A ⁇ B ⁇ 90° ⁇ C ⁇ 180° ⁇ D ⁇ 270° ⁇ E ⁇ F ⁇ 360°, as known to those skilled in the art
  • the angle range corresponding to each operation can be changed according to the specific situation.
  • a gesture interaction method is provided.
  • the position of the laser cursor is in a non-interactive control area, the relative vector information of the laser cursor projected by the transmitting device on the sensing screen is judged, so as to match the corresponding control
  • the operation realizes the specific operation of the specific content, in which the laser operation trajectory made by the user meets the rules of common touch operations and conforms to the user's cognitive habits, thereby reducing the learning cost and the operation of the action is simple and easy to understand, accurate through the laser signal
  • the content positioning improves the accuracy and sensitivity of the control content, thereby realizing the efficient, convenient and accurate interaction at far and near distances.
  • the gesture interaction method is given priority. After the app that draws from the air is applied, it responds to the basic sliding interaction and performs the drawing operation; for specific applications, such as browsing video content, the gesture sliding interaction is given priority; And in other applications, in response to trajectory manipulation.
  • the present application provides an embodiment of zoom-in or zoom-out interaction in an interaction method, and obtaining the number of laser cursors on the laser sensing screen further includes:
  • step S52000 if the number of laser cursors is more than two, select the change situation of the two laser cursors with the largest laser cursor vector change and execute the corresponding operation.
  • the display device obtains the number of laser cursors on the laser sensing screen. Since the display device can realize the laser signals emitted by multiple transmitting devices, when the number of received laser cursors is more than two, the number of laser cursors received is obtained by comparison. The changes of the two laser cursors with the largest changes in the laser cursor vector are used as the carrier of gesture interaction judgment, and then corresponding operations are performed.
  • judging the change of the vector generated by the change of the relative position of the acquired laser cursor, and selecting the change of the two vectors with the largest change as the carrier of the interactive control where if the distance between the two laser cursors gradually decreases, For example, if the two laser cursors move towards each other, the zoom-out operation is performed to realize the function of dynamic zooming out of the content; if the distance between the two laser cursors gradually increases, for example, the two laser cursors move away from each other, the zoom-in operation is performed. Realize the function of dynamic enlargement of content.
  • a zoom-in or zoom-out interaction method is provided. Under the control of multiple laser controllers, the change of the two laser cursor vectors with the largest change is obtained by comparison, and it is used as the carrier of gesture interaction movement. Then, by judging the value of the relative position distance change of the two laser cursors, the operation interaction of zooming in or zooming out is realized, in which the laser operation made by the user conforms to the law of common touch operations, which reduces learning under the user's cognitive habits. Cost, according to the target content to operate, improve the accuracy and sensitivity of the control content, so as to realize the efficient, convenient and accurate completion of the long-distance interaction.
  • performing corresponding operations according to the operation information and the position information of the laser cursor includes:
  • the operation is displayed on the laser sensing screen in the corresponding shape of the preset laser spot, and the content on the laser sensing screen of the display device is controlled to perform the corresponding operation.
  • performing corresponding operations according to the operation information and the position information of the laser cursor includes:
  • the feedback information after the operation is completed is transmitted to the transmitting device as a vibration signal, so that the user can perceive the operation result.
  • a tactile feedback interaction is provided after the execution of the operation is completed, the completed signal is transmitted by using a vibration signal through the original signal receiving channel, so as to realize the purpose of timely tactile feedback of the interaction information to the user.
  • the feedback signal can also be that when there is an error in the execution or the execution does not match the preset, the user can feel the problem by feeding back the vibration signal, so as to realize real-time feedback and improve the purpose of precise user interaction in laser sensing. .
  • the present application provides a logic flow diagram of an interaction method based on a transmitting device, which is applied to a transmitting device, and the method includes:
  • Step S60 detecting whether the laser emission is turned on
  • Step S61 if the laser emission is turned on, obtain a user operation signal
  • step S62 the acquired user operation information is converted and loaded into the laser signal and transmitted to the display device, or the acquired user operation information is transmitted to the display device as an infrared coded signal.
  • the operation information of the user is acquired and transmitted, wherein the transmitted operation information is converted into an electrical signal by the receiving module inside the transmitting device, and then the electrical signal is recoded to carry the operation information into the electrical signal. into the laser light signal, so that the user's operation signal can be transmitted through the laser, and the transmitted operation signal includes single-click operation, double-click operation and long-press operation.
  • the transmission of the operation information also includes converting the operation signal into an electrical signal through the receiver of the transmitting device, first coding, then modulating, infrared modulation or wireless frequency modulation, amplitude modulation, converting it into a wireless signal and sending it out, wherein the transmitted operation signal includes: Click, double-click, and long-press.
  • an interaction method based on a transmitting device is provided. After the laser controller is turned on, the operation information is transmitted through the physical keys of the controller, and then the operation signal is transmitted through the loaded optical signal or through the wireless infrared signal through data encoding. Then, according to the spatial position change and key operation of the user-controlled transmitting device, the operation signal and the position information change are transmitted to the display device in time, thereby realizing the corresponding interactive operation.
  • the present application provides a method for receiving feedback information of laser interactive operation, and the method further includes:
  • Step S63 acquiring feedback information transmitted by the display device
  • step S64 corresponding vibration is performed according to the feedback information, so that the user can perceive the operation result.
  • a laser interactive feedback method is provided.
  • the information fed back by the display device is received through the induction receiving module of the transmitting device, and the received feedback signal is transmitted to the control button of the transmitting end as a vibration signal through data encoding, so as to realize The purpose of delivering the feedback signal to the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

一种交互方法、显示装置、发射装置、交互系统及存储介质，接收发射装置发射的激光信号，激光信号以激光光标显示在显示装置的激光感应屏幕上（S10000），获取激光光标在激光感应屏幕上的位置信息（S20000），获取发射装置传输的操作信息（S30000），根据操作信息和激光光标的位置信息执行对应的操作（S40000）。使用户在远近距离都能便捷精准高效完成交互。

Description

交互方法、显示装置、发射装置、交互系统及存储介质
本申请要求申请日为2020年7月23日、申请号为202010720160.9、发明名称为“交互方法、显示装置、发射装置、交互系统及存储介质”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及交互领域，尤其涉及一种交互方法、显示装置、发射装置、交互系统及存储介质。
 背景技术
随着当前交互系统的广泛应用，尤其是非接触式交互操作，目前远距离操控屏幕的内容一般采用智能语音或手势的交互方式。
 技术问题
因智能语音操控的距离一般在5～8米之内，识别精度受限，响应速度一般；而采用外接摄像头来捕捉和感应手势的方法，学习成本高，交互精度低，识别距离的范围有限，所以上述远距离交互操控在很多场景，均存在非常多的限制，同时随着设备屏幕的尺寸越来越大，电容式触控大屏成本过高，因而亟需高精度远近距离都可以便捷高效完成交互的形态。
 技术解决方案
本申请的主要目的在于提供一种交互方法、显示装置、发射装置、交互系统及存储介质，旨在解决如何远距离激光操控屏幕。
为实现上述目的，本申请提供一种交互方法，应用于显示装置，所述方法包括：
接收发射装置发射的激光信号，所述激光信号以激光光标显示在所述显示装置的激光感应屏幕上；
获取所述激光光标在所述激光感应屏幕上的位置信息；
获取所述发射装置传输的操作信息；
根据所述操作信息和所述激光光标的位置信息执行对应的操作。
可选地，所述获取所述发射装置传输的操作信息包括：
解析所述激光信号获得所述发射装置传输的操作信号；
或者，接收所述发射装置发射的操作信号。
可选地，所述根据所述操作信息和所述激光光标的位置信息执行对应的操作包括：
判断所述操作信息中的第一单次操作信息的持续时间是否超过第一预设时间；
若所述第一单次操作的持续时间不超过第一预设时间，则判断在所述第一单次操作的第二预设时间内是否获取有一个相邻的第二单次操作信息；
若在所述第一单次操作的第二预设时间内获取有一个相邻的第二单次操作信息，则执行双击操作；
若在所述第一单次操作的第二预设时间内未获取有一个相邻的第二单次操作信息，则执行单击操作。
可选地，所述激光感应屏幕包括交互的控件区域和非交互的控件区域，所述判断操作信息中的第一单次操作信息的持续时间是否超过第一预设时间还包括：
若所述第一操作信息的持续时间超过第一预设时间，则判断所述激光光标的位置信息是否发生变化；
若所述激光光标的位置信息未发生变化，则执行长按操作；
若所述激光光标的位置信息发生变化，则判断所述激光光标的位置是否在所述交互控件区域；
若所述激光光标的位置在所述交互控件区域，则执行拖拽操作；
若所述激光光标的位置不在所述交互控件区域，则执行滑动操作。
可选地，所述执行滑动操作之前还包括：
获取所述激光感应屏幕上的激光光标数量；
若所述激光光标的数量为1，则判断所述激光光标运动轨迹的形状和起始位置的相对矢量；
根据所述激光光标运动轨迹的形状或起始位置的相对矢量来执行对应的操作。
可选地，所述根据所述运动轨迹的形状或起始位置的相对矢量来执行对应的操作包括：
判断所述激光运动轨迹的形状与所述预设图案的匹配度；
若所述运动轨迹的形状与所述预设图案的匹配度大于预设匹配阈值，则所述运动轨迹的形状视为与所述预设的图案相匹配并执行对应的操作。
可选地，所述预设图案包括圆形图案、叉形图案、大于符号图案、小于符号图案，所述则所述运动轨迹的形状视为与所述预设的图案相匹配并执行对应的操作包括：
所述运动轨迹的形状匹配所述圆形图案，则对目标对象执行暂停操作；
所述运动轨迹的形状匹配所述叉形图案，则对目标对象执行关闭操作；
所述运动轨迹的形状匹配所述大于符号图案，则对与目标对象相邻的下一个对象执行相应操作；
所述运动轨迹的形状匹配所述小于符号图案，则对与目标对象相邻的上一个对象执行相应操作。
可选地，所述根据所述运动轨迹的形状或起始位置的相对矢量来执行对应的操作还包括：
判断所述运动轨迹的起始位置的相对矢量是否满足与水平线的夹角范围；
若所述运动轨迹的相对矢量满足与水平线的夹角范围则执行对应的操作。
可选地，所述若所述运动轨迹的相对矢量满足与水平线的夹角范围则执行对应的操作的步骤包括：
若所述运动轨迹的相对矢量与水平线的夹角处于[A,B]或[E,F]，则执行向右滑动的操作；
若所述运动轨迹的相对矢量与水平线的夹角处于（B,C），则执行向上滑动的操作；
若所述运动轨迹的相对矢量与水平线的夹角处于[C,D]，则执行向左滑动的操作；
若所述运动轨迹的相对矢量与水平线的夹角处于(D,E），则执行向下滑动的操作，其中0°≦A<B<C<D<E<F≦360°。
可选地，所述获取所述激光感应屏幕上的激光光标数量之后，还包括：
若所述激光光标数量为两个以上及以上，则选择其中所述激光光标矢量变化最大的两个激光光标的变化情况并执行对应的操作。
可选地，所述选择其中所述激光光标矢量变化最大的两个激光光标的变化情况并执行对应的操作的步骤包括：
若两个激光光标之间的距离逐渐变小，则执行缩小操作；
若两个激光光标之间的距离逐渐变大，则执行放大操作。
可选地，所述激光信号还包括激光光斑，所述根据所述操作信息和所述激光光标的位置信息执行对应的操作包括：
所述操作以预设的所述激光光斑的对应形状显示在所述激光感应屏幕上并控制所述显示装置激光感应屏幕上的内容执行对应的操作。
可选地，所述根据所述操作信息和所述激光光标的位置信息执行对应的操作之后还包括：
执行操作完成后的反馈信息以振动信号传输至所述发射装置，以使得用户感知操作结果。
为了实现上述目的，本申请还一种交互方法，应用于发射装置，所述发射装置具有激光发射模块，所述方法包括：
检测激光发射是否开启；
若激光发射开启，获取用户操作信号；
将所述获取的用户操作信息转换后载入到所述激光信号中并传输至所述显示装置或者将所述获取的用户操作信息以红外编码信号传输至所述显示装置。
可选地，所述方法还包括：
获取所述显示装置传输的反馈信息；
根据所述反馈信息进行对应的振动，以使得用户感知操作结果。
为实现上述目的，本申请还提供一种显示装置，所述显示装置包括：交互程序，所述交互程序配置为实现如上述交互方法的步骤。
本申请还提供一种发射装置，所述发射装置包括：交互程序，所述交互程序配置为实现如上述交互方法的步骤。
为实现上述目的，本申请还提供一种交互系统，包括上述显示装置，以及上述发射装置。
为实现上述目的，本申请还提供一种存储介质，所述存储介质上存储有交互程序，所述交互程序处理器执行时实现如上述交互方法的步骤。
 有益效果
本申请实施例提出的一种交互方法，通过获取发射装置传输的操作信息以及发射装置发射在激光感应交互屏幕上的激光光标的位置信息，根据所述操作信号和所述激光光标的位置信息响应相应的控制操作，所述控制操作以相匹配的所述激光光斑形状显示并控制所述显示装置激光感应屏幕上的内容，根据用户的操作结合激光信号在激光感应屏幕上的激光光标的位置信息变化响应控制操作，通过激光信号精确的内容定位，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
此外，用户所作出的激光操作轨迹满足常见触控操作的规律，符合用户的认知习惯，从而降低学习成本。
 附图说明
图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图；
图2是本申请一种基于显示装置的交互方法的逻辑流程图；
图3是本申请一种交互方法中单击、双击、拖拽、长按、滑动交互的逻辑流程图；
图4是本申请一种交互方法中手势交互的逻辑流程图；
图5是本申请一种交互方法中运动轨迹起始位置的相对矢量的手势交互逻辑流程图；
图6是本申请一种交互方法中移动固定轨迹的手势交互的逻辑流程图；
图7为本申请一种基于发射装置的交互方法的逻辑流程图。
本申请目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
 本发明的实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
本申请实施例的主要解决方案是：
由于现有技术的远距离操控屏幕的内容一般采用智能语音或手势的交互方式，因智能语音操控的距离一般在5～8米之内，识别精度受限，响应速度一般；而采用外接摄像头来捕捉和感应手势的方法，学习成本高，交互精度低，识别距离的范围有限，所以上述远距离交互操控在很多场景，均存在非常多的限制。
本申请提供一种解决方案，通过获取发射装置传输的操作操作信号以及发射装置发射在激光感应交互屏幕上的激光光标变化，根据操作信号和光标变化响应相应的控制操作，控制操作以相对应的激光光斑形状显示并控制显示装置激光感应交互屏幕上的内容，从而解决了交互过程中识别精度受限、响应速度一般、学习成本高、识别距离的范围有限的技术问题。
如图1所示，图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图。
如图1所示，该显示装置可以包括：处理器1001，例如CPU，通信总线1002，用户接口1003，存储器1004；还包括用于接收激光信号的激光感应模块，一般为激光感应显示屏幕，以及用于识别激光位置变化的处理模块及信息传输的控制模块，其中将用于接收激光感应的屏幕模拟为一个二维坐标系，将最左下角设置为原点（0,0），X轴、Y轴分别为激光感应显示屏幕的最下端、最左端。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以红外接收模块，用于接收用户通过遥控器触发的控制指令，可选的用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口（如WI-FI接口）。存储器1004可以是高速RAM存储器，也可以是稳定的存储器（non-volatile memory），例如磁盘存储器。存储器1004可选的还可以是独立于前述处理器1001的存储装置。
本领域技术人员可以理解，图1中示出的结构并不构成对本申请的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
如图1所示，作为一种计算机存储介质的存储器1004中可以包括操作系统、网络通信模块、用户接口模块以及交互程序。
在图1所示的终端中，用户接口1003主要用于连接客户端（用户端），与客户端进行数据通信；而处理器1001可以用于调用存储器1004中存储的交互程序，并执行以下操作：
接收发射装置发射的激光信号，激光信号以激光光标显示在显示装置的激光感应屏幕上；
获取激光光标在激光感应屏幕上的位置信息；
获取发射装置传输的操作信息；
根据操作信息和激光光标的位置信息执行对应的操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
解析激光信号获得发射装置传输的操作信号；
或者，接收发射装置发射的操作信号。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
判断操作信息中的第一单次操作信息的持续时间是否超过第一预设时间；
若第一单次操作的持续时间不超过第一预设时间，则判断在第一单次操作的第二预设时间内是否获取有一个相邻的第二单次操作信息；
若在第一单次操作的第二预设时间内获取有一个相邻的第二单次操作信息，则执行双击操作；
若在第一单次操作的第二预设时间内未获取有一个相邻的第二单次操作信息，则执行单击操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
若操作信息的持续时间超过第一预设时间，则判断激光光标的位置信息是否发生变化；
若激光光标的位置信息未发生变化，则执行长按操作；
若激光光标的位置信息发生变化，则判断激光光标的位置是否在交互控件区域；
若激光光标的位置在交互控件区域，则执行拖拽操作；
若激光光标的位置不在交互控件区域，则执行滑动操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
获取激光感应屏幕上的激光光标数量；
若激光光标的数量为1，则判断激光光标运动轨迹的形状和起始位置的相对矢量；
根据激光光标运动轨迹的形状或起始位置的相对矢量来执行对应的操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
判断激光运动轨迹的形状与预设图案的匹配度；
若运动轨迹的形状与预设图案的匹配度大于预设匹配阈值，则运动轨迹的形状视为与预设的图案相匹配并执行对应的操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
运动轨迹的形状匹配圆形图案，则对目标对象执行暂停操作；
运动轨迹的形状匹配叉形图案，则对目标对象执行关闭操作；
运动轨迹的形状匹配大于符号图案，则对与目标对象相邻的下一个对象执行相应操作；
运动轨迹的形状匹配小于符号图案，则对与目标对象相邻的上一个对象执行相应操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
判断运动轨迹的起始位置的相对矢量是否满足与水平线的夹角范围；
若运动轨迹的相对矢量满足与水平线的夹角范围则执行对应的操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
若运动轨迹的相对矢量与水平线的夹角处于[A,B]或[E,F]，则执行向右滑动的操作；
若运动轨迹的相对矢量与水平线的夹角处于（B,C），则执行向上滑动的操作；
若运动轨迹的相对矢量与水平线的夹角处于[C,D]，则执行向左滑动的操作；
若运动轨迹的相对矢量与水平线的夹角处于(D,E），则执行向下滑动的操作，其中0°≦A<B<C<D<E<F≦360°。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
若激光光标数量为两个以上，则选择其中激光光标矢量变化最大的两个激光光标的变化情况并执行对应的操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
若两个激光光标之间的距离逐渐变小，则执行缩小操作；
若两个激光光标之间的距离逐渐变大，则执行放大操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
操作以预设的激光光斑的对应形状显示在激光感应屏幕上并控制显示装置激光感应屏幕上的内容执行对应的操作。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
执行操作完成后的反馈信息以振动信号传输至发射装置，以使得用户感知操作结果。
同时，应用于发射装置，处理器1001可以用于调用存储器1004中存储的交互程序，并执行以下操作：
检测激光发射是否开启；
若激光发射开启，获取用户操作信号；
将获取的用户操作信息转换后载入到激光信号中并传输至显示装置或者将获取的用户操作信息以红外编码信号传输至显示装置。
进一步地，处理器1001可以用于调用存储器1004中存储的交互程序，还执行以下操作：
获取显示装置传输的反馈信息；
根据反馈信息进行对应的振动，以使得用户感知操作结果。
本申请的显示装置、发射装置及交互系统的具体实施例与下述交互方法各实施例基本相同，在此不作赘述。
参照图2，本申请提供一种基于显示装置的交互方法的逻辑流程图，应用于显示装置，方法包括：
步骤S10000，接收发射装置发射的激光信号，激光信号以激光光标显示在激光感应屏幕上。
本实施例中显示装置，除了图1中结构之外，还有用于接收激光信号并处理的激光接收系统，在可视化装置中含有激光感应的屏幕，还有与发射装置配对连接的接收模块，连接方式包括红外编码配对，发射装置包括激光控制器、激光笔等一类具有激光发射功能的装置，显示装置是一类具有激光感应模块的装置，显示装置包括有激光感应屏幕；由于激光具有单色性、相干性好、方向性好、亮度高的特点，因此激光不仅在近距离使用，同时在较远距离使用时，也可以保持一定的稳定性，其中激光的颜色可以根据实际需要进行更换，显示装置的激光感应屏幕接收发射装置发射的激光信号，显示在激光感应屏幕上的激光信号是以激光光标为中心以及围绕激光光标的不同形态的激光光斑构成，激光光斑是和本申请应用在不同的应用软件或不同场景下具有不同的形状。
步骤S20000，获取激光光标在激光感应屏幕上的位置信息。
本实施例中，在发射装置改变激光信号的发射角度或方向时，显示在感应屏幕上的激光信号的激光光标位置也会发生相应的变化，显示装置的激光感应模块接收激光信号，并反馈激光光标的坐标位置给到显示装置，因此，激光感应模块能及时将所在激光感应模块上的相关位置信息及位置变化的情况及时地传输至显示装置的处理模块并进行分析处理。
步骤S30000，获取发射装置传输的操作信息。
本实施例中，获取发射装置传输的操作信息包括解析激光信号获得发射装置传输的操作信号，用户通过发射装置的物理按键传输目标操作信息，操作信号通过发射装置内部的接收模块并转换成电信号，进而电信号通过重新编码将操作信息载入到激光光信号中，这样用户的操作信号就可以通过激光传递出去，待激光接收感应器接收了载有操作信号的激光信号，通过解析激光信号，获取其中的操作信号。实现了将用户按键的操作信号实时传递，其中传输的操作信号包括，单击操作、双击操作以及长按操作。
作为另外一种实施例，本实施例中获取发射装置传输的操作信息还包括接收发射装置发射的操作信号，其中操作信号的传输，是通过发射装置的接收器将操作信号转换成电信号先编码，然后再调制，红外调制或者无线调频、调幅，转换成无线信号发送出去，接收机收到载有信息的无线电波接收，放大，解码，得到原先的操作信号，实现了将用户按键的操作信号实时传递，其中传输的操作信号包括，单击操作、双击操作以及长按操作。
步骤S40000，根据操作信息和激光光标的位置信息执行对应的操作。
本实施例中，根据解析获得的操作信号或者接收到的操作信号，进而结合激光光标在激光感应模块中的位置信息及相关位置变化，从而实现了不同操作的执行，其中不同操作对应不同的激光光斑形状，实现让用户直观的了解具体操作，从而提高控制的效率。
本实施中，提供一种交互的方法，通过获取发射装置传输的操作信息以及发射装置发射在激光感应交互屏幕上的激光光标的位置信息，根据操作信号和激光光标的位置信息响应相应的控制操作，控制操作以相匹配的激光光斑形状显示并控制显示装置激光感应屏幕上的内容，根据用户的操作结合激光信号在激光感应屏幕上的激光光标的位置信息变化响应控制操作，通过激光信号精确的内容定位，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
进一步的，参照图3，本申请提供一种交互方法中单击、双击、拖拽、长按、滑动交互的逻辑流程图，基于上述图2所示的实施例，根据操作信息和激光光标的位置信息执行对应的操作包括：
步骤S41000，判断操作信息中的第一单次操作信息的持续时间是否超过第一预设时间。
本实施例中，显示装置通过第一预设时间，比较获取的操作信息中获取的第一单次操作的持续时间，判断其中第一单次操作信息的传递的操作信息持续时间的大小。
步骤S41200，若第一单次操作的持续时间不超过第一预设时间，判断在第一单次操作的第二预设时间内是否获取有一个相邻的第二单次操作信息。例如，若第一预设时间是1秒，第二预设时间是0.5秒，第一单次操作的持续时间是0.6秒，那么由于第一单次操作的0.6秒小于第一预设时间1秒，那么进一步的需要在第二预设时间0.5秒内判断是否有接收到新的操作信号。
步骤S41210，若在第一单次操作的第二预设时间内获取有一个相邻的第二单次操作信息，则响应双击操作；
本实施例中，在接收的第一单次操作的时间不超过第一预设时间，那么还需要继续判断第二预设时间内所获得的第一单次操作时间是否有1个相邻的第二次操作信息；若存在，说明在第二预设时间内用户传输的操作是连续点击两次，显示装置接收到双击的操作信号，进而及时的执行双击操作，其中双击操作在不同的场景中会存有一定的差异，例如在唤醒场景中，通过双击操作，可以在激光感应大屏休眠后，进行双击可以快速唤醒激活激光大屏，从而实现正常交互，其中休眠时间可以根据实际情况进行设置；而在缩放场景中，例如地图应用中，双击地图画面，可以实现放大原有的图像比例。针对激光光标所在的空白区域，双击操作反馈为空，显示装置仍会执行双击操作。
步骤S41220，若在第一单次操作的第二预设时间内未获取有一个相邻的第二单次操作信息，则执行单击操作。
本实施例中，在获取第一单次操作信号之后的第二预设时间内未获得新的操作信息，则说明用户仅做单击操作，显示装置接收到单击的操作信号，可以及时的响应实现内容选择、确认、播放等操作，针对根据不同应用的匹配逻辑，响应不同激光光斑形态，执行响应的功能；在激光的光标显示在激光感应屏幕前提下，若针对激光光标所在的空白区域，单击操作反馈为空，显示装置仍会响应单击交互。
本实施例提供一种单击、双击交互的方法，激光光标在感应屏幕上自由移动，根据不同的场景，依据用户的操作结合激光信号在激光感应屏幕上的激光光标的位置信息变化执行控制操作，其中用户所作出的操作类型满足常见触控操作的规律，符合用户的认知习惯，从而降低学习成本；其次，通过激光信号精确的内容定位，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
此外，在发射装置未传输操作信息的时间段内，若激光信号的光标在交互控件区域，则实现交互空间的焦点激活状态的显示效果，在激光光标移到某个交互控件上之后，显示装置的显示内容将空间放大25%，并且其中光斑的形状也会有一定的变化，一般采用较直观醒目的方式告知用户当前的交互焦点所在的区域位置，例如激光光斑的增加比较醒目的颜色。若是在非交互控件区域，则激光信号在感应屏幕仅以光标形式显示。
进一步的，参照图3，本申请一种交互方法中长按、拖拽、滑动交互实施例，基于图2所示的实施例，激光感应屏幕包括交互的控件区域和非交互的控件区域，判断操作信息的持续时间是否超过第一预设时间还包括：
步骤S41100，若操作信息的持续时间超过第一预设时间，则判断激光光标的位置信息是否发生变化；
步骤S41120，若激光光标的位置信息未发生变化，则执行长按操作。
本实施例中，在第一单次操作信息的持续时间超过第一预设的时间后，例如，预设第一预设时间是1秒，在第单次操作的持续时间超过1秒，那么则认为本次单次操作是长按，同时在激光光标在激光感应屏幕上的坐标信息未发生变化，此时激光光标外圈将显示为预设的长按光斑，光标所指示的内荣将执行长按操作；根据在显示屏幕上显示的场景内容的不同，长按操作可以实现不同的功能，包括二次功能菜单的唤起、快速响应操作等功能；其中唤起场景中，例如，在播放映射画面中，长按操作可以打开设置菜单项，进行如可进行播放速率、字幕、截图等二级菜单的进一步操作；在快速响应操作场景中，例如，在地图应用中，长按“-”图标，可以快速缩小地图。
步骤S41110，若激光光标的位置信息发生变化，则判断激光光标的位置是否在交互控件区域；
步骤S41111，若激光光标的位置在交互控件区域，则执行拖拽操作；
本实施例中，根据发射装置的空间位置信息的变化，进而获取投射在激光感应屏幕上的激光光标坐标变化情况，在投射的激光光标的坐标位置发生变化时，进而判断激光光标的位置是否在可交互的控件区域，其中可交互区域是指类似菜单界面按钮、Tab、超链接、可点击的交互图标等交互控件所在的显示区域；若是激光光标在可交互控件区域发生位置变换产生了运动轨迹，通过移动激光坐标从初始位置移动到目标位置，实现目标内容的移动，例如，电视菜单中的应用软件从一个区域拖拽到另一个位置；将电视界面中的常常关注的页面拖拽到第一屏显示，并自由调整位置；还可以在具有三维内容高效浏览设备中如类似三维地球仪，可以模拟转动地球仪，快速便捷地转动到目标区域的地图信息。
步骤S41112，若激光光标的位置不在交互控件区域，则执行滑动操作。
本实施例中，根据发射装置的空间位置信息的变化，进而获取投射在激光感应屏幕上的激光光标的变化情况，在投射的激光光标的坐标位置发生变化时，即激光光标在非交互控件区域发生位置变换产生了运动轨迹，通过移动激光坐标从初始位置移动到目标位置，根据激光的移动执行对应的操作，本申请中将激光光标在非交互控件区域发生位置变换产生了位移的操作定义为滑动操作，滑动操作在不同的应用实现的功能不同，具体可以包括隔空绘图、轨迹响应等功能，针对不同的应用，会产生相应的变化，例如，进入隔空绘画的App应用后，响应绘图操作；其他应用中，执行轨迹操作。
本实施例提供一种长按、拖拽、滑动交互的方法，其中长按操作实现了针对特定软件的唤醒的功能及快速执行操作等功能，其中拖拽及滑动操作则依据发射装置的空间位置变化使得激光光标在感应屏幕上产生相应的运动轨迹，实现了将目标内容移动到目标位置的作用，其中用户所作出的激光操作满足常见触控操作的规律，符合用户的认知习惯，从而降低学习成本；进而通过激光信号精确的内容定位，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
进一步的，参照图4，本申请提供一种交互方法中手势交互的逻辑流程图，基于图2、图3所示的实施例，执行滑动操作之前还包括：
步骤S50000，获取激光感应屏幕上的激光光标数量。
步骤S51000，若激光光标的数量为1，则判断激光光标运动轨迹的形状和起始位置的相对矢量。
步骤S51100，根据激光光标运动轨迹的形状或起始位置的相对矢量来执行对应的操作。
本实施例中，在具有激光感应屏幕的显示装置的可以配对多个发射装置，因此，在需要通过手势交互执行控制操作时，需要获取激光感应屏幕上的激光信号，即激光光标的数量，若获取的激光光标的数量是1，用户通过长按发射装置的操作按键，在激光光标在在非交互控件位置时，用户通过改变发射装置的空间位置进而改变了投射到激光感应屏幕上的激光光标位置，通过移动所形成的移动轨迹，可以被显示装置获取及识别，通过判断轨迹的形状和激光光标的起始位置的相对矢量来确定具体的轨迹类型，其中可以响应的轨迹类型包括具有固定图案的运动轨迹和起始方向的运动轨迹，实现与预设的图案与方向的匹配情况实现对应的操作。
本实施例中，提供一种单个激光控制器的手势交互方法，通过激光光标的运动所产生的运动轨迹，判断轨迹的形状和激光光标的起始位置的相对矢量来确定具体的轨迹类型，实现与预设的图案与方向的匹配情况实现对应的操作。
进一步的，参照图6，本申请提供一种交互方法中移动固定轨迹的手势交互的逻辑流程图，基于图4所示的实施例，根据运动轨迹的形状或起始位置的相对矢量来执行对应的操作包括：
步骤S51200，判断激光运动轨迹的形状与预设图案的匹配度。
步骤S51210，若运动轨迹的形状与预设图案的匹配度大于预设匹配阈值，则运动轨迹的形状视为与预设的图案相匹配并执行对应的操作。
本实施例中，显示装置会预存圆形图案、叉形图案、大于符号图案、小于符号图案用于响应相应的交互，在用户通过移动激光光标产生的运动轨迹，系统会预先判断轨迹的图案与显示装置的预存图案的匹配度，通过判断轨迹的图案与预设图案的相似率得出匹配度，一般情况下，将预设匹配度在大于60%，在运动轨迹的形状与预设图案的匹配度大于60%时，可以实现相应的交互；在符合预设匹配度的情况下，激光光标的运动轨迹形成的图案将会作出相应的操作，即运动轨迹的形状匹配叉形图案，则对目标对象执行关闭操作本实施例中的执行关闭/放大/缩小等操作，都是对目标对象执行，目标对象为当前显示屏中被用户选中的操作对象，比如图片、正在播放的视频等。运动轨迹的形状匹配大于符号图案，则对与目标对象相邻的下一个对象执行相应操作，与目标对象相邻的下一个对象与目标对象相对应，具体地与目标对象相邻的下一个对象可以为下一个视频，下一张图片，下一页文档等，在下一个对象为视频时，则执行下一个视频的播放操作，在下一个对象为图片时，则执行查看操作；运动轨迹的形状匹配小于符号图案，则对与目标对象相邻的上一个对象执行相应操作，其中与目标对象相邻的上一个对象则可以为上一个视频，上一张图片，上一页文档等。具体的其中类似于圆圈的移动轨迹可以控制目标界面的暂停与否，叉形图案将控制目标界面的关闭与否，大于或小于符号则控制应用选择上一个对象还是下一个对象，符合基本操作类型，方便用户高效操作。本实施中，提供一种单个激光控制器移动固定轨迹的手势交互方法，根据激光光标的运动所产生的运动轨迹，在轨迹是固定轨迹的条件下，通过比对运动轨迹与预设图案的相似匹配度，在满足预设匹配范围时，实现相应的交互操作，其中用户所作出的激光操作轨迹满足常见触控操作的规律，符合用户的认知习惯，从而降低学习成本；其次，通过激光信号精确的内容定位，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
进一步的，参照图5,本申请提供一种交互方法中运动轨迹起始位置的相对矢量的手势交互逻辑流程图，基于图4的实施例，根据运动轨迹的形状或起始位置的相对矢量来执行对应的操作还包括：
步骤S51110，判断运动轨迹的起始位置的相对矢量是否满足与水平线的夹角范围。
步骤S51111，若运动轨迹的相对矢量满足与水平方向的夹角范围则执行对应的操作。
本实施例中，在激光光标的位置在非交互控件区域且激光光标的运动轨迹不符合预设的图形匹配度的条件下，进而判断激光光标的运动轨迹生成的起始位置的相对矢量，其中相对矢量可以包括向左的矢量、向上或向下矢量、向右矢量，进而根据具体的相对矢量执行相应的返回操作、上下滚动操作、向右滚动操作。其中，可以根据相对矢量与水平方向的夹角范围来确定具体的方向，根据滑动的方向的不同，在不同场景中显示不同的功能。具体地，若运动轨迹的相对矢量与水平线的夹角处于[A,B]或[E,F]，则执行向右滑动的操作；若运动轨迹的相对矢量与水平线的夹角处于（B,C），则执行向上滑动的操作；若运动轨迹的相对矢量与水平线的夹角处于[C,D]，则执行向下滑动的操作；若运动轨迹的相对矢量与水平线的夹角处于(D,E），则执行向左滑动的操作，其中0°≦A<B<C<D<E<F≦360°
具体的，一般情况下，预设向右滑动操作的夹角范围为[0°，45°]或者[315°，360°]，例如当激光光标的相对矢量40度，则执行向右滑动的操作，在图片应用中，针对查看未预览的图片，可以采用向右滚动实现查看，还可以在横屏页面显示的应用中，通过右滑实现同等级别的页面的查看。
一般情况下，预设向上滑动操作的夹角范围为（45°，135°），例如，当激光光标的相对矢量夹角为90度，则执行向上滑动的操作。
一般情况下，预设向下滑动操作的夹角范围为（225°，315°），例如当激光光标的相对矢量夹角为270度，则执行向下滑动的操作；同时，在向上或向下滑动时，可实现页面内容的上下移动和翻页等功能，例如，在纵向页面浏览信息时，类似于手机浏览页面的可以通过上下移动功能，实现页面的上下滚动翻页。
一般情况下，预设向左滑动操作的夹角范围为[135°，225°]，例如，当激光光标的相对矢量夹角为220度，则执行向左滑动的操作；在向左滑动时，实现场景中内容的向上一级的返回功能，例如在电视节目应用中，在根据分类进入其中综艺页面下选择了其中某一综艺节目，想换一个电视剧节目，此时需要向左滑动操作，实现将屏幕界面的内容返回上一级，进而实现选择电视剧节目的目的。
此外，进一步的为符合用户操作系统，其中各个角度的关系可以为：0°≦A<B<90°<C<180°<D<270°<E<F≦360°，本领域技术人员可知各个操作对应的夹角范围可试具体情况变动。
本实施例中，提供一种手势交互方法，在激光光标的位置在非交互的控件区域的条件时，通过判断发射装置投射在感应屏幕中的激光光标的相对矢量信息，从而匹配到对应的控制操作，实现了对特定内容的特定操作，其中用户所作出的激光操作轨迹满足常见触控操作的规律，符合用户的认知习惯，从而降低学习成本且操作的动作简单易懂，通过激光信号精确的内容定位，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
此外，在常规操作应用场景下，优先响应手势交互方法，在隔空绘画的App应用后，则响应基础滑动交互，执行绘图操作；对于特定应用，比如浏览影视内容时，优先响应手势滑动交互；而在其他应用中，响应轨迹操作。
进一步，基于图4，本申请提供一种交互方法中放大或缩小交互的实施例，获得激光感应屏幕上的激光光标数量还包括：
步骤S52000，若激光光标数量为两个以上，则选择其中激光光标矢量变化最大的两个激光光标的变化情况并执行对应的操作。
本实施例中，显示装置通过获取激光感应屏幕上的激光光标的数量，因显示装置是可以实现多个发射装置发射的激光信号，在接收的激光光标的数量为两个以上时，通过比较获取在激光光标矢量变化最大的两个激光光标的变化情况作为手势交互判断的载体，进而执行对应的操作。例如，判断获取的激光光标的相对位置变化所产生的矢量变化，并选择其中两个变化最大的矢量的变化作为交互控制的载体，其中若两个激光光标之间的距离是逐渐变小的，例如两个激光光标相向运动，则执行缩小操作，实现内容的动态缩小的功能；若两个激光光标之间的距离是逐渐变大的，例如两个激光光标背向运动，则执行放大操作，实现内容的动态放大的功能。
本实施例中，提供一种放大或缩小交互方法，在多个激光控制器控制的条件下，通过比较获取其中两个激光光标矢量变化最大的变化情况，并将其作为手势交互运动的载体，进而通过判断两个激光光标的相对位置距离变化的数值，进而实现放大或缩小的操作交互，其中用户所作出的激光操作符合常见触控操作的规律，在符合用户认知习惯下，降低了学习成本，根据目标内容进行操作，提升了控制内容的准确度及灵敏度，从而也实现了远近距离的高效便捷精准完成交互。
进一步的，基于图2到6的实施例，根据操作信息和激光光标的位置信息执行对应的操作包括：
操作以预设的激光光斑的对应形状显示在激光感应屏幕上并控制显示装置激光感应屏幕上的内容执行对应的操作。
本实施例中，提供在执行不同操作交互时，设置不同的激光光斑的形状，从而可以精准直观的知晓目前激光操作的状态，实现用户实时操作与视觉反馈。
进一步的，基于图2到6的实施例，根据操作信息和激光光标的位置信息执行对应的操作包括：
执行操作完成后的反馈信息以振动信号传输至发射装置，以使得用户感知操作结果。
本实施例中，提供一种触觉反馈交互在执行操作完成后通过以振动信号通过原有的接收信号的渠道将完成的信号进行传递，实现了将交互信息及时进行触觉反馈给用户的目的。
除此之外，也可以在显示装置执行完成后，在显示装置预设相关音效反馈，从而醒目的告知用户目前的执行情况，方便后续操作的执行。
此外，其中的反馈信号还可以是执行存在错误或是执行与预设不匹配时，通过反馈振动信号的方式让用户感触到出现的问题，实现实时反馈，提高了激光感应中用户精准交互的目的。
进一步的，参照图7，本申请提供一种基于发射装置的交互方法的逻辑流程图，应用于发射装置，方法包括：
步骤S60，检测激光发射是否开启；
步骤S61，若激光发射开启，获取用户操作信号；
步骤S62，将获取的用户操作信息转换后载入到激光信号中并传输至显示装置或者将获取的用户操作信息以红外编码信号传输至显示装置。
本实施例中，通过获取用户的操作信息，并将操作信息传递出去，其中传输的操作信息通过发射装置内部的接收模块将操作信号并转换成电信号，进而电信号通过重新编码将操作信息载入到激光光信号中，这样用户的操作信号就可以通过激光传递出去，其中传输的操作信号包括，单击操作、双击操作以及长按操作。
其中操作信息的传输还包括通过发射装置的接收器将操作信号转换成电信号先编码，然后再调制，红外调制或者无线调频、调幅，转换成无线信号发送出去，其中传输的操作信号包括，单击操作、双击操作以及长按操作。
本实施例中，提供一种基于发射装置的交互方法，在激光控制器开启后，通过控制器的物理按键传输操作信息，进而通过数据编码将操作信号通过载入光信号传输或者通过无线红外信号传输，进而根据用户控制发射装置的空间位置变化及按键操作，使得操作信号和位置信息变化及时的传递给显示装置，进而实现对应的交互操作。
进一步的，基于图7，本申请提供一种接收激光交互操作反馈信息的方法，方法还包括：
步骤S63，获取显示装置传输的反馈信息；
步骤S64，根据反馈信息进行对应的振动，以使得用户感知操作结果。
本实施例中，提供一种激光交互反馈方法，通过发射装置的感应接收模块，接收显示装置反馈的信息，并通过数据编码，将接收的反馈信号以振动信号传输至发送端的控制按键，实现了将反馈信号传递给用户的目的。
本申请计算机可读存储介质的具体实施例与上述交互方法各实施例基本相同，在此不作赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得发射装置/显示装置设备(可以是手机，激光笔，激光控制器，计算机，具有激光感应屏幕的装置，或者激光感应交互设备等)执行本申请各个实施例的方法。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。

Claims (20)

  1. 一种交互方法，其中，应用于显示装置，所述方法包括：
    接收发射装置发射的激光信号，所述激光信号以激光光标显示在所述显示装置的激光感应屏幕上；
    获取所述激光光标在所述激光感应屏幕上的位置信息；
    获取所述发射装置传输的操作信息；
    根据所述操作信息和所述激光光标的位置信息执行对应的操作。
  2. 如权利要求1所述的交互方法，其中，所述获取所述发射装置传输的操作信息包括：
    解析所述激光信号获得所述发射装置传输的操作信号。
  3. 如权利要求1所述的交互方法，其中，所述获取所述发射装置传输的操作信息包括：
    接收所述发射装置发射的操作信号。
  4. 如权利要求1所述的交互方法，其中，所述根据所述操作信息和所述激光光标的位置信息执行对应的操作包括：
    判断所述操作信息中的第一单次操作信息的持续时间是否超过第一预设时间；
    若所述第一单次操作的持续时间不超过第一预设时间，则判断在所述第一单次操作的第二预设时间内是否获取有一个相邻的第二单次操作信息；
    若在所述第一单次操作的第二预设时间内获取有一个相邻的第二单次操作信息，则执行双击操作；
    若在所述第一单次操作的第二预设时间内未获取有一个相邻的第二单次操作信息，则执行单击操作。
  5. 如权利要求4所述的交互方法，其中，所述激光感应屏幕包括交互的控件区域和非交互的控件区域，所述判断所述操作信息中的第一单次操作信息的持续时间是否超过第一预设时间还包括：
    若所述第一单次操作信息的持续时间超过第一预设时间，则判断所述激光光标的位置信息是否发生变化；
    若所述激光光标的位置信息未发生变化，则执行长按操作；
    若所述激光光标的位置信息发生变化，则判断所述激光光标的位置是否在所述交互控件区域；
    若所述激光光标的位置在所述交互控件区域，则执行拖拽操作；
    若所述激光光标的位置不在所述交互控件区域，则执行滑动操作。
  6. 如权利要求5所述的交互方法，其中，所述执行滑动操作之前还包括：
    获取所述激光感应屏幕上的激光光标数量；
    若所述激光光标的数量为1，则判断所述激光光标运动轨迹的形状和起始位置的相对矢量；
    根据所述激光光标运动轨迹的形状或起始位置的相对矢量来执行对应的操作。
  7. 如权利要求6所述的交互方法，其中，所述根据所述激光光标运动轨迹的形状或起始位置的相对矢量来执行对应的操作包括：
    判断所述运动轨迹的形状与所述预设图案的匹配度；
    若所述运动轨迹的形状与所述预设图案的匹配度大于预设匹配阈值，则所述运动轨迹的形状视为与所述预设的图案相匹配并执行对应的操作。
  8. 如权利要求7所述的交互方法，其中，所述预设图案包括圆形图案、叉形图案、大于符号图案、小于符号图案，所述则所述运动轨迹的形状视为与所述预设的图案相匹配并执行对应的操作包括：
    所述运动轨迹的形状匹配所述圆形图案，则对目标对象执行暂停操作；
    所述运动轨迹的形状匹配所述叉形图案，则对目标对象执行关闭操作；
    所述运动轨迹的形状匹配所述大于符号图案，则对与目标对象相邻的下一个对象执行相应操作；
    所述运动轨迹的形状匹配所述小于符号图案，则对与目标对象相邻的上一个对象执行相应操作。
  9. 如权利要求6所述的交互方法，其中，所述根据所述激光光标运动轨迹的形状或起始位置的相对矢量来执行对应的操作还包括：
    判断所述运动轨迹的起始位置的相对矢量是否满足与水平线的夹角范围；
    若所述运动轨迹的相对矢量满足与水平线的夹角范围则执行对应的操作。
  10. 如权利要求9所述的交互方法，其中，所述若所述运动轨迹的相对矢量满足与水平线的夹角范围则执行对应的操作的步骤包括：
    若所述运动轨迹的相对矢量与水平线的夹角处于[A,B]或[E,F]，则执行向右滑动的操作；
    若所述运动轨迹的相对矢量与水平线的夹角处于（B,C），则执行向上滑动的操作；
    若所述运动轨迹的相对矢量与水平线的夹角处于[C,D]，则执行向左滑动的操作；
    若所述运动轨迹的相对矢量与水平线的夹角处于（D,E），则执行向下滑动的操作，其中0°≦A<B<C<D<E<F≦360°。
  11. 如权利要求6所述的交互方法，其中，所述获取所述激光感应屏幕上的激光光标数量之后，还包括：
    若所述激光光标数量为两个以上，则选择其中所述激光光标矢量变化最大的两个激光光标的变化情况并执行对应的操作。
  12. 如权利要求11所述的交互方法，其中，所述选择其中所述激光光标矢量变化最大的两个激光光标的变化情况并执行对应的操作的步骤包括：
    若两个激光光标之间的距离逐渐变小，则执行缩小操作；
    若两个激光光标之间的距离逐渐变大，则执行放大操作。
  13. 如权利要求1所述的交互方法，其中，所述激光信号还包括激光光斑，所述根据所述操作信息和所述激光光标的位置信息执行对应的操作包括：
    所述操作以预设的所述激光光斑的对应形状显示在所述激光感应屏幕上并控制所述显示装置激光感应屏幕上的内容执行对应的操作。
  14. 如权利要求1所述的交互方法，其中，所述根据所述操作信息和所述激光光标的位置信息执行对应的操作之后还包括：
    执行操作完成后的反馈信息以振动信号传输至所述发射装置，以使得用户感知操作结果。
  15. 一种交互方法，其中，应用于发射装置，所述发射装置具有激光发射模块，所述方法包括：
    检测激光发射是否开启；
    若激光发射开启，获取用户操作信号；
    将所述获取的用户操作信息转换后载入到所述激光信号中并传输至所述显示装置或者将所述获取的用户操作信息以红外编码信号传输至所述显示装置。
  16. 如权利要求15所述的交互方法，所述方法还包括：
    获取所述显示装置传输的反馈信息；
    根据所述反馈信息进行对应的振动，以使得用户感知操作结果。
  17. 一种显示装置，其中，所述显示装置包括：交互程序，所述交互程序配置为实现如权利要求1至14中任一项所述的交互方法的步骤。
  18. 一种发射装置，其中，所述发射装置包括：交互程序，所述交互程序配置为实现如权利要求15至16中任一项所述的交互方法的步骤。
  19. 一种交互系统，其中，所述交互系统包括：如权利要求17所述的显示装置，以及如权利要求18所述的发射装置。
  20. 一种存储介质，其中，所述存储介质存储有交互程序，所述交互程序被处理器执行时实现如权利要求1至16中任一所述的交互方法的步骤。
PCT/CN2021/107667 2020-07-23 2021-07-21 交互方法、显示装置、发射装置、交互系统及存储介质 Ceased WO2022017421A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/006,109 US11989352B2 (en) 2020-07-23 2021-07-21 Method display device and medium with laser emission device and operations that meet rules of common touch

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010720160.9A CN112328158A (zh) 2020-07-23 2020-07-23 交互方法、显示装置、发射装置、交互系统及存储介质
CN202010720160.9 2020-07-23

Publications (1)

Publication Number Publication Date
WO2022017421A1 true WO2022017421A1 (zh) 2022-01-27

Family

ID=74302985

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/107667 Ceased WO2022017421A1 (zh) 2020-07-23 2021-07-21 交互方法、显示装置、发射装置、交互系统及存储介质

Country Status (3)

Country Link
US (1) US11989352B2 (zh)
CN (1) CN112328158A (zh)
WO (1) WO2022017421A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114546237A (zh) * 2022-02-28 2022-05-27 维沃移动通信有限公司 一种交互方法、交互装置、电子设备和可读存储介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112328158A (zh) 2020-07-23 2021-02-05 深圳Tcl新技术有限公司 交互方法、显示装置、发射装置、交互系统及存储介质
CN115016449B (zh) * 2021-02-19 2025-12-09 科沃斯机器人股份有限公司 一种控制方法、自主移动设备及存储介质
CN114035739B (zh) * 2021-11-12 2023-12-29 网易（杭州）网络有限公司 图形绘制方法和装置、计算机可读存储介质、电子设备
CN115185414B (zh) * 2022-07-26 2024-04-19 Vidaa国际控股(荷兰)公司 显示设备及光标控制方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102622108A (zh) * 2012-01-18 2012-08-01 深圳市中科睿成智能科技有限公司 一种交互式投影系统及其实现方法
US8271906B1 (en) * 2008-06-09 2012-09-18 Intuit Inc. Method and system for using a dynamic cursor area to facilitate user interaction
CN103092432A (zh) * 2011-11-08 2013-05-08 深圳市中科睿成智能科技有限公司 人机交互操作指令的触发控制方法和系统及激光发射装置
CN104166509A (zh) * 2013-05-20 2014-11-26 华为技术有限公司 一种非接触式屏幕交互方法及系统
CN112328158A (zh) * 2020-07-23 2021-02-05 深圳Tcl新技术有限公司 交互方法、显示装置、发射装置、交互系统及存储介质

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5880411A (en) * 1992-06-08 1999-03-09 Synaptics, Incorporated Object position detector with edge motion feature and gesture recognition
CN102253737B (zh) * 2011-05-31 2013-07-17 王石 一种屏幕视觉鼠标系统的实现方法
EP3015961B1 (en) * 2013-06-26 2021-07-14 Sony Corporation Information processing device, control method, program, and storage medium
KR20160008843A (ko) * 2014-07-15 2016-01-25 삼성전자주식회사 디스플레이장치 및 그 제어방법
US20160139699A1 (en) * 2014-11-16 2016-05-19 Microsoft Technology Licensing, Llc Light sensitive digitizer system
US20170357336A1 (en) * 2016-06-08 2017-12-14 Evan McNeil Remote computer mouse by camera and laser pointer
US20190369752A1 (en) * 2018-05-30 2019-12-05 Oculus Vr, Llc Styluses, head-mounted display systems, and related methods

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8271906B1 (en) * 2008-06-09 2012-09-18 Intuit Inc. Method and system for using a dynamic cursor area to facilitate user interaction
CN103092432A (zh) * 2011-11-08 2013-05-08 深圳市中科睿成智能科技有限公司 人机交互操作指令的触发控制方法和系统及激光发射装置
CN102622108A (zh) * 2012-01-18 2012-08-01 深圳市中科睿成智能科技有限公司 一种交互式投影系统及其实现方法
CN104166509A (zh) * 2013-05-20 2014-11-26 华为技术有限公司 一种非接触式屏幕交互方法及系统
CN112328158A (zh) * 2020-07-23 2021-02-05 深圳Tcl新技术有限公司 交互方法、显示装置、发射装置、交互系统及存储介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114546237A (zh) * 2022-02-28 2022-05-27 维沃移动通信有限公司 一种交互方法、交互装置、电子设备和可读存储介质

Also Published As

Publication number Publication date
US20230280837A1 (en) 2023-09-07
CN112328158A (zh) 2021-02-05
US11989352B2 (en) 2024-05-21

Similar Documents

Publication Publication Date Title
US11989352B2 (en) Method display device and medium with laser emission device and operations that meet rules of common touch
US20160170703A1 (en) System and method for linking and controlling terminals
US11126343B2 (en) Information processing apparatus, information processing method, and program
US10175847B2 (en) Method and system for controlling display device and computer-readable recording medium
US20180375987A1 (en) Method, apparatus and mobile terminal for device control based on a mobile terminal
US9880642B2 (en) Mouse function provision method and terminal implementing the same
US20120026105A1 (en) Electronic device and method thereof for transmitting data
US10386932B2 (en) Display apparatus and control method thereof
CN105227985B (zh) 显示设备及其控制方法
CN114461124B (zh) 投屏控制方法、装置、投屏器及计算机可读存储介质
CN103037253B (zh) 遥控控制系统和遥控控制方法
KR101384493B1 (ko) 단말기 연동 및 제어 시스템 및 이에 사용되는 사용자 단말기
KR20120061169A (ko) 터치스크린을 갖는 단말기를 이용한 목적물 제어시스템
US20130244730A1 (en) User terminal capable of sharing image and method for controlling the same
WO2022262292A1 (zh) 引导操作体进行隔空操作的方法和装置
KR101555830B1 (ko) 셋톱박스 시스템 및 셋톱박스 리모컨 기능 제공 방법
KR102088459B1 (ko) 사용자 제스처를 이용한 복수의 단말 간 사용자인터페이스 통합 방법 및 이를 수행하는 단말
KR100976181B1 (ko) 무선 마우스 기능을 갖는 휴대 단말기 및 그를 이용한 주변디바이스 제어방법
KR0135852B1 (ko) 원격 접촉입력 제어기를 구비한 운용데이타 제어장치 및 방법
CN119484913A (zh) 电视盒子模拟鼠标交互方法、装置、计算机设备和程序产品
CN119668735A (zh) 显示设备和悬浮窗口放缩方法
TWI517686B (zh) 一種觸控無線通訊裝置與數位電視之座標控制系統
CN112333489A (zh) 激光光标监测方法、装置和存储介质
CN117321559A (zh) 显示装置
KR20140107918A (ko) 촬영부를 이용한 원격 제어 시스템 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21845286

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21845286

Country of ref document: EP

Kind code of ref document: A1