CN112462938A - Interactive control method and device based on remote controller body state change - Google Patents
Interactive control method and device based on remote controller body state change Download PDFInfo
- Publication number
- CN112462938A CN112462938A CN202011330623.7A CN202011330623A CN112462938A CN 112462938 A CN112462938 A CN 112462938A CN 202011330623 A CN202011330623 A CN 202011330623A CN 112462938 A CN112462938 A CN 112462938A
- Authority
- CN
- China
- Prior art keywords
- remote controller
- information
- posture
- image
- body state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Position Input By Displaying (AREA)
- Selective Calling Equipment (AREA)
Abstract
The invention discloses an interactive control method and device based on the body state change of a remote controller, wherein the method comprises the following steps: acquiring a remote controller image, and determining the posture change information of the remote controller according to the remote controller image; determining the pointing position information of the remote controller in a terminal screen according to the posture change information; and executing an interaction event at a position corresponding to the pointing position information according to the pointing position information to realize interaction control. According to the invention, through identifying the body state change image of the remote controller, the position of the emission part of the remote controller pointing to the terminal screen is judged, and finally, the terminal is correspondingly operated according to the laser signal emitted by the emission part, so that the terminal can be interactively controlled based on the body state change of the remote controller, and the operation becomes convenient and fast on the functions of playing games, listening to music or watching movies and the like of the terminal as the mouse operates a computer.
Description
Technical Field
The invention relates to the technical field of equipment interaction, in particular to an interaction control method and device based on the body state change of a remote controller.
Background
Today, people and various terminal devices such as mobile phones, tablets, computers and televisions are surrounded by people and various terminal devices such as videos and videos in life. These intelligent terminals need to perform interactive control in many application scenarios. At present, no terminal equipment which can be controlled by the body state change of a remote controller is available in the market.
Thus, there is a need for improvements and enhancements in the art.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide an interactive control method, an interactive control device, an intelligent terminal and a storage medium based on the body state change of a remote controller, aiming at solving the problem that in the prior art, the interactive control of terminal equipment is mainly performed by a touch screen or a key, and no other form of interactive control mode is available.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
in a first aspect, the present invention provides an interactive control method based on a remote controller posture change, wherein the method includes:
acquiring a remote controller image, and determining the posture change information of the remote controller according to the remote controller image;
determining the pointing position information of the remote controller in a terminal screen according to the posture change information;
and executing an interaction event at a position corresponding to the pointing position information according to the pointing position information to realize interaction control.
In one implementation, the obtaining an image of a remote controller and determining posture change information of the remote controller according to the image of the remote controller includes:
starting a preset image shooting device, and acquiring images of the remote controller every other preset time period through the image shooting device;
identifying the remote controller image and determining the current posture information of the remote controller image;
and determining the posture change information of the remote controller according to the current posture information.
In one implementation, the identifying the remote controller image and determining the current posture information of the remote controller image includes:
after the remote controller image is obtained, judging whether the remote controller image needs to be calibrated or not;
if the remote controller image needs to be calibrated, selecting a preset calibration mode to calibrate the remote controller image;
and determining the current posture information according to the calibrated remote controller image.
In one implementation, the determining the body state change information of the remote controller according to the current body state information includes:
comparing the current posture information with initial posture information of the remote controller, wherein the initial posture information is the posture information of a pre-locked initial image;
if the current embodiment information is different from the initial posture information, acquiring difference information between the current posture information and the initial posture information;
and generating the posture change information according to the difference information.
In one implementation manner, the determining, according to the posture change information, pointing position information of the remote controller within a terminal screen includes:
determining a signal transmitting part of the remote controller according to the posture change information;
acquiring pointing information of the signal transmitting part, wherein the pointing information is used for reflecting the direction of the signal transmitting part of the remote controller;
and determining the position information of the signal transmitted by the signal transmitting part in the terminal screen according to the pointing information, and taking the position information as the pointing position information of the remote controller in the terminal screen.
In one implementation, the determining, according to the pointing information, the position information of the signal transmitted by the signal transmitting part within the terminal screen includes:
determining whether the direction of a signal transmitting part of the remote controller is within the range of a terminal screen or not according to the pointing information;
and if the signal transmitting part is positioned in the range of the terminal screen, determining the position information of the signal transmitted by the signal transmitting part in the terminal screen.
In one implementation manner, the executing, according to the pointing position information, an interaction event at a position corresponding to the pointing position information to implement interaction control includes:
acquiring a laser signal at a position corresponding to the pointing position information according to the pointing position information;
determining an interaction event corresponding to the laser signal according to the laser signal;
and executing the interaction event to realize interaction control.
In a second aspect, the present invention provides an interactive control device based on the body state change of a remote controller, the device comprising:
the body state information acquisition module is used for acquiring a remote controller image and determining body state change information of the remote controller according to the remote controller image;
the position information acquisition module is used for determining pointing position information of the remote controller in a terminal screen according to the posture change information;
and the interactive event execution module is used for executing the interactive event at the position corresponding to the pointing position information according to the pointing position information so as to realize interactive control.
In a third aspect, the present invention provides an intelligent terminal, where the intelligent terminal includes a memory, a processor, and an interaction control program based on a change in body state of a remote controller, which is stored in the memory and is executable on the processor, and when the interaction control program based on a change in body state of a remote controller is executed by the processor, the steps of the interaction control method based on a change in body state of a remote controller in any of the above schemes are implemented.
In a fourth aspect, the present invention provides a computer-readable storage medium, on which an interaction control program based on a body state change of a remote controller is stored, and when the interaction control program based on the body state change of the remote controller is executed by a processor, the steps of the interaction control method based on the body state change of the remote controller in any one of the above aspects are implemented.
Has the advantages that: the invention provides an interactive control method based on the body state change of a remote controller, which carries out interactive control on a terminal based on the body state change of the remote controller by identifying a body state change image of the remote controller, wherein the functions on the remote controller can be set in a self-defined way, and the interactive control method also comprises a plurality of basic one-key control functions.
Drawings
Fig. 1 is a flowchart of an embodiment of an interactive control method based on a body state change of a remote controller according to the present invention.
Fig. 2 is a flowchart for acquiring the body state change information of the remote controller according to the embodiment of the present invention.
Fig. 3 is a flowchart for acquiring pointing position information in a terminal screen according to an embodiment of the present invention.
Fig. 4 is a flowchart for implementing interactive control information according to an embodiment of the present invention.
Fig. 5 is a schematic block diagram of an interactive control device based on a body posture change of a remote controller according to an embodiment of the present invention.
Fig. 6 is a schematic block diagram of an internal structure of an intelligent terminal according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Today, people and various terminal devices such as mobile phones, tablets, computers and televisions are surrounded by people and various terminal devices such as videos and videos in life. These intelligent terminals need to perform interactive control in many application scenarios. At present, no terminal equipment which can be controlled by the body state change of a remote controller is available in the market.
In order to solve the above problems, this embodiment provides an interactive control method based on the body state change of a remote controller, and by the method of this embodiment, interactive control can be performed on a terminal by identifying the body state change of the remote controller, which breaks through the situation that most of interactive control of terminal equipment in the prior art is mainly performed by a touch screen or a key, and no other interactive control mode exists, and the terminal can be flexibly operated as a mouse to control a computer when playing games, watching movies, listening to music, and the like, and compared with the prior art, the method can only perform key pressing, up, down, left, right, or touch screen control more intelligently and simply. When the method is specifically implemented, firstly, a remote controller image is obtained, the change information of the body state of the remote controller is obtained according to the remote controller image, the body state of the remote controller is corrected, then the position pointed by the remote controller on a terminal screen can be determined according to the body state change information of the remote controller, and interactive control over the terminal can be achieved by pressing down a function key.
Specifically, for example, the terminal is opened for use, a UI man-machine interaction interface on the terminal screen has a plurality of function buttons, different function operations or other function adjustments can be performed by clicking different function buttons, in the prior art, generally, a touch screen or a key is used for positioning and function operations, but the invention adopts a remote controller for control, an image shooting device installed on the terminal equipment is embedded around the terminal to shoot the body state information of the remote controller, the body state direction of the remote controller needs to be corrected before analyzing and judging the direction of the remote controller, then the direction of a transmitting part on the remote controller is judged according to the body state change information before and after the remote controller, which position the remote controller points on the UI interface on the terminal screen can be analyzed, namely, as a computer mouse, the user can move to an application to be started or perform other operations, after the remote controller points to the correct position, the corresponding function button is arranged on the remote controller, the corresponding function operation can be carried out on the terminal screen by pressing the function key, and the function can be directly skipped by one key, so that the interactive control is realized.
Exemplary method
The interactive control method based on the remote controller posture change provided by the embodiment can be applied to an intelligent terminal, and specifically as shown in fig. 1, the method includes the following steps:
and S100, acquiring a remote controller image, and determining the posture change information of the remote controller according to the remote controller image.
The invention is based on the body state change of the remote controller to carry on the interactive control, therefore, need to discern the body state change of the remote controller at first, carry on the picture shooting to the body state of the remote controller first, judge the present body state information of the remote controller through the picture shot, the body state of the remote controller includes multiple dimensionalities, can choose the center of the terminal used as the benchmark, the emission part of the remote controller carries on the line with the terminal center, the line and terminal screen plane can form an included angle, confirm the present body state of the remote controller through detecting and calculating the size of the included angle, can also regard ground as the benchmark, add the terminal boundary as the reference object, calculate the distance and projection of the emission part of the remote controller and ground and relative distance and confirming the present body state information of the boundary on the terminal. Therefore, no matter what posture the remote controller is in, the posture can be confirmed by the method, and then accurate change information of the posture of the remote controller can be obtained by comparing the posture with the posture before and after.
In one implementation, as shown in fig. 2, the step S100 specifically includes the following steps:
step S101, starting a preset image shooting device, and acquiring remote controller images every other preset time period through the image shooting device;
s102, identifying the remote controller image and determining the current body state information of the remote controller image;
and S103, determining the posture change information of the remote controller according to the current posture information.
In specific implementation, for step S101, the image capturing device is pin-hole type, is installed on the peripheral boundary of the mobile terminal, is beautiful and does not occupy the size of the terminal screen, when capturing the image of the remote controller, acquiring remote controller images at intervals of a preset time period, taking 1 to 10 pictures each time, automatically removing pictures with fuzzy images, carrying out the same comparison and classification on the taken pictures, putting the pictures with the remote controller body state similarity reaching more than 90 percent in the pictures together, respectively carrying out statistics on the number of the pictures, extracting a group with the largest statistics number, selecting the picture with the deepest pixel point color saturation from the group to be selected as the image of the remote controller shot at the time, therefore, the most stable remote controller posture image can be shot in each shooting process, and the error of the subsequent confirmation of the pointing position of the remote controller is greatly reduced.
For step S102, the remote controller image needs to be calibrated during image recognition, and the precise calculation of the body state change of the remote controller can be ensured through calibration, so as to precisely position on the terminal screen. The calibration mode comprises 2 calibration modes, wherein the first mode is a simple mode, in the simple mode, the remote controller is kept at a specific position, the transmitting part of the remote controller is aligned to a certain specified position on a terminal screen and lasts for 10 seconds, the shooting device shoots and compares fixed posture images of the remote controller, the similarity is over 95 percent, the comparison is successful, and the verification is successful if the comparison is successful, the other mode is an initial calibration mode, the mode adopts multipoint acquisition, the transmitting part of the remote controller needs to be aligned to random confirmation points generated on the terminal screen, each confirmation point is kept for about 3 seconds, the shooting device shoots and compares the random confirmation points with prestored calibration data, and the posture error of the remote controller does not deviate from the positive and negative 1CM of the prestored posture or the deviation angle is within 5 degrees, so that the calibration is successful. After calibration, the shooting precision can be restored again no matter how the shooting device is placed or the shooting device is aged and the sensitivity is reduced, so that the shooting posture change information is optimal. After calibration is finished, the photographed remote controller posture can be accurately identified, and the correlation value of the current posture is calculated according to multiple dimensions of the remote controller posture, so that the current posture information of the remote controller image is obtained
In step S103, the initial posture information of a remote controller is locked in advance in this embodiment, the initial posture information is used as a reference for the posture change of the whole remote controller, the initial posture of the remote controller is generally stored in advance by taking the posture which is parallel, vertical, 30 degrees or 60 degrees and the like relative to a horizontal plane as a reference, after the subsequent image shooting device finishes shooting the current posture information of the remote controller, the prestored initial posture information is called for comparison, if the current posture information is different from the initial posture information, namely the difference between the current posture and the initial posture angle, distance, direction and the like, and then obtaining difference information, wherein the difference of the general difference information is more than 5 percent, and the program judges that the difference information is different posture, the remote controller is judged to be the same posture within 5 percent by the program, if the difference exists, the difference information is obtained, and the posture change information of the remote controller can be obtained through a series of integration and normalization according to the difference information. The physical state of the remote controller is parameterized by a mathematical method, so that the physical state change of the remote controller is controllable, and a foundation is laid for the accurate pointing of the subsequent remote controller.
For example, the remote controller is randomly placed at an angle to be ready for operation towards the terminal, a pinhole image shooting device preset on the periphery of the terminal starts to shoot images, the image shooting device collects images according to a custom algorithm, the best current remote controller posture information is obtained after image analysis and screening, remote controller posture shooting calibration can be carried out according to a posture calibration algorithm in the period, finally, pre-stored initial posture information and the current obtained remote controller posture information are called to be compared according to a comparison algorithm, and if the program judges that the initial posture information and the current obtained remote controller posture information are different, difference information, namely remote controller posture change information, is obtained.
And S200, determining the pointing position information of the remote controller in the terminal screen according to the posture change information. After the body state change information of the remote controller is obtained in step S100, the signal emitting part pointing information of the remote controller can be obtained by using the body state change information, and which area, i.e., the screen position, on the screen of the pointing terminal the emitting part of the remote controller points to can be known through the pointing information of the emitting part.
In one implementation, as shown in fig. 3, the step S200 specifically includes the following steps:
step S201, determining the direction of a signal transmitting part of the remote controller according to the posture change information;
step S202, acquiring pointing information of the signal transmitting part, wherein the pointing information is used for reflecting the direction of the signal transmitting part of the remote controller;
and S203, determining the position information of the signal transmitted by the signal transmitting part in the terminal screen according to the pointing information, and using the position information as the pointing position information of the remote controller in the terminal screen.
In specific implementation, for step S201, the orientation of the remote controller can be determined through the posture change information of the remote controller acquired in S100, in determining the pointing direction of the remote controller, however, it is necessary to determine whether the orientation of the transmitting part of the remote controller is within the range of the terminal screen, that is, whether or not the transmitting part of the remote controller is located in an area recognizable by the image photographing device on the terminal, there are 2 kinds of area judgment in total, the first is to set the recognizable area, the area is expanded outwards from the terminal screen to form horn-shaped radiation, the remote controller can only be controlled in the horn-shaped area, the second is to judge whether the emission part of the remote controller faces the screen or not, the posture change is performed within 60 degrees above and below the anterior hemisphere, if it is judged as yes under both of the first two judgments, the subsequent determination of the position information of the signal emitted by the signal emitting part within the screen of the terminal may be continued.
In step S202, the pointing information is derived from the posture change information of the remote controller, and a corresponding mathematical algorithm is performed on the initial pointing information according to the posture change information of the remote controller to obtain the orientation of the transmitter of the remote controller, that is, the pointing information of the remote controller is obtained.
For step S203, according to the pointing information of the remote controller, the direction of the transmitting portion of the remote controller is extended according to an algorithm, the transmitting portion is projected onto a pixel point on the terminal plane, the position of the pixel point can be quickly determined based on the center of the screen, and the pixel point is expanded into a 7-point hexagon, the pointing position of the transmitting portion of the remote controller is an area of the hexagon, the remote controller is operated, and the area is correspondingly operated, the hexagon appears only when the remote controller is detected to be used, and is light-colored and transparent, so that corresponding virtual function buttons cannot be shielded.
For example, after the body state change information of the remote controller is determined, whether the transmitting part of the remote controller is in the receivable area of the terminal screen is judged according to the algorithm, if so, the pointing direction of the remote controller is continuously confirmed, the algorithm operation is carried out according to the pointing information of the remote controller, the pointing position of the remote controller on the terminal screen is calculated, the pointing position can be an area with different shapes or a plurality of points, the area is normally displayed in an invisible area, and only when the remote controller is detected to be used, the area appears in a transparent light-colored pattern and is operated by the remote controller, the pointing area of the terminal screen is operated.
And step S300, executing an interaction event at a position corresponding to the pointing position information according to the pointing position information so as to realize interaction control. After the pointing information of the transmitting part of the remote controller is obtained, the remote controller is operated, corresponding keys are pressed, a laser signal is sent out through the transmitting part, and a terminal screen receives and triggers corresponding events to realize interactive control.
In one implementation, as shown in fig. 4, the step S300 specifically includes the following steps:
s301, acquiring a laser signal at a position corresponding to the pointing position information according to the pointing position information;
s302, determining an interaction event corresponding to the laser signal according to the laser signal;
and S303, executing the interaction event to realize interaction control.
In specific implementation, for step S301, the remote controller is operated, the transmitting part of the remote controller sends out a laser signal, the laser photosensitive layer of the terminal screen obtains the transmission of the laser signal, the photosensitive layer circuit receives the laser signal and converts the laser signal into an electrical signal for analysis, clutter is filtered, the intensity of the laser signal is amplified, amplitude-frequency conversion is performed to dissociate the signal, the signal is converted into a digital signal, and the functional information is convenient to process.
For step 302, the digital signal is verified and decoded according to a set decoding mode and converted into an interactive event corresponding to the laser signal, so that the function signal of the remote controller does not affect terminals of the same type.
In step 303, the controller obtains the control signal of the interaction event and the information of the pointing position of the remote controller obtained before, performs corresponding operation after performing program logic judgment, and allocates the required function or application.
For example, when the remote controller is operated, a plurality of function keys are arranged on the remote controller, functions can be set by self-definition, and keys with a plurality of basic functions are also arranged, each function key corresponds to a laser signal, for example, the remote controller has the functions of one-key skip, one-key screen unlocking, click confirmation, single-machine deletion, right-click pull-down menu for information query and the like, the corresponding function key is pressed, laser emitted by a remote controller emitting part is received by a photosensitive layer of a terminal screen, the function information is received by a controller after a series of hardware conversion operations are carried out, the controller carries out program logic judgment according to the function information of the laser and the previously acquired pointing position information of the remote controller, executes the corresponding function, and realizes interactive control.
In summary, in this embodiment, a body state image of a remote controller is first captured by a pinhole image capturing device preset at a peripheral boundary of a terminal device, then the body state image of the remote controller is identified to obtain body state information of the current remote controller, the current body state information is compared with preset initial body state information to obtain body state change information, pointing position information of a transmitting part of the remote controller is determined according to the body state change information, and finally interactive control is performed on the terminal according to the pointing position information and laser information obtained by pressing a function key on the remote controller.
Exemplary device
As shown in fig. 5, an embodiment of the present invention provides an interactive control device based on a body posture change of a remote controller, including: the system comprises a posture information acquisition module 10, a position information acquisition module 20 and an interaction event execution module 30. Specifically, the posture information obtaining module 10 is configured to obtain a remote controller image, and determine the posture change information of the remote controller according to the remote controller image. And the position information acquisition module 20 is configured to determine pointing position information of the remote controller in the terminal screen according to the posture change information. The interaction event executing module 30 is configured to execute an interaction event at a position corresponding to the pointing position information according to the pointing position information, so as to implement interaction control.
Based on the above embodiment, the present invention further provides an intelligent terminal, and a schematic block diagram thereof may be as shown in fig. 6. The intelligent terminal comprises a processor, a memory, a network interface, a display screen and a temperature sensor which are connected through a system bus. Wherein, the processor of the intelligent terminal is used for providing calculation and control capability. The memory of the intelligent terminal comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the intelligent terminal is used for being connected and communicated with an external terminal through a network. The computer program is executed by a processor to implement a laser sensing based interactive control method. The display screen of the intelligent terminal can be a liquid crystal display screen or an electronic ink display screen, and the temperature sensor of the intelligent terminal is arranged inside the intelligent terminal in advance and used for detecting the operating temperature of internal equipment.
It will be understood by those skilled in the art that the block diagram shown in fig. 6 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation to the intelligent terminal to which the solution of the present invention is applied, and a specific intelligent terminal may include more or less components than those shown in the figure, or combine some components, or have a different arrangement of components.
In one embodiment, an intelligent terminal is provided that includes a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
acquiring a remote controller image, and determining the posture change information of the remote controller according to the remote controller image;
determining the pointing position information of the remote controller in a terminal screen according to the posture change information;
and executing an interaction event at a position corresponding to the pointing position information according to the pointing position information to realize interaction control.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the present invention discloses an interaction control method, an intelligent terminal and a storage medium based on laser sensing, and an interaction control method, an intelligent terminal and a storage medium based on the body state change of a remote controller, wherein the method comprises: acquiring a remote controller image, and determining the posture change information of the remote controller according to the remote controller image; determining the pointing position information of the remote controller in a terminal screen according to the posture change information; and executing an interaction event at a position corresponding to the pointing position information according to the pointing position information to realize interaction control. According to the invention, through identifying the body state change image of the remote controller, the position of the emission part of the remote controller pointing to the terminal screen is judged, and finally, the terminal is correspondingly operated according to the laser signal emitted by the emission part, so that the terminal can be interactively controlled based on the body state change of the remote controller, and the operation becomes convenient and fast on the functions of playing games, listening to music or watching movies and the like the operation of a computer by a mouse.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. An interactive control method based on the posture change of a remote controller is characterized by comprising the following steps:
acquiring a remote controller image, and determining the posture change information of the remote controller according to the remote controller image;
determining the pointing position information of the remote controller in a terminal screen according to the posture change information;
and executing an interaction event at a position corresponding to the pointing position information according to the pointing position information to realize interaction control.
2. The interactive control method based on the body state change of the remote controller according to claim 1, wherein the obtaining of the image of the remote controller and the determining of the body state change information of the remote controller according to the image of the remote controller comprise:
starting a preset image shooting device, and acquiring images of the remote controller every other preset time period through the image shooting device;
identifying the remote controller image and determining the current posture information of the remote controller image;
and determining the posture change information of the remote controller according to the current posture information.
3. The method for interactive control based on the body state change of the remote controller according to claim 2, wherein the identifying the image of the remote controller and determining the current body state information of the image of the remote controller comprises:
after the remote controller image is obtained, judging whether the remote controller image needs to be calibrated or not;
if the remote controller image needs to be calibrated, selecting a preset calibration mode to calibrate the remote controller image;
and determining the current posture information according to the calibrated remote controller image.
4. The interactive control method based on the body state change of the remote controller according to claim 2, wherein the determining the body state change information of the remote controller according to the current body state information comprises:
comparing the current posture information with initial posture information of the remote controller, wherein the initial posture information is the posture information of a pre-locked initial image;
if the current posture information is different from the initial posture information, acquiring difference information between the current posture information and the initial posture information;
and generating the posture change information according to the difference information.
5. The interaction control method based on the body state change of the remote controller according to claim 1, wherein the determining the pointing position information of the remote controller in the terminal screen according to the body state change information comprises:
determining the direction of a signal transmitting part of the remote controller according to the posture change information;
acquiring pointing information of the signal transmitting part, wherein the pointing information is used for reflecting the direction of the signal transmitting part of the remote controller;
and determining the position information of the signal transmitted by the signal transmitting part in the terminal screen according to the pointing information, and taking the position information as the pointing position information of the remote controller in the terminal screen.
6. The interaction control method based on the remote controller posture change as claimed in claim 5, wherein the determining the position information of the signal emitted by the signal emitting part in the terminal screen according to the pointing information comprises:
determining whether the direction of a signal transmitting part of the remote controller is within the range of a terminal screen or not according to the pointing information;
and if the signal transmitting part is positioned in the range of the terminal screen, determining the position information of the signal transmitted by the signal transmitting part in the terminal screen.
7. The interaction control method based on the body posture change of the remote controller as claimed in claim 1, wherein the executing the interaction event at the position corresponding to the pointing position information according to the pointing position information to realize the interaction control comprises:
acquiring a laser signal at a position corresponding to the pointing position information according to the pointing position information;
determining an interaction event corresponding to the laser signal according to the laser signal;
and executing the interaction event to realize interaction control.
8. An interactive control device based on the body state change of a remote controller, which is characterized by comprising:
the body state information acquisition module is used for acquiring a remote controller image and determining body state change information of the remote controller according to the remote controller image;
the position information acquisition module is used for determining pointing position information of the remote controller in a terminal screen according to the posture change information;
and the interactive event execution module is used for executing the interactive event at the position corresponding to the pointing position information according to the pointing position information so as to realize interactive control.
9. An intelligent terminal, characterized in that the intelligent terminal comprises a memory, a processor and an interaction control program based on the body state change of the remote controller, which is stored in the memory and can run on the processor, and when the interaction control program based on the body state change of the remote controller is executed by the processor, the steps of the interaction control method based on the body state change of the remote controller according to any one of claims 1 to 7 are implemented.
10. A computer-readable storage medium, on which an interaction control program based on a change in the posture of a remote controller is stored, and when the interaction control program based on the change in the posture of the remote controller is executed by a processor, the steps of the interaction control method based on the change in the posture of the remote controller according to any one of claims 1 to 7 are implemented.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011330623.7A CN112462938A (en) | 2020-11-24 | 2020-11-24 | Interactive control method and device based on remote controller body state change |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011330623.7A CN112462938A (en) | 2020-11-24 | 2020-11-24 | Interactive control method and device based on remote controller body state change |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112462938A true CN112462938A (en) | 2021-03-09 |
Family
ID=74799265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011330623.7A Pending CN112462938A (en) | 2020-11-24 | 2020-11-24 | Interactive control method and device based on remote controller body state change |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112462938A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113671997A (en) * | 2021-08-17 | 2021-11-19 | 深圳市火乐科技发展有限公司 | Projection equipment control method, correction method, remote control device and projection equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004023220A (en) * | 2002-06-13 | 2004-01-22 | Matsushita Electric Ind Co Ltd | Remote control device |
| CN101201968A (en) * | 2006-12-14 | 2008-06-18 | 永新同方信息工程有限公司 | Mouse type remote control device |
| CN101673139A (en) * | 2008-09-10 | 2010-03-17 | Tcl集团股份有限公司 | Remote controller and input system and method thereof |
| KR20120115898A (en) * | 2011-04-11 | 2012-10-19 | 경북대학교 산학협력단 | Display apparatus having camera, remote controller for controlling the display apparatus, and display control method thereof |
| CN103218059A (en) * | 2012-01-19 | 2013-07-24 | 上海广电电子科技有限公司 | Three-dimensional remote control device and positioning method thereof |
| CN105607758A (en) * | 2015-09-22 | 2016-05-25 | 天脉聚源(北京)传媒科技有限公司 | Method and device for remotely controlling video to play |
| CN110493625A (en) * | 2019-09-11 | 2019-11-22 | 四川长虹电器股份有限公司 | Flat panel TV remote control system and method based on camera |
-
2020
- 2020-11-24 CN CN202011330623.7A patent/CN112462938A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004023220A (en) * | 2002-06-13 | 2004-01-22 | Matsushita Electric Ind Co Ltd | Remote control device |
| CN101201968A (en) * | 2006-12-14 | 2008-06-18 | 永新同方信息工程有限公司 | Mouse type remote control device |
| CN101673139A (en) * | 2008-09-10 | 2010-03-17 | Tcl集团股份有限公司 | Remote controller and input system and method thereof |
| KR20120115898A (en) * | 2011-04-11 | 2012-10-19 | 경북대학교 산학협력단 | Display apparatus having camera, remote controller for controlling the display apparatus, and display control method thereof |
| CN103218059A (en) * | 2012-01-19 | 2013-07-24 | 上海广电电子科技有限公司 | Three-dimensional remote control device and positioning method thereof |
| CN105607758A (en) * | 2015-09-22 | 2016-05-25 | 天脉聚源(北京)传媒科技有限公司 | Method and device for remotely controlling video to play |
| CN110493625A (en) * | 2019-09-11 | 2019-11-22 | 四川长虹电器股份有限公司 | Flat panel TV remote control system and method based on camera |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113671997A (en) * | 2021-08-17 | 2021-11-19 | 深圳市火乐科技发展有限公司 | Projection equipment control method, correction method, remote control device and projection equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108288044B (en) | Electronic device, face recognition method and related product | |
| CN107124543B (en) | Shooting method and mobile terminal | |
| KR20190139062A (en) | Electronic device for providing customized quality image and method for controlling thereof | |
| US8643738B2 (en) | Face detection device, digital camera, and computer readable storage medium which stores a face detection program | |
| EP2584531A1 (en) | Gesture recognition device, gesture recognition method, and program | |
| CN108509944B (en) | Fingerprint identification method and device | |
| CN112672069B (en) | Exposure method and apparatus | |
| CN108881875B (en) | Image white balance processing method and device, storage medium and terminal | |
| CN109327691B (en) | Image shooting method and device, storage medium and mobile terminal | |
| CN110834327A (en) | Robot control method and device | |
| CN112889062A (en) | Face recognition data processing method and device, mobile device and computer readable storage medium | |
| JP2018029237A5 (en) | ||
| US20140300620A1 (en) | Adjustment device and method for adjusting chrominance and luminance of display device | |
| CN111080571A (en) | Camera shielding state detection method and device, terminal and storage medium | |
| CN111126147B (en) | Image processing method, device and electronic system | |
| CN112462938A (en) | Interactive control method and device based on remote controller body state change | |
| CN113191198B (en) | Fingerprint identification method, fingerprint identification device, mobile terminal and storage medium | |
| KR20220120660A (en) | Calibration methods, devices, instruments, media, programs and temperature measurement facial recognition devices | |
| CN112948048A (en) | Information processing method, information processing device, electronic equipment and storage medium | |
| CN111885371A (en) | Image occlusion detection method and device, electronic equipment and computer readable medium | |
| CN112153300A (en) | Multi-view camera exposure method, device, equipment and medium | |
| CN112418006A (en) | Target identification method, device and electronic system | |
| CN112165579A (en) | Standard shooting method, system, computer equipment and storage medium | |
| US9842406B2 (en) | System and method for determining colors of foreground, and computer readable recording medium therefor | |
| CN108763906B (en) | Biological feature recognition method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |