CN111897430A - Application control method, display terminal and computer readable storage medium - Google Patents

Application control method, display terminal and computer readable storage medium Download PDF

Info

Publication number
CN111897430A
CN111897430A CN202010755507.3A CN202010755507A CN111897430A CN 111897430 A CN111897430 A CN 111897430A CN 202010755507 A CN202010755507 A CN 202010755507A CN 111897430 A CN111897430 A CN 111897430A
Authority
CN
China
Prior art keywords
bone
image information
user image
preset
display interface
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010755507.3A
Other languages
Chinese (zh)
Other versions
CN111897430B (en
Inventor
刘熙桐
王维才
郑东岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Skyworth RGB Electronics Co Ltd
Original Assignee
Shenzhen Skyworth RGB Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Skyworth RGB Electronics Co Ltd filed Critical Shenzhen Skyworth RGB Electronics Co Ltd
Priority to CN202010755507.3A priority Critical patent/CN111897430B/en
Publication of CN111897430A publication Critical patent/CN111897430A/en
Application granted granted Critical
Publication of CN111897430B publication Critical patent/CN111897430B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/308Details of the user interface
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides an application control method, a display terminal and a computer readable storage medium, wherein the method comprises the following steps: receiving an operation instruction, displaying a display interface corresponding to the operation instruction, and acquiring user image information in real time through an image recognition module; carrying out bone identification on the user image information to obtain at least one bone characteristic point; the method comprises the steps of determining the positions of the bone characteristic points in user image information, determining the positions and corresponding points of the display interface, executing preset operation corresponding to the corresponding points, identifying a user image through an image identification module to obtain the bone characteristic points, executing operation in a game according to the obtained bone characteristic points, enabling a body sensing game to be carried out without the help of external equipment, and improving the recognition rate of user actions through bone identification.

Description

Application control method, display terminal and computer readable storage medium
Technical Field
The present invention relates to the field of display terminal control, and in particular, to a control method for an application, a display terminal, and a computer-readable storage medium.
Background
The motion sensing game in the prior art needs external equipment such as a handle or an operating rod, a user needs to hold the external equipment all the time when playing the game, the user cannot be put into the game experience all over the body, and the accuracy of recognition is not high due to the fact that the user only needs to rely on the external equipment to perform motion recognition.
Disclosure of Invention
The invention mainly aims to provide an application control method, a display terminal and a computer readable storage medium, and aims to solve the problem that a motion sensing game needs to be assisted by external equipment in the prior art.
In order to achieve the above object, the present invention provides a method for controlling an application, the method comprising the steps of:
receiving an operation instruction, displaying a display interface corresponding to the operation instruction, and acquiring user image information in real time through an image recognition module;
carrying out bone identification on the user image information to obtain at least one bone characteristic point;
and determining the position of the bone characteristic point in the user image information, determining the position and a corresponding point of the display interface, and executing a preset operation corresponding to the corresponding point.
Optionally, the step of executing the preset operation corresponding to the corresponding point includes:
obtaining bone feature point arrangement according to the positions of the bone feature points in the user image information;
judging whether the arrangement of the bone characteristic points is matched with the arrangement of the preset characteristic points corresponding to the current display interface or not;
and if so, displaying the next display interface of the current display interface according to the preset display arrangement list.
Optionally, the step of obtaining the user image information in real time by the image recognition module further includes:
and carrying out bone identification on the user image information, and when the bone characteristic points cannot be identified, pausing the application and displaying pause information.
Optionally, the step of executing the preset operation corresponding to the corresponding point includes:
generating a bone characteristic point moving track according to the positions of the bone characteristic points in the user image information and the positions of the bone characteristic points in the user image information;
and executing preset operation corresponding to the moving track.
Optionally, the step of displaying the display interface corresponding to the operation instruction includes:
judging whether the current operating environment meets the operating conditions;
if not, displaying error information;
if yes, executing the following steps: and displaying a display interface corresponding to the operation instruction.
Optionally, the step of judging whether the current operating environment meets the operating condition includes:
acquiring operation data of an image identification module, and judging whether the image identification module operates normally;
if not, the current operating environment does not accord with the operating conditions;
if so, acquiring the authority state, and judging whether the current operating environment meets the operating conditions according to the authority state.
Optionally, the step of judging whether the current operating environment meets the operating condition according to the permission status includes:
judging whether an operation permission is acquired or not according to the permission state;
if not, the current operating environment does not accord with the operating conditions;
if yes, the current operation environment meets the operation condition.
Optionally, before the step of displaying the display interface corresponding to the operation instruction, the method further includes:
acquiring user image information through an image identification module, carrying out bone identification on the user image information, and judging whether bone characteristic points are acquired or not;
if yes, displaying preset checking skeleton feature point arrangement, acquiring user image information in real time, and carrying out skeleton recognition on the user image information to acquire skeleton feature points;
obtaining a check skeleton characteristic point arrangement according to the skeleton characteristic points, and judging whether the check skeleton characteristic point arrangement is matched with the preset check skeleton characteristic point arrangement within a preset time;
and if the verified bone characteristic point arrangement is matched with the preset verified bone characteristic point arrangement within the preset time, completing the bone identification verification.
To achieve the above object, the present invention also provides a display terminal including a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program implementing the steps of the control method of the application as described above when executed by the processor.
To achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the control method of an application as described above.
The invention provides an application control method, a display terminal and a computer readable storage medium, which receive an operation instruction, display a display interface corresponding to the operation instruction, and acquire user image information in real time through an image identification module; carrying out bone identification on the user image information to obtain at least one bone characteristic point; the method comprises the steps of determining the positions of the bone characteristic points in user image information, determining the positions and corresponding points of the display interface, executing preset operation corresponding to the corresponding points, identifying a user image through an image identification module to obtain the bone characteristic points, executing operation in a game according to the obtained bone characteristic points, enabling a body sensing game to be carried out without the help of external equipment, and improving the recognition rate of user actions through bone identification.
Drawings
FIG. 1 is a schematic flow chart of a control method according to a first embodiment of the present invention;
fig. 2 is a detailed flowchart of step S30 of the second embodiment of the control method applied in the present invention;
fig. 3 is a detailed flowchart of step S30 of the fourth embodiment of the control method applied in the present invention;
fig. 4 is a schematic structural diagram of a module of the display terminal according to the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides an application control method, referring to fig. 1, fig. 1 is a schematic flow chart of a first embodiment of the application control method of the invention, and the method comprises the following steps:
step S10, receiving an operation instruction, displaying a display interface corresponding to the operation instruction, and acquiring user image information in real time through an image recognition module;
the running instruction is an instruction sent by a user for starting running the application, and can be sent through a remote controller matched with the display terminal, an entity key or a virtual key on the display terminal, or a control program installed on a mobile terminal bound with the display terminal. In this embodiment, the display interface corresponding to the operation instruction is an in-application display interface after the application is operated. In this embodiment, the display interface is a game interface.
Step S20, carrying out bone identification on the user image information to obtain at least one bone characteristic point;
in this embodiment, the image recognition module is the camera, acquires user's image through the camera, and the rethread is right user's image discerns the skeleton characteristic point that obtains and user's image corresponds, in this embodiment, skeleton characteristic point is 14, corresponds head, chin, left side waist, right side waist, left shoulder, right shoulder, left elbow, right elbow, left hand, right hand, left knee, right knee, left ankle and right ankle respectively.
Step S30, determining the position of the bone feature point in the user image information, determining the position and the corresponding point of the display interface, and executing the preset operation corresponding to the corresponding point.
After the bone characteristic points are obtained, the bone characteristic points are correspondingly displayed on a display interface in real time, the display interface can display the arrangement of operation buttons and preset characteristic points, and the like, when the bone characteristic points are contacted with the operation buttons on the display interface, the operation corresponding to the contacted operation buttons is executed, and furthermore, the bone characteristic points corresponding to the left hand or the right hand can be limited to be only allowed to trigger the operation of the operation buttons. Further, when the bone feature point is contacted with the operation button on the display interface for a preset contact time, executing operation corresponding to the contacted operation button; and when the arrangement of the bone characteristic points is matched with the preset characteristic point arrangement, executing operation corresponding to the preset characteristic point arrangement.
According to the embodiment, the image recognition module is used for recognizing the user image to acquire the bone feature points, and then the operation in the game is executed according to the acquired bone feature points, so that the motion sensing game can be played without external equipment, and the recognition rate of the user action can be improved through bone recognition.
Further, referring to fig. 2, in the second embodiment of the control method based on the application of the present invention as set forth in the first embodiment of the present invention, the step S30 includes the steps of:
step S31, obtaining skeleton characteristic point arrangement according to the position of each skeleton characteristic point in the user image information;
step S32, judging whether the arrangement of the bone characteristic points is matched with the arrangement of the preset characteristic points corresponding to the current display interface;
in step S33, the next display interface of the current display interface is displayed according to the preset display arrangement list.
The arrangement of the bone characteristic points not only meets the requirements on the point positions of all the bone characteristic points, but also meets the requirements on the bone characteristic points corresponding to all the bone positions. When the image information of the user is subjected to bone recognition, the bone feature points to be recognized are marked to bind the bone feature points and a bone position, such as the left elbow, each feature point in the preset feature point arrangement is bound with a bone position, and when judging whether the bone feature point arrangement is matched with the preset feature point arrangement corresponding to the current display interface or not, not only is the bone feature point matching required to exist in each preset feature point in the preset feature point arrangement, but also each preset feature point is required to be matched with the bone feature point corresponding to the bound bone position. The feature point arrangement can be displayed in various forms, such as a human body virtual model, a skeleton diagram or a trunk diagram, and the like, and the feature point arrangement is formed by connecting the skeleton feature points. Further, when judging whether the arrangement of the bone feature points is matched with the arrangement of the preset feature points corresponding to the current display interface, setting a deviation threshold value, such as pixel points, angles and the like, for example, an included angle between a connecting line of a left shoulder feature point and a left elbow feature point in the arrangement of the preset feature points and a connecting line of the left elbow feature point and the left hand feature point is 90 degrees, setting an angle deviation threshold value to be 5 degrees, namely, when an included angle between a connecting line of the left shoulder feature point and the left elbow feature point in the arrangement of the bone feature points and a connecting line of the left elbow feature point and the left hand feature point is 85-95 degrees, judging that the bone feature points are matched.
The application of this embodiment is a game, in which a display interface is displayed when the game is started, a preset feature point arrangement is displayed on the display interface, when it is recognized that a bone feature point arrangement matches the preset feature point arrangement being displayed, a next preset feature point arrangement is displayed, and if it is recognized that the bone feature point arrangement does not match the preset feature point arrangement being displayed within a preset time, failure information is displayed, and the next preset feature point arrangement is displayed until a preset number of preset feature point arrangements are displayed, and a score is displayed.
The embodiment enables progress of a game to be advanced based on the skeletal feature points, and a user can play the game without an external device.
Further, in a third embodiment of the control method based on the application of the present invention as set forth in the second embodiment of the present invention, after the step S10, the method further includes the steps of:
and step S40, carrying out bone recognition on the user image information, and when the bone characteristic points cannot be recognized, pausing the application and displaying pause information.
When the bone feature points cannot be identified, the camera cannot acquire the user image due to various reasons, for example, the user leaves the imaging range of the camera; for another example, the system identification system fails, resulting in failure to identify skeletal feature points based on the user image. Therefore, when the bone feature points cannot be identified, the application needs to be paused so as to display pause information for the user to perform error troubleshooting. Further, when the bone feature points cannot be identified, the acquired user image can be identified, whether a user exists in the camera imaging range or not is judged, if not, the application running state is kept, and if yes, the application is paused and pause information is displayed. When the user temporarily leaves the camera imaging range, the application is not paused, so that the user can directly operate when returning to the camera imaging range again. Further, a preset pause time threshold may be set, and when it is not recognized that the bone feature point reaches the preset pause time threshold, the application is paused and pause information is displayed.
According to the embodiment, when the bone characteristic points cannot be identified, application is suspended, and suspension information is displayed, so that a user can check faults in time.
Further, referring to fig. 3, in a fourth embodiment of the control method based on the application of the present invention as set forth in the first embodiment of the present invention, the step S30 includes the steps of:
step S34, generating a skeleton characteristic point moving track according to the position of each skeleton characteristic point in the user image information and the positions of each skeleton characteristic point in the plurality of user image information;
and step S35, executing preset operation corresponding to the movement track.
And binding each bone feature point corresponding to one bone position, synthesizing the positions of the bone points corresponding to one bone position within a period of time to obtain the movement track of the bone feature points, matching in a preset movement track instruction library according to the obtained movement track, and executing the operation corresponding to the movement track if the corresponding movement track is matched.
In the embodiment, the preset operation corresponding to the moving track is matched, so that the operation function is widened, and the use of a user is facilitated.
Further, in a fifth embodiment of the control method based on the application of the present invention as set forth in the first embodiment of the present invention, the step of displaying the display interface corresponding to the operation instruction in the step S10 includes:
step S11, judging whether the current operation environment meets the operation condition;
step S12, if not, displaying error information;
in step S13, if yes, the method proceeds to: and displaying a display interface corresponding to the operation instruction.
The operation conditions include a hardware state condition, a software state condition and the like, and when the application is started under the condition that the current operation environment does not meet the operation conditions, an error problem may occur in the operation process, so that a user is required to perform error troubleshooting in time.
According to the method and the device, the error information is displayed when the current operating environment does not accord with the operating conditions, so that a user can check errors in time, and the problem is avoided in the operating process.
Further, in a sixth embodiment of the control method according to the application of the present invention as set forth in the first embodiment of the present invention, the step S11 includes the steps of:
step S111, acquiring operation data of the image recognition module, and judging whether the image recognition module normally operates;
step S112, if not, the current operating environment does not accord with the operating conditions;
and step S113, if yes, acquiring the authority state, and judging whether the current operating environment meets the operating conditions according to the authority state.
Further, the step of step S11 further includes:
step S114, judging whether an operation authority is acquired according to the authority state;
step S115, if not, the current operating environment does not accord with the operating conditions;
and step S116, if yes, the current operating environment meets the operating conditions.
The operation permission comprises camera permission, voice acquisition permission and the like, normal operation of the image recognition module is ensured, after the operation permission is acquired, the current operation environment is considered to be in accordance with the operation condition, and the application can be started. Further, when the operation authority is not acquired, the authority display request is displayed to acquire the operation authority.
The embodiment ensures that the application runs in the running environment meeting the running conditions by judging whether the image identification module runs normally and detecting whether the running authority is acquired.
Further, in a seventh embodiment of the control method based on the application of the present invention as set forth in the first embodiment of the present invention, the step of displaying the display interface corresponding to the operation instruction in the step S10 includes:
step S14, acquiring user image information through an image identification module, carrying out bone identification on the user image information, and judging whether bone characteristic points are acquired;
step S15, if yes, displaying preset checking skeleton characteristic point arrangement, acquiring user image information in real time, and carrying out skeleton identification on the user image information to acquire skeleton characteristic points;
step S16, obtaining check skeleton characteristic point arrangement according to skeleton characteristic points, and judging whether the check skeleton characteristic point arrangement is matched with the preset check skeleton characteristic point arrangement within preset time;
step S17, if the verification skeleton characteristic point arrangement is matched with the preset verification skeleton characteristic point arrangement within the preset time, the skeleton identification verification is completed.
And judging whether the bone identification function is normal or not by judging whether the bone characteristic points are acquired or not, and executing bone identification verification when the bone identification function is normal so as to improve the accuracy of bone identification.
The embodiment ensures the normal operation of the bone identification function and improves the accuracy of the bone identification by carrying out the bone identification check.
Referring to fig. 4, the display terminal may include components of a communication module 10, a memory 20, and a processor 30 in a hardware structure. In the display terminal, the processor 30 is connected to the memory 20 and the communication module 10, respectively, the memory 20 stores thereon a computer program, which is executed by the processor 30 at the same time, and when executed, implements the steps of the above-mentioned method embodiments.
The communication module 10 may be connected to an external communication device through a network. The communication module 10 may receive a request from an external communication device, and may also send a request, an instruction, and information to the external communication device, where the external communication device may be another display terminal, a server, or an internet of things device, such as a television.
The memory 20 may be used to store software programs as well as various data. The memory 20 may mainly include a program storage area and a data storage area, where the program storage area may store an operating system, an application program required by at least one function (for example, obtaining user image information through an image recognition module, performing bone recognition on the user image information, and determining whether a bone feature point is obtained), and the like; the storage data area may include a database, and the storage data area may store data or information created according to use of the system, or the like. Further, the memory 20 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 30, which is a control center of the display terminal, connects various parts of the entire display terminal using various interfaces and lines, and performs various functions of the display terminal and processes data by operating or executing software programs and/or modules stored in the memory 20 and calling data stored in the memory 20, thereby performing overall monitoring of the display terminal. Processor 30 may include one or more processing units; alternatively, the processor 30 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 30.
Although not shown in fig. 4, the display terminal may further include a circuit control module for connecting with a power supply to ensure normal operation of other components. Those skilled in the art will appreciate that the display terminal configuration shown in fig. 4 does not constitute a limitation of the display terminal and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The invention also proposes a computer-readable storage medium on which a computer program is stored. The computer-readable storage medium may be the Memory 20 in the display terminal of fig. 4, and may also be at least one of a ROM (Read-Only Memory)/RAM (Random Access Memory), a magnetic disk, and an optical disk, where the computer-readable storage medium includes instructions for enabling a terminal device (which may be a television, an automobile, a mobile phone, a computer, a server, a terminal, or a network device) having a processor to execute the method according to the embodiments of the present invention.
In the present invention, the terms "first", "second", "third", "fourth" and "fifth" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance, and those skilled in the art can understand the specific meanings of the above terms in the present invention according to specific situations.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Although the embodiment of the present invention has been shown and described, the scope of the present invention is not limited thereto, it should be understood that the above embodiment is illustrative and not to be construed as limiting the present invention, and that those skilled in the art can make changes, modifications and substitutions to the above embodiment within the scope of the present invention, and that these changes, modifications and substitutions should be covered by the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (10)

1. A method for controlling an application, the method comprising:
receiving an operation instruction, displaying a display interface corresponding to the operation instruction, and acquiring user image information in real time through an image recognition module;
carrying out bone identification on the user image information to obtain at least one bone characteristic point;
and determining the position of the bone characteristic point in the user image information, determining the position and a corresponding point of the display interface, and executing a preset operation corresponding to the corresponding point.
2. The method for controlling an application according to claim 1, wherein the step of performing the preset operation corresponding to the corresponding point comprises:
obtaining bone feature point arrangement according to the positions of the bone feature points in the user image information;
judging whether the arrangement of the bone characteristic points is matched with the arrangement of the preset characteristic points corresponding to the current display interface or not;
and if so, displaying the next display interface of the current display interface according to the preset display arrangement list.
3. The method for controlling an application according to claim 2, wherein the step of obtaining the user image information in real time by the image recognition module further comprises:
and carrying out bone identification on the user image information, and when the bone characteristic points cannot be identified, pausing the application and displaying pause information.
4. The method for controlling an application according to claim 1, wherein the step of performing the preset operation corresponding to the corresponding point comprises:
generating a bone characteristic point moving track according to the positions of the bone characteristic points in the user image information and the positions of the bone characteristic points in the user image information;
and executing preset operation corresponding to the moving track.
5. The method for controlling an application according to claim 1, wherein the step of displaying the display interface corresponding to the execution instruction previously comprises:
judging whether the current operating environment meets the operating conditions;
if not, displaying error information;
if yes, executing the following steps: and displaying a display interface corresponding to the operation instruction.
6. The method for controlling an application according to claim 5, wherein the step of determining whether the current operating environment meets the operating condition comprises:
acquiring operation data of an image identification module, and judging whether the image identification module operates normally;
if not, the current operating environment does not accord with the operating conditions;
if so, acquiring the authority state, and judging whether the current operating environment meets the operating conditions according to the authority state.
7. The method for controlling an application according to claim 6, wherein the step of determining whether the current operating environment meets the operating condition according to the permission status comprises:
judging whether an operation permission is acquired or not according to the permission state;
if not, the current operating environment does not accord with the operating conditions;
if yes, the current operation environment meets the operation condition.
8. The method for controlling an application according to claim 1, wherein the step of displaying the display interface corresponding to the execution instruction further comprises:
acquiring user image information through an image identification module, carrying out bone identification on the user image information, and judging whether bone characteristic points are acquired or not;
if yes, displaying preset checking skeleton feature point arrangement, acquiring user image information in real time, and carrying out skeleton recognition on the user image information to acquire skeleton feature points;
obtaining a check skeleton characteristic point arrangement according to the skeleton characteristic points, and judging whether the check skeleton characteristic point arrangement is matched with the preset check skeleton characteristic point arrangement within a preset time;
and if the verified bone characteristic point arrangement is matched with the preset verified bone characteristic point arrangement within the preset time, completing the bone identification verification.
9. A display terminal, characterized in that it comprises a memory, a processor and a computer program stored on said memory and executable on said processor, said computer program, when executed by said processor, implementing the steps of the control method of an application according to any one of claims 1 to 8.
10. A computer-readable storage medium, characterized in that a computer program is stored thereon, which computer program, when being executed by a processor, carries out the steps of a method of controlling an application according to any one of claims 1 to 8.
CN202010755507.3A 2020-07-30 2020-07-30 Application control method, display terminal and computer readable storage medium Active CN111897430B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010755507.3A CN111897430B (en) 2020-07-30 2020-07-30 Application control method, display terminal and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010755507.3A CN111897430B (en) 2020-07-30 2020-07-30 Application control method, display terminal and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN111897430A true CN111897430A (en) 2020-11-06
CN111897430B CN111897430B (en) 2023-05-23

Family

ID=73183829

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010755507.3A Active CN111897430B (en) 2020-07-30 2020-07-30 Application control method, display terminal and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN111897430B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112473121A (en) * 2020-11-13 2021-03-12 海信视像科技股份有限公司 Display device and method for displaying dodging ball based on limb recognition
CN113058261A (en) * 2021-04-22 2021-07-02 杭州当贝网络科技有限公司 Somatosensory action recognition method and system based on reality scene and game scene
CN113058258A (en) * 2021-04-22 2021-07-02 杭州当贝网络科技有限公司 Method, system and storage medium for recognizing expected somatosensory action based on player game
CN113058260A (en) * 2021-04-22 2021-07-02 杭州当贝网络科技有限公司 Method, system and storage medium for recognizing motion of body based on player portrait
CN113542832A (en) * 2021-07-01 2021-10-22 深圳创维-Rgb电子有限公司 Display control method, display device, and computer-readable storage medium
WO2022100262A1 (en) * 2020-11-12 2022-05-19 海信视像科技股份有限公司 Display device, human body posture detection method, and application

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104375630A (en) * 2013-10-22 2015-02-25 安徽寰智信息科技股份有限公司 Public information terminal based on Kinect
US20170177087A1 (en) * 2015-12-18 2017-06-22 Intel Corporation Hand skeleton comparison and selection for hand and gesture recognition with a computing interface
CN107067451A (en) * 2017-04-07 2017-08-18 广州爱九游信息技术有限公司 The implementation method and device of dynamic bone in animation
CN108635840A (en) * 2018-05-17 2018-10-12 南京华捷艾米软件科技有限公司 A kind of mobile phone games motion sensing manipulation system and method based on Sikuli image recognitions
CN110559645A (en) * 2019-07-18 2019-12-13 华为技术有限公司 Application operation method and electronic equipment
CN110947181A (en) * 2018-09-26 2020-04-03 Oppo广东移动通信有限公司 Game picture display method, game picture display device, storage medium and electronic equipment
CN111045511A (en) * 2018-10-15 2020-04-21 华为技术有限公司 Gesture-based control method and terminal equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104375630A (en) * 2013-10-22 2015-02-25 安徽寰智信息科技股份有限公司 Public information terminal based on Kinect
US20170177087A1 (en) * 2015-12-18 2017-06-22 Intel Corporation Hand skeleton comparison and selection for hand and gesture recognition with a computing interface
CN107067451A (en) * 2017-04-07 2017-08-18 广州爱九游信息技术有限公司 The implementation method and device of dynamic bone in animation
CN108635840A (en) * 2018-05-17 2018-10-12 南京华捷艾米软件科技有限公司 A kind of mobile phone games motion sensing manipulation system and method based on Sikuli image recognitions
CN110947181A (en) * 2018-09-26 2020-04-03 Oppo广东移动通信有限公司 Game picture display method, game picture display device, storage medium and electronic equipment
CN111045511A (en) * 2018-10-15 2020-04-21 华为技术有限公司 Gesture-based control method and terminal equipment
CN110559645A (en) * 2019-07-18 2019-12-13 华为技术有限公司 Application operation method and electronic equipment

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022100262A1 (en) * 2020-11-12 2022-05-19 海信视像科技股份有限公司 Display device, human body posture detection method, and application
CN112473121A (en) * 2020-11-13 2021-03-12 海信视像科技股份有限公司 Display device and method for displaying dodging ball based on limb recognition
CN112473121B (en) * 2020-11-13 2023-06-09 海信视像科技股份有限公司 Display device and avoidance ball display method based on limb identification
CN113058261A (en) * 2021-04-22 2021-07-02 杭州当贝网络科技有限公司 Somatosensory action recognition method and system based on reality scene and game scene
CN113058258A (en) * 2021-04-22 2021-07-02 杭州当贝网络科技有限公司 Method, system and storage medium for recognizing expected somatosensory action based on player game
CN113058260A (en) * 2021-04-22 2021-07-02 杭州当贝网络科技有限公司 Method, system and storage medium for recognizing motion of body based on player portrait
CN113058260B (en) * 2021-04-22 2024-02-02 杭州当贝网络科技有限公司 Method, system and storage medium for identifying motion of body feeling based on player image
CN113058261B (en) * 2021-04-22 2024-04-19 杭州当贝网络科技有限公司 Somatosensory motion recognition method and system based on reality scene and game scene
CN113058258B (en) * 2021-04-22 2024-04-19 杭州当贝网络科技有限公司 Method, system and storage medium for identifying motion based on expected motion of player game
CN113542832A (en) * 2021-07-01 2021-10-22 深圳创维-Rgb电子有限公司 Display control method, display device, and computer-readable storage medium

Also Published As

Publication number Publication date
CN111897430B (en) 2023-05-23

Similar Documents

Publication Publication Date Title
CN111897430B (en) Application control method, display terminal and computer readable storage medium
KR101864380B1 (en) Surgical image data learning system
CN111191599B (en) Gesture recognition method, device, equipment and storage medium
WO2021121029A1 (en) Training model updating method and system, and agent, server and computer-readable storage medium
CN110227254B (en) Visual angle switching control method and device, storage medium and electronic device
KR20190088375A (en) Surgical image data learning system
CN110780789A (en) Game application starting method and device, storage medium and electronic device
EP3628380A1 (en) Method for controlling virtual objects, computer readable storage medium and electronic device
KR102241414B1 (en) Electronic device for providing a feedback for a specivic motion using a machine learning model a and machine learning model and method for operating thereof
KR102594938B1 (en) Apparatus and method for comparing and correcting sports posture using neural network
CN108096833B (en) Motion sensing game control method and device based on cascade neural network and computing equipment
CN112486691A (en) Control method and system of display device and computer readable storage medium
CN110597395A (en) Object interaction control method and device, storage medium and electronic device
CN112904994A (en) Gesture recognition method and device, computer equipment and storage medium
CN110977959B (en) Control device, robot, control method, and storage medium
CN111273772A (en) Augmented reality interaction method and device based on slam mapping method
CN114363225B (en) MTQQ protocol-based equipment debugging mode, system and storage medium
CN109740511B (en) Facial expression matching method, device, equipment and storage medium
CN114513694A (en) Scoring determination method and device, electronic equipment and storage medium
CN112954113B (en) Scene switching method and device, electronic equipment and storage medium
CN110781084B (en) Method and device for determining stuck identification parameter, storage medium and electronic device
CN113434422A (en) Virtual device debugging method and device and virtual device debugging system
CN117455989A (en) Indoor scene SLAM tracking method and device, head-mounted equipment and medium
CN113591885A (en) Target detection model training method, device and computer storage medium
CN113018853B (en) Data processing method, data processing device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant