CN113253847B - Terminal control method, device, terminal and storage medium - Google Patents
Terminal control method, device, terminal and storage medium Download PDFInfo
- Publication number
- CN113253847B CN113253847B CN202110636871.2A CN202110636871A CN113253847B CN 113253847 B CN113253847 B CN 113253847B CN 202110636871 A CN202110636871 A CN 202110636871A CN 113253847 B CN113253847 B CN 113253847B
- Authority
- CN
- China
- Prior art keywords
- preset
- gesture
- preset mode
- mode
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 230000004044 response Effects 0.000 claims abstract description 18
- 238000012790 confirmation Methods 0.000 claims description 8
- 239000000758 substrate Substances 0.000 claims 5
- 238000001514 detection method Methods 0.000 claims 1
- 238000012545 processing Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 7
- 238000004590 computer program Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000002829 reductive effect Effects 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 230000000977 initiatory effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000000670 limiting effect Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the disclosure provides a control method and device of a terminal, the terminal and a storage medium. The control method of the terminal provided by the embodiment of the disclosure comprises the following steps: acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to the first gesture in the first image, wherein the preset mode has an associated preset gesture; if the preset condition is met, entering a preset mode, and immediately responding to the recognized preset gesture in the preset mode during the preset mode. The method provided by the embodiment of the disclosure can improve the use smoothness of the user while reducing false triggering, thereby improving the use experience of the user.
Description
Technical Field
The disclosure relates to the technical field of intelligent terminals, and in particular relates to a control method and device of a terminal, the terminal and a storage medium.
Background
Part of intelligent terminals, such as intelligent televisions, have gesture recognition functions, take gestures of users through cameras, execute operations associated with the gestures, such as mouse movement, clicking and the like, so that control modes are enriched, and user experience is improved.
Disclosure of Invention
The disclosure provides a control method and device of a terminal, the terminal and a storage medium.
The present disclosure adopts the following technical solutions.
In some embodiments, the present disclosure provides a method for controlling a terminal, including:
Acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to a first gesture in the first image, wherein the preset mode has an associated preset gesture;
If the preset condition is met, entering the preset mode, and immediately responding to the recognized preset gesture of the preset mode during the preset mode.
In some embodiments, the present disclosure provides a control apparatus of a terminal, including:
The device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to the first gesture in the first image, wherein the preset mode has an associated preset gesture;
and the control unit is used for entering the preset mode if the preset condition is met, and immediately responding to the recognized preset gesture of the preset mode during the preset mode.
In some embodiments, the present disclosure provides a terminal comprising: at least one memory and at least one processor;
the memory is used for storing program codes, and the processor is used for calling the program codes stored in the memory so as to enable the terminal to execute the method.
In some embodiments, the present disclosure provides a non-transitory computer storage medium storing program code that, when executed by a computer device, causes the computer device to perform the method of any one of the present disclosure.
According to the control method of the terminal, a first image is obtained, whether preset conditions for entering a preset mode are met or not is determined in response to the fact that a first gesture is arranged in the first image, and the preset mode is provided with an associated preset gesture; if the preset condition is met, entering a preset mode, and immediately responding to the recognized preset gesture in the preset mode during the preset mode, and in some embodiments, not responding to the first gesture in the first image if the preset condition is not met. The method provided by the embodiment of the disclosure can improve the use smoothness of the user while reducing false triggering, thereby improving the use experience of the user.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by reference to the following detailed description when taken in conjunction with the accompanying drawings. The same or similar reference numbers will be used throughout the drawings to refer to the same or like elements. It should be understood that the figures are schematic and that elements and components are not necessarily drawn to scale.
Fig. 1 is a flowchart of a control method of a terminal according to an embodiment of the present disclosure.
Fig. 2 is a flowchart of another control method of a terminal according to an embodiment of the present disclosure.
Fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure have been shown in the accompanying drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustration purposes only and are not intended to limit the scope of the present disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "including" and variations thereof as used herein are intended to be open-ended, i.e., including, but not limited to. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments. Related definitions of other terms will be given in the description below.
It should be noted that the terms "first," "second," and the like in this disclosure are merely used to distinguish between different devices, modules, or units and are not used to define an order or interdependence of functions performed by the devices, modules, or units.
It should be noted that references to "a" and "an" in this disclosure are intended to be illustrative rather than limiting, and those of ordinary skill in the art will appreciate that "one or more" is intended to be construed as "one or more" unless the context clearly indicates otherwise.
The names of messages or information interacted between the various devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.
Some smart televisions are configured with a camera for capturing a gesture image of a user, and responding to a gesture of the user according to the gesture image of the user, for example, the user can control movement of a focus on the smart television through gesture operation, or perform control such as clicking, selecting, and the like. In the interaction process of the user and the intelligent television, if each recognized gesture is immediately responded, false recognition is easy to occur, if the gesture is recognized and then is responded after a period of time, such as confirmation, the interaction experience of the user is unsmooth, the experience is reduced, and therefore the fluency of the user interaction is ensured while false triggering is reduced, so that the problem to be solved is urgent.
The following describes in detail the schemes provided by the embodiments of the present disclosure with reference to the accompanying drawings.
As shown in fig. 1, fig. 1 is a flowchart of a control method of a terminal according to an embodiment of the present disclosure, including the following steps S11 to S12. The terminal may be, for example, a terminal with a camera, for example, a television.
S11: and acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to the first gesture in the first image.
In some embodiments, a preset mode is defined in the terminal, the preset mode has associated preset gestures, the number of the preset gestures may be multiple, the preset gestures may be, for example, gestures that may be responded in the preset mode, for example, gestures may be limb actions of the user, and may generally refer to limb actions of the hand of the user, and the gestures of the user may be captured and determined through a camera on the terminal. The preset mode may be, for example, a focus control mode, and the preset gesture may be a preset gesture for controlling focus movement by a user, and may be, for example, upward pointing, downward pointing, leftward pointing, and rightward pointing. The focus may be, for example, a mouse.
In some embodiments, the first image may be captured by a camera of the terminal, or may be obtained by an external device (for example, an external camera) in communication with the terminal, where the first image may be, for example, an image of a user, and the first gesture in the first image refers to a gesture displayed in a screen displayed by the first image, and the first gesture is a gesture that can be recognized by the terminal, that is, a gesture with a preset meaning. Under the condition that the terminal detects that the first gesture is in the first image, the terminal does not directly respond to the first gesture, but judges whether a preset condition for entering a preset mode is met or not, wherein the preset condition can be one or more conditions, and the preset condition is not limited. For example, it may include that the current user has the right to use the preset mode, etc.
S12: if the preset condition is met, entering a preset mode, and immediately responding to the recognized preset gesture in the preset mode during the preset mode.
In some embodiments, when the preset condition is met, the terminal enters a preset mode, and in the preset mode, the terminal immediately responds to the detected preset gesture associated with the preset mode without confirmation, so that the user can experience higher fluency. In some embodiments, images are captured during the preset mode and the captured images are identified to determine the identified gesture, and if the identified gesture is a preset gesture associated with the preset mode, the terminal immediately responds, in some embodiments, captures a user image in real time or periodically, and analyzes the user image to identify the gesture of the user.
In some embodiments, please refer to fig. 2, in some embodiments of the present disclosure, comprising:
S11: and acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to the first gesture in the first image.
S12: if the preset condition is met, entering a preset mode, and immediately responding to the recognized preset gesture in the preset mode during the preset mode.
S13: if the preset condition is not met, the first gesture in the first image is not responded.
In some embodiments, if the preset condition is not met, it indicates that the first gesture performed by the user is a false trigger, and at this time, the first gesture in the first image is not responded, the preset mode is not entered, and any display related to the first gesture is not displayed on the display interface of the terminal, so as to avoid disturbing the user.
In some embodiments of the present disclosure, when the terminal detects that the first gesture is in the first image, the terminal does not directly respond to the first gesture, but determines whether a preset condition is met, if yes, the terminal enters a preset mode, immediately responds to the preset gesture in the preset mode, if not, does not respond to the first gesture, and does not enter the preset mode, so that when the user mistakenly triggers the first gesture, since the preset condition is not met, any response to the first gesture is not performed, the display content on the terminal is not changed due to the first gesture, and if the preset condition is met, smoother gesture interaction can be performed, thereby improving the user experience of the user. In some embodiments of the present disclosure, through setting up preset mode and preset condition, thereby not only can avoid the false response caused by false triggering of the user, but also can provide smooth use experience for the user, thereby guaranteeing use smoothness while reducing false triggering, and greatly improving use experience of the user.
In some embodiments of the present disclosure, the first gesture is a preset gesture associated with a preset mode, in some embodiments, the first gesture is a preset gesture associated with a preset mode, and if the preset gesture is detected, it indicates that the user is likely to want to control the terminal, and at this time, whether the preset condition is met is determined.
In some embodiments of the present disclosure, the first gesture is a preset entry gesture for entering a preset mode. In some embodiments, the first gesture is used as a preset gesture for entering the preset mode, and the user enters the preset mode by executing the first gesture, in some embodiments, only one gesture for entering the preset mode is provided, so that the probability of the user executing the first gesture unintentionally is reduced by setting only one gesture for entering the preset mode, and the false recognition caused by false triggering can be reduced.
In some embodiments of the present disclosure, the number of preset patterns is at least two; before determining whether a preset condition for entering a preset mode is satisfied, determining the entered preset mode based on the first gesture. In some embodiments, since there may be multiple preset modes, it is necessary to determine which preset mode the user wants to enter, which preset mode may be determined according to the first gesture, for example, in the case that the first gesture is a preset gesture, the entering preset mode is a preset mode associated with the first gesture, and for example, different gestures for entering the preset mode may be set for each preset mode, in the case that the first gesture is a gesture for entering the preset mode, the entering preset mode is determined according to the difference of the first gesture, so that the user may conveniently select to enter different preset modes. In some embodiments, the preset conditions of the unused preset patterns may be different or the same.
In some embodiments of the present disclosure, determining whether a preset condition for entering a preset mode is satisfied includes: determining the number of images with first gestures in a preset number of images behind the first image; and if the number of the images is not less than the number threshold, meeting the preset condition. In some embodiments, the terminal may periodically acquire images, after the first gesture is detected in the first image, may acquire a preset number of images that are temporally located after the first image, and if the images in which the first gesture is displayed exceed a number threshold, it indicates that the user continuously performs the first gesture, which indicates that the first gesture is performed at this time not due to false triggering. The preset number may be 10, the number threshold may be 8, and 5 images may be captured per second.
In some embodiments of the present disclosure, determining whether a preset condition for entering a preset mode is satisfied includes: determining the quantity proportion of the images with the first gesture in the images within a preset time period after the first image; and if the number proportion is not smaller than the proportion threshold value, the preset condition is met. In some embodiments, whether the user performs the first gesture is continuously detected within a preset time period after the first image is detected, and if a certain proportion of images in the subsequent images have the first gesture, the false triggering is not indicated. In some embodiments, in order to improve the use experience of the user, the preset duration may be not more than 1 second, for example, may be not more than 0.5 second, so that in the case that the first gesture is the preset gesture, the preset mode may be quickly entered, at this time, if the user is still executing the first gesture, the user may respond to the first gesture, because the preset duration is set to be shorter, from the viewpoint of use of the user, the user only normally executes the preset gesture, and the terminal responds to the preset gesture without feeling a click feeling.
In some embodiments of the present disclosure, in response to entering the preset mode, a countdown is performed; before the countdown is finished, if a preset gesture in a preset mode is recognized, immediately responding to the recognized preset gesture and counting down again; and before the countdown is finished, if the preset gesture of the preset mode is not recognized, exiting the preset mode.
In some embodiments, if the terminal is always in the preset mode, because the terminal responds to the preset operation immediately in the preset mode, false touch is easy to generate, and if the user is required to manually exit the preset mode, the user experience is reduced. A countdown may be displayed during the countdown to alert the user.
In some embodiments of the present disclosure, during a period when the terminal is in the preset mode, if a second gesture is identified, exiting the preset mode and responding to the second gesture; the second gesture is a gesture that the terminal can respond to and is not a preset gesture of the entered preset mode.
In some embodiments, photographing is continuously performed during the preset mode, image recognition is performed on the photographed photo, if a second gesture is recognized, the second gesture has a predefined meaning, and the second gesture is a non-preset gesture, which indicates that the user may need to perform other gesture control, so that the preset mode is automatically exited at this time, without manual operation of the user, and in response to the second gesture, the user may freely switch between the preset mode and the non-preset mode according to his own wish, without performing an action of exiting the preset mode.
In some embodiments of the present disclosure, the preset identity is displayed during the terminal is in the preset mode; and hiding the preset identification during the period that the terminal is not in the preset mode. In some embodiments, the preset identifier may be an icon, and if the countdown is performed during the preset mode, a countdown symbol may be displayed, for example, the countdown may be displayed in an hourglass or in a countdown number manner as the preset identifier. The preset mark is displayed, so that a user can conveniently determine whether the gesture is in the preset mode at any time, and gesture control is better performed.
In order to better illustrate the technical solution proposed in the present disclosure, a specific embodiment is presented below, and the gesture recognition technology in the related art is based on an algorithm engine configured in a camera module to recognize a static gesture made by a user. Only a few simple shortcut instructions exist, and no instructions similar to basic interaction capability such as focus movement, air mouse and the like exist. In some embodiments of the present disclosure, our algorithm is deployed in an embedded neural network processor so that more instructions, including instructions of basic interaction capabilities, can be executed. However, these basic interaction instructions need to be compatible with reducing misidentification and smoothness of use during execution. When complex combined instructions (e.g., interactive instructions) are controlled by gestures, it is involved in the need to respond to a variety of instructions, such as instructions to control focus including "up", "down", "left", "right", such as instructions to move "," click "for a mouse. If the corresponding instruction is executed immediately each time the user makes a gesture, the false touch may be greatly increased. If the user performs a confirmation time while the gesture is being made, the interactive experience may be very unsmooth. Therefore, the two technical problems of reducing false touch and ensuring smoothness are needed to be solved simultaneously.
In some embodiments of the present disclosure, a preset pattern is predefined, and one or more preset gestures are associated with the preset pattern. For example, four gestures related to focus movement are defined as preset gestures of a preset mode. And after any one preset gesture in the preset mode is identified, entering a mode identification state. This procedure is to determine which preset mode is the preset mode to be enabled. In other embodiments, an initiation gesture may be preset as a gesture for initiating the preset mode, and the mode recognition state is entered after the initiation gesture is detected.
After entering the mode recognition state, entering the mode confirmation state, and confirming whether the detected gesture meets the preset condition of entering the preset mode or not, wherein the process is to avoid false touch. After the preset condition is successfully confirmed to be met, the method enters a preset mode, a countdown is generated during the preset mode, and if the preset gesture associated with the preset mode where the user is currently located is recognized in the countdown, the corresponding response is immediately executed without a confirmation process, and the countdown is reset to continue recognition. In the countdown, if a preset gesture in the preset mode where the user is currently located is not recognized, exiting the preset mode; or in the countdown, other gestures which are not preset but supported are recognized, the preset mode is exited and the response is made.
By the embodiment of the disclosure, a user can control the terminal (such as a television) in a mode of not relying on media such as a remote controller, a mobile phone remote controller, voice and the like. But rather the control of the television can be done entirely with gesture control.
In an embodiment of the present disclosure, a control device for a terminal includes:
The device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to the first gesture in the first image, wherein the preset mode has an associated preset gesture;
And the control unit is used for entering a preset mode if the preset condition is met, and immediately responding to the recognized preset gesture in the preset mode during the preset mode.
In some embodiments, the control unit is further configured to not respond to the first gesture in the first image if the preset condition is not satisfied.
In some embodiments, the first gesture is a preset gesture associated with the preset mode, or the first gesture is a preset entry gesture for entering the preset mode.
In some embodiments, the number of preset modes is at least two; the control unit determines the entered preset mode based on the first gesture before determining whether a preset condition for entering the preset mode is satisfied.
In some embodiments, the control unit determines whether a preset condition for entering the preset mode is satisfied, including: determining the number of images with the first gesture in a preset number of images behind the first image; and if the number of the images is not less than the number threshold, the preset condition is met.
Or determining the quantity proportion of the images with the first gesture in the images within a preset time period after the first image; and if the quantity proportion is not smaller than the proportion threshold value, the preset condition is met.
In some embodiments, the control unit counts down in response to entering the preset mode;
Before the countdown is finished, if the preset gesture in the preset mode is recognized, immediately responding to the recognized preset gesture and carrying out countdown again; and before the countdown is finished, if the preset gesture of the preset mode is not recognized, exiting the preset mode.
In some embodiments, the control unit is further configured to, during the period when the terminal is in the preset mode, exit the preset mode if a second gesture is identified, and respond to the second gesture; the second gesture is a gesture that the terminal can respond to and is not a preset gesture of the entered preset mode.
In some embodiments, the control unit is further configured to display a preset identifier during the period when the terminal is in the preset mode; and hiding the preset identification when the terminal is not in the preset mode.
For embodiments of the device, reference is made to the description of method embodiments for the relevant points, since they essentially correspond to the method embodiments. The apparatus embodiments described above are merely illustrative, wherein the modules illustrated as separate modules may or may not be separate. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
The method and apparatus of the present disclosure are described above based on the embodiments and applications. In addition, the present disclosure also provides a terminal and a storage medium, which are described below.
Referring now to fig. 3, a schematic diagram of an electronic device (e.g., a terminal device or server) 800 suitable for use in implementing embodiments of the present disclosure is shown. The terminal devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in the drawings is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
The electronic device 800 may include a processing means (e.g., a central processor, a graphics processor, etc.) 801 that may perform various appropriate actions and processes in accordance with programs stored in a Read Only Memory (ROM) 802 or loaded from a storage 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, the ROM 802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.
In general, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, and the like; an output device 807 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, etc.; storage 808 including, for example, magnetic tape, hard disk, etc.; communication means 809. The communication means 809 may allow the electronic device 800 to communicate wirelessly or by wire with other devices to exchange data. While an electronic device 800 having various means is shown, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be implemented or provided instead.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via communication device 809, or installed from storage device 808, or installed from ROM 802. The above-described functions defined in the methods of the embodiments of the present disclosure are performed when the computer program is executed by the processing device 801.
It should be noted that the computer readable medium described in the present disclosure may be a computer readable signal medium or a computer readable storage medium, or any combination of the two. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this disclosure, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, however, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with the computer-readable program code embodied therein. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText Transfer Protocol ), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the internet (e.g., the internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed networks.
The computer readable medium may be contained in the electronic device; or may exist alone without being incorporated into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to perform the methods of the present disclosure described above.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units involved in the embodiments of the present disclosure may be implemented by means of software, or may be implemented by means of hardware. Wherein the names of the units do not constitute a limitation of the units themselves in some cases.
The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a Complex Programmable Logic Device (CPLD), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, including:
Acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to a first gesture in the first image, wherein the preset mode has an associated preset gesture;
if the preset condition is met, entering a preset mode, and immediately responding to the recognized preset gesture in the preset mode during the preset mode.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, further including: if the preset condition is not met, the first gesture in the first image is not responded.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, where the first gesture is a preset gesture associated with a preset mode, or
The first gesture is a preset entering gesture for entering a preset mode.
According to one or more embodiments of the present disclosure, there is provided a method for controlling a terminal, the number of preset modes being at least two;
Before determining whether a preset condition for entering a preset mode is satisfied, determining the entered preset mode based on the first gesture.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, which determines whether a preset condition for entering a preset mode is satisfied, including:
Determining the number of images with first gestures in a preset number of images behind the first image; and if the number of the images is not less than the number threshold, meeting the preset condition.
Or determining the quantity proportion of the images with the first gesture in the images within a preset time period after the first image; and if the number proportion is not smaller than the proportion threshold value, the preset condition is met.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, which performs countdown in response to entering a preset mode;
Before the countdown is finished, if a preset gesture in a preset mode is recognized, immediately responding to the recognized preset gesture and counting down again;
and before the countdown is finished, if the preset gesture of the preset mode is not recognized, exiting the preset mode.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, which exits a preset mode and responds to a second gesture if the second gesture is recognized during the preset mode of the terminal;
The second gesture is a gesture that the terminal can respond to and is not a preset gesture of the entered preset mode.
According to one or more embodiments of the present disclosure, there is provided a control method of a terminal, which displays a preset identification during a preset mode of the terminal; and hiding the preset identification during the period that the terminal is not in the preset mode.
According to one or more embodiments of the present disclosure, there is provided a control apparatus of a terminal, including:
The device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring a first image, and determining whether a preset condition for entering a preset mode is met or not in response to the first gesture in the first image, wherein the preset mode has an associated preset gesture;
And the control unit is used for entering a preset mode if the preset condition is met, and immediately responding to the recognized preset gesture in the preset mode during the preset mode.
According to one or more embodiments of the present disclosure, there is provided a terminal including: at least one memory and at least one processor;
Wherein the at least one memory is configured to store program code, and the at least one processor is configured to invoke the program code stored in the at least one memory to cause the terminal to perform any of the methods described above.
According to one or more embodiments of the present disclosure, there is provided a non-transitory computer storage medium storing program code which, when executed by a computer device, causes the computer device to perform the method of any one of the preceding claims.
The foregoing description is only of the preferred embodiments of the present disclosure and description of the principles of the technology being employed. It will be appreciated by persons skilled in the art that the scope of the disclosure referred to in this disclosure is not limited to the specific combinations of features described above, but also covers other embodiments which may be formed by any combination of features described above or equivalents thereof without departing from the spirit of the disclosure. Such as those described above, are mutually substituted with the technical features having similar functions disclosed in the present disclosure (but not limited thereto).
Moreover, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are example forms of implementing the claims.
Claims (10)
1. A control method of a terminal, comprising:
Acquiring a first image, and responding to the first gesture in the first image, and confirming the detected gesture; the method comprises the steps of confirming detected gestures to determine whether preset conditions for entering a preset mode are met or not, wherein the preset mode is provided with associated preset gestures which can be responded in the preset mode, and the first gesture is any preset gesture associated with the preset mode;
If the preset condition is met, entering the preset mode, and immediately responding to the recognized preset gesture of the preset mode during the preset mode without confirming the recognized preset gesture of the preset mode;
Wherein performing a confirmation of the detected gesture to determine whether a preset condition for entering the preset mode is satisfied, comprises: determining the number of images with the first gesture in a preset number of images behind the first image; if the number of the images is not less than the number threshold, the preset condition is met; or determining the quantity proportion of the images with the first gesture in the images within a preset time period after the first image; and if the quantity proportion is not smaller than the proportion threshold value, the preset condition is met.
2. The method as recited in claim 1, further comprising:
And if the preset condition is not met, not responding to the first gesture in the first image.
3. The method of claim 1, wherein the step of determining the position of the substrate comprises,
The preset gesture is a preset gesture for controlling the focus to move by a user.
4. The method of claim 1, wherein the step of determining the position of the substrate comprises,
The number of the preset modes is at least two;
The entered preset mode is determined based on the first gesture before a confirmation of the detected gesture is made to determine whether preset conditions for entering the preset mode are met.
5. The method of claim 1, wherein the step of determining the position of the substrate comprises,
In response to entering the preset mode, counting down;
before the countdown is finished, if the preset gesture in the preset mode is recognized, immediately responding to the recognized preset gesture and carrying out countdown again;
and before the countdown is finished, if the preset gesture of the preset mode is not recognized, exiting the preset mode.
6. The method of claim 1, wherein the step of determining the position of the substrate comprises,
If a second gesture is identified during the period that the terminal is in the preset mode, exiting the preset mode and responding to the second gesture;
The second gesture is a gesture which the terminal can respond to and is not a preset gesture associated with the entered preset mode.
7. The method of claim 1, wherein the step of determining the position of the substrate comprises,
Displaying a preset identifier during the period that the terminal is in the preset mode;
and hiding the preset identification when the terminal is not in the preset mode.
8. A control device of a terminal, comprising:
The device comprises an acquisition unit, a detection unit and a display unit, wherein the acquisition unit is used for acquiring a first image, and responding to the first gesture in the first image, and confirming the detected gesture; the method comprises the steps of confirming detected gestures to determine whether preset conditions for entering a preset mode are met or not, wherein the preset mode is provided with associated preset gestures which can be responded in the preset mode, and the first gesture is any preset gesture associated with the preset mode;
a control unit, configured to enter the preset mode if the preset condition is satisfied, and immediately respond to the recognized preset gesture of the preset mode during the preset mode without performing the confirmation of the recognized preset gesture of the preset mode;
Wherein the confirming of the detected gesture to determine whether a preset condition for entering the preset mode is satisfied comprises:
Determining the number of images with the first gesture in a preset number of images behind the first image; if the number of the images is not less than the number threshold, the preset condition is met; or determining the quantity proportion of the images with the first gesture in the images within a preset time period after the first image; and if the quantity proportion is not smaller than the proportion threshold value, the preset condition is met.
9. A terminal, comprising:
At least one memory and at least one processor;
Wherein the at least one memory is configured to store program code, and the at least one processor is configured to invoke the program code stored in the at least one memory to cause the terminal to perform the method of any of claims 1 to 7.
10. A non-transitory computer storage medium comprising,
The non-transitory computer storage medium stores program code that, when executed by a computer device, causes the computer device to perform the method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110636871.2A CN113253847B (en) | 2021-06-08 | 2021-06-08 | Terminal control method, device, terminal and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110636871.2A CN113253847B (en) | 2021-06-08 | 2021-06-08 | Terminal control method, device, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113253847A CN113253847A (en) | 2021-08-13 |
| CN113253847B true CN113253847B (en) | 2024-04-30 |
Family
ID=77187068
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110636871.2A Active CN113253847B (en) | 2021-06-08 | 2021-06-08 | Terminal control method, device, terminal and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113253847B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113946216A (en) * | 2021-10-18 | 2022-01-18 | 阿里云计算有限公司 | Man-machine interaction method, intelligent device, storage medium and program product |
| CN115421591B (en) * | 2022-08-15 | 2024-03-15 | 珠海视熙科技有限公司 | Gesture control device and image pickup apparatus |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102221891A (en) * | 2011-07-13 | 2011-10-19 | 广州视源电子科技有限公司 | Method and system for realizing optical image gesture recognition |
| CN102609176A (en) * | 2010-10-29 | 2012-07-25 | 霍尼韦尔国际公司 | Method and apparatus for gesture recognition |
| CN104063041A (en) * | 2013-03-21 | 2014-09-24 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN110426962A (en) * | 2019-07-30 | 2019-11-08 | 苏宁智能终端有限公司 | A kind of control method and system of smart home device |
| CN110716648A (en) * | 2019-10-22 | 2020-01-21 | 上海商汤智能科技有限公司 | Gesture control method and device |
| CN112822388A (en) * | 2019-11-15 | 2021-05-18 | 北京小米移动软件有限公司 | Shooting mode triggering method, device, equipment and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9785217B2 (en) * | 2012-09-28 | 2017-10-10 | Synaptics Incorporated | System and method for low power input object detection and interaction |
| EP3465400B1 (en) * | 2016-06-07 | 2021-10-13 | Koninklijke Philips N.V. | Operation control of wireless sensors |
| CN107493495B (en) * | 2017-08-14 | 2019-12-13 | 深圳市国华识别科技开发有限公司 | Interactive position determining method, system, storage medium and intelligent terminal |
| CN109948542B (en) * | 2019-03-19 | 2022-09-23 | 北京百度网讯科技有限公司 | Gesture recognition method and device, electronic equipment and storage medium |
-
2021
- 2021-06-08 CN CN202110636871.2A patent/CN113253847B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102609176A (en) * | 2010-10-29 | 2012-07-25 | 霍尼韦尔国际公司 | Method and apparatus for gesture recognition |
| CN102221891A (en) * | 2011-07-13 | 2011-10-19 | 广州视源电子科技有限公司 | Method and system for realizing optical image gesture recognition |
| CN104063041A (en) * | 2013-03-21 | 2014-09-24 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN110426962A (en) * | 2019-07-30 | 2019-11-08 | 苏宁智能终端有限公司 | A kind of control method and system of smart home device |
| CN110716648A (en) * | 2019-10-22 | 2020-01-21 | 上海商汤智能科技有限公司 | Gesture control method and device |
| CN112822388A (en) * | 2019-11-15 | 2021-05-18 | 北京小米移动软件有限公司 | Shooting mode triggering method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113253847A (en) | 2021-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113489937B (en) | Video sharing method, device, equipment and medium | |
| EP3454198A1 (en) | Method and apparatus for controlling application | |
| CN113253847B (en) | Terminal control method, device, terminal and storage medium | |
| CN114217707B (en) | Sharing method, sharing device, electronic equipment and storage medium | |
| CN113934349B (en) | Interaction method, interaction device, electronic equipment and storage medium | |
| CN111565332A (en) | Video transmission method, electronic device, and computer-readable medium | |
| CN110647286A (en) | Screen element control method, device, equipment and storage medium | |
| CN111309225B (en) | Screen clearing processing method and device | |
| CN114422482B (en) | Message sending method and device, electronic equipment and storage medium | |
| CN114390360B (en) | Live voting method and device, electronic equipment and storage medium | |
| WO2022151870A1 (en) | Interaction method and apparatus, electronic device, and computer-readable storage medium | |
| CN115379105B (en) | Video shooting method, device, electronic equipment and storage medium | |
| CN113312103A (en) | Software definition method and device for intelligent camera, electronic equipment and storage medium | |
| CN117244249A (en) | Multimedia data generation method and device, readable medium and electronic equipment | |
| CN115515014B (en) | Media content sharing method and device, electronic equipment and storage medium | |
| US11810336B2 (en) | Object display method and apparatus, electronic device, and computer readable storage medium | |
| CN114025116B (en) | Video generation method, device, readable medium and electronic equipment | |
| CN114419201B (en) | Animation display method and device, electronic equipment and medium | |
| CN115933936A (en) | Task prompting method and device, storage medium and electronic equipment | |
| CN115671723A (en) | Resource processing method, device, equipment and medium | |
| CN111290692B (en) | Picture display method and device, electronic equipment and computer readable medium | |
| CN113342440A (en) | Screen splicing method and device, electronic equipment and storage medium | |
| CN115082368A (en) | Image processing method, device, equipment and storage medium | |
| CN110489040B (en) | Method and device for displaying feature model, terminal and storage medium | |
| CN113055524A (en) | Terminal control method and device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |