CN108255300B - Control method and device of electronic equipment - Google Patents

Control method and device of electronic equipment Download PDF

Info

Publication number
CN108255300B
CN108255300B CN201810035095.9A CN201810035095A CN108255300B CN 108255300 B CN108255300 B CN 108255300B CN 201810035095 A CN201810035095 A CN 201810035095A CN 108255300 B CN108255300 B CN 108255300B
Authority
CN
China
Prior art keywords
gesture
application icon
image
display unit
image acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810035095.9A
Other languages
Chinese (zh)
Other versions
CN108255300A (en
Inventor
王江涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lenovo Beijing Ltd
Original Assignee
Lenovo Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lenovo Beijing Ltd filed Critical Lenovo Beijing Ltd
Priority to CN201810035095.9A priority Critical patent/CN108255300B/en
Publication of CN108255300A publication Critical patent/CN108255300A/en
Application granted granted Critical
Publication of CN108255300B publication Critical patent/CN108255300B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a control method and a device of electronic equipment, wherein the method comprises the following steps: when the operation that a user triggers a certain application icon on a display unit is detected, the triggered application icon is determined to be a first application icon; acquiring a gesture image; wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user; processing the gesture image by using an image recognition module so as to recognize the gesture; searching a moving direction corresponding to the recognized gesture in a pre-stored corresponding relation; when the moving direction corresponding to the recognized gesture is found, determining a target position of a first application icon meeting a preset rule on the display unit according to the found moving direction; the first application icon is moved to the target position, the application icon does not need to be dragged to the target position by a user, operation is simple, and user experience is improved.

Description

Control method and device of electronic equipment
The application is a divisional application with an application number of 201410090538.6, which is named as a control method and a control device of electronic equipment and has an application date of 2014, 03 and 12.
Technical Field
The invention relates to the technical field of automatic control, in particular to a control method and a control device of electronic equipment
Background
Various applications can be run on the present electronic device, and the applications can be displayed on the display unit of the electronic device in the form of application icons for the convenience of use of a user.
Among them, in some large-screen electronic devices, users generally drag some application icons to the front of themselves manually for viewing. For example, in an electronic device that displays a floor, a user drags a favorite floor icon to the front of the user for viewing.
However, in the above case, since the display unit of the large-screen electronic device is large, the user's hand cannot leave the mobile application icon before dragging the application icon to the target position, so that the operation is inconvenient and the user experience is seriously degraded.
Disclosure of Invention
In view of this, the present invention provides a method and an apparatus for controlling an electronic device, so as to simplify user operations and improve user experience.
In order to achieve the purpose, the invention provides the following technical scheme:
a control method of an electronic device is provided, wherein the electronic device is provided with a display unit, an image acquisition module and an image identification module connected with the image acquisition module; at least one application icon is displayed on the display unit;
the method comprises the following steps:
when the operation that a user triggers one application icon on the display unit is detected, the triggered application icon is determined to be a first application icon;
controlling the image acquisition module to be started so as to acquire a gesture image by using the image acquisition module;
wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user;
processing the gesture image by using the image recognition module so as to recognize a gesture;
searching a moving direction corresponding to the recognized gesture in a pre-stored corresponding relation; the corresponding relation is the corresponding relation between the gesture and the moving direction;
when the moving direction corresponding to the recognized gesture is found, determining a target position of the first application icon on the display unit, which meets a preset rule, according to the found moving direction;
moving the first application icon to the target location.
Preferably, after the moving direction corresponding to the recognized gesture is searched in the pre-stored corresponding relationship, the method further includes:
and when the moving direction corresponding to the recognized gesture is not found, generating a control instruction to control the image acquisition module to acquire the gesture image again.
Preferably, the electronic device has a plurality of image acquisition modules, and the plurality of image acquisition modules are respectively arranged at the edge of the display unit and are connected with the image identification module;
wherein, control the image acquisition module is opened to utilize the image acquisition module gathers gesture image, specifically do:
and controlling the plurality of image acquisition modules to be started so as to acquire gesture images by utilizing the plurality of image acquisition modules.
Preferably, the electronic device further comprises a plurality of operation controls, and the operation controls are located on the display unit and correspond to the image acquisition modules one to one;
before controlling the plurality of image acquisition modules to be opened so as to acquire the gesture images by using the plurality of image acquisition modules, the method further comprises the following steps:
detecting that a user triggers a certain operation control on the display unit;
the control the plurality of image acquisition modules are opened so as to acquire gesture images by utilizing the plurality of image acquisition modules, and the control method specifically comprises the following steps:
and controlling an image acquisition module corresponding to the operation control triggered by the user to be started so as to acquire the gesture image by using the image acquisition module corresponding to the operation control triggered by the user.
A control device of an electronic device is provided, wherein the electronic device is provided with a display unit, an image acquisition module and an image identification module connected with the image acquisition module; at least one application icon is displayed on the display unit;
the device includes:
the detection determining unit is used for determining that the triggered application icon is a first application icon when the operation that a user triggers a certain application icon on the display unit is detected;
the first control unit is used for controlling the image acquisition module to be started so as to acquire a gesture image by using the image acquisition module; wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user;
the first recognition unit is used for processing the gesture image by using the image recognition module so as to recognize a gesture;
a first searching unit, configured to search for a moving direction corresponding to the recognized gesture in a pre-stored correspondence; the corresponding relation is the corresponding relation between the gesture and the moving direction;
a first determining unit, configured to determine, when a moving direction corresponding to the recognized gesture is found, a target position of the first application icon on the display unit that meets a preset rule according to the found moving direction;
a first moving unit, configured to move the first application icon to the target location.
Preferably, the method further comprises the following steps:
and the generation control unit is used for generating a control instruction when the moving direction corresponding to the recognized gesture is not found so as to control the image acquisition module to acquire the gesture image again.
Preferably, the electronic device has a plurality of image acquisition modules, and the plurality of image acquisition modules are respectively arranged at the edge of the display unit and are connected with the image identification module;
the first control unit is specifically configured to control the plurality of image acquisition modules to be turned on, so that the plurality of image acquisition modules are used for acquiring gesture images.
Preferably, the electronic device further comprises a plurality of operation controls, and the operation controls are located on the display unit and correspond to the image acquisition modules one to one;
the device also includes: the first detection unit is used for detecting that a user triggers a certain operation control on the display unit;
the first control unit is specifically used for controlling the image acquisition module corresponding to the operation control triggered by the user to be started so as to acquire the gesture image by using the image acquisition module corresponding to the operation control triggered by the user.
According to the technical scheme, compared with the prior art, the method for controlling the electronic equipment has the advantages that the user only needs to trigger one application icon on the display unit and indicate the moving direction of the triggered application icon with the hand, the triggered application icon can be moved to the target position determined according to the moving direction indicated by the user gesture, the user does not need to drag the application icon to the target position with the hand, the operation is simple, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flowchart of an embodiment of a control method for an electronic device according to the present invention;
FIG. 2 is a schematic diagram of a palm posture provided by the present invention;
fig. 3 is a schematic flowchart of another embodiment of a control method of an electronic device according to the present invention;
fig. 4 is a schematic flowchart of a control method of an electronic device according to another embodiment of the present invention;
fig. 5 is a schematic structural diagram of an embodiment of a control device of an electronic device according to the present invention;
fig. 6 is a schematic structural diagram of another embodiment of a control device of an electronic device according to the present invention;
fig. 7 is a schematic structural diagram of a control method of an electronic device according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention discloses a control method and a control device of electronic equipment, which are simple to operate and improve user experience without dragging an application icon to a target position by hands of a user.
The embodiment of the invention discloses a control method of electronic equipment, which is mainly applied to certain large-screen electronic equipment, such as electronic equipment for displaying a building; of course, the method can also be applied to electronic equipment such as mobile phones, palm computers and tablet computers.
The electronic equipment is provided with a display unit, an image acquisition module and an icon identification module connected with the image acquisition module.
The display unit may be a display screen of the electronic device, wherein the electronic device may run a plurality of application programs, the application programs may be displayed in the form of application icons, and at least one application icon is displayed on the display unit of the electronic device.
Referring to fig. 1, the method may include the steps of:
step 101: when the operation that a user triggers a certain application icon on a display unit is detected, the triggered application icon is determined as a first application icon;
when a user wants to move a certain application icon displayed on the display unit, the application icon can be triggered; the triggering operation of the user refers to an operation that the time for the user to touch and press the application icon by hand reaches a preset time, the preset time can be set according to actual conditions, and under general conditions, the preset time is very short, such as 3s, 2s or 1s, and can be even shorter.
It should be noted that the user triggers an operation of an application icon, which is different from the operation in the prior art in which the user drags the application icon with a hand until the application icon reaches the target position, and the user cannot release the hand. In the invention, the user only needs to trigger the application icon to be moved, and the user does not need to drag the application icon to the target position.
Step 102: controlling an image acquisition module to be started so as to acquire a gesture image by using the image acquisition module;
wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user, specifically, the image of the palm posture of the user indicating the moving direction of the first application icon.
The image acquisition module is a device capable of acquiring images, such as a camera of an electronic device; in the present invention, the position of the image capturing module is not particularly limited, and the image capturing module may be disposed on the back surface of the electronic device, wherein the surface on which the display unit is disposed is the front surface of the electronic device; of course, in order to facilitate the user to indicate the moving direction of the first application icon under the image capturing module, it is preferable that the image capturing module is disposed on the front side of the electronic device, i.e., the side where the display unit is located.
After a user triggers a certain application icon on the display unit, the palm posture can be changed to indicate the moving direction of the first application icon on the display unit, so that the image acquisition module can acquire a gesture image; for example, if the user wants to move the first application icon to the right of the display unit, the user can point to the right with a hand.
It should be noted that the palm posture of the user indicating the moving direction of the first application icon needs to meet a preset standard, so that the moving direction can be determined according to the corresponding relationship between the recognized gesture and the moving direction in the subsequent action. However, the preset standard can be set according to actual conditions;
for example, the palm posture may be: the palm is vertical to the display unit and the five fingers are closed; then, when the user wants to move the first application icon to the right of the display unit, the palm needs to be perpendicular to the display unit, the five fingers are closed, and the finger tip points to the right.
Alternatively, the palm gesture may be: the palm is parallel to the display unit, and the five fingers are closed;
alternatively, other palm gestures, such as shown in FIG. 2, show a palm gesture, as can be seen in FIG. 2, where the user intends to move the first application icon to the left.
Step 103: processing the gesture image by using an image recognition module so as to recognize the gesture;
after the image acquisition module acquires the gesture image, the image recognition module can be used for processing the gesture image so as to recognize the palm posture.
Step 104: searching a moving direction corresponding to the recognized gesture in a pre-stored corresponding relation;
the corresponding relationship between the gesture and the moving direction is prestored in the electronic device, and it should be noted that the gesture in the corresponding relationship is a palm posture meeting a preset standard, so that when the palm posture of the user indicating the moving direction of the first application icon meets the preset standard, the moving direction corresponding to the palm posture can be searched according to the recognized gesture.
In the pre-stored correspondence, the moving direction may include all directions in which the application icon can move on the display unit, such as upward, downward, leftward, rightward, upward by 30 degrees to the left, upward by 45 degrees to the right, left by 60 degrees to the bottom, and the like. Each moving direction corresponds to a gesture meeting a predetermined criterion, wherein if there are a plurality of gestures meeting the predetermined criterion, each moving direction may correspond to a plurality of gestures meeting the predetermined criterion.
For example, the palm posture in which the palm is perpendicular to the display unit and the five fingers are closed together, and the palm posture in which the palm is parallel to the display unit and the five fingers are closed together all meet the preset standard; then, the rightward movement direction may correspond to a gesture in which the palm is perpendicular to the display unit, the five fingers are closed, and the gesture is indicated rightward, and a gesture in which the palm is parallel to the display unit, the five fingers are closed, and the gesture is indicated rightward.
Step 105: when the moving direction corresponding to the recognized gesture is found, determining a target position of the first application icon on the display unit, which meets a preset rule, according to the found moving direction;
the preset rule is a standard for determining a target position of the first application icon on the display unit according to the moving direction, and may be set according to a user's requirement, and is not specifically limited.
For example, the preset rule may be: the current position of the first application icon is used as a starting point, the edge position of the display unit determined along the moving direction is used as an end point, and the position which is closest to the edge of the display unit and can display the first application icon between the two points is used as a target position. The position at which the first application icon can be displayed and which is closest to the edge of the display unit is a position at which no other application icon is displayed at the position closest to the edge of the display unit.
For ease of understanding, the description is made with a particular application, assuming that the user indicates the direction of movement of the first application icon to the left; then, with the current position of the first application icon as a starting point and the edge position of the display unit determined to the left as a terminal, there are 3 positions between the two points at which the first application icon can be displayed, the first position being closest to the edge position of the display unit, the third position being farthest from the edge position of the display unit, and the second position being located between the first position and the second position. If no other application icons are displayed on the first position, determining the first position as a target position; if other application icons are displayed on the first position and other application icons are not displayed on the second position and the third position, the second position is determined to be the target position because the second position is the position between the two points where the first application icon can be displayed and is closest to the edge position of the display unit.
Of course, the user may prefer other positions, which are not necessarily the closest position between two points to the edge position of the display unit, for easy viewing, and thus, other preset rules may be set in order to determine the target position.
Step 106: the first application icon is moved to a target location.
And when the target position is determined, the first application icon is moved to the position.
In the embodiment of the invention, the user can move the triggered application icon to the target position determined according to the movement direction pointed by the user gesture only by triggering one application icon on the display unit and indicating the movement direction of the triggered application icon with a hand, the user does not need to drag the application icon to the target position with the hand, the operation is simple, and the user experience is improved.
In the embodiment of the present invention, if the palm posture of the user indicating the moving direction of the first application icon does not meet the preset standard, the moving direction corresponding to the recognized gesture cannot be found in the pre-stored corresponding relationship, and the first application icon cannot be moved to the target position. In this case, the user may wait for a long time, which may degrade the user experience.
Based on this, another embodiment of the present invention further discloses a method for controlling an electronic device, as shown in fig. 3, the method may include the following steps:
step 301: when the operation that a user triggers one application icon on the display unit is detected, the triggered application icon is determined to be a first application icon;
step 302: controlling an image acquisition module to be started so as to acquire a gesture image by using the image acquisition module;
wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user.
Step 303: processing the gesture image by using an image recognition module so as to recognize a gesture;
step 304: searching a moving direction corresponding to the recognized gesture in a pre-stored corresponding relation;
the corresponding relationship is the corresponding relationship between the gesture and the moving direction.
Step 305: and when the moving direction corresponding to the recognized gesture is not found, generating a control instruction to control the image acquisition module to acquire the gesture image again.
When the moving direction corresponding to the recognized gesture is not found, it is indicated that the palm posture of the user indicating the moving direction of the first application icon does not meet the preset standard, and in this case, the image acquisition module may be controlled to acquire the gesture image again.
It should be noted that, a user may not know what the palm posture meeting the preset criteria is specifically, in the embodiment of the present invention, after the moving direction corresponding to the recognized gesture is not found, the method may further include: and outputting a standard gesture meeting a preset rule, so that a user can indicate the moving direction of the first application icon according to the standard gesture, and the working efficiency of moving the first application icon is improved.
After the gesture image re-acquired by the image acquisition module is processed by the image identification module, the corresponding moving direction can be found in the pre-stored corresponding relation according to the identified gesture, when the moving direction corresponding to the identified gesture is found, the target position of the first application icon meeting the preset rule on the display unit is determined according to the found moving direction, and the first application icon is moved to the target position.
In the embodiment of the invention, if the moving direction corresponding to the recognized gesture cannot be found in the pre-stored corresponding relationship, the control instruction can be generated to control the image acquisition module to acquire the gesture image again, so that long-time waiting of a user is avoided, and the user experience is improved.
In the embodiment of the present invention, the number of the image capturing modules of the electronic device is not specifically limited, and may be one or multiple (at least two); when the number of the image acquisition modules of the electronic device is one, each time the movement direction of the first application icon is indicated, the user needs to indicate the movement direction before the image acquisition module is located, so that the image acquisition module can acquire the image.
If the electronic device is a large-screen electronic device, the above manner wastes time of the user, and in this case, a plurality of image acquisition modules of the electronic device may be respectively disposed at the edge of the display unit and connected to the image recognition module, so that the user may indicate the moving direction of the first application icon under the image acquisition module closer to the user.
For example, the number of the image acquisition modules can be 2, and the image acquisition modules are respectively arranged on two opposite sides of the display unit; or 4 image acquisition modules are respectively arranged on four sides of the display unit. Or, an image acquisition module is arranged around the display unit at intervals of a preset distance.
Then, controlling the image acquisition module to start, and acquiring the gesture image by using the image acquisition module, which may specifically be: and controlling the plurality of image acquisition modules to be started so as to acquire gesture images by utilizing the plurality of image acquisition modules.
It should be noted that, when the number of the image capturing modules is multiple (at least two), if the image capturing modules are controlled to be turned on simultaneously, the power consumption loss of the electronic device will be increased, and the standby time of the electronic device will be shortened.
Based on this, another embodiment of the present invention further discloses a control method of an electronic device, which has a display unit, a plurality of image capturing modules (at least two), and an image recognizing module;
the electronic equipment also comprises a plurality of operation controls, wherein the operation controls are positioned on the display unit and correspond to the image acquisition modules one by one;
the control component is used for controlling the image acquisition module to be started.
Referring to fig. 4, the method may include the steps of:
step 401: when the operation that a user triggers a certain application icon on the display unit is detected, the triggered application icon is determined to be a first application icon;
step 402: detecting that a user triggers a certain operation control on a display unit;
the user can select the image acquisition module which is closer to the user to acquire the gesture, and accordingly, the user can trigger the operation control corresponding to the image acquisition module to be selected.
Step 403: controlling an image acquisition module corresponding to the operation control triggered by the user to be started so as to acquire a gesture image by using the image acquisition module corresponding to the operation control triggered by the user;
wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user.
When a user triggers a certain operation control, the image acquisition module corresponding to the operation control is started, so that the user can indicate the moving direction of the first application image under the image acquisition module.
Step 404: processing the gesture image by using an image recognition module so as to recognize the gesture;
step 405: searching a moving direction corresponding to the recognized gesture in a pre-stored corresponding relation;
step 406: when the moving direction corresponding to the recognized gesture is found, determining a target position of the first application icon on the display unit, which meets a preset rule, according to the found moving direction;
step 407: the first application icon is moved to a target location.
In the embodiment of the invention, the electronic equipment is provided with a plurality of image acquisition modules, the image acquisition modules correspond to the operation controls one by one, and a user controls the image acquisition modules corresponding to the operation controls to be started by triggering one operation control so as to acquire images by using the started image acquisition modules, so that the starting of all the image acquisition modules is not required to be controlled, the power consumption loss of the electronic equipment is reduced, and the standby time of the electronic equipment is prolonged.
The embodiment of the invention also discloses a control device of the electronic equipment, and the electronic equipment is mainly applied to certain large-screen electronic equipment, such as electronic equipment for displaying a building; of course, the method can also be applied to electronic equipment such as mobile phones, palm computers and tablet computers.
The electronic equipment is provided with a display unit, an image acquisition module and an icon identification module connected with the image acquisition module.
The display unit may be a display screen of the electronic device, wherein the electronic device may run a plurality of application programs, the application programs may be displayed in the form of application icons, and at least one application icon is displayed on the display unit of the electronic device.
As shown in fig. 5, the apparatus may include: a detection determination unit 501, a first control unit 502, a first identification unit 503, a first search unit 504, a first determination unit 505, and a first moving unit 506, wherein:
the detection determining unit 501 may be configured to determine, when an operation that a user triggers an application icon on the display unit is detected, that the triggered application icon is a first application icon;
the first control unit 502 may be configured to control the image capturing module to be turned on, so as to capture a gesture image by using the image capturing module;
wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user.
A first recognition unit 503, which may be configured to process the gesture image with an image recognition module, so as to recognize a gesture;
a first searching unit 504, configured to search a pre-stored correspondence for a moving direction corresponding to the recognized gesture;
and the corresponding relation is the corresponding relation between the gesture and the moving direction.
A first determining unit 505, configured to determine, when the moving direction corresponding to the recognized gesture is found, a target position of the first application icon on the display unit, where the target position meets a preset rule, according to the found moving direction;
a first moving unit 506, which may be configured to move the first application icon to the target location.
In the embodiment of the invention, the user can move the triggered application icon to the target position determined according to the movement direction pointed by the user gesture only by triggering one application icon on the display unit and indicating the movement direction of the triggered application icon with a hand, the user does not need to drag the application icon to the target position with the hand, the operation is simple, and the user experience is improved.
In the embodiment of the present invention, if the palm posture of the user indicating the moving direction of the first application icon does not meet the preset standard, the moving direction corresponding to the recognized gesture cannot be found in the pre-stored corresponding relationship, and the first application icon cannot be moved to the target position. In this case, the user may wait for a long time, which may degrade the user experience.
Based on this, another embodiment of the present invention further discloses a control apparatus for an electronic device, as shown in fig. 6, the apparatus may include: a detection determining unit 601, a first control unit 602, a first identifying unit 603, a first searching unit 604, a first determining unit 605, a first moving unit 606, and a generation control unit 607, wherein:
a detection determining unit 601, configured to determine, when an operation that a user triggers an application icon on the display unit is detected, that the triggered application icon is a first application icon;
a first control unit 602, configured to control the image capturing module to start, so as to capture a gesture image by using the image capturing module; wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user;
a first recognition unit 603, configured to process the gesture image by using the image recognition module, so as to recognize a gesture;
a first searching unit 604, configured to search for a moving direction corresponding to the recognized gesture in a pre-stored correspondence;
and the corresponding relation is the corresponding relation between the gesture and the moving direction.
The generation control unit 607 may be configured to generate a control instruction to control the image acquisition module to acquire the gesture image again when the moving direction corresponding to the recognized gesture is not found;
a first determining unit 605, configured to determine, when the moving direction corresponding to the recognized gesture is found, a target position of the first application icon on the display unit that meets a preset rule according to the found moving direction;
a first move menu 606 may be used to move the first application icon to the target location.
In the embodiment of the invention, if the moving direction corresponding to the recognized gesture cannot be found in the pre-stored corresponding relationship, the control instruction can be generated to control the image acquisition module to acquire the gesture image again, so that long-time waiting of a user is avoided, and the user experience is improved.
In the embodiment of the present invention, the number of the image capturing modules of the electronic device is not specifically limited, and may be one or multiple (at least two); when the number of the image acquisition modules of the electronic equipment is one, when a user indicates the moving direction of the first application icon each time, the user needs to be positioned in the image acquisition module for indication so as to facilitate the acquisition of the image acquisition module;
when the electronic device has a plurality of image acquisition modules, the plurality of image acquisition modules can be respectively arranged at the edge position of the display unit and are connected with the image identification module; then, the first control unit may be specifically configured to control the plurality of image capturing modules to be turned on, so as to capture the gesture image by using the plurality of image capturing modules.
It should be noted that, when the number of the image capturing modules is multiple (at least two), if the image capturing modules are controlled to be turned on simultaneously, the power consumption loss of the electronic device will be increased, and the standby time of the electronic device will be shortened.
Based on this, the invention further discloses a control device of an electronic device, which comprises a display unit, a plurality of image acquisition modules (at least two) and an image identification module;
the electronic equipment also comprises a plurality of operation controls, wherein the operation controls are positioned on the display unit and correspond to the image acquisition modules one by one;
the control component is used for controlling the image acquisition module to be started.
As shown in fig. 7, the apparatus may include: a detection determination unit 701, a first detection unit 702, a first control unit 703, a first identification unit 704, a first search unit 705, a first determination unit 706, and a first moving unit 707, wherein:
a detection determining unit 701, configured to determine, when an operation that a user triggers an application icon on the display unit is detected, that the triggered application icon is a first application icon;
a first detecting unit 702, configured to detect that a user triggers a certain operation control on the display unit;
the first control unit 703 may be specifically configured to control an image acquisition module corresponding to the operation control triggered by the user to be started, so as to acquire the gesture image by using the image acquisition module corresponding to the operation control triggered by the user.
Wherein: the gesture image is used for representing the moving direction of the first application icon indicated by the user.
A first recognition unit 704, configured to process the gesture image with an image recognition module, so as to recognize a gesture;
a first searching unit 705, configured to search, in a pre-stored correspondence, a moving direction corresponding to the recognized gesture; the corresponding relation is the corresponding relation between the gesture and the moving direction;
a first determining unit 706, configured to determine, when the moving direction corresponding to the recognized gesture is found, a target position of the first application icon on the display unit that meets a preset rule according to the found moving direction;
a first move sheet 707 may be used to move the first application icon to the target location.
In the embodiment of the invention, the electronic equipment is provided with a plurality of image acquisition modules, the image acquisition modules correspond to the operation controls one by one, and a user controls the image acquisition modules corresponding to the operation controls to be started by triggering one operation control so as to acquire images by using the started image acquisition modules, so that the starting of all the image acquisition modules is not required to be controlled, the power consumption loss of the electronic equipment is reduced, and the standby time of the electronic equipment is prolonged.
The embodiments of the apparatuses correspond to the embodiments of the methods, and specific implementation manners may refer to the embodiments of the methods, which are not described in detail herein.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (8)

1. A control method of an electronic device is characterized in that the electronic device is provided with a display unit and an image recognition module; at least one application icon is displayed on the display unit;
the method comprises the following steps:
when the operation that a user triggers one application icon on the display unit is detected, the triggered application icon is determined to be a first application icon, and the triggering operation of the user is the operation that the time when the user touches and presses the application icon by hand reaches the preset time;
acquiring a gesture image;
wherein: the gesture image includes a gesture that characterizes a user indicating a direction of movement of the first application icon;
processing the gesture image by using the image recognition module so as to recognize the gesture;
searching a moving direction corresponding to the recognized gesture in a pre-stored corresponding relation; the corresponding relation is the corresponding relation between the gesture and the moving direction;
when the moving direction corresponding to the recognized gesture is found, determining a target position of the first application icon on the display unit, which meets a preset rule, according to the found moving direction, wherein the preset rule comprises: taking the current position of the first application icon as a starting point, taking the edge position of the display unit determined along the moving direction as an end point, and taking the position which can display the first application icon and is closest to the edge of the display unit between the two points as a target position;
moving the first application icon to the target location.
2. The control method according to claim 1, wherein after searching for the moving direction corresponding to the recognized gesture in the pre-stored correspondence relationship, the method further comprises:
and when the moving direction corresponding to the recognized gesture is not found, generating a control instruction to control the gesture image to be collected again.
3. The control method according to claim 1, wherein the electronic device is provided with a plurality of image acquisition modules, and the plurality of image acquisition modules are respectively arranged at the edge of the display unit and are connected with the image identification module;
the acquiring of the gesture image specifically comprises the following steps:
and controlling the plurality of image acquisition modules to be started so as to acquire gesture images by utilizing the plurality of image acquisition modules.
4. The control method according to claim 3, wherein the electronic device further comprises a plurality of operation controls, the operation controls being located on the display unit and corresponding to the image acquisition modules one to one;
before controlling the plurality of image acquisition modules to be opened so as to acquire the gesture images by using the plurality of image acquisition modules, the method further comprises the following steps:
detecting that a user triggers a certain operation control on the display unit;
the control the plurality of image acquisition modules are opened so as to acquire gesture images by utilizing the plurality of image acquisition modules, and the control method specifically comprises the following steps:
and controlling an image acquisition module corresponding to the operation control triggered by the user to be started so as to acquire the gesture image by using the image acquisition module corresponding to the operation control triggered by the user.
5. A control device of an electronic device is characterized in that the electronic device is provided with a display unit and an image recognition module; at least one application icon is displayed on the display unit;
the device includes:
the detection determining unit is used for determining that the triggered application icon is a first application icon when the operation that a user triggers a certain application icon on the display unit is detected, and the triggering operation of the user is the operation that the time that the user touches and presses the application icon by hand reaches the preset time;
the first control unit is used for acquiring a gesture image; wherein: the gesture image includes a gesture that characterizes a user indicating a direction of movement of the first application icon;
the first recognition unit is used for processing the gesture image by using the image recognition module so as to recognize a gesture;
the first searching unit is used for searching the moving direction corresponding to the recognized gesture in a pre-stored corresponding relation; the corresponding relation is the corresponding relation between the gesture and the moving direction;
a first determining unit, configured to determine, when a moving direction corresponding to the recognized gesture is found, a target position of the first application icon on the display unit that meets a preset rule according to the found moving direction, where the preset rule includes: taking the current position of the first application icon as a starting point, taking the edge position of the display unit determined along the moving direction as an end point, and taking the position which can display the first application icon and is closest to the edge of the display unit between the two points as a target position;
a first moving unit, configured to move the first application icon to the target location.
6. The control device according to claim 5, characterized by further comprising:
and the generation control unit is used for generating a control instruction to control the gesture image to be acquired again when the moving direction corresponding to the recognized gesture is not found.
7. The control device of claim 5, wherein the electronic device has a plurality of image acquisition modules, and the plurality of image acquisition modules are respectively arranged at the edge of the display unit and are connected with the image recognition module;
the first control unit is specifically configured to control the plurality of image acquisition modules to be turned on, so that the plurality of image acquisition modules are used for acquiring gesture images.
8. The control device according to claim 7, wherein the electronic device further comprises a plurality of operation controls, the operation controls being located on the display unit and corresponding to the image acquisition modules one to one;
the device also includes:
the first detection unit is used for detecting that a user triggers a certain operation control on the display unit;
the first control unit is specifically used for controlling an image acquisition module corresponding to the operation control triggered by the user to be started so as to acquire the gesture image by using the image acquisition module corresponding to the operation control triggered by the user.
CN201810035095.9A 2014-03-12 2014-03-12 Control method and device of electronic equipment Active CN108255300B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810035095.9A CN108255300B (en) 2014-03-12 2014-03-12 Control method and device of electronic equipment

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810035095.9A CN108255300B (en) 2014-03-12 2014-03-12 Control method and device of electronic equipment
CN201410090538.6A CN104914982B (en) 2014-03-12 2014-03-12 The control method and device of a kind of electronic equipment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN201410090538.6A Division CN104914982B (en) 2014-03-12 2014-03-12 The control method and device of a kind of electronic equipment

Publications (2)

Publication Number Publication Date
CN108255300A CN108255300A (en) 2018-07-06
CN108255300B true CN108255300B (en) 2023-03-21

Family

ID=54084123

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201810035095.9A Active CN108255300B (en) 2014-03-12 2014-03-12 Control method and device of electronic equipment
CN201410090538.6A Active CN104914982B (en) 2014-03-12 2014-03-12 The control method and device of a kind of electronic equipment

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201410090538.6A Active CN104914982B (en) 2014-03-12 2014-03-12 The control method and device of a kind of electronic equipment

Country Status (1)

Country Link
CN (2) CN108255300B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108255300B (en) * 2014-03-12 2023-03-21 联想(北京)有限公司 Control method and device of electronic equipment
CN107493495B (en) 2017-08-14 2019-12-13 深圳市国华识别科技开发有限公司 Interactive position determining method, system, storage medium and intelligent terminal
CN113056718A (en) * 2018-11-14 2021-06-29 华为技术有限公司 Handheld mobile terminal control method and related device
CN111562877A (en) * 2020-04-30 2020-08-21 联想(北京)有限公司 Image processing method and device
CN111562867B (en) * 2020-06-11 2021-12-14 京东方科技集团股份有限公司 Image display control method and device and display device
CN113253849A (en) * 2021-07-01 2021-08-13 湖北亿咖通科技有限公司 Display control method, device and equipment of control bar

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1148411A3 (en) * 2000-04-21 2005-09-14 Sony Corporation Information processing apparatus and method for recognising user gesture
CN102346618A (en) * 2010-07-29 2012-02-08 鸿富锦精密工业(深圳)有限公司 Electronic device and data transmission method thereof
CN102479027A (en) * 2010-11-24 2012-05-30 中兴通讯股份有限公司 Control method and device of application icons on touch screen
US20130014053A1 (en) * 2011-07-07 2013-01-10 Microsoft Corporation Menu Gestures
CN103218035B (en) * 2012-01-19 2016-10-05 联想(北京)有限公司 A kind of gesture input method and electronic equipment
CN103257792A (en) * 2012-02-17 2013-08-21 宇龙计算机通信科技(深圳)有限公司 Icon operation method, icon operation device and mobile terminal
TWI470481B (en) * 2012-02-24 2015-01-21 Lg Electronics Inc Mobile terminal and control method for the mobile terminal
JP5994328B2 (en) * 2012-03-29 2016-09-21 ソニー株式会社 Information processing apparatus, information processing method, and computer program
KR101984154B1 (en) * 2012-07-16 2019-05-30 삼성전자 주식회사 Control method for terminal using touch and gesture input and terminal thereof
CN102819394B (en) * 2012-07-27 2016-06-08 东莞宇龙通信科技有限公司 Terminal and terminal operation method
CN103116468A (en) * 2013-03-12 2013-05-22 上海揆志网络科技有限公司 Touch control system and touch control method for managing files / folders
CN103218117B (en) * 2013-03-18 2016-04-13 惠州Tcl移动通信有限公司 Realize method and the electronic equipment of screen display interface translation
CN103577069B (en) * 2013-11-15 2017-03-08 Tcl通讯(宁波)有限公司 The quick method and system starting camera under a kind of touch screen locking screen interface
CN103616994A (en) * 2013-12-09 2014-03-05 珠海金山办公软件有限公司 Method and device for controlling electronic device
CN108255300B (en) * 2014-03-12 2023-03-21 联想(北京)有限公司 Control method and device of electronic equipment

Also Published As

Publication number Publication date
CN104914982B (en) 2017-12-26
CN104914982A (en) 2015-09-16
CN108255300A (en) 2018-07-06

Similar Documents

Publication Publication Date Title
CN108255300B (en) Control method and device of electronic equipment
KR101896947B1 (en) An apparatus and method for inputting command using gesture
CN102221957B (en) Electronic equipment and operation control method thereof
CN105511781B (en) Start the method, apparatus and user equipment of application program
US9665273B2 (en) Information processing terminal and method, program, and recording medium
CN106415472B (en) Gesture control method and device, terminal equipment and storage medium
JP2015153420A (en) Multitask switching method and system and electronic equipment having the same system
JPWO2011142317A1 (en) Gesture recognition apparatus, method, program, and computer-readable medium storing the program
US9256359B2 (en) Touch control method and electronic device using the same
CN103425394A (en) Method and device for changing icon position for touch screen
US20110157233A1 (en) Display apparatus, display control method, and non-transitory computer-readable medium storing display control program
CN103064627A (en) Application management method and device
US20150248206A1 (en) Word processing method and device for smart device with touch screen
CN105446607A (en) Camera touch shooting method and touch terminal thereof
JP2012027515A (en) Input method and input device
WO2014146516A1 (en) Interactive device and method for left and right hands
US10656746B2 (en) Information processing device, information processing method, and program
CN105589636A (en) Method and mobile terminal used for realizing virtual pointer control on touch screen
CN105808129B (en) Method and device for quickly starting software function by using gesture
US10627953B2 (en) Information processing apparatus, program, and information processing system
US9971413B2 (en) Positioning method and apparatus
US9665260B2 (en) Method and apparatus for controlling screen of mobile device
CN104020956A (en) Method and system for holding mobile terminal with one hand to take pictures
JP2013225013A5 (en)
KR100984826B1 (en) Portable terminal and user interface method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant