CN103176595A - Method and system for information prompt - Google Patents
Method and system for information prompt Download PDFInfo
- Publication number
- CN103176595A CN103176595A CN2011104402236A CN201110440223A CN103176595A CN 103176595 A CN103176595 A CN 103176595A CN 2011104402236 A CN2011104402236 A CN 2011104402236A CN 201110440223 A CN201110440223 A CN 201110440223A CN 103176595 A CN103176595 A CN 103176595A
- Authority
- CN
- China
- Prior art keywords
- information
- module
- operation method
- user
- application object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 221
- 230000002452 interceptive effect Effects 0.000 claims abstract description 98
- 230000003993 interaction Effects 0.000 claims description 83
- 238000012544 monitoring process Methods 0.000 claims description 22
- 230000001960 triggered effect Effects 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 6
- 238000012163 sequencing technique Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 12
- 230000004913 activation Effects 0.000 description 8
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000005520 cutting process Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for information prompt. The method for the information prompt comprises the following steps: when an application object is in an activated state, operational method information of the application object can be obtained, wherein the operational method information comprises interactive gesture information and an operation order corresponding to the interactive gesture information, the application object comprises a user operation interface, an application program, a file folder and a file and the activated state comprises displaying the user operation interface, selecting or operating the application program, selecting or opening the file folder and selecting or opening the file; and the operational method information is displayed. According to the method for the information prompt, the prompt information can be displayed to the user when the user controls an electronic device through an interactive gesture so that a corresponding relation of the operation order and the interactive gesture does not need to be learned by the user. The probability that the user inputs an error interactive gesture is reduced so that burden of a human-machine interactive system can be reduced. The invention further discloses a system for the information prompt.
Description
Technical Field
The invention belongs to the technical field of human-computer interaction, and particularly relates to an information prompting method and system.
Background
With the development of science and technology, gesture interaction is increasingly adopted as a new man-machine interaction mode.
At present, a man-machine interaction mode based on gesture interaction is applied to devices such as computers and televisions, and a user can trigger corresponding operations by making interaction gestures in the air. Compared with the traditional input equipment such as a keyboard, a mouse and a remote controller, the man-machine interaction mode realized based on gesture interaction is more convenient.
However, in the conventional gesture-based human-computer interaction method, a user needs to learn before performing human-computer interaction so as to be familiar with interaction gestures corresponding to various operation instructions, which increases the learning burden of the user on the one hand, and on the other hand, when the user wants to trigger an operation, the user may use an incorrect interaction gesture due to unfamiliarity with the correspondence between the interaction gesture and the operation instruction, and at this time, the user needs to input the interaction gesture again, thereby increasing the burden of the human-computer interaction system.
Disclosure of Invention
In view of this, an object of the present invention is to provide an information prompting method and system, which can display prompting information to a user when the user controls an electronic device through an interactive gesture, so that the user does not need to learn a corresponding relationship between an operation instruction and the interactive gesture any more, and the probability of inputting an incorrect interactive gesture by the user is reduced, thereby reducing the burden of a human-computer interaction system.
In order to achieve the purpose, the invention provides the following technical scheme:
an information prompting method comprises the following steps:
when an application object is in an activated state, acquiring operation method information of the application object, wherein the operation method information comprises interaction gesture information and an operation instruction corresponding to the interaction gesture information, the application object comprises a user operation interface, an application program, a folder and a file, and the activated state comprises that the user operation interface is displayed, the application program is selected or running, the folder is selected or opened, and the file is selected or opened;
and displaying the operation method information.
Preferably, in the above information presentation method,
the operation method information for obtaining the application object is as follows: acquiring all operation method information of the application object;
correspondingly, the process of displaying the operation method information comprises the following steps: simultaneously displaying all operation method information of the application object; or
Sequencing all operation method information of the application objects according to a preset rule; and displaying the sorted operation method information one by one at preset time intervals.
Preferably, in the above information presentation method,
the operation method information for obtaining the application object is as follows: acquiring operation method information of the application object;
correspondingly, after the operation method information is displayed, the method further comprises the following steps:
judging whether image information input by a user is received within preset time;
when image information input by a user is not received within preset time, acquiring and displaying next operation method information of the application object;
when image information input by a user is received within preset time, judging whether interaction gesture information contained in the image information is valid or not, if the interaction gesture information is invalid, acquiring next operation method information of the application object, displaying the next operation method information, and if the interaction gesture information is valid, stopping displaying the operation method information.
Preferably, in the information presentation method, a correspondence relationship between the interactive gesture information and the operation command in the operation method information is set by a user.
Preferably, in the information presentation method, the step of setting the correspondence between the interactive gesture information and the operation command includes:
displaying an identifier of the operation instruction and an identifier of the alternative interaction gesture information;
receiving an instruction containing an interactive gesture information identifier selected by a user in the alternative interactive gesture information identifiers;
and establishing a corresponding relation between the operation instruction and the interactive gesture information contained in the instruction.
Preferably, in the information presentation method, the step of setting the correspondence between the interactive gesture information and the operation command includes:
displaying the identifier of the operation instruction;
receiving image information containing interactive gestures input by a user through an image acquisition device;
extracting interactive gesture information from the image information;
and establishing a corresponding relation between the operation instruction and the interactive gesture information.
Preferably, in the information presentation method, the operation method information is audio information, image information, or video information.
An information prompting system for an electronic device with interactive gesture recognition function, comprising:
the storage unit is used for storing operation method information of an application object, the operation method information comprises interaction gesture information and an operation instruction corresponding to the interaction gesture information, and the application object comprises a user operation interface, an application program, a folder and a file;
an information obtaining unit, configured to obtain, from the storage unit, operation method information of an application object when the application object is in an active state, where the active state includes that the user operation interface is displayed, the application program is selected or running, the folder is selected or opened, and the file is selected or opened;
and the control unit is used for controlling a display device in the electronic equipment to display the operation method information.
Preferably, in the information prompt system, the information acquisition unit includes a state monitoring module and a first information acquisition module, and the control unit includes a first control module;
the state monitoring module is used for monitoring the state of the application object and triggering the first information acquisition module when the application object is in an activated state;
the first information acquisition module is used for acquiring all operation method information of the application object in the storage unit;
the first control module is used for controlling a display device in the electronic equipment to display all the operation method information.
Preferably, in the above information prompt system, the information obtaining unit includes a state monitoring module and a first information obtaining module, and the control unit includes a sorting module and a second control module:
the state monitoring module is used for monitoring the state of the application object and triggering the first information acquisition module when the application object is in an activated state;
the first information acquisition module is used for acquiring all operation method information of the application object in the storage unit;
the sorting module is used for sorting all operation method information of the application objects according to a preset rule;
the second control module is used for controlling a display device in the electronic equipment to display the sequenced operation method information one by one at preset time intervals.
Preferably, in the above information prompt system, the information obtaining unit includes a status monitoring module and a second information obtaining module, and the control unit includes a first judging module, a second judging module and a third controlling module:
the state monitoring module is used for monitoring the state of the application object and triggering the second information acquisition module when the application object is in an activated state;
the second information acquisition module is used for acquiring operation method information of the application object in the storage unit;
the first judging module is used for judging whether image information input by a user is received within preset time, if so, the second judging module is triggered, and if not, the third control module is triggered;
the second judging module is used for judging whether the interaction gesture information contained in the image information input by the user is effective or not and triggering the third control module;
the third control module is used for controlling the second information acquisition module to acquire next operation method information and controlling the display device to display when image information input by a user is not received within preset time or when interaction gesture information contained in the image information input by the user is invalid, and is used for controlling the display device to stop displaying when the interaction gesture information contained in the image information input by the user is valid.
Preferably, in the information presentation system, a correspondence between the interaction gesture information and the operation instruction in the operation method information is set by a user, and the system further includes a setting unit.
Preferably, in the information prompt system, the setting unit includes a fourth control module, an instruction receiving module, and a corresponding relationship establishing module;
the fourth control module is used for controlling a display device of the electronic equipment to display an identification of an operation instruction and an identification of a candidate interaction gesture;
the instruction receiving module is used for receiving an instruction containing an interactive gesture information identifier selected by a user in the alternative interactive gesture information identifiers;
and the corresponding relation establishing module is used for establishing the corresponding relation between the operation instruction and the interactive gesture information contained in the instruction.
Preferably, in the information prompt system, the setting unit includes a fifth control module, an image receiving module, an interactive gesture information extraction module, and a corresponding relationship establishing module;
the fifth control module is used for controlling a display device of the electronic equipment to display an identifier of an operation instruction;
the image receiving module is used for receiving image information which is input by a user through the image acquisition device and contains an interactive gesture;
the interactive gesture information extraction module is used for extracting interactive gesture information from the image information;
and the corresponding relation establishing module is used for establishing the corresponding relation between the operation instruction and the interactive gesture information.
Preferably, in the information presentation system, the operation method information is audio information, image information, or video information.
Therefore, the beneficial effects of the invention are as follows: the information prompting method and the information prompting system can display the prompting information to the user when the user controls the electronic equipment through the interactive gesture, the user does not need to learn the corresponding relation between the operation instruction and the interactive gesture any more, the probability of inputting the wrong interactive gesture by the user is reduced, and therefore the burden of a man-machine interactive system is reduced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a flowchart of a disclosed information prompting method according to an embodiment of the present invention;
FIG. 2 is a flowchart of an information prompting method disclosed in the second embodiment of the present invention;
FIG. 3 is a flowchart of an information prompting method disclosed in the third embodiment of the present invention;
FIG. 4 is a flowchart of an information prompting method disclosed in the fourth embodiment of the present invention;
FIG. 5 is a flowchart of a method for setting a correspondence between interaction gesture information and an operation command according to the present invention;
FIG. 6 is a flowchart of another method for setting a correspondence between interaction gesture information and an operation command according to the present disclosure;
FIG. 7 is a diagram of the effect of information prompt after "my computer" is selected based on the method shown in FIG. 1;
FIG. 8 is a schematic structural diagram of an information prompt system according to the present disclosure;
FIG. 9 is a schematic structural diagram of another information prompting system disclosed in the present invention;
FIG. 10 is a schematic structural diagram of another information prompting system disclosed in the present invention;
FIG. 11 is a schematic structural diagram of another information prompting system disclosed in the present invention;
FIG. 12 is a schematic structural diagram of a setting unit according to the present disclosure;
fig. 13 is a schematic structural diagram of another setting unit disclosed in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention discloses an information prompting method which can display prompting information to a user when the user controls electronic equipment through an interactive gesture, the user does not need to learn the corresponding relation between an operation instruction and the interactive gesture any more, and the probability of inputting an incorrect interactive gesture by the user is reduced, so that the burden of a man-machine interaction system is reduced.
The basic principle is as follows: when a user triggers a certain application object to enable the application object to be in an activated state, one or more pieces of operation method information of the application object are obtained and displayed, the user can make an interaction gesture according to the operation method information, and after the electronic equipment obtains the interaction gesture, an operation instruction corresponding to the interaction gesture is executed.
Example one
Referring to fig. 1, fig. 1 is a flowchart of a disclosed information prompting method according to an embodiment of the present invention. The method comprises the following steps:
step S11: and when a certain application object is in an activated state, acquiring the operation method information of the application object.
The operation method information comprises interaction gesture information and an operation instruction corresponding to the interaction gesture information. The application objects include user operation interfaces, application programs, folders, and files. When the application object is a user operation interface, the activation state is that the user operation interface is displayed on a display screen of the electronic equipment; when the application object is an application program, the activation state of the application object is that the application program is selected or the application program is in the running state; when the application object is a folder, the activation state of the application object is that the folder is selected or opened; when the application object is a file, the activation state is that the file is selected or opened.
The application program can be a mouse, office software (such as word, excel and visio), other software (such as a music playing tool, a video playing tool, a drawing tool and a picture editor), or a shortcut of the software, and the application program is not limited in the invention.
The files can be word files, excel files and visio files created by office software, and can also be picture files, audio files and video files, and the files are not limited in the invention.
The operation instructions related to the operation method information include opening operation, closing operation, advancing operation, retreating operation, enlarging operation, reducing operation, rotating operation, copying operation, cutting operation, pasting operation, selecting operation, left moving operation, right moving operation, up moving operation and down moving operation, and the operations which can be triggered by a mouse and a keyboard can be used as the operation instructions in the operation method information.
When an application object is in an activated state, one, a plurality of or all operation method information of the application object can be acquired.
Step S12: and displaying the acquired operation method information.
In step S12, all the operation method information acquired in step S11 may be displayed, or only a part of the operation method information may be displayed.
In practice, the position where the operation method information is displayed may be set in advance.
For example: when the application object is the user operation interface, the operation method information of the user operation interface can be displayed in a blank part of the user operation interface. Of course, the operation method information may also be displayed in a non-blank area, and at this time, it is to be ensured that the layer where the operation method information is located is the highest layer.
For example: when the application object is an application program, a folder, or a file, the display position of the operation method information may be determined according to the display position of the application program, the folder, or the file on the display device of the electronic device. When an application, folder, or file is displayed on the leftmost side of the display device, its operation method information may be displayed on the right, upper, or lower side thereof; when an application, folder, or file is displayed on the rightmost side of the display device, its operation method information may be displayed on its left, upper, or lower side; when an application, folder, or file is displayed on the uppermost side of the display device, its operation method information may be displayed on the right, left, or lower side thereof; when an application, folder, or file is displayed on the lowermost side of the display device, its operation method information may be displayed on the left, right, or upper side thereof. Of course, the operation method information thereof may be displayed at any location other than the location of the application, folder, and file.
Taking my computer as an example for explanation, when a user selects my computer through a mouse, a keyboard, a touch pad or an interactive gesture, the my computer is in an activated state, one, a plurality of or all operation method information of the my computer is acquired at this time, and then the operation method information is displayed on the right side of the icon of the my computer, as shown in fig. 7.
In the information prompting method disclosed in this embodiment, when a user triggers an application object to be in an activated state, one or more pieces of operation method information of the application object may be acquired and displayed, the user does not need to learn the corresponding relationship between an operation instruction and an interaction gesture any more, and the probability of the user inputting an incorrect interaction gesture is reduced, thereby reducing the burden of a human-computer interaction system.
Example two
Referring to fig. 2, fig. 2 is a flowchart of an information prompting method disclosed in the second embodiment of the present invention. The method comprises the following steps:
step S21: when a certain application object is in an activated state, all operation method information of the application object is acquired.
Step S22: and simultaneously displaying all operation method information of the application object.
Because the application object has a plurality of operation method information, after a user selects a certain application object or runs a certain application object, different subsequent operations may be performed, at this time, all the operation method information of the application object is displayed on the display device of the electronic device, and the user can know the interaction gesture information corresponding to all the subsequent operations and perform the subsequent operations with reference to the displayed interaction gesture information.
EXAMPLE III
Referring to fig. 3, fig. 3 is a flowchart of an information prompting method disclosed in the third embodiment of the present invention. The method comprises the following steps:
step S31: when a certain application object is in an activated state, all operation method information of the application object is acquired.
Step S32: and sequencing all the operation method information of the application object according to a preset rule.
The preset rule may be sorted from high to low according to the number of times the operation instruction included in each operation method information is executed within a preset time period, or sorted from low to high. The operation method information may be displayed in a preset time period, and the operation method information may be displayed in a sequence from high to low, or in a sequence from low to high.
Step S33: and displaying the sorted operation method information one by one at preset time intervals.
The preset interval may be 2 seconds to 5 seconds, as long as it is ensured that the user can completely know the operation method information within the preset time interval. It can be understood that, the elderly and children are limited by their physical conditions or knowledge reserves, and the time for completely acquiring the operation method information is slightly longer than that of teenagers, so that the preset time interval (i.e., the time for displaying the operation method information) can be flexibly adjusted according to the personal condition of the user, and the present invention does not limit it.
It should be noted that, for all the operation method information after sorting, a plurality of operation method information may be displayed at the same time, and of course, the plurality of operation method information is smaller than the number of all the operation method information, for example, 2 or 3. In addition, in the implementation process, all the operation method information may be displayed only once, that is, the operation method information after being sorted is displayed one by one, and the display is stopped after all the operation method information is displayed once, or all the operation method information may be displayed in a loop, that is, the operation method information after being sorted is displayed one by one, and after all the operation method information is displayed, the operation method information is displayed from the first operation method information after being sorted again until the image information including the interaction gesture information input by the user is received, or the preset stop time is reached.
In the information prompting method disclosed in this embodiment, all the operation method information acquired after activating a certain application object is not displayed on the display device of the electronic device at the same time, but all the operation method information is firstly sorted according to the preset parameters, and then the operation method information is displayed in batches. The third embodiment of the information prompting method disclosed by the third embodiment of the invention has the significance that when all the operation method information of a certain application object is displayed at the same time, a large amount of space in the display device may be occupied, which is not beneficial for a user to obtain other information displayed on the display device at the same time.
Example four
Referring to fig. 4, fig. 4 is a flowchart of an information prompting method disclosed in the fourth embodiment of the present invention. The method comprises the following steps:
step S41: when a certain application object is in an activated state, acquiring operation method information of the application object.
When an application object is activated, operation method information with the highest priority level may be obtained from all operation method information of the application object, where the priority level may be how many times or how high the probability is that an operation instruction included in each operation method information is executed, or how many times or how high the probability is that each operation method information is displayed. Of course, the operation method information to be displayed may be arbitrarily selected among all application objects.
Step S42: and displaying the operation method information.
Step S43: and judging whether the image information input by the user is received within a preset time, if so, executing the step S44, and otherwise, executing the step S46.
If the user defines the interaction gesture corresponding to the next operation through self-learning or prompting of the operation method information, the user may make the interaction gesture so as to trigger the next operation, the image acquisition device in the electronic device may acquire the image information including the interaction gesture input by the user, and at this time, the step S44 may be continuously executed. If the image acquisition device in the electronic device does not acquire the image information, it is still not clear that the interactive gesture corresponding to the next operation of the user is not yet made, that is, the interactive gesture information corresponding to the next operation of the user is not given yet.
Step S44: and judging whether the interaction gesture information contained in the image is effective, if so, executing step S45, and if not, executing step S46.
The interactive gesture recognition device in the electronic device can extract the interactive gesture information from the image information, and then judge whether the extracted interactive gesture information is effective or not by comparing the extracted interactive gesture information with all the interactive gesture information corresponding to the application object. And when the extracted interactive gesture information contains all the interactive gesture information corresponding to the application object, the extracted interactive gesture information is valid, otherwise, the extracted interactive gesture information is invalid.
Step S45: the display of the operation method information is stopped.
And when the effective interaction gesture information is input by the user, stopping displaying the operation method information, and continuing the subsequent flow by the electronic equipment.
Step S46: next operation method information of the application object is acquired, and step S42 is performed.
And when the electronic equipment acquires the image information input by the user or the image information input by the user does not contain effective interaction gesture information, acquiring and displaying next operation method information of the application object. It should be noted that the next operation method information may be any operation method information that is not displayed in the process after the application object is triggered this time, and the next operation method information may be selected according to the priority, or the next operation method information may be selected according to the address of the storage space where the operation method information is located.
In the information prompting methods disclosed in the second and third embodiments, a large temporary storage space is required to store all the operation method information of an application object after the operation method information is acquired, whereas in the information prompting method disclosed in the fourth embodiment, only one operation method information is acquired at a time, thereby reducing the requirement for the size of the temporary storage space.
In the information prompting method disclosed in each of the above embodiments, the correspondence between the interaction gesture information and the operation instruction in the operation method information may be set by a manufacturer before the electronic device leaves a factory, or may be set by a user during a use process.
The invention is preferably set by the user, the user can select the interactive gesture triggering a certain operation instruction according to the own operation habit at the moment, and when the user controls the electronic equipment by utilizing the interactive gesture conforming to the own operation habit, the probability of inputting the wrong interactive gesture by the user can be reduced, thereby reducing the burden of a human-computer interaction system in the electronic equipment. The details will be described below.
Referring to fig. 5, fig. 5 is a flowchart of a method for setting a corresponding relationship between interaction gesture information and an operation instruction according to the present invention. The method comprises the following steps:
step S51: and displaying the identification of the operation instruction.
And when a user operation interface for setting the corresponding relation between the interactive gesture information and the operation instruction is entered through mouse operation, keyboard operation, touch screen operation or interactive gesture operation, displaying the identifier of the operation instruction to be processed on the user operation interface. The identifier of the operation instruction can be an English name or a Chinese translation name for describing the operation instruction, or can be a pre-agreed icon or other pre-agreed identifier.
Step S52: displaying an identification of alternative interaction gesture information.
The identification of the interactive gesture information may be an english name or a chinese name describing the interactive gesture information, or may be a pre-agreed icon or other pre-agreed identifier. It should be noted that, the present invention does not limit the sequence of step S51 and step S52, step S51 may be executed first, or step S51 and step S52 may be executed simultaneously, that is, the identifier of the operation command and the identifier of the alternative interaction gesture information are displayed simultaneously.
Step S53: and receiving an instruction containing the interactive gesture information identification selected by the user in the alternative interactive gesture information identifications.
The user can select one of the multiple alternative interactive gesture information identifications through multiple operation modes such as mouse operation, keyboard operation, touch screen operation or interactive gesture operation.
Step S54: and establishing a corresponding relation between the operation instruction and the selected interactive gesture information.
Fig. 5 shows only one method, and further, a process of setting the correspondence between the interactive gesture information and the operation instruction may be as shown in fig. 6. The method comprises the following steps:
step S61: and displaying the identification of the operation instruction.
And when a user operation interface for setting the corresponding relation between the interactive gesture information and the operation instruction is entered through mouse operation, keyboard operation, touch screen operation or interactive gesture operation, displaying the identifier of the operation instruction to be processed on the user operation interface. The operation command identifier may be an english name or a chinese translation name describing the operation command, or may be a predetermined icon or other predetermined identifier.
Step S62: and receiving image information containing the interactive gestures input by a user through the image acquisition device.
The user can define the interactive gesture corresponding to the operation instruction by himself, and when the user makes the interactive gesture in the acquisition range of the image acquisition device of the electronic equipment, the image acquisition device can acquire the image information containing the interactive gesture information.
Step S63: and extracting the interactive gesture information from the image information.
The interactive gesture recognition device of the electronic equipment can extract the interactive gesture information from the image information.
Step S64: and establishing a corresponding relation between the operation instruction and the extracted interactive gesture information.
In the method shown in fig. 5, although the user can arbitrarily set the corresponding relationship between the operation instruction and the interactive gesture information in the interactive gesture information given by the system, the method is still limited by the original given resource data of the system. In the method shown in fig. 6, the user may input any interaction gesture information and establish a corresponding relationship between the interaction gesture information and the operation instruction, without being limited to the original given resource data of the system.
In each of the above-disclosed information presentation methods of the present invention, the operation method information is audio information, image information, or video information.
The invention also discloses a system applying the information prompting method, which has a structure shown in fig. 8 and comprises a storage unit 81, an information acquisition unit 82 and a control unit 83. Wherein,
the storage unit 81 is used for storing the operation method information of the application object. An information obtaining unit 82, configured to obtain, when an application object is in an activated state, operation method information of the application object from the storage unit 81. A control unit 83 for controlling a display device in the electronic apparatus to display the operation method information acquired by the information storage unit 82.
The operation method information comprises interaction gesture information and an operation instruction corresponding to the interaction gesture information, and the operation method information can be audio information, image information or video information. The application objects include user operation interfaces, application programs, folders, and files. When the application object is a user operation interface, the activation state is that the user operation interface is displayed on a display screen of the electronic equipment; when the application object is an application program, the activation state of the application object is that the application program is selected or the application program is in the running state; when the application object is a folder, the activation state of the application object is that the folder is selected or opened; when the application object is a file, the activation state is that the file is selected or opened. The operation instructions related to the operation method information include opening operation, closing operation, advancing operation, retreating operation, enlarging operation, reducing operation, rotating operation, copying operation, cutting operation, pasting operation, selecting operation, left moving operation, right moving operation, up moving operation and down moving operation, and the operations which can be triggered by a mouse and a keyboard can be used as the operation instructions in the operation method information.
In the information prompt system disclosed by the invention, when a user triggers a certain application object to enable the application object to be in an activated state, one or more pieces of operation method information of the application object can be acquired and displayed, the user does not need to learn the corresponding relation between an operation instruction and an interaction gesture, the probability of inputting an error interaction gesture by the user is reduced, and the burden of a man-machine interaction system is reduced.
In practice, the information acquisition unit 82 and the control unit 83 are described in various forms with reference to the drawings.
Referring to fig. 9, fig. 9 is a schematic structural diagram of another information prompting system disclosed in the present invention. The information presentation system includes a storage unit 81, an information acquisition unit 82, and a control unit 83. Wherein,
the storage unit 81 is used for storing the operation method information of the application object.
The information acquisition unit 82 includes a status monitoring module 821 and a first information acquisition module 822. The state monitoring module 821 is configured to monitor a state of the application object, and trigger the first information obtaining module 822 when the application object is in an active state; the first information obtaining module 822 is configured to obtain all operation method information of the application object in the storage unit 81.
The control unit 83 includes a first control module 831, and the first control module 831 is configured to control a display device in the electronic apparatus to display all the operation method information acquired by the first information acquisition module 822.
Referring to fig. 10, fig. 10 is a schematic structural diagram of another information prompting system disclosed in the present invention.
The information presentation system includes a storage unit 81, an information acquisition unit 82, and a control unit 83. Only the differences from the information presentation system shown in fig. 9 will be described.
The control unit 83 includes a sorting module 832 and a second control module 833. The sorting module 832 is configured to sort all operation method information of the application objects according to a preset rule; the second control module 833 is used to control the display device in the electronic device to display the sorted operation method information one by one at preset time intervals.
Referring to fig. 11, fig. 11 is a schematic structural diagram of another information prompting system disclosed in the present invention.
The information presentation system includes a storage unit 81, an information acquisition unit 82, and a control unit 83. Wherein,
the storage unit 81 is used for storing the operation method information of the application object.
The information acquisition unit 82 includes a state monitoring module 821 and a second information acquisition module 823. The status monitoring module 821 is configured to monitor the status of the application object, and trigger the second information obtaining module 823 when the application object is in an active status, where the second information obtaining module 823 is configured to obtain an operation method information of the application object in the storage unit 81.
The control unit 83 includes a first determination module 834, a second determination module 835 and a third control module 836. The first determining module 834 is configured to determine whether image information input by a user is received within a preset time, if so, trigger the second determining module 835, and if not, trigger the third controlling module 836; the second determination module 835 is configured to determine whether the interaction gesture information included in the image information input by the user is valid, and trigger the third control module 836; the third control module 836 is configured to, when the image information input by the user is not received within a preset time or when the interaction gesture information included in the image information input by the user is invalid, control the second information obtaining module 823 to obtain next operation method information and control the display device to display, and is configured to, when the interaction gesture information included in the image information input by the user is valid, control the display device to stop displaying.
In each of the information prompt systems disclosed above, the correspondence between the interaction gesture information and the operation instruction in the operation method information may be set by a manufacturer before the electronic device leaves a factory, or may be set by a user during use.
The invention is preferably set by the user, the user can select the interactive gesture triggering a certain operation instruction according to the own operation habit at the moment, and when the user controls the electronic equipment by utilizing the interactive gesture conforming to the own operation habit, the probability of the user inputting the malposition interactive gesture can be reduced, thereby reducing the burden of a human-computer interaction system in the electronic equipment. In the information presentation systems shown in fig. 8 to 11, a setting unit connected to the storage unit 81 may be further set, and the setting unit is configured to set a correspondence relationship between the interaction gesture information and the operation instruction and store the correspondence relationship in the storage unit 81. In practice, the configuration of the setting unit may be as shown in fig. 12 and 13.
Referring to fig. 12, fig. 12 is a schematic structural diagram of a setting unit according to the present disclosure.
The setting unit includes a fourth control module 841, an instruction receiving module 842, and a corresponding relationship establishing module 843. Wherein,
a fourth control module 841, configured to control a display device of the electronic device to display an identifier of the operation instruction and an identifier of the alternative interaction gesture; an instruction receiving module 842, configured to receive an instruction including an interactive gesture information identifier selected by a user from the alternative interactive gesture information identifiers; the corresponding relationship establishing module 843 is configured to establish a corresponding relationship between the operation instruction and the interaction gesture information included in the instruction.
Referring to fig. 13, fig. 13 is a schematic structural diagram of another setting unit disclosed in the present invention.
The setting unit includes a fifth control module 844, an image receiving module 845, an interactive gesture information extraction module 846, and a correspondence relationship establishing module 843. Wherein,
a fifth control module 844, configured to control a display device in the electronic device to display an identifier of the operation instruction; the image receiving module 845 is used for receiving image information which is input by a user through the image acquisition device and contains the interactive gesture; an interactive gesture information extraction module 846, configured to extract interactive gesture information from the image information received by the image receiving module 845; the corresponding relationship establishing module 843 is configured to establish a corresponding relationship between the operation instruction and the interactive gesture information.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (15)
1. An information prompting method, comprising:
when an application object is in an activated state, acquiring operation method information of the application object, wherein the operation method information comprises interaction gesture information and an operation instruction corresponding to the interaction gesture information, the application object comprises a user operation interface, an application program, a folder and a file, and the activated state comprises that the user operation interface is displayed, the application program is selected or running, the folder is selected or opened, and the file is selected or opened;
and displaying the operation method information.
2. The method of claim 1,
the operation method information for obtaining the application object is as follows: acquiring all operation method information of the application object;
correspondingly, the process of displaying the operation method information comprises the following steps: simultaneously displaying all operation method information of the application object; or
Sequencing all operation method information of the application objects according to a preset rule; and displaying the sorted operation method information one by one at preset time intervals.
3. The method of claim 1,
the operation method information for obtaining the application object is as follows: acquiring operation method information of the application object;
correspondingly, after the operation method information is displayed, the method further comprises the following steps:
judging whether image information input by a user is received within preset time;
when image information input by a user is not received within preset time, acquiring and displaying next operation method information of the application object;
when image information input by a user is received within preset time, judging whether interaction gesture information contained in the image information is valid or not, if the interaction gesture information is invalid, acquiring next operation method information of the application object, displaying the next operation method information, and if the interaction gesture information is valid, stopping displaying the operation method information.
4. The method according to claim 1, 2 or 3, wherein the correspondence between the interaction gesture information and the operation instruction in the operation method information is set by a user.
5. The method according to claim 4, wherein the step of setting the corresponding relationship between the interactive gesture information and the operation instruction comprises:
displaying an identifier of the operation instruction and an identifier of the alternative interaction gesture information;
receiving an instruction containing an interactive gesture information identifier selected by a user in the alternative interactive gesture information identifiers;
and establishing a corresponding relation between the operation instruction and the interactive gesture information contained in the instruction.
6. The method according to claim 4, wherein the step of setting the corresponding relationship between the interactive gesture information and the operation instruction comprises:
displaying the identifier of the operation instruction;
receiving image information containing interactive gestures input by a user through an image acquisition device;
extracting interactive gesture information from the image information;
and establishing a corresponding relation between the operation instruction and the interactive gesture information.
7. The method according to claim 1, 2 or 3, wherein the operation method information is audio information, image information or video information.
8. An information prompting system for an electronic device with interactive gesture recognition function, comprising:
the storage unit is used for storing operation method information of an application object, the operation method information comprises interaction gesture information and an operation instruction corresponding to the interaction gesture information, and the application object comprises a user operation interface, an application program, a folder and a file;
an information obtaining unit, configured to obtain, from the storage unit, operation method information of an application object when the application object is in an active state, where the active state includes that the user operation interface is displayed, the application program is selected or running, the folder is selected or opened, and the file is selected or opened;
and the control unit is used for controlling a display device in the electronic equipment to display the operation method information.
9. The system of claim 8, wherein: the information acquisition unit comprises a state monitoring module and a first information acquisition module, and the control unit comprises a first control module;
the state monitoring module is used for monitoring the state of the application object and triggering the first information acquisition module when the application object is in an activated state;
the first information acquisition module is used for acquiring all operation method information of the application object in the storage unit;
the first control module is used for controlling a display device in the electronic equipment to display all the operation method information.
10. The system of claim 8, wherein: the information acquisition unit comprises a state monitoring module and a first information acquisition module, and the control unit comprises a sequencing module and a second control module:
the state monitoring module is used for monitoring the state of the application object and triggering the first information acquisition module when the application object is in an activated state;
the first information acquisition module is used for acquiring all operation method information of the application object in the storage unit;
the sorting module is used for sorting all operation method information of the application objects according to a preset rule;
the second control module is used for controlling a display device in the electronic equipment to display the sequenced operation method information one by one at preset time intervals.
11. The system of claim 8, wherein: the information acquisition unit comprises a state monitoring module and a second information acquisition module, and the control unit comprises a first judgment module, a second judgment module and a third control module:
the state monitoring module is used for monitoring the state of the application object and triggering the second information acquisition module when the application object is in an activated state;
the second information acquisition module is used for acquiring operation method information of the application object in the storage unit;
the first judging module is used for judging whether image information input by a user is received within preset time, if so, the second judging module is triggered, and if not, the third control module is triggered;
the second judging module is used for judging whether the interaction gesture information contained in the image information input by the user is effective or not and triggering the third control module;
the third control module is used for controlling the second information acquisition module to acquire next operation method information and controlling the display device to display when image information input by a user is not received within preset time or when interaction gesture information contained in the image information input by the user is invalid, and is used for controlling the display device to stop displaying when the interaction gesture information contained in the image information input by the user is valid.
12. The system according to any one of claims 8 to 11, wherein the correspondence between the interaction gesture information and the operation instruction in the operation method information is set by a user, and the system further comprises a setting unit.
13. The system of claim 12, wherein: the setting unit comprises a fourth control module, an instruction receiving module and a corresponding relation establishing module;
the fourth control module is used for controlling a display device of the electronic equipment to display an identifier of an operation instruction and an identifier of alternative interaction gesture information;
the instruction receiving module is used for receiving an instruction containing an interactive gesture information identifier selected by a user in the alternative interactive gesture information identifiers;
and the corresponding relation establishing module is used for establishing the corresponding relation between the operation instruction and the interactive gesture information contained in the instruction.
14. The system of claim 12, wherein: the setting unit comprises a fifth control module, an image receiving module, an interactive gesture information extraction module and a corresponding relation establishing module;
the fifth control module is used for controlling a display device of the electronic equipment to display an identifier of an operation instruction;
the image receiving module is used for receiving image information which is input by a user through the image acquisition device and contains an interactive gesture;
the interactive gesture information extraction module is used for extracting interactive gesture information from the image information;
and the corresponding relation establishing module is used for establishing the corresponding relation between the operation instruction and the interactive gesture information.
15. The system according to any one of claims 8 to 11, wherein the operation method information is audio information, image information, or video information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110440223.6A CN103176595B (en) | 2011-12-23 | 2011-12-23 | A kind of information cuing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110440223.6A CN103176595B (en) | 2011-12-23 | 2011-12-23 | A kind of information cuing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103176595A true CN103176595A (en) | 2013-06-26 |
| CN103176595B CN103176595B (en) | 2016-01-27 |
Family
ID=48636534
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110440223.6A Active CN103176595B (en) | 2011-12-23 | 2011-12-23 | A kind of information cuing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103176595B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103616994A (en) * | 2013-12-09 | 2014-03-05 | 珠海金山办公软件有限公司 | Method and device for controlling electronic device |
| CN103616992A (en) * | 2013-11-13 | 2014-03-05 | 华为技术有限公司 | Method and device for controlling application programs |
| CN104375884A (en) * | 2013-08-15 | 2015-02-25 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104423825A (en) * | 2013-09-02 | 2015-03-18 | 联想(北京)有限公司 | Electronic equipment and information processing method thereof |
| CN105843401A (en) * | 2016-05-12 | 2016-08-10 | 深圳市联谛信息无障碍有限责任公司 | Screen reading instruction input method and device based on camera |
| CN106775259A (en) * | 2017-01-09 | 2017-05-31 | 广东欧珀移动通信有限公司 | A kind of processing method of information, device and terminal |
| WO2018023574A1 (en) * | 2016-08-04 | 2018-02-08 | 薄冰 | Adjustment method for using gesture to open file folder, and file system |
| CN108564402A (en) * | 2018-03-29 | 2018-09-21 | 北京微播视界科技有限公司 | Information is shown and method and device for analyzing, the information transfer system |
| CN109683776A (en) * | 2018-12-13 | 2019-04-26 | 廖明月 | A kind of method for page jump and system |
| CN111309153A (en) * | 2020-03-25 | 2020-06-19 | 北京百度网讯科技有限公司 | Control method and device for man-machine interaction, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5612719A (en) * | 1992-12-03 | 1997-03-18 | Apple Computer, Inc. | Gesture sensitive buttons for graphical user interfaces |
| JPH10105324A (en) * | 1996-09-09 | 1998-04-24 | Motorola Inc | Intuitive gestuer system graphical user interface |
| WO1999028811A1 (en) * | 1997-12-04 | 1999-06-10 | Northern Telecom Limited | Contextual gesture interface |
| CN101196793A (en) * | 2006-12-04 | 2008-06-11 | 三星电子株式会社 | Gesture-based user interface method and apparatus |
| CN102132229A (en) * | 2008-08-29 | 2011-07-20 | 微软公司 | Internal scroll activation and cursor adornment |
-
2011
- 2011-12-23 CN CN201110440223.6A patent/CN103176595B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5612719A (en) * | 1992-12-03 | 1997-03-18 | Apple Computer, Inc. | Gesture sensitive buttons for graphical user interfaces |
| JPH10105324A (en) * | 1996-09-09 | 1998-04-24 | Motorola Inc | Intuitive gestuer system graphical user interface |
| WO1999028811A1 (en) * | 1997-12-04 | 1999-06-10 | Northern Telecom Limited | Contextual gesture interface |
| CN101196793A (en) * | 2006-12-04 | 2008-06-11 | 三星电子株式会社 | Gesture-based user interface method and apparatus |
| CN102132229A (en) * | 2008-08-29 | 2011-07-20 | 微软公司 | Internal scroll activation and cursor adornment |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104375884B (en) * | 2013-08-15 | 2018-03-23 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN104375884A (en) * | 2013-08-15 | 2015-02-25 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104423825A (en) * | 2013-09-02 | 2015-03-18 | 联想(北京)有限公司 | Electronic equipment and information processing method thereof |
| CN103616992B (en) * | 2013-11-13 | 2017-10-17 | 华为技术有限公司 | Application control method and device |
| CN103616992A (en) * | 2013-11-13 | 2014-03-05 | 华为技术有限公司 | Method and device for controlling application programs |
| US11144172B2 (en) | 2013-11-13 | 2021-10-12 | Huawei Technologies Co., Ltd. | Launching application task based on single user input and preset condition |
| US11669219B2 (en) | 2013-11-13 | 2023-06-06 | Huawei Technologies Co., Ltd. | Launching application task based on single user input and preset condition |
| CN103616994A (en) * | 2013-12-09 | 2014-03-05 | 珠海金山办公软件有限公司 | Method and device for controlling electronic device |
| CN105843401A (en) * | 2016-05-12 | 2016-08-10 | 深圳市联谛信息无障碍有限责任公司 | Screen reading instruction input method and device based on camera |
| WO2018023574A1 (en) * | 2016-08-04 | 2018-02-08 | 薄冰 | Adjustment method for using gesture to open file folder, and file system |
| CN106775259A (en) * | 2017-01-09 | 2017-05-31 | 广东欧珀移动通信有限公司 | A kind of processing method of information, device and terminal |
| CN108564402A (en) * | 2018-03-29 | 2018-09-21 | 北京微播视界科技有限公司 | Information is shown and method and device for analyzing, the information transfer system |
| CN109683776A (en) * | 2018-12-13 | 2019-04-26 | 廖明月 | A kind of method for page jump and system |
| CN111309153A (en) * | 2020-03-25 | 2020-06-19 | 北京百度网讯科技有限公司 | Control method and device for man-machine interaction, electronic equipment and storage medium |
| CN111309153B (en) * | 2020-03-25 | 2024-04-09 | 北京百度网讯科技有限公司 | Man-machine interaction control method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103176595B (en) | 2016-01-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103176595B (en) | A kind of information cuing method and system | |
| CN105204745B (en) | Screen capturing method and device for mobile terminal | |
| EP2474973A1 (en) | Display apparatus and voice control method thereof | |
| KR101779977B1 (en) | Method and apparatus for realizing display of component's content | |
| CN107577415B (en) | Touch operation response method and device | |
| CN105630565A (en) | Mobile terminal and way to open application programs of mobile terminal | |
| CN102981704A (en) | Icon placement method and mobile terminal of display interface | |
| CN104461346A (en) | Method and device for visually impaired people to touch screen and intelligent touch screen mobile terminal | |
| CN107066171A (en) | The multiwindow switching method and system of touch screen terminal | |
| CN103324436A (en) | Task processing method and device | |
| CN107797750A (en) | A kind of screen content identifying processing method, apparatus, terminal and medium | |
| CN113721808A (en) | Control method and device | |
| CN103761041A (en) | Information processing method and electronic device | |
| CN105975552B (en) | Question searching method and device of intelligent equipment | |
| US11237699B2 (en) | Proximal menu generation | |
| US9971413B2 (en) | Positioning method and apparatus | |
| TWI511029B (en) | Touch display apparatus and operating method thereof | |
| US20150261392A1 (en) | Adaptive interface providing apparatus and method | |
| CN105956078B (en) | Question searching method and device of intelligent equipment | |
| WO2014023148A1 (en) | Electronic equipment and method and device for controlling electronic device | |
| CN107193466B (en) | Gesture recognition method and device | |
| CN104156119A (en) | Touch response method and device for drawer type control | |
| CN112035271B (en) | User operation information processing method and device, electronic equipment and storage medium | |
| CN103092339A (en) | Electronic device and page demonstration method | |
| CN109739590B (en) | Desktop wallpaper replacing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |