CN111292736A - Information processing method, system, electronic device, and computer-readable medium - Google Patents
Information processing method, system, electronic device, and computer-readable medium Download PDFInfo
- Publication number
- CN111292736A CN111292736A CN201811490588.8A CN201811490588A CN111292736A CN 111292736 A CN111292736 A CN 111292736A CN 201811490588 A CN201811490588 A CN 201811490588A CN 111292736 A CN111292736 A CN 111292736A
- Authority
- CN
- China
- Prior art keywords
- instruction
- voice
- control element
- rule
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 26
- 238000003672 processing method Methods 0.000 title claims abstract description 19
- 238000000034 method Methods 0.000 claims description 39
- 230000008569 process Effects 0.000 claims description 7
- 238000004458 analytical method Methods 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 14
- 238000004590 computer program Methods 0.000 description 11
- 230000015654 memory Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000004891 communication Methods 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 108010001267 Protein Subunits Proteins 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides an information processing method, which includes obtaining a control element on a current interface, determining an instruction rule based on the control element, wherein the instruction rule includes a rule for limiting a voice instruction for operating the control element, and playing the instruction rule through voice. The present disclosure also provides an information processing system, an electronic device, and a computer-readable storage medium.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to an information processing method, system, electronic device, and computer readable medium.
Background
With the rapid development of computer technology, various portable electronic devices, such as smart glasses, smart watches, etc., are emerging. Some portable electronic devices that are inconvenient to control by hand typically use voice to control the electronic device.
In the course of implementing the disclosed concept, the inventors found that there are at least the following problems in the prior art: controlling an electronic device by speech often requires that the speech received by the electronic device complies with predefined speech rules, which is costly for a user to learn from speech rules of different applications.
Disclosure of Invention
In view of the above, the present disclosure provides an information processing method, system, electronic device, and computer readable medium.
One aspect of the present disclosure provides an information processing method, including obtaining a control element on a current interface, determining an instruction rule based on the control element, where the instruction rule includes a rule for defining a voice instruction for operating the control element, and playing the instruction rule by voice.
According to the embodiment of the disclosure, the control elements include a plurality of control elements, the playing the instruction rule through voice includes sequentially playing the instruction rules corresponding to the control elements through voice, and the method further includes marking the control elements corresponding to the instruction rules in the process of playing the instruction rules through voice.
According to the embodiment of the disclosure, the method further includes obtaining a voice instruction, analyzing the voice instruction when the voice instruction conforms to the instruction rule, determining a target control element and an operation performed on the target control element from the plurality of control elements, and performing the operation on the target control element.
According to the embodiment of the disclosure, acquiring the voice instruction includes acquiring voice information, sending the voice information to a server, enabling the server to recognize the voice information to acquire the voice instruction, and receiving the voice instruction sent by the server.
According to the embodiment of the disclosure, the instruction rule includes an instruction rule corresponding to an input operation performed on the target control element, or an instruction rule corresponding to a click operation performed on the target control element, or an instruction rule corresponding to a slide operation performed on the target control element.
According to an embodiment of the present disclosure, the method further includes playing a replay instruction rule by voice, the replay instruction rule being used to instruct a voice format of the replay instruction rule.
Another aspect of the present disclosure provides an information processing system including an obtaining module configured to obtain a control element on a current interface, a determining module configured to determine an instruction rule based on the control element, where the instruction rule includes a rule for defining a voice instruction for operating the control element, and a first playing module configured to play the instruction rule by voice.
According to the embodiment of the disclosure, the control elements comprise a plurality of control elements, the first playing module comprises a playing submodule and a marking module, the playing submodule is used for sequentially playing a plurality of instruction rules corresponding to the control elements respectively through voice, and the marking module is used for marking the control elements corresponding to the instruction rules in the process of playing the instruction rules through voice.
According to an embodiment of the present disclosure, the system further includes an obtaining module configured to obtain a voice instruction, an analyzing module configured to analyze the voice instruction, determine a target control element from the plurality of control elements, and determine an operation to be performed on the target control element, if the voice instruction conforms to the instruction rule, and an executing module configured to execute the operation on the target control element.
According to the embodiment of the disclosure, the obtaining module comprises a obtaining submodule used for obtaining voice information, a sending submodule used for sending the voice information to a server so that the server recognizes the voice information to obtain a voice instruction, and a receiving submodule used for receiving the voice instruction sent by the server.
According to the embodiment of the disclosure, the instruction rule includes an instruction rule corresponding to an input operation performed on the target control element, or an instruction rule corresponding to a click operation performed on the target control element, or an instruction rule corresponding to a slide operation performed on the target control element.
According to the embodiment of the disclosure, the system further comprises a second playing module, which is used for playing the replay instruction rule through voice, wherein the replay instruction rule is used for indicating the voice format of the replay instruction rule.
Another aspect of the disclosure provides an electronic device comprising one or more processors and storage for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of the above.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the method as described above when executed.
Another aspect of the disclosure provides a computer program comprising computer executable instructions for implementing the method as described above when executed.
According to the embodiments of the present disclosure, a problem that a cost of a user to learn a voice rule for controlling an electronic device is large can be at least partially solved, and thus a technical effect of reducing the cost of the user to learn the voice rule can be achieved.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
fig. 1 schematically shows an application scenario of an information processing method according to an embodiment of the present disclosure;
FIG. 2 schematically shows a flow chart of an information processing method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating a control element corresponding to a marked instruction rule according to an embodiment of the present disclosure;
FIG. 4 schematically shows a flow chart of an information processing method according to another embodiment of the present disclosure;
FIG. 5 schematically shows a flow chart for obtaining voice instructions according to an embodiment of the present disclosure;
FIG. 6 schematically shows a flow chart of an information processing method according to another embodiment of the present disclosure;
FIG. 7 schematically shows a block diagram of an information handling system according to an embodiment of the present disclosure;
FIG. 8 schematically shows a block diagram of an information handling system according to an embodiment of the present disclosure;
FIG. 9 schematically shows a block diagram of an information handling system according to an embodiment of the present disclosure; and
FIG. 10 schematically shows a block diagram of an electronic device according to an embodiment of the disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
The embodiment of the disclosure provides an information processing method, which includes obtaining a control element on a current interface, determining an instruction rule based on the control element, wherein the instruction rule includes a rule for limiting a voice instruction for operating the control element, and playing the instruction rule through voice.
Fig. 1 schematically shows an application scenario of an information processing method according to an embodiment of the present disclosure. It should be noted that fig. 1 is only an example of an application scenario in which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, but does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the application scenario includes a terminal device 100, an application 101 of XX mall may be installed on the terminal device 100, and a current display interface of the application 101 may be, for example, an order settlement interface 102. The user completes the settlement of the order by clicking the "settle" control on the order settlement interface 102.
However, interaction with the terminal device is realized through operations such as clicking by the user, which increases interaction cost and brings inconvenience to the user. For example, the buttons of a full-screen cell phone or wearable electronic device are small, and it is difficult for a user to accurately click on the corresponding control. To facilitate user interaction with an electronic device, some voice control techniques are applied in electronic devices. However, the application program cannot be controlled by voice generally, or the application program can be controlled by voice, but the user has difficulty in knowing the voice rule for controlling the application program, so that the voice control cannot be realized, and the user experience is not high.
According to an embodiment of the present disclosure, the user may control the application 101 through speech, for example. The application 101 can obtain the control element on the current interface 102, determine the instruction rule of the control element, and play the instruction rule by voice, so that the user can conveniently learn the voice control rule.
The terminal device 100 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, and the like.
Fig. 2 schematically shows a flow chart of an information processing method according to an embodiment of the present disclosure.
As shown in FIG. 2, the method includes operations S210-230.
In operation S210, a control element on the current interface is obtained.
In operation S220, an instruction rule is determined based on the control element, wherein the instruction rule includes a rule for defining a voice instruction for operating on the control element.
In operation S230, the instruction rule is played through voice.
The method can operate the voice rule of the control element on the current interface through voice playing, reduce the cost of learning the voice rule for the user, and improve the user experience.
According to the embodiment of the present disclosure, in operation S210, for example, in a case that the interface of the application program is switched from the first interface to the second interface, the application program actively obtains the control element on the second interface. For example, in the process of developing the application program, control elements on the interface are registered, a control element list is established, the element list includes information such as names, interaction modes, element types, element identifications and the like of the control elements, and when the application program is switched to the second interface, the control elements on the second interface can be obtained through a table lookup method, for example. For example, in the scenario shown in FIG. 1, the control elements that the application obtains on the current interface include the "Settlement," "home" buttons.
According to an embodiment of the present disclosure, in operation S220, for example, in the scenario shown in fig. 1, according to the control elements "settle" and "home" buttons on the current interface, an instruction rule for clicking the "settle" and "home" buttons is determined. The instruction rule may be determined, for example, by means of a look-up table. The instruction rule indicates a rule of a voice instruction so as to operate the control element on the current interface through the voice instruction. For example, the instruction rule for clicking the "settlement" button is "click settlement", and the instruction rule for setting the content "xxx" in the input box of the user name is "input user name xxx".
According to an embodiment of the present disclosure, in operation S230, the voice playing instruction rule may be, for example, a voice playing "if voice control" settlement "control, please say: and (5) click settlement.
According to the embodiment of the disclosure, the control elements comprise a plurality of control elements, and the playing of the instruction rules through voice comprises the step of sequentially playing the instruction rules corresponding to the control elements through voice. For example, in the scenario shown in fig. 1, the instruction rules corresponding to the "settlement" control and the "home" control are played in sequence by voice. According to the embodiment of the disclosure, under the condition that the instruction rules corresponding to the multiple control elements are played in sequence, the control elements corresponding to the instruction rules being played are marked. For example, the control element corresponding to the instruction rule being played may be highlighted. The method highlights the control element corresponding to the instruction rule being played, so that the user can define the control element corresponding to the instruction rule, and the user experience is further improved.
Fig. 3 schematically illustrates a diagram of a control element corresponding to a marked instruction rule according to an embodiment of the present disclosure.
As shown in fig. 3, for example, if the application is playing the command rule for the control "home" button 310, the "home" button 310 is highlighted.
Fig. 4 schematically shows a flow chart of an information processing method according to another embodiment of the present disclosure.
As shown in FIG. 4, the method includes operations S410-430.
In operation S410, a voice instruction is acquired.
In operation S420, in a case that the voice instruction conforms to the instruction rule, the voice instruction is parsed to determine a target control element and an operation performed on the target control element from among the plurality of control elements.
In operation S430, the operation is performed on the target control element.
According to an embodiment of the present disclosure, in operation S410, the voice command may be, for example, text information that an application program can recognize into which voice information uttered by a user is converted.
FIG. 5 schematically shows a flow chart for obtaining voice instructions according to an embodiment of the disclosure.
As shown in FIG. 5, the method includes operations S411 to 413.
In operation S411, voice information is acquired.
In operation S412, the voice message is sent to a server, so that the server recognizes the voice message to obtain a voice command.
In operation S413, a voice instruction transmitted by the server is received.
The method uses the server to identify the voice information, and improves the calculation speed of acquiring the voice instruction.
According to an embodiment of the present disclosure, in operation S411, the voice information may be, for example, sound information uttered by the user. The voice information of the user may be acquired using a microphone, for example.
According to an embodiment of the present disclosure, in operation S412, the application program may transmit the received sound information to the server, for example. And the server performs voice recognition on the received voice information and converts the voice information into a voice command which can be recognized by the application program.
According to an embodiment of the present disclosure, in operation S413, for example, a voice command in a text form sent by the server may be received.
Referring back to fig. 4, in operation S420, for example, the voice command is "click settlement", and the voice command conforms to the command rule. Analyzing the click settlement, acquiring the target control element as a settlement button, and executing click operation on the target control element settlement button. According to the embodiment of the disclosure, the instruction rule includes an instruction rule corresponding to an input operation performed on the target control element, or an instruction rule corresponding to a click operation performed on the target control element, or an instruction rule corresponding to a slide operation performed on the target control element. According to an embodiment of the present disclosure, the instruction rule may further include some default system command rules, for example, system commands such as a return instruction, an open notification, and the like are included on any interface.
In operation S430, for example, the application program may automatically perform the operation on the target control element when the target control element is obtained and the operation needs to be performed on the target control element.
Fig. 6 schematically shows a flow chart of an information processing method according to another embodiment of the present disclosure.
As shown in fig. 6, the method further includes operation S610 based on the foregoing embodiment.
In operation S610, a replay instruction rule for instructing to replay a voice format of the instruction rule is played through voice.
The method sets replay instructions so that the user can control the replay instruction rules of the application program under the condition that the voice instruction rules are not clear.
According to an embodiment of the present disclosure, in operation S610, for example, the replay instruction rule of replaying all instruction rules may be "replay", and for example, the instruction rule of replaying a specific control may be "replay xxxx instruction rule".
It should be understood that the above information processing method is not limited to be applied to an application program, and for example, the above information processing method may be applied to a system of a terminal device, such as an android system, a windows system, and the like.
FIG. 7 schematically shows a block diagram of an information handling system 700 according to an embodiment of the disclosure.
As shown in fig. 7, the information processing system 700 includes an obtaining module 710, a determining module 720, and a first playing module 730.
The obtaining module 710, for example, performs operation S210 described above with reference to fig. 2, for obtaining a control element on the current interface.
The determining module 720, for example performing operation S220 described above with reference to fig. 2, is configured to determine an instruction rule based on the control element, where the instruction rule includes a rule for defining a voice instruction for operating on the control element.
The first playing module 730, for example, performs the operation S230 described above with reference to fig. 2, for playing the instruction rule through voice.
According to the embodiment of the present disclosure, the control elements include a plurality of control elements, the first playing module 730 includes a playing submodule configured to sequentially play a plurality of instruction rules corresponding to the control elements respectively through voice, and the information processing system further includes a marking module configured to mark the control elements corresponding to the instruction rules in a process of playing the instruction rules through voice.
FIG. 8 schematically shows a block diagram of an information handling system 800 according to an embodiment of the disclosure.
As shown in fig. 8, the information processing system 800 further includes an obtaining module 810, a parsing module 820 and an executing module 830 on the basis of the foregoing embodiments.
The obtaining module 810, for example, performs operation S410 described above with reference to fig. 4, for obtaining the voice instruction.
The parsing module 820, for example, performs operation S420 described above with reference to fig. 4, and is configured to parse the voice instruction, determine a target control element from the plurality of control elements, and determine an operation performed on the target control element, if the voice instruction conforms to the instruction rule.
The execution module 830, for example, performs the operation S430 described above with reference to fig. 4, for performing the operation on the target control element.
According to an embodiment of the present disclosure, the obtaining module 810 includes an obtaining submodule, a sending submodule, and a receiving submodule. The obtaining sub-module, for example, performs operation S411 described above with reference to fig. 5, for obtaining voice information. The sending sub-module, for example, performs operation S412 described above with reference to fig. 5, and is configured to send the voice message to a server, so that the server recognizes the voice message to obtain a voice instruction. The receiving submodule, for example, performs operation S413 described above with reference to fig. 5, for receiving the voice instruction sent by the server.
According to the embodiment of the disclosure, the instruction rule includes an instruction rule corresponding to an input operation performed on the target control element, or an instruction rule corresponding to a click operation performed on the target control element, or an instruction rule corresponding to a slide operation performed on the target control element.
FIG. 9 schematically shows a block diagram of an information handling system 900 according to an embodiment of the disclosure.
As shown in fig. 9, the information processing system 900 further includes a second playing module 910 on the basis of the foregoing embodiment.
The second playing module 910, for example, performs operation S610 described above with reference to fig. 6, for playing the replay instruction rule by voice, where the replay instruction rule is used to instruct to replay the voice format of the instruction rule.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any plurality of the obtaining module 710, the determining module 720, the first playing module 730, the obtaining module 810, the parsing module 820, the executing module 830, and the second playing module 910 may be combined and implemented in one module, or any one of the modules may be split into a plurality of modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of the other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the obtaining module 710, the determining module 720, the first playing module 730, the obtaining module 810, the parsing module 820, the executing module 830 and the second playing module 910 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware and firmware, or an appropriate combination of any several of them. Alternatively, at least one of the obtaining module 710, the determining module 720, the first playing module 730, the obtaining module 810, the parsing module 820, the executing module 830 and the second playing module 910 may be at least partially implemented as a computer program module, which when executed, may perform a corresponding function.
FIG. 10 schematically illustrates a block diagram of an electronic device suitable for implementing information processing methods and systems in accordance with embodiments of the present disclosure. The electronic device shown in fig. 10 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 10, an electronic device 1000 according to an embodiment of the present disclosure includes a processor 1001 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)1002 or a program loaded from a storage section 1008 into a Random Access Memory (RAM) 1003. Processor 1001 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 1001 may also include onboard memory for caching purposes. The processor 1001 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the present disclosure.
In the RAM1003, various programs and data necessary for the operation of the system 1000 are stored. The processor 1001, ROM1002, and RAM1003 are connected to each other by a bus 1004. The processor 1001 performs various operations of the method flow according to the embodiments of the present disclosure by executing programs in the ROM1002 and/or the RAM 1003. Note that the programs may also be stored in one or more memories other than the ROM1002 and the RAM 1003. The processor 1001 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication part 1009 and/or installed from the removable medium 1011. The computer program performs the above-described functions defined in the system of the embodiment of the present disclosure when executed by the processor 1001. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM1002 and/or the RAM1003 described above and/or one or more memories other than the ROM1002 and the RAM 1003.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.
Claims (14)
1. An information processing method comprising:
acquiring a control element on a current interface;
determining an instruction rule based on the control element, wherein the instruction rule comprises a rule for defining a voice instruction for operating the control element; and
and playing the instruction rule through voice.
2. The method of claim 1, wherein the control element comprises a plurality, and wherein playing the instruction rule by voice comprises:
sequentially playing instruction rules corresponding to the control elements through voice,
the method further comprises the following steps:
and marking the control element corresponding to the instruction rule in the process of playing the instruction rule through voice.
3. The method of claim 1, further comprising:
acquiring a voice instruction;
under the condition that the voice instruction conforms to the instruction rule, analyzing the voice instruction to determine a target control element and an operation performed on the target control element from a plurality of control elements; and
performing the operation on the target control element.
4. The method of claim 3, wherein the obtaining voice instructions comprises:
acquiring voice information;
sending the voice information to a server, and enabling the server to identify the voice information so as to obtain a voice instruction; and
and receiving a voice instruction sent by the server.
5. The method of claim 3, wherein the instruction rule comprises:
performing instruction rules corresponding to input operation on the target control element; or
Carrying out instruction rules corresponding to the clicking operation on the target control element; or
And carrying out instruction rules corresponding to sliding operation on the target control element.
6. The method of claim 1, further comprising:
and playing a replay instruction rule through voice, wherein the replay instruction rule is used for indicating the voice format of the replay instruction rule.
7. An information processing system comprising:
the obtaining module is used for obtaining control elements on the current interface;
a determining module, configured to determine an instruction rule based on the control element, where the instruction rule includes a rule for defining a voice instruction for operating on the control element; and
and the first playing module is used for playing the instruction rule through voice.
8. The system of claim 7, wherein the control element comprises a plurality, the first playback module comprising:
the playing sub-module is used for sequentially playing the instruction rules corresponding to the control elements through voice,
the system further comprises:
a marking module for marking the instruction rule in the process of playing the instruction rule through voice,
and marking the control element corresponding to the instruction rule.
9. The system of claim 7, further comprising:
the acquisition module is used for acquiring a voice instruction;
the analysis module is used for analyzing the voice instruction under the condition that the voice instruction conforms to the instruction rule so as to determine a target control element and an operation executed on the target control element from a plurality of control elements; and
an execution module to execute the operation on the target control element.
10. The system of claim 9, wherein the acquisition module comprises:
the acquisition submodule is used for acquiring voice information;
the sending submodule is used for sending the voice information to a server so that the server can identify the voice information to obtain a voice instruction; and
and the receiving submodule is used for receiving the voice instruction sent by the server.
11. The system of claim 9, the instruction rule comprising:
performing instruction rules corresponding to input operation on the target control element; or
Carrying out instruction rules corresponding to the clicking operation on the target control element; or
And carrying out instruction rules corresponding to sliding operation on the target control element.
12. The system of claim 7, further comprising:
and the second playing module is used for playing the replay instruction rule through voice, and the replay instruction rule is used for indicating the voice format of the replay instruction rule.
13. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method of any of claims 1-6.
14. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811490588.8A CN111292736A (en) | 2018-12-06 | 2018-12-06 | Information processing method, system, electronic device, and computer-readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811490588.8A CN111292736A (en) | 2018-12-06 | 2018-12-06 | Information processing method, system, electronic device, and computer-readable medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111292736A true CN111292736A (en) | 2020-06-16 |
Family
ID=71023061
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811490588.8A Pending CN111292736A (en) | 2018-12-06 | 2018-12-06 | Information processing method, system, electronic device, and computer-readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111292736A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102339221A (en) * | 2010-07-22 | 2012-02-01 | 厦门雅迅网络股份有限公司 | Method for processing application program interface based on Windows CE platform |
| CN102375733A (en) * | 2010-08-24 | 2012-03-14 | 北大方正集团有限公司 | Convenient and quick interface arrangement method |
| CN103116439A (en) * | 2013-01-23 | 2013-05-22 | 东莞宇龙通信科技有限公司 | Mobile terminal and display method of application program interface elements of mobile terminal |
| US20150279367A1 (en) * | 2014-03-25 | 2015-10-01 | GM Global Technology Operations LLC | Methods and apparatus to convert received graphical and/or textual user commands into voice commands for application control |
| CN106406867A (en) * | 2016-09-05 | 2017-02-15 | 深圳市联谛信息无障碍有限责任公司 | Android system-based screen reading method and apparatus |
| CN107977203A (en) * | 2017-10-20 | 2018-05-01 | 捷开通讯(深圳)有限公司 | The creation method of storage device, application program control and user interface |
| CN108364644A (en) * | 2018-01-17 | 2018-08-03 | 深圳市金立通信设备有限公司 | A kind of voice interactive method, terminal and computer-readable medium |
| CN108733343A (en) * | 2018-05-28 | 2018-11-02 | 北京小米移动软件有限公司 | Generate the method, apparatus and storage medium of phonetic control command |
| CN108874356A (en) * | 2018-05-31 | 2018-11-23 | 珠海格力电器股份有限公司 | voice broadcast method, device, mobile terminal and storage medium |
-
2018
- 2018-12-06 CN CN201811490588.8A patent/CN111292736A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102339221A (en) * | 2010-07-22 | 2012-02-01 | 厦门雅迅网络股份有限公司 | Method for processing application program interface based on Windows CE platform |
| CN102375733A (en) * | 2010-08-24 | 2012-03-14 | 北大方正集团有限公司 | Convenient and quick interface arrangement method |
| CN103116439A (en) * | 2013-01-23 | 2013-05-22 | 东莞宇龙通信科技有限公司 | Mobile terminal and display method of application program interface elements of mobile terminal |
| US20150279367A1 (en) * | 2014-03-25 | 2015-10-01 | GM Global Technology Operations LLC | Methods and apparatus to convert received graphical and/or textual user commands into voice commands for application control |
| CN106406867A (en) * | 2016-09-05 | 2017-02-15 | 深圳市联谛信息无障碍有限责任公司 | Android system-based screen reading method and apparatus |
| CN107977203A (en) * | 2017-10-20 | 2018-05-01 | 捷开通讯(深圳)有限公司 | The creation method of storage device, application program control and user interface |
| CN108364644A (en) * | 2018-01-17 | 2018-08-03 | 深圳市金立通信设备有限公司 | A kind of voice interactive method, terminal and computer-readable medium |
| CN108733343A (en) * | 2018-05-28 | 2018-11-02 | 北京小米移动软件有限公司 | Generate the method, apparatus and storage medium of phonetic control command |
| CN108874356A (en) * | 2018-05-31 | 2018-11-23 | 珠海格力电器股份有限公司 | voice broadcast method, device, mobile terminal and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11693531B2 (en) | Page display position jump method and apparatus, terminal device, and storage medium | |
| US20230379280A1 (en) | Information interaction method, apparatus, device, storage medium and program product | |
| US11379183B2 (en) | System and method for providing a response to a user query using a visual assistant | |
| CN107728783B (en) | Artificial intelligence processing method and system | |
| WO2021068634A1 (en) | Page jump method and apparatus, electronic device and computer-readable storage medium | |
| US20120280915A1 (en) | Method and apparatus for facilitating interacting with a multimodal user interface | |
| CN109857506B (en) | Method and device for realizing guide information, electronic equipment and storage medium | |
| US10768947B2 (en) | Method for interface refresh synchronization,terminal device, and non-transitory computer-readable storage medium | |
| CN111309617A (en) | Application program control method and device, storage medium and electronic equipment | |
| CN112307375A (en) | Page display method and device, electronic equipment and computer readable medium | |
| CN112306447A (en) | Interface navigation method, device, terminal and storage medium | |
| US9389747B2 (en) | Quick close button | |
| US20220215482A1 (en) | User information processing method, apparatus, electronic device, and computer storage medium | |
| EP3825894A1 (en) | Method, device and terminal for performing word segmentation on text information, and storage medium | |
| CN110069186B (en) | Method and equipment for displaying operation interface of application | |
| CN109976857B (en) | Display control method and device of terminal interface, storage medium and electronic equipment | |
| US20170013118A1 (en) | Electronic device and notification method thereof | |
| CN112422614A (en) | Method, apparatus, and medium for device interaction | |
| CN109408387B (en) | Page testing method and device | |
| CN116107680A (en) | Operation guiding method and device of mobile terminal and electronic equipment | |
| CN111292736A (en) | Information processing method, system, electronic device, and computer-readable medium | |
| WO2020143556A1 (en) | Method and apparatus used for displaying page | |
| CN113849416A (en) | Test method, test device, storage medium and electronic equipment | |
| CN109656659B (en) | Behavior event processing method and device, electronic equipment and readable storage medium | |
| CN113296771A (en) | Page display method, device, equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200616 |