CN107240400B - Terminal operation method and device - Google Patents
Terminal operation method and device Download PDFInfo
- Publication number
- CN107240400B CN107240400B CN201710531194.1A CN201710531194A CN107240400B CN 107240400 B CN107240400 B CN 107240400B CN 201710531194 A CN201710531194 A CN 201710531194A CN 107240400 B CN107240400 B CN 107240400B
- Authority
- CN
- China
- Prior art keywords
- application program
- terminal
- voice information
- voice
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000001514 detection method Methods 0.000 claims description 18
- 238000000605 extraction Methods 0.000 claims description 9
- 230000001172 regenerating effect Effects 0.000 claims description 4
- 238000012544 monitoring process Methods 0.000 claims description 3
- 239000000126 substance Substances 0.000 claims 1
- 238000013461 design Methods 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 50
- 235000013305 food Nutrition 0.000 description 11
- 239000000284 extract Substances 0.000 description 10
- 235000013410 fast food Nutrition 0.000 description 5
- 101100264195 Caenorhabditis elegans app-1 gene Proteins 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011022 operating instruction Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 235000011888 snacks Nutrition 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a terminal operation method and device. The method comprises the following steps: detecting an interface mode of a terminal; receiving input first voice information when the interface mode is a non-interface mode, and extracting first key information from the first voice information; determining a target application program from the at least one application program according to a preset rule; and searching an operation instruction corresponding to the first key information from the instruction set of the target application program, and executing the operation indicated by the operation instruction on the target application program. Through the design, a user can operate the terminal completely through voice without checking a terminal display interface, and the use is very convenient.
Description
Technical Field
The invention relates to the technical field of voice control, in particular to a terminal operation method and device.
Background
At present, the voice technology is more and more mature, and a user can operate an application program through voice, such as making a call, starting the application program and the like. However, the existing voice operation method requires the user to check the application interface to determine the application program to be operated at intervals during the operation process, and is inconvenient for the blind or the user driving.
Disclosure of Invention
In view of the above, the present invention provides a method and an apparatus for operating a terminal, so as to improve the above problem.
In order to achieve the above object, an embodiment of the present invention provides a terminal operation method, where the terminal stores an instruction set of at least one application program, where the instruction set includes a relationship between key information and an operation instruction, and the method includes:
detecting an interface mode of the terminal;
receiving input first voice information under the condition that the interface mode is a non-interface mode, and extracting first key information from the first voice information;
determining a target application program from the at least one application program according to a preset rule;
and searching an operation instruction corresponding to the first key information from the instruction set of the target application program, and executing the operation indicated by the operation instruction on the target application program.
An embodiment of the present invention further provides a terminal operating apparatus, where the terminal stores an instruction set of at least one application program, where the instruction set includes a relationship between key information and an operation instruction, and the terminal operating apparatus includes:
the first detection module is used for detecting the interface mode of the terminal;
the first extraction module is used for receiving input first voice information and extracting first key information from the first voice information under the condition that the interface mode is a non-interface mode;
the determining module is used for determining a target application program from the at least one application program according to a preset rule;
and the first operation module is used for searching an operation instruction corresponding to the first key information from the instruction set of the target application program and executing the operation indicated by the operation instruction on the target application program.
According to the terminal operation method and device provided by the embodiment of the invention, the terminal stores the instruction set of at least one application program, and the instruction set comprises the relationship between key information and an operation instruction. The terminal receives input first voice information under the condition of being in a non-interface mode, and first key information is extracted from the first voice information. The terminal determines a target application program in the at least one application program according to a preset rule, searches an operation instruction corresponding to the first key information from an instruction set of the target application program, and executes an operation indicated by the operation instruction on the target application program. Through the design, a user can directly operate the application program through voice without viewing an interface when needed, and the use is very convenient.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained according to the drawings without inventive efforts.
Fig. 1 is a block diagram of a terminal according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating a terminal operation method according to an embodiment of the present invention.
Fig. 3 is a schematic flowchart of a terminal operation method according to an embodiment of the present invention.
Fig. 4 is a functional block diagram of a terminal operating device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
As shown in fig. 1, which is a block diagram of a terminal 100 according to an embodiment of the present invention, the terminal operation method and apparatus according to the embodiment of the present invention may be used to operate the terminal 100. The terminal 100 may be an intelligent terminal (e.g., a mobile phone, a notebook computer, etc.), or may be a server, which is not limited in this embodiment. The terminal 100 includes a terminal operating device 110, a memory 120, a processor 130, and a detection unit 140.
The memory 120, the processor 130, and the detection unit 140 are electrically connected to each other indirectly or indirectly to achieve data transmission or interaction. For example, the components may be electrically connected to each other via one or more communication buses or signal lines. The terminal operating device 110 includes at least one software functional module that can be stored in a memory 120 in the form of software or firmware (firmware) or solidified in an Operating System (OS) of the terminal 100. In the memory 120, in addition to the software function module corresponding to the terminal operating device 110, at least one application program (App) and an instruction set of the at least one application program are stored, where the instruction set includes an operation instruction and a relationship between the operation instruction and key information.
The Memory 120 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Read-Only Memory (EPROM), an electrically Erasable Read-Only Memory (EEPROM), and the like. The processor 130 may be an integrated circuit chip having signal processing capabilities. The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP)), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The detection unit 140 may be an audio sensor for detecting a sound signal in an environment in which the terminal 100 is located.
It should be understood that the configuration shown in fig. 1 is merely illustrative, and that terminal 100 may include more or fewer components than shown in fig. 1, or may have a different configuration than shown in fig. 1. Further, the components included in the terminal 100 may be implemented in hardware, software, or a combination thereof.
Fig. 2 is a schematic flowchart of a terminal operation method according to an embodiment of the present invention, where the terminal operation method is applicable to the terminal 100 shown in fig. 1, and an instruction set of at least one application program is stored in the terminal 100, where the instruction set includes a relationship between key information and an operation instruction. The specific process shown in fig. 2 will be described in detail below.
S101, detecting the interface mode of the terminal 100.
In this embodiment, the interface modes of the terminal 100 include a non-interface mode and other interface modes, wherein the non-interface mode refers to a mode in which a user does not need to view and operate a display interface. In practice, the terminal 100 detects the interface mode in which it is located.
S102, receiving input first voice information under the condition that the interface mode is the interface-free mode, and extracting first key information from the first voice information.
In this embodiment, the terminal 100 starts to receive the first voice information input by the user only when detecting that the interface mode in which the terminal is located is the interface-less mode. That is, if the terminal 100 is not in the no interface mode, the terminal 100 does not receive even if the user inputs a voice. In this way, power of the terminal 100 can be saved.
It should be noted that the phrase "the interface mode is the interface-less mode" may include a case of switching from the other interface mode to the interface-less mode. For example, assuming that the user is operating an application interface of a certain takeout application program in the terminal 100, if the user switches the terminal 100 to the non-interface mode, the terminal 100 starts to receive the voice input by the user, that is, the first voice information in S101.
Optionally, in this embodiment, there may be a plurality of ways to switch the interface mode of the terminal 100 to the non-interface mode, for example, a function button may be set in the terminal 100, and when the user clicks the function button, the terminal 100 automatically switches to the non-interface mode. The function keys can be software keys or hardware keys.
For another example, a monitoring module may be preset in the terminal 100, and configured to monitor a sliding operation of a user on a display interface of the terminal 100, and when the user performs a preset sliding operation (e.g., sliding according to an "L" shape) on the display interface, the terminal 100 switches to the interface-less mode.
For another example, an operation instruction for starting the non-interface mode may be set in the voice operation instruction carried by the terminal 100, where the operation instruction corresponds to the preset voice information. In implementation, the user may manually start the voice recording function of the terminal 100 for voice recording. When the terminal 100 detects that the voice input by the user is the preset voice information, an operation instruction for starting the non-interface mode is called to start the non-interface mode.
Alternatively, after receiving the first voice message, the terminal 100 may extract the first key message from the first voice message in various ways.
For example, a plurality of preset key information may be stored in the terminal 100 in advance. After receiving the first voice message, the terminal 100 may directly search whether the first voice message includes at least one preset key message of the plurality of preset key messages, and if so, extract the at least one preset key message as the first key message of the first voice message.
For another example, after receiving the first voice message, the terminal 100 may split the first voice message into a plurality of voice signal features by using a word segmentation technology, respectively calculate semantic similarities between each voice signal feature and a plurality of preset key information pre-stored in the terminal 100 based on an external database, and use the preset key information corresponding to the semantic similarity with the largest value in the calculated semantic similarities as the first key information of the first voice message.
In this embodiment, the extracting of the first key information in the first speech information may also be implemented by many other existing methods, which is not limited in this embodiment.
The inventor researches and discovers that the existing voice operation method requires a user to check which application programs are installed in the terminal 100 in advance and determine the application program to be operated by the user before the user can carry out voice operation. That is, the existing voice operation method cannot be implemented completely separated from the display screen. This is inconvenient for the blind or the person driving the vehicle.
Therefore, after extracting the first key information from the first voice information, the terminal 100 may determine a target application program, that is, an application program to be operated by the first voice information, among the stored at least one application program.
S103, determining a target application program from at least one application program according to a preset rule.
The inventor finds that, in general, when a user is operating a certain application program of the terminal 100, the display interface of the terminal 100 stays in the certain application interface of the application program. When the user operates the application program in the terminal 100 through the voice information, although the user may not necessarily view the display interface of the terminal 100, the display interface of the terminal 100 may actually stay on the application interface of the application program operated by the user through the voice information.
In practical applications, if a user is operating an application program in the interface mode, when the user switches to the interface-less mode and inputs voice information to operate, the operating application program has a high possibility that the voice information input by the user is the target application program to be operated.
Thus, as shown in fig. 3, after the terminal 100 extracts the first key information from the first voice information, the terminal operation method provided by the embodiment of the present invention may further include step S105.
S105, detecting the current interface of the terminal 100, and judging whether the current interface is the application interface of the application program.
In this case, S103 may include two substeps of S1031 and S1032.
In a case where the current interface is an application interface of an application program, S1031 may be performed. In a case where the interface currently located is not an application interface of an application program, S1032 may be performed.
And S1031, determining the application program as a target application program.
In this case, when the current interface is an application interface of an application program, the terminal 100 may search whether an operation instruction corresponding to the first key information is included in the instruction set of the application program, and if the operation instruction is included, determine that the application program is a target application program.
S1032, searching a corresponding instruction set based on the first key information, and taking an application program corresponding to the searched instruction set as a target application program.
When the current interface is not an application interface of an application program, searching for a corresponding instruction set based on the first key information may specifically be implemented in the following manner:
the terminal 100 searches for an instruction set including an operation instruction corresponding to the first key information in the stored instruction set. If the voice information is not found, prompting the user to input an error or prompting the user to input the voice information again; if the instruction set is found, judging the number of the found instruction sets; if one instruction set is found, taking an application program corresponding to the instruction set as a target application program; if the number of the searched instruction sets is larger than 1, the names of the application programs corresponding to the searched instruction sets are played in a voice mode, and a user determines one application program as a target application program in the application programs played in the voice mode.
In practical applications, a plurality of application programs with similar functions may be installed in the terminal 100, so that the operation instructions with the same corresponding key information exist in the instruction sets of the plurality of application programs.
For example, it is assumed that the terminal 100 has the application app1 and the application app2 installed therein, and the instruction sets corresponding to the application app1 and the application app2 each include an operation instruction corresponding to the key information "take out". Thus, in practice, the instruction set found by the terminal 100 according to the key information "takeaway" is 2. At this time, the terminal 100 may play the found names of the application app1 and the application app2 in voice. The user can determine the application program which the user wants to operate according to the name played by voice, and input the name of the application program by voice within a preset time length (for example, 1 minute or 30 seconds). When the user inputs the name of any one of the names of the application app1 and the application app2 within the preset time period, the terminal 100 takes the application corresponding to the name input by the user as a target application.
S104, searching an operation instruction corresponding to the first key information from the instruction set of the target application program, and executing the operation indicated by the operation instruction on the target application program.
In practical applications, there may be a case where the operation instruction corresponding to the first key information cannot be found from the instruction set of the target application program. For this case, the terminal 100 may voice-prompt the user for an input error or voice-prompt the user to re-input voice information.
Optionally, in this embodiment, when the interface mode of the terminal 100 is the interface-less mode, after receiving the input first voice message and extracting the first key message from the first voice message, the user may determine whether the extracted first key message is correct, so that accuracy of voice control may be improved.
Optionally, after the terminal 100 executes S102, the terminal operation method provided in the embodiment of the present invention may further include three steps S106, S107, and S108.
And S106, generating voice information to be played based on the first key information, and playing the voice information to be played.
In this embodiment, the first key information may be directly used as the voice information to be played, or preset information may be added on the basis of the first key information to generate the voice information to be played, for example, if the first key information "take-out" is extracted, the terminal 100 may generate the voice information to be played, which is "take-out you" and play the voice information.
S107, detecting whether the second voice message is received within a first preset time after the voice message to be played is played. If the second voice message is not received, S103 is executed. If the second voice message is received, S108 is executed.
And S108, extracting key information from the second voice information, and regenerating the voice information to be played based on the extracted key information.
In implementation, if the user determines that the voice information to be played corresponds to the first voice information input by the user, no operation is required to be performed. Therefore, when the terminal 100 does not receive the second voice message within the first preset time after playing the voice message to be played, it indicates that the key message is correctly extracted, and the subsequent operations can be further executed.
If the user finds that the voice information to be played does not correspond to the first voice information input by the user, the user can input the voice information again, namely, the second voice information. The terminal 100 may extract key information from the second voice information and regenerate voice information to be played based on the extracted key information for the user to confirm again.
It should be noted that the second speech information in the present embodiment is actually the first speech information re-input in the case where the first key information is extracted incorrectly.
In this embodiment, extracting the key information from the second speech information corresponds to replacing the first speech information in step S102 with the input second speech information when the first key information is extracted incorrectly in step S102, and then executing the step of extracting the first key information in step S102 again.
Optionally, in this embodiment, the instruction set may further include function options associated with each operation instruction. After the terminal 100 executes step S104, that is, after the terminal 100 executes the operation indicated by the operation instruction on the target application program, the terminal operation method provided in the embodiment of the present invention may further include steps S109, S110, and S111.
S109, based on the operation indicated by the operation instruction, the function option associated with the operation instruction is searched in the instruction set, and the searched function option is played in a voice mode.
In this embodiment, for the operation indicated by each operation instruction executed by the terminal 100, if the operation instruction is associated with a function option, the terminal 100 provides the function option associated with the operation instruction for the user to select after executing the operation indicated by the operation instruction. Thus, the terminal 100 can search the function option associated with the operation instruction in the instruction set after performing the operation indicated by the operation instruction on the target application program. If the terminal is not found, it indicates that the terminal 100 does not provide the function options available for the user to select, and voice playing is not needed. And if the function options are found, the found function options are played in a voice mode so that the user can select the function options conveniently.
S110, whether third voice information is received within a second preset time after voice playing is detected, and if the third voice information is received, second key information is extracted from the third voice information.
In this embodiment, the third voice message refers to the voice message of the user selecting the target function option from the function options played by the terminal 100 in voice. In implementation, for the function options played by the terminal 100 in the voice mode, if the user does not make a selection within the second preset time duration, that is, the terminal 100 does not receive the third voice message within the second preset time duration after the voice mode is played, the terminal 100 may select a default option from the searched function options as the target function option.
If the user inputs the third voice message within the second preset time period, the terminal 100 receives the third voice message and determines the target function option selected by the user based on the third voice message.
And S111, determining a target function option in the searched function options based on the second key information, and executing the operation indicated by the operation instruction corresponding to the second key information on the determined target function option.
In this embodiment, there is a corresponding relationship between the second key information and the function options associated with each operation instruction stored in the terminal 100, and the corresponding relationship may be recorded in the terminal 100. The operation instruction corresponding to the second key information may be an operation of selecting a function option corresponding to the second key information. That is, after the terminal 100 determines a target function option based on the second key information, the terminal 100 may automatically invoke an operation instruction corresponding to the second key information to perform an operation of selecting the target function option.
For example, assuming that the terminal 100 stores a shopping application, in the case that the terminal 100 performs the operation indicated by the operation instruction a1, the shopping application provides the following options for the user to select: 1. footwear; 2. a garment; 3. a food is provided. That is, the operating instruction a1 is associated with three functional options of footwear, apparel, and food.
If the user inputs the corresponding voice information to enable the terminal 100 to perform the operation indicated by the operation instruction a1 on the shopping application, after the operation is performed, the terminal 100 finds three function options of footwear, clothing and food in the instruction set based on the operation instruction a1 and plays the three function options in voice. The terminal 100 detects whether the user inputs the third voice information within a second preset time after the three function options are played in voice, for example, if the user does not input the third voice information within 30 seconds, a default option (e.g., clothing) may be selected from the three function options as the target function option, where the second preset time is 30 seconds. If the user inputs the third voice message containing 'food' within 30 seconds, the '2, food' is determined as the target function option selected by the user among the three function options based on the third voice message.
After determining that "2, food" is the target function option selected by the user, the terminal 100 may invoke an operation instruction for selecting the option "2, food", and perform an operation for selecting the option "2, food".
In practice, some applications may require the user to enter information during use, for example, a loan application may require the user to enter loan information.
Optionally, in this case, after the terminal 100 searches for the function option associated with the operation instruction in the instruction set based on the operation indicated by the operation instruction, the terminal operation method provided in the embodiment of the present invention may further include two steps S112 and S113.
And S112, if the function option is used for indicating the input of the loan information, the name of each item of information to be input is played in a voice mode, and the input voice information is input after the name of each item of information is played.
In implementation, each time the terminal 100 finishes playing the name of one information, the third preset time duration of the voice entry function may be started, and the user may input corresponding voice information within the third preset time duration.
And S113, associating and storing the input voice information and the name of the voice playing.
Wherein the inputted voice information entered by the terminal 100 is associated with and stored with the name played before the entry.
The terminal operation method provided by the embodiment of the invention can be applied to a plurality of scenes, for example, suppose that a takeout application program is installed in the terminal 100. When the user inputs the first voice message including "take out", the terminal 100 may extract first key information of "take out" from the first voice message and find the take out application according to the first key information. The terminal 100 controls the takeaway application to start, opens the takeaway interface of the takeaway application based on the first key information, and plays a takeaway option provided by the takeaway interface in a voice manner, for example, "please select the type of ordering you: 1. fast food; 2. wheaten food; 3. snacks ".
The terminal 100 may detect whether the user inputs the third voice message (i.e., the voice for selecting the function option) within a second preset time (e.g., 3 seconds) after the voice playing is completed, and may select the default ordering type if not detected. And if so, determining the type of the food ordering selected by the user based on the detected third voice information. For example, assuming that the user inputs "1" and/or "fast food", the terminal 100 may determine a target function option of fast food and call a corresponding operation instruction to perform an operation of selecting the option of fast food. The terminal 100 may further provide the function options included in the fast food type based on the selection operation, and so on until the user finishes ordering the food.
For another example, assuming that a plurality of loan applications are installed in the terminal 100, when the user inputs first voice information including "loan", the terminal 100 extracts first key information of "loan" from the first voice information, and searches a stored instruction set for an instruction set including an operation instruction corresponding to "loan". Since a plurality of loan applications are installed in the terminal 100, that is, a plurality of instruction sets including an operation instruction corresponding to "loan" are stored in the terminal 100, the terminal 100 can search for the plurality of instruction sets.
After the instruction sets are found, the terminal 100 may play the names of the application programs corresponding to the instruction sets in a voice manner, and after the voice play is completed, select one of the application programs as a target application program to be started based on the voice input by the user, and perform an operation indicated by an operation instruction corresponding to "loan" on the target application program to enter a loan interface of the target application program.
The terminal 100 may detect whether the loan interface instructs the user to enter information, and if so, may play the name of each item of information instructed to be entered in a voice, and enter the input voice information after playing the name of each item of information. In the recording process, the terminal 100 associates and stores the recorded voice information of the input with the name played before recording. After the entry is completed, the terminal 100 may control the target application to perform loan assessment and the like according to the entered voice information.
As shown in fig. 4, a terminal operating device 110 according to an embodiment of the present invention is provided, and the terminal operating device 110 is applied to the terminal 100 according to an embodiment of the present invention. Alternatively, the terminal operating device 100 may be a third party application in the terminal 100, that is, an application that may be downloaded from some specific server and installed in the terminal 100. The terminal operating device 100 may be a native application program that is fixed to the operating system of the terminal 100, or may be an applet that runs based on an application program existing in the terminal 100.
In this embodiment, the terminal 100 stores an instruction set of at least one application program, and the instruction set includes a relationship between the key information and the operation instruction. The terminal operating device 110 includes a first detecting module 111, a first extracting module 112, a determining module 113, and a first operating module 114.
The first detecting module 111 is configured to detect an interface mode of the terminal 100.
In the present embodiment, the description of the first detecting module 111 may specifically refer to the detailed description of step S101 shown in fig. 2, that is, step S101 may be performed by the first detecting module 111.
The first extracting module 112 is configured to receive input first voice information and extract first key information from the first voice information when the interface mode of the terminal 100 is the non-interface mode.
In the present embodiment, the description of the first extraction module 112 may specifically refer to the detailed description of step S102 shown in fig. 2, that is, step S102 may be executed by the first extraction module 112.
The determining module 113 is configured to determine a target application from at least one application in the terminal 100 according to a preset rule.
In the present embodiment, the description about the determination module 113 may specifically refer to the detailed description of step S103 shown in fig. 2, that is, step S103 may be performed by the determination module 113.
The first operation module 114 is configured to search an operation instruction corresponding to the extracted first key information from the instruction set of the target application program, and perform an operation indicated by the operation instruction on the target application program.
In the present embodiment, the description about the first operation module 114 may specifically refer to the detailed description of step S104 shown in fig. 2. That is, step S104 may be performed by the first operation module 114.
Optionally, the terminal operating device 110 may further include a production module, a second detection module, a first trigger module, and a second trigger module.
The generating module is configured to receive input first voice information when the first extracting module is in the interface-less mode of the terminal 100, extract first key information from the first voice information, generate to-be-played voice information based on the first key information, and play the to-be-played voice information.
In this embodiment, the description of the generation module may specifically refer to the description of the relevant steps in the above content.
The second detection module is used for detecting whether the second voice information is received within a first preset time after the voice information to be played is played.
In this embodiment, the description of the second detection module may specifically refer to the description of the relevant steps in the above content.
The first triggering module is configured to trigger the determining module 113 to perform an operation of determining a target application program from at least one application program of the terminal 100 according to a preset rule, when the second voice message is not received.
In this embodiment, the description of the first triggering module may specifically refer to the description of the relevant steps in the above description.
The second triggering module is used for extracting key information from the second voice information under the condition of receiving the second voice information, and regenerating the voice information to be played based on the extracted key information.
In this embodiment, the description of the second triggering module may specifically refer to the description of the relevant steps in the above description.
Optionally, the instruction set stored in the terminal 100 further includes function options associated with each operation instruction. The terminal operating device 110 may further include a search module, a third detection module, a second extraction module, and a second operation module.
The searching module is used for searching the function options related to the operation instruction in the instruction set of the target application program based on the operation indicated by the operation instruction after the first operation module executes the operation indicated by the operation instruction on the target application program, and playing the searched function options in a voice mode.
In this embodiment, the detailed description of the relevant steps in the above contents may be referred to for the description of the search module.
The third detection module is used for detecting whether third voice information is received within a second preset time length after voice playing.
In this embodiment, the detailed description of the relevant steps in the above contents can be referred to for the description of the third detection module.
The second extraction module is used for extracting second key information from the third voice information under the condition of receiving the third voice information.
In the present embodiment, the detailed description of the relevant steps in the above contents can be referred to for the description of the second extraction module.
The second operation module is used for determining a target function option in the searched function options based on the second key information and executing the operation indicated by the operation instruction corresponding to the second key information on the target function option.
Optionally, the terminal operating device 110 may further include an entry module and a storage module.
The input module is used for playing the name of each item of information to be input in a voice mode under the condition that the function option searched by the search module is used for indicating the input of the loan information, and the input voice information is input after the name of each item of information is played.
In the present embodiment, the description of the entry module may specifically refer to the detailed description of the relevant steps in the above.
The storage module is used for associating and storing the input voice information and the name played by the voice.
In the present embodiment, specific reference may be made to the detailed description of the relevant steps in the above description for the description of the memory module.
Optionally, the terminal operating device 110 may further include a fourth detecting module, where the fourth detecting module is configured to receive the input first voice information and detect the current interface of the terminal 100 after the first extracting module extracts the first key information from the first voice information when the interface mode of the terminal 100 is the non-interface mode.
In the present embodiment, the description about the fourth detection module may specifically refer to the detailed description of step S105 shown in fig. 3. That is, step S105 may be performed by the fourth detection module.
In the case where the terminal operation device 100 includes the fourth detection module, the determination module 113 may include a first determination sub-module and a second determination sub-module.
The first determining submodule is used for determining that the application program is the target application program under the condition that the current interface is the application interface of the application program.
In the present embodiment, the description about the first determining sub-module may specifically refer to the detailed description of step S1031 shown in fig. 3, that is, step S1031 may be executed by the first determining sub-module.
And the second determining submodule is used for searching a corresponding instruction set based on the extracted first key information under the condition that the current interface is not the application interface of the application program, and determining the application program corresponding to the searched instruction set as the target application program.
In the present embodiment, the description about the second determining sub-module may specifically refer to the detailed description about step S1032 shown in fig. 3, that is, step S1032 may be performed by the second determining sub-module.
In summary, in the terminal operation method and apparatus provided in the embodiments of the present invention, the terminal 100 stores an instruction set of at least one application program, where the instruction set includes a relationship between key information and an operation instruction. The terminal 100 receives the input first voice information while in the non-interface mode, and extracts first key information from the first voice information. The terminal 100 determines a target application program in the at least one application program according to a preset rule, searches an operation instruction corresponding to the first key information from an instruction set of the target application program, and executes an operation indicated by the operation instruction on the target application program. Through the design, a user can directly operate the application program through voice without viewing the interface when needed, and the use is very convenient for blind people, drivers and other people who are inconvenient to view the display interface.
The above description is only an example of the present invention, and is not intended to limit the present invention, and it is obvious to those skilled in the art that various modifications and variations can be made in the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A method for operating a terminal, wherein the terminal stores an instruction set of at least one application program, the instruction set including a relationship between key information and an operation instruction, the method comprising:
detecting an interface mode of the terminal; if the interface mode of the terminal is other interface modes, switching the interface mode of the terminal to a non-interface mode;
receiving input first voice information under the condition that the interface mode is a non-interface mode, and extracting first key information from the first voice information;
determining a target application program from the at least one application program according to a preset rule;
searching an operation instruction corresponding to the first key information from an instruction set of the target application program, and executing the operation indicated by the operation instruction on the target application program;
the step of switching the interface mode of the terminal to the non-interface mode comprises the following steps:
monitoring the sliding operation of a user on a display interface of the terminal, and switching the interface mode of the terminal to a non-interface mode when the user slides according to the preset sliding operation; or the like, or, alternatively,
detecting the input voice information of a user, and calling an operation instruction for starting a non-interface mode to start the non-interface mode when the input voice information is preset voice information, wherein the instruction set comprises the operation instruction for starting the non-interface mode and the relationship between the operation instruction for starting the non-interface mode and the preset voice information;
after receiving input first voice information and extracting first key information from the first voice information under the condition that the interface mode is the interface-free mode, the method further comprises the following steps:
detecting an interface where the terminal is located currently;
the determining the target application program from the at least one application program according to the preset rule comprises the following steps:
determining that the application program is a target application program under the condition that the current interface of the terminal is the application interface of the application program;
under the condition that the current interface of the terminal is not the application interface of the application program, searching a corresponding instruction set based on the first key information, and determining the application program corresponding to the instruction set as a target application program;
the step of searching for a corresponding instruction set based on the first key information and determining the application program corresponding to the instruction set as a target application program includes:
searching an instruction set comprising an operation instruction corresponding to the first key information in a stored instruction set; if the voice information is not found, prompting the user to input an error or prompting the user to input the voice information again; if the instruction set is found, judging the number of the found instruction sets; if one instruction set is found, taking an application program corresponding to the instruction set as a target application program; and if the number of the searched instruction sets is more than 1, the names of the application programs corresponding to the searched instruction sets are played in a voice mode, so that the user can determine one application program as a target application program in the voice-played application programs.
2. The method according to claim 1, wherein after receiving the input first voice information and extracting first key information from the first voice information in the case that the interface mode is the non-interface mode, the method further comprises:
generating voice information to be played based on the first key information, and playing the voice information to be played;
detecting whether second voice information is received within a first preset time after the voice information to be played is played;
if the second voice information is not received, executing the operation of determining the target application program from the at least one application program according to the preset rule;
and if second voice information is received, extracting key information from the second voice information, and regenerating the voice information to be played based on the extracted key information.
3. The method according to claim 1 or 2, wherein the instruction set further includes a function option associated with each operation instruction, and after the operation indicated by the operation instruction is performed on the target application program, the method further includes:
based on the operation indicated by the operation instruction, searching a function option associated with the operation instruction in the instruction set, and playing the function option in a voice mode;
detecting whether third voice information is received within a second preset time length after voice playing;
if third voice information is received, second key information is extracted from the third voice information;
and determining a target function option in the function options based on the second key information, and executing the operation indicated by the operation instruction corresponding to the second key information on the target function option.
4. The method according to claim 3, wherein after searching the instruction set for the function option associated with the operation instruction based on the operation indicated by the operation instruction, the method further comprises:
if the functional option is used for indicating to input the loan information, the name of each item of information to be input is played in a voice mode, and the input voice information is input after the name of each item of information is played;
and associating and storing the input voice information recorded with the name of voice playing.
5. A terminal operating device, wherein the terminal stores an instruction set of at least one application program, the instruction set including a relationship between key information and an operation instruction, the terminal operating device comprising:
the first detection module is used for detecting the interface mode of the terminal; if the interface mode of the terminal is other interface modes, switching the interface mode of the terminal to a non-interface mode;
the first extraction module is used for receiving input first voice information and extracting first key information from the first voice information under the condition that the interface mode is a non-interface mode;
the determining module is used for determining a target application program from the at least one application program according to a preset rule;
the first operation module is used for searching an operation instruction corresponding to the first key information from an instruction set of the target application program and executing the operation indicated by the operation instruction on the target application program;
the first detection module is used for monitoring the sliding operation of a user on a display interface of the terminal, and switching the interface mode of the terminal to a non-interface mode when the user slides according to the preset sliding operation; or the like, or, alternatively,
detecting the input voice information of a user, and calling an operation instruction for starting a non-interface mode to start the non-interface mode when the input voice information is preset voice information, wherein the instruction set comprises the operation instruction for starting the non-interface mode and the relationship between the operation instruction for starting the non-interface mode and the preset voice information;
the terminal operating device further includes:
the fourth detection module is used for receiving the input first voice information under the condition that the interface mode of the first extraction module is the non-interface mode, and detecting the current interface where the terminal is located after first key information is extracted from the first voice information;
the determining module comprises:
the first determining submodule is used for determining that the application program is a target application program under the condition that the current interface is the application interface of the application program;
the second determining submodule is used for searching a corresponding instruction set based on the first key information and determining the application program corresponding to the instruction set as a target application program under the condition that the current interface is not the application interface of the application program; wherein the content of the first and second substances,
the second determining submodule is used for searching an instruction set comprising an operation instruction corresponding to the first key information in a stored instruction set; if the voice information is not found, prompting the user to input an error or prompting the user to input the voice information again; if the instruction set is found, judging the number of the found instruction sets; if one instruction set is found, taking an application program corresponding to the instruction set as a target application program; and if the number of the searched instruction sets is more than 1, the names of the application programs corresponding to the searched instruction sets are played in a voice mode, so that the user can determine one application program as a target application program in the voice-played application programs.
6. The apparatus according to claim 5, wherein the terminal operating apparatus further comprises:
the generating module is used for receiving input first voice information under the condition that the interface mode of the first extracting module is the non-interface mode, extracting first key information from the first voice information, generating voice information to be played based on the first key information, and playing the voice information to be played;
the second detection module is used for detecting whether second voice information is received within a first preset time length after the voice information to be played is played;
the first triggering module is used for triggering the determining module to execute the operation of determining the target application program from the at least one application program according to the preset rule under the condition that the second voice information is not received;
and the second triggering module is used for extracting the key information from the second voice information under the condition of receiving the second voice information and regenerating the voice information to be played based on the extracted key information.
7. The apparatus according to claim 5 or 6, wherein the instruction set further includes function options associated with the respective operation instructions, and the terminal operation apparatus further includes:
the searching module is used for searching the function options related to the operation instruction in the instruction set based on the operation indicated by the operation instruction after the first operation module executes the operation indicated by the operation instruction on the target application program, and playing the function options in a voice mode;
the third detection module is used for detecting whether third voice information is received within a second preset time length after voice playing;
the second extraction module is used for extracting second key information from third voice information under the condition of receiving the third voice information;
and the second operation module is used for determining a target function option in the function options based on the second key information and executing the operation indicated by the operation instruction corresponding to the second key information on the target function option.
8. The apparatus according to claim 7, wherein the terminal operating apparatus further comprises:
the recording module is used for playing the name of each item of information to be recorded in a voice mode under the condition that the function option searched by the searching module is used for indicating the recording of the loan information, and recording the input voice information after the name of each item of information is played;
and the storage module is used for associating and storing the input voice information and the name of voice playing.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710531194.1A CN107240400B (en) | 2017-07-03 | 2017-07-03 | Terminal operation method and device |
| PCT/CN2018/089395 WO2019007169A1 (en) | 2017-07-03 | 2018-05-31 | Method and apparatus for operating terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710531194.1A CN107240400B (en) | 2017-07-03 | 2017-07-03 | Terminal operation method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107240400A CN107240400A (en) | 2017-10-10 |
| CN107240400B true CN107240400B (en) | 2020-08-11 |
Family
ID=59990260
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710531194.1A Active CN107240400B (en) | 2017-07-03 | 2017-07-03 | Terminal operation method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107240400B (en) |
| WO (1) | WO2019007169A1 (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107240400B (en) * | 2017-07-03 | 2020-08-11 | 重庆小雨点小额贷款有限公司 | Terminal operation method and device |
| CN107783705A (en) * | 2017-10-20 | 2018-03-09 | 珠海市魅族科技有限公司 | Show method, apparatus, computer installation and the storage medium of application program |
| US10747954B2 (en) * | 2017-10-31 | 2020-08-18 | Baidu Usa Llc | System and method for performing tasks based on user inputs using natural language processing |
| CN108364645A (en) * | 2018-02-08 | 2018-08-03 | 北京奇安信科技有限公司 | A kind of method and device for realizing page interaction based on phonetic order |
| CN109086028A (en) * | 2018-07-27 | 2018-12-25 | 重庆柚瓣家科技有限公司 | Voice UI and its implementation |
| CN109346072A (en) * | 2018-09-27 | 2019-02-15 | 珠海格力电器股份有限公司 | A kind of method of interactive voice, electronic equipment and computer storage medium |
| CN109840119A (en) * | 2018-12-28 | 2019-06-04 | 努比亚技术有限公司 | A kind of terminal applies starting method, terminal and computer readable storage medium |
| CN110162776A (en) * | 2019-03-26 | 2019-08-23 | 腾讯科技（深圳）有限公司 | Interaction message processing method, device, computer equipment and storage medium |
| CN110580904A (en) * | 2019-09-29 | 2019-12-17 | 百度在线网络技术（北京）有限公司 | Method and device for controlling small program through voice, electronic equipment and storage medium |
| CN110851108A (en) * | 2019-11-18 | 2020-02-28 | 北京小米移动软件有限公司 | Electronic equipment operation method and device, electronic equipment and storage medium |
| CN111026355A (en) * | 2019-12-09 | 2020-04-17 | 珠海市魅族科技有限公司 | Information interaction method and device, computer equipment and computer readable storage medium |
| CN112519639B (en) * | 2020-12-10 | 2022-10-14 | 广州橙行智动汽车科技有限公司 | Vehicle control method, system, device, vehicle and storage medium |
| CN113190697A (en) * | 2021-06-02 | 2021-07-30 | 口碑(上海)信息技术有限公司 | Image information playing method and device |
| CN113190323A (en) * | 2021-06-02 | 2021-07-30 | 口碑(上海)信息技术有限公司 | Information playing method and device, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1897108A (en) * | 2005-07-15 | 2007-01-17 | 环隆电气股份有限公司 | Motor acoustic-controlled method with limited condition as assistant discrimination and system thereof |
| CN105551487A (en) * | 2015-12-07 | 2016-05-04 | 北京云知声信息技术有限公司 | Voice control method and apparatus |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ATE345526T1 (en) * | 2001-03-22 | 2006-12-15 | Canon Kk | INFORMATION PROCESSING APPARATUS AND METHOD AND PROGRAM PRODUCT |
| KR101502003B1 (en) * | 2008-07-08 | 2015-03-12 | 엘지전자 주식회사 | Mobile terminal and method for inputting a text thereof |
| CN102520788B (en) * | 2011-11-16 | 2015-01-21 | 歌尔声学股份有限公司 | Voice identification control method |
| CN103533391B (en) * | 2013-10-12 | 2016-09-14 | 青岛旲天下智能科技有限公司 | The method of work of the Bidirectional interdynamic digital television box system that a kind of voice-control is mutual |
| CN107240400B (en) * | 2017-07-03 | 2020-08-11 | 重庆小雨点小额贷款有限公司 | Terminal operation method and device |
-
2017
- 2017-07-03 CN CN201710531194.1A patent/CN107240400B/en active Active
-
2018
- 2018-05-31 WO PCT/CN2018/089395 patent/WO2019007169A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1897108A (en) * | 2005-07-15 | 2007-01-17 | 环隆电气股份有限公司 | Motor acoustic-controlled method with limited condition as assistant discrimination and system thereof |
| CN106157955A (en) * | 2015-03-30 | 2016-11-23 | 阿里巴巴集团控股有限公司 | A kind of sound control method and device |
| CN105551487A (en) * | 2015-12-07 | 2016-05-04 | 北京云知声信息技术有限公司 | Voice control method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019007169A1 (en) | 2019-01-10 |
| CN107240400A (en) | 2017-10-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107240400B (en) | Terminal operation method and device | |
| CN106098060B (en) | Method and device for error correction processing of voice | |
| US9338293B2 (en) | Communication device and communication method thereof | |
| CN110930969B (en) | Background music determining method and related equipment | |
| CN110740373A (en) | audio/video file buffering method and related device | |
| CN112052784A (en) | Article searching method, device, equipment and computer readable storage medium | |
| CN112291411A (en) | Method, terminal and computer readable medium for recommending operation sequence | |
| CN111797746B (en) | Face recognition method, device and computer readable storage medium | |
| CN105718109B (en) | A kind of the weight processing method and mobile terminal of touching display screen | |
| CN110213062B (en) | Method and device for processing message | |
| US20150066514A1 (en) | Information processing method and electronic device | |
| WO2017118296A1 (en) | Information reminding method and apparatus | |
| CN104202482B (en) | A kind of communications records treatment facility, method and mobile terminal | |
| KR20170060148A (en) | Information processing method and device | |
| CN115758307A (en) | Space login method and device of terminal equipment, terminal equipment and storage medium | |
| US9894193B2 (en) | Electronic device and voice controlling method | |
| CN106649698B (en) | Information processing method and information processing device | |
| CN106775633A (en) | A kind of method, device and the terminal of the acquiescence Launcher that automatically switches | |
| CN112542168A (en) | Voice control method and device | |
| CN107688400B (en) | Input error correction method and device for input error correction | |
| CN111381685B (en) | Sentence association method and sentence association device | |
| CN115688187B (en) | Method, device and equipment for safety management of hard link data and storage medium | |
| CN115801948B (en) | Operation method, device, electronic equipment and storage medium | |
| CN113315871B (en) | Mobile terminal and operating method thereof | |
| CN110287365B (en) | Data processing method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |