CN109254972B - Offline command word bank updating method, terminal and computer readable storage medium - Google Patents
Offline command word bank updating method, terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN109254972B CN109254972B CN201810813102.3A CN201810813102A CN109254972B CN 109254972 B CN109254972 B CN 109254972B CN 201810813102 A CN201810813102 A CN 201810813102A CN 109254972 B CN109254972 B CN 109254972B
- Authority
- CN
- China
- Prior art keywords
- display interface
- text information
- command word
- offline command
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Electrically Operated Instructional Devices (AREA)
- Machine Translation (AREA)
Abstract
The invention discloses an off-line command word bank updating method, a terminal and a computer readable storage medium, the method comprises judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library, if not, the invention analyzes the display content of the preset area of the current display interface to generate the text information, updates the offline command lexicon according to the text information, solves the problems that the updating mode of the existing offline command lexicon is fixed and single and influences the experience of the user, also discloses a terminal and a computer readable storage medium, by implementing the scheme, the off-line command word bank is dynamically updated according to the display content of the display interface, the user can identify the text content of the current interface by using the offline command word bank, and the experience and satisfaction of the user are improved.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method, a terminal, and a computer-readable storage medium for updating an offline command word bank.
Background
The off-line command word recognition means that the recognition of converting voice into characters can be completed locally without connecting a network. However, entries that can be recognized by an offline command word need to be configured in an offline command word bank in advance, and only the configured entries can be recognized, so that the offline command word cannot recognize any word and needs to be updated; or after the server updates the offline command lexicon, the terminal downloads the latest offline command lexicon for local identification, but the time for updating the offline command lexicon by the server is not fixed, and the updated offline command lexicon is not necessarily required by the user, so that the updating mode of the existing offline command lexicon is relatively fixed and single, and the experience of the user is influenced.
Disclosure of Invention
The technical problem to be solved by the invention is that the existing updating mode of the offline command word bank is relatively fixed and single, and the experience of a user is influenced.
In order to solve the above technical problem, the present invention provides an offline command word stock updating method, which comprises:
judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library;
if not, analyzing the display content of the preset area of the current display interface to generate text information;
and updating the offline command word bank according to the text information.
Optionally, before determining whether the display content of the preset area of the current display interface matches with the display content of the corresponding display interface in the preset interface library, the method includes:
judging whether the current display interface is a display interface of a desktop including an application program;
or, judging whether the current display interface is the display interface of a preset application program;
if yes, judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library.
Optionally, the preset area includes a display area except for the original notification bar area.
Optionally, analyzing the display content in the preset area of the current display interface, and generating the text information includes:
and performing screenshot processing on the current display interface, and identifying character information and/or image information in a preset area in the screenshot to generate text information.
Optionally, the updating the offline command word bank according to the text information includes:
acquiring target text information which is in a preset area of a current display interface and is not matched with display contents of a corresponding display interface in a preset interface library;
matching the target text information with the text information in the offline command word bank;
and adding the target text information which fails to be matched to an offline command word bank.
Optionally, the updating the offline command word bank according to the text information includes:
matching all text information in a preset area of a current display interface with text information in an offline command word bank;
and adding the text information which fails to be matched into an offline command word library.
Optionally, after updating the offline command word library according to the text information, the method includes:
judging whether the capacity of the offline command word bank exceeds a preset capacity or not;
if yes, acquiring the use frequency of each text message in the non-updated offline command word bank;
and deleting the corresponding text information in sequence from small to large according to the use frequency until the capacity of the offline command word bank is less than or equal to the preset capacity.
Optionally, after updating the offline command word bank according to the text information, the method includes:
receiving input voice information, identifying the voice information according to the updated offline command word bank, matching the voice information with text information in the updated offline command word bank, and converting the voice information into character information when matching is successful.
Furthermore, the invention also provides a terminal, which comprises a processor, a memory and a communication bus;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute one or more programs stored in the memory to implement the steps of the offline command thesaurus update method as described above.
Further, the present invention also provides a computer-readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the steps of the offline command thesaurus updating method as described above.
Advantageous effects
The invention provides an updating method of an offline command word stock, a terminal and a computer readable storage medium, aiming at the problems that the updating mode of the existing offline command word stock is relatively fixed and single and the experience of a user is influenced, whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library is judged, if not, the display content of the preset area of the current display interface is analyzed to generate text information, and the offline command word stock is updated according to the text information; the method for updating the offline command word stock provided by the invention realizes that the offline command word stock is dynamically updated according to the display content of the display interface, so that a user can identify the text content of the current interface by using the offline command word stock, and the experience and satisfaction of the user are improved.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;
FIG. 3 is a basic flowchart of a method for updating an offline command lexicon according to a first embodiment of the present invention;
FIG. 4 is a schematic diagram of a preset area of a display interface according to a first embodiment of the present invention;
fig. 5 is a schematic diagram of image content of display content according to a first embodiment of the present invention;
FIG. 6 is a flowchart of a method for updating a lexicon of offline commands according to a second embodiment of the present invention;
FIG. 7 is a flowchart of a method for updating an offline command lexicon according to a third embodiment of the present invention;
fig. 8 is a schematic structural diagram of a terminal according to a fourth embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
The terminal may be implemented in various forms. For example, the terminal described in the present invention may include mobile terminals such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and fixed terminals such as a Digital TV, a desktop computer, and the like.
The following description will be given by way of example of a mobile terminal, and it will be understood by those skilled in the art that the construction according to the embodiment of the present invention can be applied to a fixed type terminal, in addition to elements particularly used for mobile purposes.
Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following specifically describes the components of the mobile terminal with reference to fig. 1:
the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).
WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.
The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, can collect touch operations of a user (e.g., operations of a user on the touch panel 1071 or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory) thereon or nearby and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.
Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.
The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.
Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module and the like, which will not be described in detail herein.
In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.
Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.
Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.
The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.
The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. The MME2031 is a control node for processing signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address allocation and other functions for UE201, PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for policy and charging enforcement function (not shown).
The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.
Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.
Based on the above mobile terminal hardware structure and communication network system, the present invention provides various embodiments of the method.
First embodiment
In order to solve the problem that the existing updating method of the offline command lexicon is relatively fixed and single and affects the experience of the user, the embodiment provides an updating method of the offline command lexicon, as shown in fig. 3, fig. 3 is a basic flow chart of the updating method of the offline command lexicon provided by the embodiment, and the updating method of the offline command lexicon includes:
s301, judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library, if so, finishing, otherwise, turning to S302.
It should be noted that, in this embodiment, the display content in the preset area of the current display interface is detected, and whether the current display interface sends a change is determined by judging whether the display content in the preset area of the current display interface matches the display content of the corresponding display interface in the preset interface library; when the preset interface library comprises a plurality of corresponding display interfaces, matching the current display interface with the closest display interface, wherein the closest display interface can be the closest display interface in time or the closest display interface in display content; for example, when the display interface at the current time 9 point is the display interface including the desktop of the application program, the preset interface library includes the display interface of the desktop at 8 points, the desktop display interface in the preset area at 9 point is matched with the desktop display interface at 8 points, and whether the display content is added or deleted or modified in comparison between the desktop display interface in the preset area at 9 point and the desktop display interface at 8 points is judged, where the display content includes, but is not limited to, text content and image content of the display interface.
It can be understood that, for some display interfaces such as display interfaces of videos and games, the display content of the interface is changed every moment, and the power consumption of the terminal is too high by judging the display content of the interface every moment, so that before judging whether the display interface is changed, the display interface can be limited, for example, whether the current display interface is the display interface of a desktop including an application program is judged; or judging whether the current display interface is the display interface of the preset application program, if so, judging whether the display content of the preset area of the current display interface changes. The preset application program includes, but is not limited to, applications such as an address list, a short message, a mailbox and the like. When the display interface is a desktop, the desktop of the display interface comprises an application program and state information such as time, electric quantity, signals and the like, and when the display interface is a preset application display interface, the display interface also comprises the state information, namely no matter what the display interface is (except for a full-screen display interface), the state information in an original notification bar is fixed above the display interface, the state information changes every 1 minute, and the state information has no relation with the updating of an offline command word stock. As shown in fig. 4, the original notification bar area is a dashed box area 401, and the display content of the preset area 402 of the current display interface is detected. Of course, in other embodiments, the preset area may be all areas of the current display interface, or may be determined according to the received instruction.
In this embodiment, when the current display interface is a display interface of a desktop or a display interface of a preset application program, before the display content of the current display interface is detected, the continuous display time of the current display interface may also be detected, and then the frequency of detecting the display content is determined according to the display time. For example, when the continuous display time of the current display interface is detected to belong to a first preset time range, detecting the display content of the current display interface every other first preset time period within the first preset time range; when the continuous display time of the current display interface is detected to belong to a second preset time range, detecting the display content of the current display interface every other second preset time period within the first preset time range; when the second preset time range is larger than the first preset time range, the second preset time interval is larger than the first preset time interval. If the continuous display time of the current display interface is detected to be 1 minute and belongs to the first preset time range of 1-3 minutes, the display content of the current display interface is detected every 1 minute within 1-3 minutes, and if the continuous display time of the current display interface is detected to be 4 minutes and belongs to the second preset time range of 4-8 minutes, the display content of the current display interface is detected every 2 minutes within 4-8 minutes. When the continuous display time of the current display interface is less than 1 minute, the display content can be detected in real time.
And S302, analyzing the display content of the preset area of the current display interface to generate text information.
When the display content of the current display interface is detected to be changed, the interface content capturing service can be realized based on the auxiliary assistant service, for example, a screenshot function is started, screenshot processing is carried out on the current display interface, then the display content in a preset area in screenshot is analyzed, and text information is obtained. Analyzing the display content in the preset area comprises identifying character information and/or image information of the preset area to generate text information; for example, as shown in fig. 5, when the display interface is a desktop display interface, a screenshot function is started to perform screenshot on the desktop, and then a display area outside an original notification bar area is identified to identify the name of the application program; when the application program has no name and only has an application icon, the application icon may also be identified, such as the application icon 501 in fig. 5, and the application name corresponding to the application icon is identified as "WeChat". Certainly, in some embodiments, the display content of the preset area of the current display interface may also be directly identified to generate text information.
And S303, updating the offline command word bank according to the text information.
It should be understood that the offline recognition technology is a technology that can locally recognize a speech-to-text word without connecting to a network, where entries recognized by the offline recognition technology need to be configured in an offline command word bank in advance, and only the configured entries can be recognized, so that the offline recognition technology cannot recognize any word, in this embodiment, the offline command word bank may be updated according to text information in display content of a display interface, and the updating mode may adopt the following two modes:
the first method is as follows: when the display content of the current display interface is compared with the display content of the corresponding display interface in the preset interface library and partial display content is added/modified, acquiring target text information which is in a preset area of the current display interface and is not matched with the display content of the corresponding display interface in the preset interface library, and matching the target text information with the text information in the current off-line command word library; and when the matching is successful, the offline command word bank is not updated. For example, the display contents of the preset area of the current display interface include "WeChat", "QQ", "photo", "microblog"; the display contents corresponding to the display interface in the preset interface library comprise 'QQ' and 'photo'; the acquired target text information includes 'WeChat', 'microblog'; and matching the target text information with the text information in the offline command word bank, and adding the 'WeChat' and the 'microblog' into the offline command word bank when the text information in the offline command word bank has no 'WeChat' and 'microblog', namely the matching fails.
The second method comprises the following steps: matching all text information in a preset area of a current display interface with text information in an offline command word stock, and adding text information failed in matching into the offline command word stock, wherein the display content of the preset area of the current display interface comprises 'WeChat', 'QQ', 'photo', 'microblog', for example; matching the 'WeChat', 'QQ', 'photo', 'microblog' with the text information in the offline command word bank, and adding the 'WeChat', 'microblog' and 'QQ' which fail to be matched into the offline command word bank.
In this embodiment, when the display content of the current display interface is compared with the display content of the corresponding display interface in the preset interface library, and a part of the display content is added/modified, different updating modes can be selected according to the number of the text information in the preset area of the current display interface, for example, when the number of the text information is greater than a preset number threshold, all the text information is matched with the offline command word library, and the data size is large; therefore, the updating mode of the first mode can be selected; and when the text data is smaller than the preset number threshold, selecting a second mode. When the display content of the current display interface is compared with the display content of the corresponding display interface in the preset interface library, and partial display content is deleted, the target text information does not exist in the first mode, and the text information with failed matching does not exist in the second mode.
It should be understood that the offline command word library has a capacity, and in order to avoid the updated offline command word library exceeding the capacity, after the offline command word library is updated according to the text information, whether the capacity of the offline command word library exceeds a preset capacity can also be judged, if so, the use frequency of each text information in the offline command word library which is not updated is obtained; and deleting the corresponding text information in sequence from small to large according to the use frequency until the capacity of the offline command word bank is less than or equal to the preset capacity, namely deleting the text information corresponding to the lowest use frequency until the capacity of the offline command word bank is not more than the preset capacity.
In some embodiments, when the capacity of the offline command word bank exceeds the preset capacity, partial deletion of text information in the offline command word bank may be performed according to the display content of the current display interface. For example, when the display content of the preset area of the current display interface includes "WeChat", "QQ", "photo"; when the offline command word bank comprises 'WeChat', 'QQ', 'photo', 'microblog', and when the capacity exceeds the preset capacity, the 'microblog' can be deleted from the offline command word bank.
After the offline command word bank is updated, when the input voice information is received, the voice information is recognized according to the updated offline command word bank, the voice information is matched with the text information in the updated offline command word bank, and when the matching is successful, the voice information is converted into character information. For example, when the user's voice information ' open WeChat ' is detected, matching the keyword ' WeChat ' in the voice information with the text information in the offline command word bank, and then the user opens the application displayed on the current interface through voice.
The embodiment provides an offline command word bank updating method, which includes judging whether display content of a preset area of a current display interface changes or not when the current display interface is a display interface of a desktop or a display interface of a preset application program, and analyzing the display content of the preset area of the current display interface to generate text information when the display content of the preset area of the current display interface changes; the text information is matched with the text information in the offline command word bank, when the matching fails, the text information which is failed to be matched is added into the offline command word bank, the offline command word bank is dynamically updated according to the display content of the display interface, and when the offline command word bank exceeds the preset capacity, part of text information is deleted according to the use frequency of the text information in the offline command word bank which is not updated, so that the capacity of the offline command word bank is ensured, and the experience of a user is provided.
Second embodiment
In order to facilitate understanding of the method for updating the offline command word stock provided by the present invention, this embodiment is described with a specific application scenario, when a corresponding application needs to be opened according to a voice input application name, a manufacturer does not know which applications will be installed by a user before the terminal leaves a factory, so that it is impossible to configure all application name entries in the offline command word stock in advance. In this embodiment, when the terminal is currently in the standby interface, and the standby interface is different from the previous standby interface, at this time, the terminal captures all text contents including the application name of the current interface, and updates the text contents to the offline command word library, so as to dynamically update the offline word library according to the display contents of the interface. Specifically, as shown in fig. 6, fig. 6 is a flowchart of an offline command word bank updating method according to a second embodiment of the present invention, where the offline command word bank updating method includes:
s601, judging whether the current display interface is the display interface of the desktop including the application program, if so, turning to S602, and if not, ending.
S602, judging whether the display content of the preset area of the display interface is matched with the display content of the desktop display interface in the preset interface library, if not, turning to S603, and if so, ending.
In this embodiment, the preset area includes a display area except for the original notification bar area, and it may be understood that the original notification bar includes state information such as time, power, signal, and the like, in this embodiment, a change of the original notification bar does not drive updating of an offline command thesaurus, and it is determined whether a display interface before a current display interface is changed compared with a display interface before a previous desktop by judging whether the display content of the preset area is matched with the display content of the previous desktop, where the change may be addition, deletion, modification, and the like of an application program.
And S603, analyzing the display content of the preset area of the current display interface to generate text information.
In this embodiment, when it is detected that the display content of the current display interface changes, the interface content capture service may be implemented based on an auxiliary assistant service, for example, a screenshot function is started, screenshot processing is performed on the current display interface, and then text information is generated by identifying text information and image information in a preset area.
S604, target text information which is not matched with the display content of the corresponding display interface in the preset interface library in the preset area of the current display interface is obtained.
The display contents of the preset area of the current display interface are assumed to comprise 'WeChat', 'QQ', 'photo', 'microblog'; the display contents of the desktop display interface in the preset interface library comprise 'QQ' and 'photo'; the acquired target text information includes 'WeChat' and 'microblog'.
And S605, matching the target text information with the text information in the offline command word bank.
And searching the target text information in an offline command word bank, judging whether the offline command word bank comprises the target text information, and when the corresponding text information is searched, namely the target text information is matched with the offline command word bank, not updating the offline command word bank.
And S606, adding the target text information which fails to be matched to an offline command word bank.
And when the target text information is not included in the offline command word bank, namely the matching fails, the target text information is added into the command word bank.
And S607, judging whether the updated offline command word bank exceeds the preset capacity, if so, turning to S608, and if not, ending.
And S608, deleting partial text information according to the use frequency of each text information in the non-updated offline command word bank.
And acquiring the use frequency of each text message in the non-updated offline command word bank, sequencing the text messages in sequence from small to large of the use frequency, and deleting the text message corresponding to the lowest use frequency until the offline command word bank does not exceed the preset capacity.
To facilitate understanding, this embodiment describes a method for updating an offline command lexicon by using a specific example, where when a current display interface is a display interface of a desktop, a display content in a preset area of the current display interface is detected, whether the display content matches a previous display content is judged, if the display content does not match the previous display content, a screenshot process is performed on the current display interface, text information and/or image information in the preset area in the screenshot is identified, text information is generated, target text information in the preset area of the current display interface, which does not match the display content of a corresponding display interface in the preset interface library, is obtained, the target text information is matched with the offline command lexicon, and text information that fails to match is added to the offline command lexicon, so that the offline command lexicon can be updated according to the display content of the display interface, and then, based on the updated offline command word bank, the recognition of converting voice into characters can be completed, and the experience and satisfaction of the user can be improved.
Third embodiment
The present embodiment provides an offline command word library updating method, as shown in fig. 7, the offline command word library updating method includes:
and S701, judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library, if not, turning to S702, and if so, ending.
In this embodiment, the current display interface may be any interface except for full-screen display, and the preset area may be all display areas of the current display interface or a display area except for the original notification bar; the method comprises the steps of detecting display contents in a preset area of a current display interface, and judging whether the current display interface changes compared with a corresponding closest display interface in a preset interface library or not, wherein the closest display interface can be the closest display interface in time or the closest display interface in display contents.
And S702, analyzing the display content of the preset area of the current display interface to generate text information.
The step is the same as S603, and is not described in detail here.
And S703, matching all the text information in the preset area of the current display interface with the text information in the offline command word bank.
And when the text information in the preset area of the current display interface is acquired, comparing all the text information with the text information in the offline command word bank.
And S704, adding the text information which fails to be matched into an offline command word bank.
When the text information in the offline command word bank comprises all the text information in the preset area, the offline command word bank is not updated, and when the offline command word bank comprises partial text information, the text information which is not included is added into the offline command word bank. Of course, in some embodiments, when a match fails, all text information is added to the offline command thesaurus, and then duplicate text information is deleted.
Third embodiment
The present embodiment provides a terminal, as shown in fig. 8, which includes a processor 801, a memory 802, and a communication bus 803, wherein:
the communication bus 803 is used for realizing connection communication between the processor 801 and the memory 802;
the processor 801 is then configured to execute one or more programs stored in the memory 802 to implement the following steps:
judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library;
if not, analyzing the display content of the preset area of the current display interface to generate text information;
and updating the offline command word bank according to the text information.
Before judging whether the display content of the preset area of the current display interface is matched with the corresponding pre-stored display interface content, the processor 801 may further judge whether the current display interface is a display interface of a desktop including an application program; or, judging whether the current display interface is the display interface of a preset application program; and when the current display interface is a desktop display interface or a display interface of a preset application program, judging whether the display content of a preset area of the current display interface changes or not, wherein the preset area comprises a display area except the original notification bar area.
In this embodiment, the processor 801 analyzes the display content of the preset area of the current display interface, and the specific implementation step of generating the text information includes performing screenshot processing on the current display interface, and identifying text information and/or image information of the preset area of the screenshot to generate the text information.
In this embodiment, the specific implementation steps of the processor 801 for updating the offline command word library according to the text information may be acquiring target text information in a preset area of the current display interface, where the target text information does not match the display content of the corresponding display interface in the preset interface library; matching the target text information with the text information in the offline command word bank; and adding the target text information which fails to be matched to an offline command word bank. Matching all text information in a preset area of the current display interface with text information in an offline command word bank; and adding the text information which fails to be matched into an offline command word library.
Of course, when the updated offline command word bank exceeds the preset capacity, the processor 801 may further determine whether the capacity of the offline command word bank exceeds the preset capacity; if yes, acquiring the use frequency of each text message in the non-updated offline command word bank; and deleting the corresponding text information in sequence from small to large according to the use frequency until the capacity of the offline command word bank is less than or equal to the preset capacity.
Of course, the terminal processor 801 may also receive the input voice information, recognize the voice information according to the updated offline command lexicon, match the voice information with the text information in the updated offline command lexicon, and convert the voice information into text information when matching is successful.
It is to be noted that, in order to avoid redundant description, all examples of the first embodiment and the second embodiment are not fully set forth in the present embodiment, and it should be clear that all examples of the first embodiment and the second embodiment are applicable to the present embodiment.
The present embodiment also provides a computer-readable storage medium storing one or more programs, which are executable by one or more processors to implement the steps of the offline command thesaurus updating method in the above embodiments.
The embodiment provides a terminal and a computer readable storage medium, which are used for realizing the steps of the offline command thesaurus updating method in each embodiment, whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface thesaurus is judged, whether the display content of the preset area of the current display interface is changed is further judged, and when the display content of the preset area is changed, text information corresponding to the display content of the preset area is further updated according to the text information.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (6)
1. An offline command word stock updating method is characterized by comprising the following steps:
judging whether the current display interface is a display interface of a desktop including an application program;
or, judging whether the current display interface is the display interface of a preset application program;
if yes, judging whether the display content of the preset area of the current display interface is matched with the display content of the corresponding display interface in the preset interface library; the preset interface library comprises various display interfaces in the historical use process of a user;
if not, starting a screenshot function, carrying out screenshot processing on the current display interface, and then analyzing the display content in a preset area in the screenshot to obtain text information; analyzing the display content in the preset area in the screenshot comprises identifying character information and/or image information of the preset area to generate text information;
updating an offline command word bank according to the text information, wherein the updating mode adopts the following two modes:
the first method is as follows: when the display content of the current display interface is compared with the display content of the corresponding display interface in the preset interface library and part of the display content is added/modified, acquiring target text information in a preset area of the current display interface, which is not matched with the display content of the corresponding display interface in the preset interface library, and matching the target text information with the text information in the current offline command word library; when the matching is failed, adding the target text information which is failed to be matched into the offline command word bank, and when the matching is successful, not updating the offline command word bank;
the second method comprises the following steps: and matching all the text information in the preset area of the current display interface with the text information in the offline command word bank, and adding the text information failed in matching into the offline command word bank.
2. The method of claim 1, wherein the predetermined area comprises a display area except an original notification bar area.
3. The method for updating the offline command thesaurus according to any one of claims 1 to 2, wherein after updating the offline command thesaurus according to the text information, the method comprises the following steps:
judging whether the capacity of the offline command word bank exceeds a preset capacity or not;
if yes, acquiring the use frequency of each text message in the non-updated offline command word bank;
and deleting the corresponding text information in sequence from small to large according to the use frequency until the capacity of the offline command word bank is less than or equal to the preset capacity.
4. The method of claim 3, wherein after updating the thesaurus of offline commands according to the text information, the method comprises:
receiving input voice information, identifying the voice information according to the updated offline command word bank, matching the voice information with text information in the updated offline command word bank, and converting the voice information into character information when matching is successful.
5. A terminal, characterized in that the terminal comprises a processor, a memory and a communication bus;
the communication bus is used for realizing connection communication between the processor and the memory;
the processor is configured to execute one or more programs stored in the memory to implement the steps of the offline command thesaurus updating method of any one of claims 1 to 4.
6. A computer readable storage medium, storing one or more programs, which are executable by one or more processors, for performing the steps of the offline command thesaurus updating method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810813102.3A CN109254972B (en) | 2018-07-23 | 2018-07-23 | Offline command word bank updating method, terminal and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810813102.3A CN109254972B (en) | 2018-07-23 | 2018-07-23 | Offline command word bank updating method, terminal and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109254972A CN109254972A (en) | 2019-01-22 |
| CN109254972B true CN109254972B (en) | 2022-09-13 |
Family
ID=65049743
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810813102.3A Active CN109254972B (en) | 2018-07-23 | 2018-07-23 | Offline command word bank updating method, terminal and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109254972B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112309383A (en) * | 2019-08-01 | 2021-02-02 | 北京声智科技有限公司 | Voice interaction method and device and set top box |
| CN110970026A (en) * | 2019-12-17 | 2020-04-07 | 用友网络科技股份有限公司 | Voice interaction matching method, computer device and computer-readable storage medium |
| CN113190647A (en) * | 2021-04-15 | 2021-07-30 | 北京小米移动软件有限公司 | Media file playing method, media file playing device and storage medium |
| CN114267348A (en) * | 2021-11-16 | 2022-04-01 | 北京执象科技发展有限公司 | Man-machine collaborative teaching interaction method, system, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008022581A1 (en) * | 2006-08-09 | 2008-02-28 | Beijing Sogou Technology Development Co., Ltd. | Method and device for obtaining the new words and input method system |
| CN103493047A (en) * | 2011-08-30 | 2014-01-01 | 宇龙计算机通信科技(深圳)有限公司 | Dictionary database update device, input system, input method, and terminal |
| CN104503674A (en) * | 2014-12-10 | 2015-04-08 | 深圳市金立通信设备有限公司 | Screenshot picture generating method |
| CN105957530A (en) * | 2016-04-28 | 2016-09-21 | 海信集团有限公司 | Speech control method, device and terminal equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103680498A (en) * | 2012-09-26 | 2014-03-26 | 华为技术有限公司 | Speech recognition method and speech recognition equipment |
| CN107665187A (en) * | 2016-07-28 | 2018-02-06 | 百度在线网络技术（北京）有限公司 | A kind of method and apparatus for judging mobile device application interface and whether changing |
| CN107657950B (en) * | 2017-08-22 | 2021-07-13 | 广州小鹏汽车科技有限公司 | Automobile voice control method, system and device based on cloud and multi-command words |
-
2018
- 2018-07-23 CN CN201810813102.3A patent/CN109254972B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008022581A1 (en) * | 2006-08-09 | 2008-02-28 | Beijing Sogou Technology Development Co., Ltd. | Method and device for obtaining the new words and input method system |
| CN103493047A (en) * | 2011-08-30 | 2014-01-01 | 宇龙计算机通信科技(深圳)有限公司 | Dictionary database update device, input system, input method, and terminal |
| CN104503674A (en) * | 2014-12-10 | 2015-04-08 | 深圳市金立通信设备有限公司 | Screenshot picture generating method |
| CN105957530A (en) * | 2016-04-28 | 2016-09-21 | 海信集团有限公司 | Speech control method, device and terminal equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109254972A (en) | 2019-01-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108572764B (en) | Character input control method and device and computer readable storage medium | |
| CN108509299B (en) | Message processing method, device and computer readable storage medium | |
| CN109036420B (en) | Voice recognition control method, terminal and computer readable storage medium | |
| CN107329682B (en) | Edge interaction method and mobile terminal | |
| CN109254972B (en) | Offline command word bank updating method, terminal and computer readable storage medium | |
| CN107749919B (en) | Application program page display method and device and computer readable storage medium | |
| CN109922078B (en) | Upgrade control method, mobile terminal and computer-readable storage medium | |
| CN107547741B (en) | Information processing method and device and computer readable storage medium | |
| CN109219004B (en) | Short message unsubscribing method and device, mobile terminal and readable storage medium | |
| CN107862217B (en) | Position information acquisition method, mobile terminal and computer storage medium | |
| CN109766119B (en) | Recovery partition upgrade method, terminal and computer readable storage medium | |
| CN107832032B (en) | Screen locking display method and mobile terminal | |
| CN113067734B (en) | Electronic price tag upgrading method, electronic price tag system, electronic terminal and storage medium | |
| CN107818022B (en) | Application program interface merging method, mobile terminal and computer readable storage medium | |
| CN112346824B (en) | Screen projection application control method and device and computer readable storage medium | |
| CN108845821B (en) | Application program updating method, terminal and computer readable storage medium | |
| CN112494932A (en) | Game frame supplementing method and device, terminal and computer readable storage medium | |
| CN110083294B (en) | Screen capturing method, terminal and computer readable storage medium | |
| CN110187934B (en) | Application control method, terminal and computer readable storage medium | |
| CN109683796B (en) | Interaction control method, equipment and computer readable storage medium | |
| CN109062688B (en) | Memory allocation method, server and mobile terminal | |
| CN108900696B (en) | Data processing method, terminal and computer readable storage medium | |
| CN108566476B (en) | Information processing method, terminal and computer readable storage medium | |
| CN107562304B (en) | Control method, mobile terminal and computer readable storage medium | |
| CN107404568B (en) | Control switch management method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220824 Address after: Room 1003, Building 3, No. 968, Jinzhong Road, Changning District, Shanghai, 200050 Applicant after: Shanghai Farben Information Technology Co.,Ltd. Address before: 10 / F, block a, Han's innovation building, 9018 Beihuan Avenue, gaoxinyuan, Nanshan District, Shenzhen, Guangdong Province Applicant before: NUBIA TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |