CN110213441B - Voice control method, wearable device and computer-readable storage medium - Google Patents
Voice control method, wearable device and computer-readable storage medium Download PDFInfo
- Publication number
- CN110213441B CN110213441B CN201910459052.8A CN201910459052A CN110213441B CN 110213441 B CN110213441 B CN 110213441B CN 201910459052 A CN201910459052 A CN 201910459052A CN 110213441 B CN110213441 B CN 110213441B
- Authority
- CN
- China
- Prior art keywords
- application
- information
- voice
- wearable device
- list
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000012544 monitoring process Methods 0.000 claims abstract description 23
- 230000000694 effects Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 7
- 238000012163 sequencing technique Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 19
- 238000004891 communication Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 14
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 10
- 230000009471 action Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 239000008186 active pharmaceutical agent Substances 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 239000011230 binding agent Substances 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 239000012769 display material Substances 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G04—HOROLOGY
- G04G—ELECTRONIC TIME-PIECES
- G04G21/00—Input or output devices integrated in time-pieces
- G04G21/06—Input or output devices integrated in time-pieces using voice
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72406—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by software upgrading or downloading
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/225—Feedback of the input speech
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computational Linguistics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Telephone Function (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a voice control method, wearable equipment and a computer readable storage medium, belonging to the technical field of wearable equipment, wherein the method comprises the following steps: setting monitoring buried points for the applications of all interfaces; when the equipment is started, recording the application on an interface, and establishing a voice control task set; when a voice assistant starting command is received, starting the voice assistant; the voice assistant receives and analyzes the voice information; and judging whether the voice information contains information for starting the application, if so, matching the name information for starting the application with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set to start the application. The invention realizes the accurate starting of the application on the wearable equipment by the voice assistant, and enhances the practicability of the equipment.
Description
Technical Field
The present application relates to the field of wearable device technologies, and in particular, to a voice control method, a wearable device, and a computer-readable storage medium.
Background
Wearable equipment application is divided into 5 interfaces, each interface has an application with a variable number, and three different modes are adopted for starting the application, namely clicking a desktop icon to enter the application, opening a telephone application when an incoming call comes, and clicking a button in notification details to open the application. The function of the voice assistant is to call up some functions such as an application on the desktop through voice. The application steps of each call are as follows: firstly, the voice assistant converts the voice into a corresponding application name, and the voice assistant acquires information such as packageName (package name), lunchactionName (name of started interface) and the like through an interface provided by a desktop to start the application. The wearable device records all applications on the wearable device through a global static set (arrayList set), and since the applications and package names on the wearable device are not one-to-one, that is, the applications on 5 interfaces of the wearable device may have a package name corresponding to multiple applications (different from a mobile phone), each application cannot be acquired by calling a system standard method.
Disclosure of Invention
The invention mainly aims to provide a voice control method, a wearable device and a computer readable storage medium, and aims to solve the problem that the prior art cannot utilize a voice assistant to start an application on the wearable device.
In order to solve the above problem, the present invention provides a voice control method applied to a wearable device, comprising the following steps:
setting monitoring buried points for the applications of all interfaces;
when the equipment is started, recording the application on an interface, and establishing a voice control task set;
when a voice assistant starting command is received, starting the voice assistant;
the voice assistant receives and analyzes the voice information;
judging whether the voice information contains information for starting the application, if so, matching the name information of the started application with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set;
and starting the application.
Further, the method comprises, after the step of launching the application:
recording the starting time of the application, and adding the information of the application into a background application list;
checking whether the started application exists in a recently used application list, and if so, deleting the information of the application in the recently used application list.
Further, the method checks whether the started application exists in a recently used application list, if so, the method includes deleting the information of the application in the recently used application list;
monitoring a closing signal of the application;
when a closing signal of the application is monitored, the information of the application is deleted from the background application list, and the information of the application is added to the recently used application list.
Further, the method comprises, after deleting the information of the application from the background application list and adding the information of the application to the recently used application list in step when a closing signal of the application is monitored:
and judging whether the number of the applications in the recently-used application list exceeds a set value or not, if so, deleting the application with the earliest starting time from the recently-used application list, and enabling the number of the applications in the recently-used application list to be less than or equal to the set value.
Further, the method comprises, after deleting the information of the application from the background application list and adding the information of the application to the recently used application list in step when a closing signal of the application is monitored:
and sequencing the applications in the most recently used application list according to the time from the near to the far of the starting time.
Further, the method includes recording the application starting time in the step o, and after adding the information of the application to a background application list, the method includes:
and recalculating and displaying the height of the background application display module according to the new background application program list.
Further, when the device is started, the method records the application on the interface, and the establishing of the voice control task set further includes: and recording the application package name, the started activity name, the activity type name and the picture of each application on the interface when the voice control task set is started, and establishing the voice control task set.
Further, the method comprises, after the step of the voice assistant receiving and analyzing the voice information:
the voice assistant stores the information of the application into the Bundle, the Bundle is placed into the Intent to carry, and the desktop of the wearable device is informed in a broadcast sending mode.
To solve the above problem, the present invention also provides a wearable device, including:
a memory, a processor, and a computer program stored on the memory and executable on the processor;
the computer program, when executed by the processor, implements the steps of the voice control method of any of the above.
In order to solve the above problem, the present invention further provides a computer-readable storage medium, on which a voice control program is stored, and the voice control program realizes the steps of any of the voice control methods when executed by a processor.
According to the voice control method, the wearable device and the computer readable storage medium, the monitoring buried point is arranged on the application of the desktop of the wearable device, so that when the application is used in combination with the voice assistant, the voice assistant can accurately find and start the corresponding application, and after the voice assistant starts the application, the background application list and the recently used application list of the desktop are automatically subjected to duplicate removal processing, so that the display interface is concise, and the interface utilization efficiency is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description, serve to explain the principles of the invention.
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive exercise.
Fig. 1 is a schematic hardware structure diagram of an implementation manner of a wearable device according to an embodiment of the present invention;
fig. 2 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;
fig. 3 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;
fig. 4 is a hardware schematic diagram of an implementation of a wearable device provided in an embodiment of the present application;
fig. 5 is a hardware schematic diagram of an implementation manner of a wearable device provided in an embodiment of the present application;
fig. 6 is a schematic flow chart illustrating an implementation of a voice control method according to a first embodiment of the present invention;
fig. 7 is a schematic flow chart illustrating an implementation of a voice control method according to a second embodiment of the present invention;
fig. 8 is a schematic flow chart illustrating an implementation of a voice control method according to a third embodiment of the present invention;
fig. 9 is a schematic flow chart of an implementation of a voice control method according to a fourth embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.
The wearable device provided by the embodiment of the invention comprises a mobile terminal such as an intelligent bracelet, an intelligent watch, an intelligent mobile phone and the like. With the continuous development of screen technologies, screen forms such as flexible screens and folding screens appear, and mobile terminals such as smart phones can also be used as wearable devices. The wearable device provided in the embodiment of the present invention may include: a Radio Frequency (RF) unit, a Wi-Fi module, an audio output unit, an audio/video (a/V) input unit, a sensor, a display unit, a user input unit, an interface unit, a memory, a processor, a power supply, and the like.
In the following description, a wearable device will be taken as an example, please refer to fig. 1, which is a schematic diagram of a hardware structure of a wearable device for implementing various embodiments of the present invention, where the wearable device 100 may include: RF (Radio Frequency) unit 101, Wi-Fi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the wearable device structure shown in fig. 1 does not constitute a limitation of the wearable device, and that the wearable device may include more or fewer components than shown, or combine certain components, or a different arrangement of components.
The following describes the various components of the wearable device in detail with reference to fig. 1:
the rf unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, the rf unit 101 may transmit uplink information to a base station, in addition, the downlink information sent by the base station may be received and then sent to the processor 110 of the wearable device for processing, the downlink information sent by the base station to the radio frequency unit 101 may be generated according to the uplink information sent by the radio frequency unit 101, or may be actively pushed to the radio frequency unit 101 after detecting that the information of the wearable device is updated, for example, after detecting that the geographic location where the wearable device is located changes, the base station may send a message notification of the change in the geographic location to the radio frequency unit 101 of the wearable device, and after receiving the message notification, the message notification may be sent to the processor 110 of the wearable device for processing, and the processor 110 of the wearable device may control the message notification to be displayed on the display panel 1061 of the wearable device; typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with a network and other devices through wireless communication, which may specifically include: the server may push a message notification of resource update to the wearable device through wireless communication to remind a user of updating the application program if the file resource corresponding to the application program in the server is updated after the wearable device finishes downloading the application program. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access2000 ), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).
In one embodiment, the wearable device 100 may access an existing communication network by inserting a SIM card.
In another embodiment, the wearable device 100 may be configured with an esim card (Embedded-SIM) to access an existing communication network, and by using the esim card, the internal space of the wearable device may be saved, and the thickness may be reduced.
It is understood that although fig. 1 shows the radio frequency unit 101, it is understood that the radio frequency unit 101 does not belong to the essential constituents of the wearable device, and can be omitted entirely as required within the scope not changing the essence of the invention. Wearable device 100 may implement a communication connection with other devices or a communication network through Wi-Fi module 102 alone, which is not limited by the embodiments of the present invention.
Wi-Fi belongs to short distance wireless transmission technology, and wearable device can help the user send and receive e-mail, browse the webpage and visit STREAMING media etc. through Wi-Fi module 102, and it provides wireless broadband internet access for the user. Although fig. 1 shows the Wi-Fi module 102, it is understood that it does not belong to the essential constitution of the wearable device and can be omitted entirely as needed within the scope not changing the essence of the invention.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the Wi-Fi module 102 or stored in the memory 109 into an audio signal and output as sound when the wearable device 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the wearable device 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the Wi-Fi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
In one embodiment, the wearable device 100 includes one or more cameras, and by turning on the cameras, capturing of images can be realized, functions such as photographing and recording can be realized, and the positions of the cameras can be set as required.
The wearable device 100 also includes at least one sensor 105, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or the backlight when the wearable device 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), and the like.
In one embodiment, the wearable device 100 further comprises a proximity sensor, and the wearable device can realize non-contact operation by adopting the proximity sensor, so that more operation modes are provided.
In one embodiment, the wearable device 100 further comprises a heart rate sensor, which, when worn, enables detection of heart rate by proximity to the user.
In one embodiment, the wearable device 100 may further include a fingerprint sensor, and by reading the fingerprint, functions such as security verification can be implemented.
The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
In one embodiment, the display panel 1061 is a flexible display screen, and when the wearable device using the flexible display screen is worn, the screen can be bent, so that the wearable device is more conformable. Optionally, the flexible display screen may adopt an OLED screen body and a graphene screen body, in other embodiments, the flexible display screen may also be made of other display materials, and this embodiment is not limited thereto.
In one embodiment, the display panel 1061 of the wearable device may take a rectangular shape to wrap around when worn. In other embodiments, other approaches may be taken.
The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the wearable device. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.
In one embodiment, the side of the wearable device 100 may be provided with one or more buttons. The button can realize various modes such as short-time pressing, long-time pressing, rotation and the like, thereby realizing various operation effects. The number of the buttons can be multiple, and different buttons can be combined for use to realize multiple operation functions.
Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components to implement the input and output functions of the wearable device, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the wearable device, and is not limited herein. For example, when receiving a message notification of an application program through the rf unit 101, the processor 110 may control the message notification to be displayed in a predetermined area of the display panel 1061, where the predetermined area corresponds to a certain area of the touch panel 1071, and perform a touch operation on the certain area of the touch panel 1071 to control the message notification displayed in the corresponding area on the display panel 1061.
The interface unit 108 serves as an interface through which at least one external device is connected to the wearable apparatus 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the wearable apparatus 100 or may be used to transmit data between the wearable apparatus 100 and the external device.
In one embodiment, the interface unit 108 of the wearable device 100 is configured as a contact, and is connected to another corresponding device through the contact to implement functions such as charging and connection. The contact can also be waterproof.
The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 110 is a control center of the wearable device, connects various parts of the entire wearable device by various interfaces and lines, and performs various functions of the wearable device and processes data by running or executing software programs and/or modules stored in the memory 109 and calling up data stored in the memory 109, thereby performing overall monitoring of the wearable device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The wearable device 100 may further include a power source 111 (such as a battery) for supplying power to various components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
Although not shown in fig. 1, the wearable device 100 may further include a bluetooth module or the like, which is not described herein. The wearable device 100 can be connected with other terminal devices through Bluetooth, so that communication and information interaction are realized.
Please refer to fig. 2-4, which are schematic structural diagrams of a wearable device according to an embodiment of the present invention. The wearable device in the embodiment of the invention comprises a flexible screen. When the wearable device is unfolded, the flexible screen is in a strip shape; when the wearable device is in a wearing state, the flexible screen is bent to be annular. Fig. 2 and 3 show the structural schematic diagram of the wearable device screen when the wearable device screen is unfolded, and fig. 4 shows the structural schematic diagram of the wearable device screen when the wearable device screen is bent.
Based on the above embodiments, it can be seen that, if the device is a watch, a wearable device, or a wearable device, the screen of the device may not cover the watchband region of the device, or may cover the watchband region of the device. Here, the present application proposes an alternative embodiment, in which the device may be a watch, a wearable device, or a wearable device, and the device includes a screen and a connection portion. The screen can be a flexible screen, and the connecting part can be a watchband. Optionally, the screen of the device or the display area of the screen may partially or completely cover the wristband of the device. As shown in fig. 5, fig. 5 is a hardware schematic diagram of an implementation manner of a wearable device provided in an embodiment of the present application, where a screen of the device extends to two sides, and a part of the screen is covered on a watchband of the device. In other embodiments, the screen of the device may also be entirely covered on the watchband of the device, and this is not limited in this application.
Example one
A first embodiment of the present invention provides a voice control method, which is applied to a wearable device, as shown in fig. 6, and includes the following steps:
s11, setting monitoring and burying points for the application of all interfaces;
the wearable device usually includes a plurality of interfaces, for example, in this embodiment, the wearable device includes 4 interfaces (views) in addition to the main interface, and the corresponding 4 controllers are, respectively, a watchfunctioncardzerocontroller (first dial on the left of the main interface), a watchfunctioncardfirstcontroller (first dial on the right of the main interface), a watchfunctioncardseconcontroller (second dial on the right of the main interface), and a watchfunctioncardthfirstcontroller (third dial on the right of the main interface), each interface is provided with an application program, and each page interface is created when its controller is created.
In order to better monitor each application program on the wearable device, a monitoring buried point is set for the application programs of all interfaces. Specifically, a embedding point is set for the application program, that is, a service is embedded in the AMS, and is used for monitoring the starting and closing of the application program. The ActivityManagerService is called AMS for short, is an important service in the android, and manages four large components of the android in a comprehensive manner; uniformly scheduling each application process; the AMN is derived from a Binder class, an IActivityManager interface is realized, the client uses an ActivityManager class, as the AMS is a system core service, a plurality of APIs cannot be directly accessed, an ActivityManager is needed to obtain an ActivityManagerProxy object by calling a getDefault method of the AMN inside the ActivityManager, and the ActivityManagerProxy object can communicate with the AMS through the ActivityManager.
A recording point is embedded in the selection button in the notification details. With pendingIntent it is possible to open the application, where the recording spot is buried. And monitoring the incoming call, namely acquiring current incoming call information through a state in an onCallStateChanged callback method of PhoneStateListener, embedding a recording point at the position, and monitoring the state of the call, including incoming call, hang-up and the like. The storage of the RecentrTaskListSix by RecentrTaskUtil is performed by RecentrTaskBean.
S12, when the equipment is started, recording the application on the interface, and establishing a voice control task set;
when the device is started, the application is accurately recorded, the records are stored in a voicerecentTaskList set, the content of each item is contained in a recentTaskBean (which is a class and has field storage information in the class), the detailed information of each application is stored, and the detailed information comprises an application package name, a started activity name, an activity type name and a picture of the application package name, wherein lunchModelNameVoice () is a field which is most critical for communication with a voice assistant.
S13, when receiving the voice assistant starting command, starting the voice assistant, and the voice assistant receives and analyzes the voice information;
the voice assistant receives the voice information through a microphone on the device or through a bluetooth headset connected to the wearable device. And carrying out data analysis on the received voice information through keyword analysis and semantic analysis.
S14, judging whether the voice information contains the information of starting the application, if yes, executing the step S15, otherwise, ending.
And S15, matching the application name information with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set and starting the application.
If the voice information contains information for starting the application, the application name information is extracted, the voice assistant stores the received information of the application needing to be started into a Bundle (used for transmitting between Android activities), the information is put into an Intent to be carried, and the wearable device desktop is notified through sendBroadcast. Intent mainly addresses communication between components of Android applications. The Android is responsible for describing actions, action related data and additional data of one operation in the application, and the Android is responsible for finding a corresponding component according to the description of the Intent, transmitting the Intent to the called component and completing calling of the component. Therefore, Intent plays a role of media intermediary, and specially provides related information of mutual calling of components, so that decoupling between a caller and a callee is realized.
And if the voice assistant contains the information for starting the application program, matching the name information of the started application with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set and starting the application. The voice control task set comprises the package name corresponding to the startup of each application, the started activity name, the activity type name and the picture thereof, so that the voice assistant can accurately start the corresponding application program.
According to the voice control method, the monitoring buried point is arranged on the application of the wearable device desktop, so that when the wearable device desktop is used in combination with the voice assistant, the voice assistant can accurately find the corresponding application and start the corresponding application, and the function of the voice assistant is enhanced.
Example two
A second embodiment of the present invention provides a voice control method, applied to a wearable device, as shown in fig. 7, including the following steps:
s21, setting monitoring and burying points for the application of all interfaces;
s22, when the equipment is started, recording the application on the interface, and establishing a voice control task set;
s23, when receiving the voice assistant starting command, starting the voice assistant, and the voice assistant receives and analyzes the voice information;
s24, judging whether the voice information contains the information of starting application, if yes, executing step S25, otherwise ending;
s25, matching the application name information with the name of the application on the interface, after matching successfully, extracting all information of the application from the voice control task set, and starting the application;
s26, recording the application starting time, and adding the information of the application to a background application list;
according to the starting and closing of the distributed buried point monitoring application, the starting and closing data of the application can be accurately acquired, stored and analyzed.
And calling requestLayout () of WatchControlCenterView to recalculate the onMeasure and the onLayout every time the number of the background applications is changed, and recalculating the onMeasure to enable the background application display module to reach a proper height. Namely, the height of the background application display module is recalculated and displayed according to the new background application program list.
S27, checking whether the started application exists in the application list used recently, if so, deleting the information of the application in the application list used recently.
The information of the started application can be automatically listed in a background application list and displayed in a background application module, if the application is restarted, the information of the application can be displayed in a recently used application list, in order to avoid repeated application information existing in an interface, the information of the application in the recently used application list is deleted, namely, the recently used application list is subjected to deduplication processing, when a reported process is started by a new process, all service fields in mListService are traversed, and a recent TaskUtil.
In order to avoid that the restarted application exists in the background application list and the recently used application list at the same time and forms an information repetition and waste display interface, when each application is started, whether the started application exists in the recently used application list is checked, and if yes, the information of the application in the recently used application list is deleted.
According to the voice control method, the monitoring buried point is arranged on the application of the desktop of the wearable device, so that when the application is used in combination with the voice assistant, the voice assistant can accurately find and start the corresponding application, and after the voice assistant starts the application, the background application list and the recently used application list of the desktop are automatically subjected to duplicate removal processing, so that the display interface is concise, and the interface utilization efficiency is improved.
EXAMPLE III
In order to solve the above problem, a third embodiment of the present invention provides a voice control method, as shown in fig. 8, applied to a wearable device, including the following steps:
s31, setting monitoring and burying points for the application of all interfaces;
s32, when the equipment is started, recording the application on the interface, and establishing a voice control task set;
s33, when receiving the voice assistant starting command, starting the voice assistant, and the voice assistant receives and analyzes the voice information;
s34, judging whether the voice information contains the information of starting application, if yes, executing step S35, otherwise ending;
s35, matching the application name information with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set; starting the application;
s36, recording the application starting time, and adding the information of the application to a background application list;
and calling requestLayout () of WatchControlCenterView to recalculate the onMeasure and the onLayout every time the number of the background applications is changed, and recalculating the onMeasure to enable the background application display module to reach a proper height. Namely, the height of the background application display module is recalculated and displayed according to the new background application program list.
S37, checking whether the started application exists in the application list used recently, if so, deleting the information of the application in the application list used recently;
the information of the started application can be automatically listed in a background application list and displayed in a background application module, if the application is restarted, the information of the application can be displayed in a recently used application list, in order to avoid repeated application information existing in an interface, the information of the application in the recently used application list is deleted, namely, the recently used application list is subjected to deduplication processing, when a reported process is started by a new process, all service fields in mListService are traversed, and a recent TaskUtil.
In order to avoid that the restarted application exists in the background application list and the recently used application list at the same time and forms an information repetition and waste display interface, when each application is started, whether the started application exists in the recently used application list is checked, and if yes, the information of the application in the recently used application list is deleted.
S38, monitoring a closing signal of the application;
in order to update the recently used application in time, a closing signal of the application is monitored; the process of closing the monitoring application is the same as the process of opening the monitoring application, and the data acquisition of closing the application is carried out through the buried points arranged on the corresponding interfaces. And the processor receives a signal for closing the application, namely closing the process of the application, and quitting the running of the processor. When the user needs to close, a signal for closing the application can be sent out through a set button for closing the application, and a signal for closing the application can also be sent out through a set touch gesture.
And S39, when the closing signal of the application is monitored, deleting the information of the application from the background application list and adding the information of the application to the recently used application list.
When a closing signal of the application is monitored, recording closing time of the application; and deleting the information of the application from the background application list, and adding the information of the application to the recently used application list. The information of the started application can be automatically listed in a background application list and displayed in a background application module, if the application is restarted, the information of the application can be displayed in a recently used application list, in order to avoid repeated application information existing in an interface, the information of the application in the recently used application list is deleted, namely, the recently used application list is subjected to deduplication processing, when a reported process is started by a new process, all service fields in mListService are traversed, and a recent TaskUtil.
In order to help the user to make the use time of the applications in the application list used recently clear, the applications in the application list are arranged in the order of the start time from near to far. Because the display interface is limited, part of the recently used applications are preferably displayed in the interface, so that whether the number of the applications in the recently used application list exceeds a set value or not is judged, if so, the application with the earliest starting time is deleted from the recently used application list, and the number of the applications in the recently used application list is less than or equal to the set value. Preferably, the setting value is 6, that is, when the number of applications in the most recently used application list is at most 6, once whether the number of applications in the most recently used application list exceeds 6 or not, the application with the earliest start time is deleted from the most recently used application list.
According to the voice control method, the monitoring buried point is arranged on the application of the wearable device desktop, so that when the wearable device desktop is used in combination with the voice assistant, the voice assistant can accurately find and start the corresponding application, and after the voice assistant starts the application, the background application list and the recently-used application list of the desktop are automatically subjected to deduplication processing, so that the started application is not displayed in the recently-used application list, the closed application can be timely displayed in the recently-used application list, a display interface is concise, and the interface utilization efficiency is improved.
Example four
A fourth embodiment of the present invention provides a voice control method, which is applied to a wearable device, and as shown in fig. 9, the method includes the following steps:
s41, setting monitoring and burying points for the application of all interfaces;
s42, when the equipment is started, recording the application on the interface, and establishing a voice control task set;
when the device is started, the application is accurately recorded, the records are stored in a voicerecentTaskList set, the content of each item is contained in a recentTaskBean (which is a class and has field storage information in the class), the detailed information of each application is stored, and the detailed information comprises an application package name, a started activity name, an activity type name and a picture of the activity type name, wherein lunchModelNameVoice () is a field which is most critical for communication with a voice assistant.
S43, when receiving the voice assistant starting command, starting the voice assistant; the voice assistant receives and analyzes the voice information;
s44, the voice assistant stores the information of the application into a Bundle, carries the information in Intent, and informs a desktop of the wearable device in a broadcast sending mode;
the voice assistant stores the received information of the application needing to be started into a Bundle (used for transmitting between Android activities), puts the information into an Intent to carry, and informs a wearable device desktop through sendBroadcast.
Intent mainly addresses communication between components of Android applications. The Android is responsible for describing actions, action related data and additional data of one operation in the application, and the Android is responsible for finding a corresponding component according to the description of the Intent, transmitting the Intent to the called component and completing calling of the component. Therefore, Intent plays a role of media intermediary, and specially provides related information of mutual calling of components, so that decoupling between a caller and a callee is realized.
S45, judging whether the voice information contains the information of starting application, if yes, executing step S46, otherwise ending;
and S46, matching the application name information with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set and starting the application.
Obtaining key data APPName (application name) and lunchModelNameVoice (name of each application stored on the desktop) for matching, and after matching is successful, taking all information of the application from a voice control task set (voiceRecentrtTaskList), namely, the information of application starting can be realized and the application can be accurately started.
According to the voice control method, the monitoring buried point is arranged on the application of the wearable device desktop, so that when the wearable device desktop is used in combination with the voice assistant, the voice assistant can accurately find the corresponding application and start the corresponding application, and the function of the voice assistant is enhanced.
EXAMPLE five
A fifth embodiment of the present invention provides a wearable device, which includes, as shown in fig. 1:
a memory 109, a processor 110 and a computer program stored on the memory 109 and executable on the processor 110;
when executed by the processor 110, the computer program implements the steps of the voice control method according to any one of the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment.
EXAMPLE six
The sixth embodiment of the present invention further provides a computer-readable storage medium, where a voice control program is stored on the computer-readable storage medium, and the voice control program, when executed by a processor, implements the steps of the voice control method according to any one of the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (10)
1. A voice control method is applied to a smart wearable device, and the device comprises: a memory, a processor and a computer program stored on the memory and executable on the processor, the voice control method comprising the steps of:
setting monitoring buried points for the applications of all interfaces;
when the equipment is started, recording the application on an interface, and establishing a voice control task set;
when a voice assistant starting command is received, starting the voice assistant;
the voice assistant receives and analyzes the voice information;
judging whether the voice information contains information for starting the application, if so, matching the name information of the started application with the name of the application on the interface, and after the matching is successful, extracting all information of the application from the voice control task set;
and starting the application.
2. The voice-controlled method according to claim 1, wherein the steps of the method, after launching the application, comprise:
recording the starting time of the application, and adding the information of the application into a background application list;
checking whether the started application exists in a recently used application list, and if so, deleting the information of the application in the recently used application list.
3. The voice control method according to claim 2, wherein the method comprises, after checking in step whether the started application exists in a recently used application list, and if so, deleting information of the application in the recently used application list, the steps of:
monitoring a closing signal of the application;
when a closing signal of the application is monitored, the information of the application is deleted from the background application list, and the information of the application is added to the recently used application list.
4. The voice control method according to claim 3, wherein the method comprises, after the step of deleting the information of the application from a background application list when a closing signal of the application is monitored, and adding the information of the application to a recently used application list:
and judging whether the number of the applications in the recently-used application list exceeds a set value or not, if so, deleting the application with the earliest starting time from the recently-used application list, and enabling the number of the applications in the recently-used application list to be less than or equal to the set value.
5. The voice control method according to claim 3, wherein the method comprises, after the step of deleting the information of the application from a background application list when a closing signal of the application is monitored, and adding the information of the application to a recently used application list:
and sequencing the applications in the most recently used application list according to the time from the near to the far of the starting time.
6. The voice control method according to claim 2, wherein the method comprises, after recording the time when the application is started, adding the information of the application to a background application list:
and recalculating and displaying the height of the background application display module according to the new background application program list.
7. The voice-controlled method of claim 1, wherein the steps of the method include recording an application on an interface when the device is started, and establishing the voice-controlled task set further comprises:
and recording the application package name, the started activity name, the activity type name and the picture of each application on the interface when the voice control task set is started, and establishing the voice control task set.
8. The voice-controlled method of claim 1, after the step of the voice assistant receiving and analyzing the voice information, comprising:
the voice assistant stores the information of the application into the Bundle, the Bundle is placed into the Intent to carry, and the desktop of the wearable device is informed in a broadcast sending mode.
9. A smart wearable device, the device comprising:
a memory, a processor, and a computer program stored on the memory and executable on the processor;
the computer program realizing the steps of the speech control method according to any one of claims 1 to 8 when executed by the processor.
10. A computer-readable storage medium, having stored thereon a speech control program which, when executed by a processor, implements the steps of the speech control method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910459052.8A CN110213441B (en) | 2019-05-29 | 2019-05-29 | Voice control method, wearable device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910459052.8A CN110213441B (en) | 2019-05-29 | 2019-05-29 | Voice control method, wearable device and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110213441A CN110213441A (en) | 2019-09-06 |
| CN110213441B true CN110213441B (en) | 2021-09-07 |
Family
ID=67789308
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910459052.8A Active CN110213441B (en) | 2019-05-29 | 2019-05-29 | Voice control method, wearable device and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110213441B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110780967B (en) * | 2019-10-30 | 2024-06-21 | 努比亚技术有限公司 | Application display method, terminal and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105096951A (en) * | 2015-05-28 | 2015-11-25 | 惠州Tcl移动通信有限公司 | Voice control realizing method and system based on intelligent wearable equipment |
| CN105159709A (en) * | 2015-08-26 | 2015-12-16 | 小米科技有限责任公司 | Application starting method and apparatus, and intelligent terminal |
| CN108597512A (en) * | 2018-04-27 | 2018-09-28 | 努比亚技术有限公司 | Method for controlling mobile terminal, mobile terminal and computer readable storage medium |
| CN109725523A (en) * | 2018-12-25 | 2019-05-07 | 广东乐芯智能科技有限公司 | A kind of method and wrist-watch of smartwatch speech recognition controlled |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10095473B2 (en) * | 2015-11-03 | 2018-10-09 | Honeywell International Inc. | Intent managing system |
-
2019
- 2019-05-29 CN CN201910459052.8A patent/CN110213441B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105096951A (en) * | 2015-05-28 | 2015-11-25 | 惠州Tcl移动通信有限公司 | Voice control realizing method and system based on intelligent wearable equipment |
| CN105159709A (en) * | 2015-08-26 | 2015-12-16 | 小米科技有限责任公司 | Application starting method and apparatus, and intelligent terminal |
| CN108597512A (en) * | 2018-04-27 | 2018-09-28 | 努比亚技术有限公司 | Method for controlling mobile terminal, mobile terminal and computer readable storage medium |
| CN109725523A (en) * | 2018-12-25 | 2019-05-07 | 广东乐芯智能科技有限公司 | A kind of method and wrist-watch of smartwatch speech recognition controlled |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110213441A (en) | 2019-09-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108845853B (en) | Application program starting method and mobile terminal | |
| CN108777859A (en) | Data processing method, terminal between mobile terminal and wearable device and storage medium | |
| CN109947327B (en) | Interface viewing method, wearable device and computer-readable storage medium | |
| CN110399195B (en) | Desktop icon dynamic replacement method, equipment and computer readable storage medium | |
| CN109976612B (en) | Application function implementation method, wearable device, mobile phone and computer-readable storage medium | |
| CN112566089A (en) | Power consumption saving method, intelligent wearable device and computer readable storage medium | |
| CN108009031B (en) | Application program control method and mobile terminal | |
| CN111131607A (en) | Information sharing method, electronic equipment and computer readable storage medium | |
| CN111107223B (en) | Message processing method and electronic equipment | |
| CN110098845B (en) | Message processing method, wearable device, mobile terminal and readable storage medium | |
| CN109165651A (en) | A kind of identification code recognition methods, terminal and computer readable storage medium | |
| CN110139270B (en) | Wearable device pairing method, wearable device and computer readable storage medium | |
| CN110750191A (en) | Method and electronic equipment for application combined display | |
| CN108228357B (en) | Memory cleaning method and mobile terminal | |
| CN110083205B (en) | Page switching method, wearable device and computer-readable storage medium | |
| CN111309392B (en) | Equipment control method and electronic equipment | |
| CN110213637B (en) | Method for adding watermark to video file, wearable device and readable storage medium | |
| CN110071866B (en) | Instant messaging application control method, wearable device and storage medium | |
| CN110086808B (en) | Account login control method and device and computer readable storage medium | |
| CN110213441B (en) | Voice control method, wearable device and computer-readable storage medium | |
| CN110072071B (en) | Video recording interaction control method, equipment and computer readable storage medium | |
| CN109933187B (en) | Wearing equipment operation control method, wearing equipment and computer readable storage medium | |
| CN110069200B (en) | Wearable device input control method, wearable device and storage medium | |
| CN110177208B (en) | Video recording association control method, equipment and computer readable storage medium | |
| CN109947617B (en) | Method, terminal and readable storage medium for monitoring display content of application interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |