CN109167884A - A kind of method of servicing and device based on user speech - Google Patents
A kind of method of servicing and device based on user speech Download PDFInfo
- Publication number
- CN109167884A CN109167884A CN201811291702.4A CN201811291702A CN109167884A CN 109167884 A CN109167884 A CN 109167884A CN 201811291702 A CN201811291702 A CN 201811291702A CN 109167884 A CN109167884 A CN 109167884A
- Authority
- CN
- China
- Prior art keywords
- key message
- object run
- application program
- information
- triggering command
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000008569 process Effects 0.000 claims abstract description 22
- 230000004044 response Effects 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 4
- 235000013399 edible fruits Nutrition 0.000 claims 1
- 230000006854 communication Effects 0.000 abstract description 20
- 238000004891 communication Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 11
- 238000004590 computer program Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000007667 floating Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 235000012054 meals Nutrition 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72484—User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
Landscapes
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Telephone Function (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The present invention provides a kind of method of servicing and device based on user speech.Applied to mobile terminal, which comprises in voice call process, the key message of dialog context is extracted from the user speech of both call sides；Show the key message；Receive the object run triggering command for being directed to the key message；The object run triggering command is responded, object run corresponding with the key message is executed.Through the embodiment of the present invention, further service can be provided for user according to dialog context, keeps mobile terminal more intelligent, improves the usage experience of user in user speech communication process.
Description
Technical field
The present invention relates to technical field of mobile terminals more particularly to a kind of method of servicing and device based on user speech.
Background technique
With the development of science and technology, intelligent mobile terminal is more more and more universal.It is carried out in user using intelligent mobile terminal
When voice communication, it is sometimes desirable to record information, provide sound-recording function in the prior art for record information.But recording is rear
Inconvenient and efficiency is lower when continuous lookup information.When either progress voice passes through, need to be searched mutually inside the Pass according to call
Hold.At this moment it generally requires to interrupt voice communication, carries out voice communication after lookup again, efficiency can also be reduced by repeatedly linking up.For example,
Two friends, which make an appointment to have a meal, to watch movie, and thinks where determination eats, what is eaten, what film seen in voice communication, it is necessary to first
Voice communication is interrupted, voice communication is carried out after problem to be solved again, links up the usage experience for reducing user repeatedly in this way.
Summary of the invention
The embodiment of the present invention provides a kind of method of servicing and device based on user speech, to solve voice in the prior art
Information is recorded when call or searches the problem of content inconvenience.
In order to solve the above-mentioned technical problem, it the embodiment of the invention provides a kind of method of servicing based on user speech, answers
For mobile terminal, which comprises
In voice call process, the key message of dialog context is extracted from the user speech of both call sides；
Show the key message；
Receive the object run triggering command for being directed to the key message；
The object run triggering command is responded, object run corresponding with the key message is executed.
The embodiment of the invention also provides a kind of service units based on user speech, are deployed in mobile terminal, the dress
It sets and includes:
Key message extraction module, for extracting call from the user speech of both call sides in voice call process
The key message of content；
Key message display module, for showing the key message；
Command reception module, for receiving the object run triggering command for being directed to the key message；
Respond module executes target behaviour corresponding with the key message for responding the object run triggering command
Make.
The embodiment of the invention also provides a kind of mobile terminal, including processor, memory and it is stored in the memory
Computer program that is upper and can running on the processor, is realized as above when the computer program is executed by the processor
The step of method of servicing based on user speech stated.
The embodiment of the invention also provides a kind of computer readable storage medium, deposited on the computer readable storage medium
Computer program is stored up, is realized when the computer program is executed by processor such as the above-mentioned method of servicing based on user speech
Step.
In the embodiment of the present invention, in voice call process, dialog context is extracted from the user speech of both call sides
Key message；Show key message；The object run triggering command for being directed to key message is received, response object run triggering refers to
It enables, executes object run corresponding with key message.Through the embodiment of the present invention, can be in user speech communication process, root
Further service is provided for user according to dialog context, keeps mobile terminal more intelligent, improves the usage experience of user.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a kind of step flow chart of method of servicing based on user speech of the embodiment of the present invention one；
Fig. 2 is a kind of step flow chart of method of servicing based on user speech of the embodiment of the present invention two；
Fig. 3 is a kind of one of structural block diagram of service unit based on user speech of the embodiment of the present invention three；
Fig. 4 is the two of the structural block diagram of a kind of service unit based on user speech of the embodiment of the present invention three；
Fig. 5 is a kind of hardware structural diagram of mobile terminal of the embodiment of the present invention four.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
Embodiment one
Referring to Fig.1, a kind of step process of method of servicing based on user speech provided in an embodiment of the present invention is shown
Figure.Applied to mobile terminal, which comprises
Step 101, in voice call process, the crucial letter of dialog context is extracted from the user speech of both call sides
Breath.
In the present embodiment, during user makes a phone call or user uses instant message applications progress video calling
In the process, mobile terminal can acquire the user speech of both call sides, dialog context be identified according to user speech, from what is identified
Key message is extracted in dialog context.For example, mobile terminal is according to user A's during user A and friend's video calling
User speech identifies dialog context, and key message " restaurant X " and " film Y " are extracted from dialog context.Alternatively, user B
During making a phone call with colleague, mobile terminal identifies dialog context according to the user speech of user B, extracts from dialog context
Key message " M point in afternoon " and " meeting room N " out.
Step 102, the key message is shown.
In the present embodiment, key message is shown on the screen, specifically, can be jumped from call interface and be shown for key message
Show interface, shows key message on key message display interface；Floating window key message can also be shown on call interface.Example
Such as, floating window shows " restaurant X " and " film Y " on the call interface of video calling.Display mode can be with flexible setting, the present invention
Embodiment does not limit this in detail.
Step 103, the object run triggering command for being directed to the key message is received.
In the present embodiment, after user sees the key message shown, object run can be inputted for key message
Triggering command, mobile terminal receive object run triggering command.For example, receiving the triggering command of record key message, or search
The triggering command of rope key message.The embodiment of the present invention does not limit object run triggering command in detail, can be according to reality
Situation is configured.
Step 104, the object run triggering command is responded, object run corresponding with the key message is executed.
In the present embodiment, after receiving object run triggering command, object run triggering command, performance objective behaviour are responded
Make.Specifically, the object run triggering command of response record key message, record key message, such as record " restaurant X " and
" film Y ".Or the object run triggering command of response search key message, it is scanned for according to key message, for example search for
" restaurant X ", or search " film Y ".During record and search, user facilitates user to grasp without interrupting voice communication
Make and improves communication efficiency.
In conclusion in embodiments of the present invention, in voice call process, being extracted from the user speech of both call sides
The key message of dialog context；Show key message；Receive the object run triggering command for being directed to key message, response target behaviour
Make triggering command, executes object run corresponding with key message.Through the embodiment of the present invention, it can converse in user speech
Cheng Zhong provides further service according to dialog context for user, improves communication efficiency, and keep mobile terminal more intelligent
Change, improves the usage experience of user.
Embodiment two
Referring to Fig. 2, a kind of step process of method of servicing based on user speech provided in an embodiment of the present invention is shown
Figure.Applied to mobile terminal, which comprises
Step 201, in voice call process, the crucial letter of dialog context is extracted from the user speech of both call sides
Breath.
In the present embodiment, the user speech of both call sides is converted into text information first.Specifically, in voice communication
User speech can be converted to text information according to transformation model trained in advance by Cheng Zhong, for example, being turned according to training in advance
User speech is converted to that " tomorrow noon, we had a meal in restaurant X, and then go to the cinema Y " by mold changing type；Or according to preparatory instruction
User speech is converted to " afternoon, M point was in meeting room N meeting " by experienced transformation model.It can also be by other means by user's language
Sound is converted to text information, and the embodiment of the present invention does not limit conversion regime in detail, can be configured according to the actual situation.
Secondly, extracting key message from text information, and determine the affiliated information category of key message.It specifically, can be with
Content recognition is carried out to text information by artificial intelligence, therefrom extracts key message.For example, extracting " restaurant X " and " electricity
Shadow Y "；Or extract " M point in afternoon " and " meeting room N ".And the affiliated information category of key message is determined according to text information.
For example, according to the content of text information determine key message " restaurant X " and " film Y " belonging to information category be life classification, really
Determining information category belonging to key message " M point in afternoon " and " meeting room N " is operation class (of an amplifying stage).Further, life classification and work
Classification can also be subdivided into the subclass such as " time ", " place ", " attentinal contents ".The embodiment of the present invention is not made information category in detail
It is thin to limit, it can be according to being configured according to the actual situation.Determine the affiliated information category of key message, as object run determines
Application scenarios can provide more accurate service for user.
Step 202, the key message is shown.
In the present embodiment, after user speech is converted to text information, display text information；And to text information
In key message add signature, signature includes at least one of pre-set color, default font, default size.
For example, " afternoon, M point was had a meeting in meeting room N, needed to prepare data Z " in advance for display.Family understanding can be used in display text information
The context of key message, and the scene conversed at that time provide more detailed content for record key message.
After extracting key message, signature is added to key message.For example, key message is shown as default face
Color, default font, default size etc..For example, key message mark is yellow, or key message is shown as italic.The present invention
Embodiment does not limit signature in detail, can be configured according to the actual situation.Signature is added to key message
Family can be used, key message is more easily seen in one section of text information.
Step 203, the operational controls of the affiliated information category of the key message are shown according to operational order.
In the present embodiment, operational order can be the touch screen at long-pressing key message；It is also possible to click key message；
It can also be provided with control at key message and show that key, operational order are to click control to show key.The embodiment of the present invention is to behaviour
It instructs and does not limit in detail, can be configured according to the actual situation.Mobile terminal according to operational order display operation control,
And different according to the affiliated information category of key message, the operational controls of display are also different.For example, the other operational controls of life kind
In, the keys such as search, navigation can be set；In the operational controls of operation class (of an amplifying stage), the keys such as record, prompting can be set.
Also, the keys such as storage, sharing are also provided in operational controls.Different information categories corresponds to different operational controls,
On the one hand display space can be saved, on the other hand more accurate object run can be provided for user.
Step 204, the object run triggering command is received by the operational controls.
In the present embodiment, user can key to be arranged in clicking operation control, mobile terminal passes through operational controls and receives
Object run triggering command.For example, receiving the object runs triggering commands such as search, navigation, record, prompting.
Step 205, the object run triggering command is responded, object run corresponding with the key message is executed.
In the present embodiment, after receiving object run triggering command, object run triggering command is responded, executes and believes with crucial
Cease corresponding object run.It can specifically include such as under type:
Mode one is opened and the associated default application program of the affiliated information category of the key message；It is answered in described preset
With executing the object run in program.
Information category and default application program can be associated in advance.For example, will life classification and shopping software,
Figure etc. is associated, and operation class (of an amplifying stage) and notepad, alarm clock etc. are associated.Mobile terminal can be with preset information classification and default
The incidence relation of application program can also pass through the incidence relation of user's manual setting information classification and default application program.This
Inventive embodiments do not limit this in detail, can be configured according to the actual situation.
When responding object run triggering command, open and the associated default application program of the affiliated information category of key message.
For example, key message is " restaurant X " and " film Y ", when receiving the object run triggering command for " restaurant X ", open
Map；When receiving the object run triggering command for " film Y ", shopping software is opened.Alternatively, key message be " under
Noon M point " and " meeting room N " open alarm clock when receiving the object run triggering command for " M point in afternoon "；When receiving
For " meeting room N " object run triggering command when, then open notepad.
After opening default application program, the performance objective operation in default application program, according to different application scenarios, tool
Body may include following situation:
Situation one searches for the key message when the object run is search in the default application program, and
Show search result；Wherein, described search result includes contact information, the file information, film information, cuisines information, shopping
At least one of information, chat record.
For example, opening map when the object run triggering command for " restaurant X " is search, " restaurant is searched in map
X " shows search result, such as the geographical location, neighbouring bus stop, subway station that show " restaurant X " etc..For " film
When the object run triggering command of Y " is search, shopping software is opened, " film Y " is searched in shopping software, is shown after search
Search result, such as display projection time of " film Y ", movie theatre, admission fee etc..Default application program removes above-mentioned map, shopping
It can also include address list, local folders, instant message applications etc. except software.Therefore, search result may include connection
It is people's information, the file information, film information, cuisines information, shopping information, chat record etc..
Further, at least one of shared, store, pay operation to search result.
Specifically, after showing search result, object run can be carried out to search result, as user provides further
Service.For example, the projection time of the geographical location of " the restaurant X " that searches, bus stop, " film Y " are shared with other
User allows user to obtain wanting the content of search in the case where not interrupting voice communication.Or storage search result,
It can also directly be paid in shopping software.The embodiment of the present invention does not limit this in detail, can be according to the actual situation
It is configured.
Situation two records the key message in the default application program when the object run is record.
For example, opening notepad when the object run triggering command for " M point in afternoon " is record, remembering in notepad
It records " M point in afternoon ".When object run triggering command for " meeting room N " is record, notepad is opened, is recorded in notepad
" meeting room N ".Compared with recording, more convenient user checks after voice communication.
Prompting message is arranged when the object run is to remind in situation three in the default application program, and according to
The prompting message reminds user, alerting pattern include pop-up show, indicator light flashing, vibration, at least one of jingle bell.
For example, the object run triggering command for " M point in afternoon " is when reminding, to open alarm clock, be arranged in alarm clock and mention
It wakes up the time；Until when reminder time, can be shown by pop-up, indicator light flashing, vibration, the modes such as jingle bell remind user, mention
High user experience.
Mode two edits the key message, and the editor includes at least one of choosing, deleting, replicate.
In the present embodiment, when the affiliated information category of key message is not associated with default application program, it is not turned on default answer
Use program.For example, life classification belonging to key message " restaurant X " is not associated with map, it is not turned on map.Therefore, exist
When the display life corresponding operational controls of classification, edit key can be set in operational controls, for example choose, delete, duplication
Equal keys, convenient for providing object run for user.For example, being deletion by the object run triggering command that operational controls receive
When, " restaurant X " is deleted from key message；It is when replicating, again by the object run triggering command that operational controls receive
It makes " restaurant X ", so that the manually opened map of user scans for.
In conclusion in embodiments of the present invention, in voice call process, extracting key message simultaneously from user speech
Display；The object run triggering command for being directed to key message is received, object run triggering command is responded, is executed and key message pair
The object run answered.Through the embodiment of the present invention, it can be provided in user speech communication process according to dialog context for user
Further service, keeps mobile terminal more intelligent, improves the usage experience of user.
Embodiment three
Referring to Fig. 3, a kind of structural block diagram of service unit based on user speech provided in an embodiment of the present invention is shown.
It is deployed in mobile terminal, described device includes key message extraction module 301, key message display module 302, command reception mould
Block 303, respond module 304:
Key message extraction module 301, for being extracted from from the user speech of both call sides in voice call process
The key message of dialog context；
Key message display module 302, for showing the key message；
Command reception module 303, for receiving the object run triggering command for being directed to the key message；
Respond module 304 executes target corresponding with the key message for responding the object run triggering command
Operation.
On the basis of Fig. 3, optionally, described instruction receiving module 303 includes operational controls display sub-module 3031, refers to
Receiving submodule 3032 is enabled, sees Fig. 4:
Operational controls display sub-module 3031, for showing the affiliated information category of the key message according to operational order
Operational controls；
Command reception submodule 3032, for receiving the object run triggering command by the operational controls.
On the basis of Fig. 3, optionally, the respond module 304 includes that default application program is opened submodule 3041, held
Row submodule 3042, is shown in Fig. 4:
Default application program opens submodule 3041, associated pre- with the affiliated information category of the key message for opening
If application program；
Implementation sub-module 3042, for executing the object run in the default application program.
On the basis of fig. 4, optionally, the implementation sub-module 3042 includes:
Search unit, for searching for the key in the default application program when the object run is search
Information, and show search result；Wherein, described search result includes contact information, the file information, film information, cuisines letter
At least one of breath, shopping information, chat record；
Recording unit, for recording the key in the default application program when the object run is record
Information；
Reminding unit, for prompting message to be arranged in the default application program when the object run is to remind,
And user is reminded according to the prompting message, alerting pattern include pop-up show, indicator light flashing, vibration, in jingle bell at least
It is a kind of.
On the basis of Fig. 3, optionally, the respond module 304 includes editor's submodule 3043, sees Fig. 4:
Submodule 3043 is edited, for editing to the key message, the editor includes selection, deletes, duplication
At least one of.
Service unit provided in an embodiment of the present invention based on user speech can be realized the embodiment of the method for Fig. 1 and Fig. 2
Each process of middle realization, to avoid repeating, which is not described herein again.Through the embodiment of the present invention, it can converse in user speech
In the process, further service is provided for user according to dialog context, keeps mobile terminal more intelligent, improve making for user
With experience.
Example IV
A kind of hardware structural diagram of Fig. 5 mobile terminal of each embodiment to realize the present invention.
The mobile terminal 400 includes but is not limited to: radio frequency unit 401, network module 402, audio output unit 403, defeated
Enter unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, processor
The components such as 410 and power supply 411.It will be understood by those skilled in the art that mobile terminal structure shown in Fig. 5 is not constituted
Restriction to mobile terminal, mobile terminal may include than illustrating more or fewer components, perhaps combine certain components or
Different component layouts.In embodiments of the present invention, mobile terminal include but is not limited to mobile phone, tablet computer, laptop,
Palm PC, car-mounted terminal, wearable device and pedometer etc..
Wherein, processor 410, for being extracted in call from the user speech of both call sides in voice call process
The key message of appearance；Show the key message；Receive the object run triggering command for being directed to the key message；Described in response
Object run triggering command executes object run corresponding with the key message.
Through the embodiment of the present invention, it can be provided for user into one in user speech communication process according to dialog context
The service of step keeps mobile terminal more intelligent, improves the usage experience of user.
It should be understood that the embodiment of the present invention in, radio frequency unit 401 can be used for receiving and sending messages or communication process in, signal
Send and receive, specifically, by from base station downlink data receive after, to processor 410 handle；In addition, by uplink
Data are sent to base station.In general, radio frequency unit 401 includes but is not limited to antenna, at least one amplifier, transceiver, coupling
Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 401 can also by wireless communication system and network and other set
Standby communication.
Mobile terminal provides wireless broadband internet by network module 402 for user and accesses, and such as user is helped to receive
It sends e-mails, browse webpage and access streaming video etc..
Audio output unit 403 can be received by radio frequency unit 401 or network module 402 or in memory 409
The audio data of storage is converted into audio signal and exports to be sound.Moreover, audio output unit 403 can also be provided and be moved
The relevant audio output of specific function that dynamic terminal 400 executes is (for example, call signal receives sound, message sink sound etc.
Deng).Audio output unit 403 includes loudspeaker, buzzer and receiver etc..
Input unit 404 is for receiving audio or video signal.Input unit 404 may include graphics processor
(Graphics Processing Unit, GPU) 4041 and microphone 4042, graphics processor 4041 is in video acquisition mode
Or the image data of the static images or video obtained in image capture mode by image capture apparatus (such as camera) carries out
Reason.Treated, and picture frame may be displayed on display unit 406.Through graphics processor 4041, treated that picture frame can be deposited
Storage is sent in memory 409 (or other storage mediums) or via radio frequency unit 401 or network module 402.Mike
Wind 4042 can receive sound, and can be audio data by such acoustic processing.Treated audio data can be
The format output that mobile communication base station can be sent to via radio frequency unit 401 is converted in the case where telephone calling model.
Mobile terminal 400 further includes at least one sensor 405, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 4061, and proximity sensor can close when mobile terminal 400 is moved in one's ear
Display panel 4061 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (general
For three axis) size of acceleration, it can detect that size and the direction of gravity when static, can be used to identify mobile terminal posture (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；It passes
Sensor 405 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet
Meter, thermometer, infrared sensor etc. are spent, details are not described herein.
Display unit 406 is for showing information input by user or being supplied to the information of user.Display unit 406 can wrap
Display panel 4061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode can be used
Forms such as (Organic Light-Emitting Diode, OLED) configure display panel 4061.
User input unit 407 can be used for receiving the number or character information of input, and generate the use with mobile terminal
Family setting and the related key signals input of function control.Specifically, user input unit 407 include touch panel 4071 and
Other input equipments 4072.Touch panel 4071, also referred to as touch screen collect the touch operation of user on it or nearby
(for example user uses any suitable objects or attachment such as finger, stylus on touch panel 4071 or in touch panel 4071
Neighbouring operation).Touch panel 4071 may include both touch detecting apparatus and touch controller.Wherein, touch detection
Device detects the touch orientation of user, and detects touch operation bring signal, transmits a signal to touch controller；Touch control
Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 410, receiving area
It manages the order that device 410 is sent and is executed.Furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc.
Seed type realizes touch panel 4071.In addition to touch panel 4071, user input unit 407 can also include other input equipments
4072.Specifically, other input equipments 4072 can include but is not limited to physical keyboard, function key (such as volume control button,
Switch key etc.), trace ball, mouse, operating stick, details are not described herein.
Further, touch panel 4071 can be covered on display panel 4061, when touch panel 4071 is detected at it
On or near touch operation after, send processor 410 to determine the type of touch event, be followed by subsequent processing device 410 according to touching
The type for touching event provides corresponding visual output on display panel 4061.Although in Fig. 5, touch panel 4071 and display
Panel 4061 is the function that outputs and inputs of realizing mobile terminal as two independent components, but in some embodiments
In, can be integrated by touch panel 4071 and display panel 4061 and realize the function that outputs and inputs of mobile terminal, it is specific this
Place is without limitation.
Interface unit 408 is the interface that external device (ED) is connect with mobile terminal 400.For example, external device (ED) may include having
Line or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end
Mouth, port, the port audio input/output (I/O), video i/o port, earphone end for connecting the device with identification module
Mouthful etc..Interface unit 408 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and
By one or more elements that the input received is transferred in mobile terminal 400 or can be used in 400 He of mobile terminal
Data are transmitted between external device (ED).
Memory 409 can be used for storing software program and various data.Memory 409 can mainly include storing program area
The storage data area and, wherein storing program area can (such as the sound of application program needed for storage program area, at least one function
Sound playing function, image player function etc.) etc.；Storage data area can store according to mobile phone use created data (such as
Audio data, phone directory etc.) etc..In addition, memory 409 may include high-speed random access memory, it can also include non-easy
The property lost memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 410 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part by running or execute the software program and/or module that are stored in memory 409, and calls and is stored in storage
Data in device 409 execute the various functions and processing data of mobile terminal, to carry out integral monitoring to mobile terminal.Place
Managing device 410 may include one or more processing units；Preferably, processor 410 can integrate application processor and modulatedemodulate is mediated
Manage device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is main
Processing wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 410.
Mobile terminal 400 can also include the power supply 411 (such as battery) powered to all parts, it is preferred that power supply 411
Can be logically contiguous by power-supply management system and processor 410, to realize management charging by power-supply management system, put
The functions such as electricity and power managed.
In addition, mobile terminal 400 includes some unshowned functional modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, including processor 410, and memory 409 is stored in
On memory 409 and the computer program that can run on the processor 410, the computer program are executed by processor 410
Each process of the above-mentioned method of servicing embodiment based on user speech of Shi Shixian, and identical technical effect can be reached, to keep away
Exempt to repeat, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine program, the computer program realize each of the above-mentioned method of servicing embodiment based on user speech when being executed by processor
Process, and identical technical effect can be reached, to avoid repeating, which is not described herein again.Wherein, the computer-readable storage
Medium, such as read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access
Memory, abbreviation RAM), magnetic or disk etc..
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, method, article or the device that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or device institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including being somebody's turn to do
There is also other identical elements in the process, method of element, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in a storage medium
In (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that a terminal (can be mobile phone, computer, service
Device, air conditioner or network equipment etc.) execute method described in each embodiment of the present invention.
The embodiment of the present invention is described with above attached drawing, but the invention is not limited to above-mentioned specific
Embodiment, the above mentioned embodiment is only schematical, rather than restrictive, those skilled in the art
Under the inspiration of the present invention, without breaking away from the scope protected by the purposes and claims of the present invention, it can also make very much
Form, all of these belong to the protection of the present invention.
Claims (10)
1. a kind of method of servicing based on user speech, which is characterized in that be applied to mobile terminal, which comprises
In voice call process, the key message of dialog context is extracted from the user speech of both call sides；
Show the key message；
Receive the object run triggering command for being directed to the key message；
The object run triggering command is responded, object run corresponding with the key message is executed.
2. the method according to claim 1, wherein the object run touching received for the key message
Send instructions, comprising:
The operational controls of the affiliated information category of the key message are shown according to operational order；
The object run triggering command is received by the operational controls.
3. according to the method described in claim 2, it is characterized in that, the response object run triggering command, execute with
The corresponding object run of the key message, comprising:
It opens and the associated default application program of the affiliated information category of the key message；
The object run is executed in the default application program.
4. according to the method described in claim 3, it is characterized in that, described execute the target in the default application program
Operation, comprising:
When the object run is search, the key message is searched in the default application program, and shows search knot
Fruit；Wherein, described search result includes contact information, the file information, film information, cuisines information, shopping information, chat note
At least one of record；
When the object run is record, the key message is recorded in the default application program；
When the object run is to remind, prompting message is set in the default application program, and believes according to the prompting
Breath reminds user, alerting pattern include pop-up show, indicator light flashing, vibration, at least one of jingle bell.
5. the method according to claim 1, wherein the response object run triggering command, execute with
The corresponding object run of the key message, comprising:
The key message is edited, the editor includes at least one of choosing, deleting, replicate.
6. a kind of service unit based on user speech, which is characterized in that be deployed in mobile terminal, described device includes:
Key message extraction module, for extracting dialog context from the user speech of both call sides in voice call process
Key message；
Key message display module, for showing the key message；
Command reception module, for receiving the object run triggering command for being directed to the key message；
Respond module executes object run corresponding with the key message for responding the object run triggering command.
7. device according to claim 6, which is characterized in that described instruction receiving module includes:
Operational controls display sub-module, for showing the operation control of the affiliated information category of the key message according to operational order
Part；
Command reception submodule, for receiving the object run triggering command by the operational controls.
8. device according to claim 7, which is characterized in that the respond module includes:
It presets application program and opens submodule, it is associated default using journey with the affiliated information category of the key message for opening
Sequence；
Implementation sub-module, for executing the object run in the default application program.
9. device according to claim 8, which is characterized in that the implementation sub-module includes:
Search unit, for searching for the key message in the default application program when the object run is search,
And show search result；Wherein, described search result includes contact information, the file information, film information, cuisines information, purchase
At least one of object information, chat record.
Recording unit, for recording the key message in the default application program when the object run is record；
Reminding unit, for prompting message, and root to be arranged in the default application program when the object run is to remind
Remind user according to the prompting message, alerting pattern include pop-up show, indicator light flashing, vibration, at least one of jingle bell.
10. device according to claim 6, which is characterized in that the respond module includes:
Edit submodule, for being edited to the key message, it is described editor include choose, delete, duplication at least
It is a kind of.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811291702.4A CN109167884A (en) | 2018-10-31 | 2018-10-31 | A kind of method of servicing and device based on user speech |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811291702.4A CN109167884A (en) | 2018-10-31 | 2018-10-31 | A kind of method of servicing and device based on user speech |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109167884A true CN109167884A (en) | 2019-01-08 |
Family
ID=64876514
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811291702.4A Pending CN109167884A (en) | 2018-10-31 | 2018-10-31 | A kind of method of servicing and device based on user speech |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109167884A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109994111A (en) * | 2019-02-26 | 2019-07-09 | 维沃移动通信有限公司 | A kind of exchange method, device and mobile terminal |
| CN110059263A (en) * | 2019-04-18 | 2019-07-26 | 大众问问(北京)信息科技有限公司 | Information cuing method, device and vehicle-mounted terminal equipment |
| CN110933225A (en) * | 2019-11-04 | 2020-03-27 | Oppo（重庆）智能科技有限公司 | Call information acquisition method and device, storage medium and electronic equipment |
| CN111773670A (en) * | 2020-07-10 | 2020-10-16 | 网易（杭州）网络有限公司 | Marking method, device, equipment and storage medium in game |
| CN113079247A (en) * | 2021-03-24 | 2021-07-06 | 广州三星通信技术研究有限公司 | Associated service providing method and associated service providing device |
| CN113299290A (en) * | 2021-04-06 | 2021-08-24 | 维沃移动通信有限公司 | Method and device for speech recognition, electronic equipment and readable storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103067579A (en) * | 2012-12-24 | 2013-04-24 | 广东欧珀移动通信有限公司 | Method and device assisting in on-line voice chat |
| CN103226548A (en) * | 2012-01-30 | 2013-07-31 | 北京四维图新科技股份有限公司 | Search service method, search service device and search service system for Internet map |
| CN103325031A (en) * | 2012-03-19 | 2013-09-25 | 联想(北京)有限公司 | Schedule reminding method and terminal |
| US8620658B2 (en) * | 2007-04-16 | 2013-12-31 | Sony Corporation | Voice chat system, information processing apparatus, speech recognition method, keyword data electrode detection method, and program for speech recognition |
| CN103873654A (en) * | 2012-12-13 | 2014-06-18 | 深圳富泰宏精密工业有限公司 | Call content analyzing and extracting system and method |
| CN104780278A (en) * | 2015-04-22 | 2015-07-15 | 努比亚技术有限公司 | Communication data-based route generation method and device |
| CN104796536A (en) * | 2015-03-17 | 2015-07-22 | 乐视致新电子科技（天津）有限公司 | Voice assisting method and device during communication |
| CN104980549A (en) * | 2015-06-12 | 2015-10-14 | 努比亚技术有限公司 | Information processing method and mobile terminal |
| CN105183778A (en) * | 2015-08-11 | 2015-12-23 | 百度在线网络技术（北京）有限公司 | Service providing method and apparatus |
| CN105635426A (en) * | 2014-11-28 | 2016-06-01 | 东莞宇龙通信科技有限公司 | Information prompting method and terminal |
| CN107995101A (en) * | 2017-11-30 | 2018-05-04 | 上海掌门科技有限公司 | A kind of method and apparatus for being used to switching to speech message into text message |
| CN108551520A (en) * | 2018-03-13 | 2018-09-18 | 努比亚技术有限公司 | A kind of phonetic search response method, equipment and computer readable storage medium |
-
2018
- 2018-10-31 CN CN201811291702.4A patent/CN109167884A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8620658B2 (en) * | 2007-04-16 | 2013-12-31 | Sony Corporation | Voice chat system, information processing apparatus, speech recognition method, keyword data electrode detection method, and program for speech recognition |
| CN103226548A (en) * | 2012-01-30 | 2013-07-31 | 北京四维图新科技股份有限公司 | Search service method, search service device and search service system for Internet map |
| CN103325031A (en) * | 2012-03-19 | 2013-09-25 | 联想(北京)有限公司 | Schedule reminding method and terminal |
| CN103873654A (en) * | 2012-12-13 | 2014-06-18 | 深圳富泰宏精密工业有限公司 | Call content analyzing and extracting system and method |
| CN103067579A (en) * | 2012-12-24 | 2013-04-24 | 广东欧珀移动通信有限公司 | Method and device assisting in on-line voice chat |
| CN105635426A (en) * | 2014-11-28 | 2016-06-01 | 东莞宇龙通信科技有限公司 | Information prompting method and terminal |
| CN104796536A (en) * | 2015-03-17 | 2015-07-22 | 乐视致新电子科技（天津）有限公司 | Voice assisting method and device during communication |
| CN104780278A (en) * | 2015-04-22 | 2015-07-15 | 努比亚技术有限公司 | Communication data-based route generation method and device |
| CN104980549A (en) * | 2015-06-12 | 2015-10-14 | 努比亚技术有限公司 | Information processing method and mobile terminal |
| CN105183778A (en) * | 2015-08-11 | 2015-12-23 | 百度在线网络技术（北京）有限公司 | Service providing method and apparatus |
| CN107995101A (en) * | 2017-11-30 | 2018-05-04 | 上海掌门科技有限公司 | A kind of method and apparatus for being used to switching to speech message into text message |
| CN108551520A (en) * | 2018-03-13 | 2018-09-18 | 努比亚技术有限公司 | A kind of phonetic search response method, equipment and computer readable storage medium |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109994111A (en) * | 2019-02-26 | 2019-07-09 | 维沃移动通信有限公司 | A kind of exchange method, device and mobile terminal |
| CN110059263A (en) * | 2019-04-18 | 2019-07-26 | 大众问问(北京)信息科技有限公司 | Information cuing method, device and vehicle-mounted terminal equipment |
| CN110059263B (en) * | 2019-04-18 | 2021-07-27 | 大众问问(北京)信息科技有限公司 | Information prompting method and device and vehicle-mounted terminal equipment |
| CN110933225A (en) * | 2019-11-04 | 2020-03-27 | Oppo（重庆）智能科技有限公司 | Call information acquisition method and device, storage medium and electronic equipment |
| CN110933225B (en) * | 2019-11-04 | 2022-03-15 | Oppo（重庆）智能科技有限公司 | Call information acquisition method and device, storage medium and electronic equipment |
| CN111773670A (en) * | 2020-07-10 | 2020-10-16 | 网易（杭州）网络有限公司 | Marking method, device, equipment and storage medium in game |
| CN113079247A (en) * | 2021-03-24 | 2021-07-06 | 广州三星通信技术研究有限公司 | Associated service providing method and associated service providing device |
| CN113299290A (en) * | 2021-04-06 | 2021-08-24 | 维沃移动通信有限公司 | Method and device for speech recognition, electronic equipment and readable storage medium |
| WO2022213986A1 (en) * | 2021-04-06 | 2022-10-13 | 维沃移动通信有限公司 | Voice recognition method and apparatus, electronic device, and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109167884A (en) | A kind of method of servicing and device based on user speech | |
| CN110321044A (en) | Sharing files method and terminal | |
| CN109032734A (en) | A kind of background application display methods and mobile terminal | |
| CN109408172A (en) | A kind of processing method and terminal device of application program | |
| CN109660728B (en) | Photographing method and device | |
| CN108089891A (en) | A kind of application program launching method, mobile terminal | |
| CN108334265B (en) | A kind of document handling method and mobile terminal | |
| CN108920239A (en) | A kind of long screenshotss method and mobile terminal | |
| CN110531904A (en) | A kind of background task display methods and terminal | |
| CN109491738A (en) | A kind of control method and terminal device of terminal device | |
| CN109743504A (en) | A kind of auxiliary photo-taking method, mobile terminal and storage medium | |
| CN107908705A (en) | A kind of information-pushing method, information push-delivery apparatus and mobile terminal | |
| CN108021397A (en) | A kind of schedule processing method, device and mobile terminal | |
| CN108989558A (en) | The method and device of terminal call | |
| CN108986026A (en) | A kind of picture joining method, terminal and computer readable storage medium | |
| CN110049185A (en) | Image processing method and terminal device | |
| CN110209332A (en) | A kind of information processing method and terminal device | |
| CN109151200A (en) | A kind of means of communication and mobile terminal | |
| CN109412932A (en) | A kind of screenshotss method and terminal | |
| CN110097872A (en) | A kind of audio-frequency processing method and electronic equipment | |
| CN110286980A (en) | A kind of schedule creation method and mobile terminal | |
| CN110379428A (en) | A kind of information processing method and terminal device | |
| CN110442279A (en) | A kind of message method and mobile terminal | |
| CN110096203A (en) | A kind of screenshot method and mobile terminal | |
| CN109584897A (en) | Vedio noise reduction method, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190108 |
|
| RJ01 | Rejection of invention patent application after publication |