Summary of the invention
Embodiments of the invention provide a kind of vehicle-mounted service method, system and method based on voice command control, have simplified the operating procedure that the user carries out vehicle-mounted service, have improved the user experience of vehicle-mounted service.This system has a vehicle-mounted mapping display device, as has the display unit of wireless receiving sending module, and it also can be the panel computer with LCDs.
This vehicle-mounted mapping display device can be by multiple wireless environment (including but not limited to WiFi, WiMax, bluetooth and other privately owned wireless protocols) and mobile phone association, can communicate to realize the communication protocol and the mobile phone that define by open or encrypting traffic.Has a control unit in the mobile phone, it is used for mobile phone screen information, audio-frequency information and data control information are mail to this vehicle-mounted mapping display device, the communication module of this vehicle-mounted mapping display device can be obtained these data by wireless network, and decode by predetermined communication protocol, mobile phone screen information can be shown in real time, handset audio stream is play and can obtain control information that mobile phone terminal sends responding, as equipment state control etc.Simultaneously, this vehicle-mounted mapping display device also has some buttons or touch-screen feedback areas, can also oppositely send control information to the mobile phone terminal of prior connection by wireless network by these buttons or this vehicle-mounted mapping display device of touch-screen feedback areas, to its sending controling instruction signal, the mobile phone end obtains these signals, and also can carry out state transformation by predefined communication control processor, the time-out during as play content, continuation, F.F., rewind down and control mobile phone are called out etc.This vehicle-mounted mapping display device can also install microphone additional, can be by microphone, and pass to mobile phone by wireless network with speaker's information gathering, and mobile phone can be handled it, as speech recognition, send to and specify remote equipment, voice call etc.
This vehicle-mounted mapping display device is mainly used in mobile phone is navigated, value-added services such as multimedia interactive information are shone upon, and reverse operating mobile phone, it has following advantage: (1) has avoided when driving complex operations to mobile phone (although should forbid mobile phone operation when driving or forbid other that all do not meet the action of safe driving, but can be inevitably in driving procedure occurring need be to the special circumstances of mobile phone operation), human pilot only need be operated accordingly this vehicle-mounted mapping display device and get final product, its all operation can be mapped in the mobile phone, because this vehicle-mounted mapping display device has the large scale display screen, make it easy to operate, reduce the probability of misoperation, realized that safety drives; (2) human pilot is in non-driving procedure, as under the people such as stop, situation such as in car, have a rest, can use this vehicle-mounted mapping display device carry out multiple operation as play, see a film, listen to the music, amusement online or handle corporate business, it is equivalent to a removable computer, carry out real-time communication in the external world by mobile phone, realized the strange land office; (3) accomplished a card active/standby devices application easily, realize the theory that a mobile phone just can " be got on the bus to automobile-used; get off to human ", after human pilot is got on the bus, only need be set to get final product by mobile phone with this vehicle-mounted mapping display unit connecting state, and mobile phone can be carried and needn't be fixed on the visual position of human pilot, only needs will this vehicle-mounted mapping display device to be fixed on human pilot and is convenient to the visual position of arriving and gets final product, as being adsorbed onto on the front windshield by vehicle frame.After getting off, human pilot just can directly leave after only need closing this connection status, and do not need SIM cards of mobile phones is repeatedly plugged from different equipment, thereby also prolonged useful life of SIM, and make human pilot use this system to become more simple and convenient.
For reaching above-mentioned target, embodiments of the invention adopt following technical scheme:
A kind of vehicle-mounted service system based on voice command control comprises one-touch control device, terminal equipment, cloud computing platform server, display device, it is characterized in that:
Described one-touch control device, be installed on the fixed part of vehicle, be used for after the user presses start key, connect by direct or short haul connection mode and terminal equipment, and drive described terminal equipment and the cloud computing platform server connects by direct or short haul connection mode;
Described terminal equipment after being used for connecting with described one-touch control device, is set up voice conversation by voice call switching network or multiple radio data network with the cloud computing platform server of network side and is connected; Receive first information of voice prompt that described cloud computing platform server sends, play this first information of voice prompt to the user, receive the voice command of the startup value-added service that described user sends according to described first information of voice prompt, and the voice command that will start value-added service sends to described cloud computing platform server; Receive the value-added service voice directive command that described user sends, and this value-added service voice directive command is sent to described cloud computing platform server; Receive the value-added service control information that described cloud computing platform server sends, start corresponding value-added service according to this value-added service control information, connect with the server that described value-added service is provided, obtain the value-added service data from this server, these value-added service data are sent to display unit by communication;
Described cloud computing platform server comprises the unspecified person sound identification module, and described cloud computing platform server is used for sending described first information of voice prompt to described terminal equipment, and described first information of voice prompt is used to indicate the user to import the value-added service type; Receive the voice command of the startup value-added service of described terminal equipment transmission, by described unspecified person sound identification module the voice command of described startup value-added service is resolved, obtain startup value-added service order, start value-added service order according to this and start corresponding value-added service; Receive the value-added service voice directive command that described terminal equipment sends, by described unspecified person sound identification module described value-added service voice directive command is resolved, obtain the relevant indication information of described value-added service, the indication information relevant according to described value-added service generates the value-added service control information; The mode that adopts note to issue or set up the mobile data passage sends to described terminal equipment with this value-added service control information;
Described display unit is used for establishing a communications link by communication and described terminal equipment, receives and show the value-added service data of described terminal equipment transmission.
A kind of vehicle-mounted method of servicing based on voice command control comprises:
Press the user after the start key of one-touch control device, described one-touch control device connects by direct or short haul connection mode and terminal equipment, wherein, described one-touch control device is arranged on the fixed part of vehicle, and described one-touch control device drives described terminal equipment by direct or short haul connection mode and the cloud computing platform server connects;
Described terminal equipment is set up voice conversation by voice call switching network or multiple radio data network with the cloud computing platform server of network side and is connected;
Described cloud computing platform server sends first information of voice prompt by described voice conversation connection to described terminal equipment, and described first information of voice prompt is used to indicate described user to import the value-added service type;
Described terminal equipment is play described first information of voice prompt to described user, receive the voice command of the startup value-added service that described user sends according to described first information of voice prompt, and the voice command that will start value-added service sends to described cloud computing platform server;
Described cloud computing platform server adopts the unspecified person speech recognition technology that the voice command of described startup value-added service is resolved, and obtains to start the value-added service order, starts the value-added service order according to this and starts corresponding value-added service;
Described terminal equipment receives the value-added service voice directive command that described user sends, and this value-added service voice directive command is sent to described cloud computing platform server;
Described cloud computing platform server adopts the unspecified person speech recognition technology that described value-added service voice directive command is resolved, obtain the relevant indication information of described value-added service, the indication information relevant according to described value-added service generates the value-added service control information, and the mode that adopts note to issue or set up the mobile data passage sends to described terminal equipment with this value-added service control information;
Described terminal equipment starts corresponding value-added service according to this value-added service control information, connect with the server that described value-added service is provided, obtain the value-added service data from this server, these value-added service data are sent to display unit by communication;
Described display unit shows the value-added service data that described terminal equipment sends.
Vehicle-mounted service system and method that the embodiment of the invention provides based on voice command control, the user only need press the start key of the one-touch control device on the fixed part of vehicle of setting, can connect by the cloud computing platform server of this one-touch control device terminal equipment and network side, obtain value-added service by the voice control mode, and these value-added service data are sent to display unit show, reached and simplified the operating procedure that the user carries out vehicle-mounted service, improved the purpose of the user experience of vehicle-mounted service, realized to carry out any manual operation more basically when driving, and only controlled by voice command.Because the cloud computing platform server can adopt the unspecified person speech recognition technology that the voice command that terminal equipment sends is resolved, make that the versatility of the technical scheme that the embodiment of the invention provides is better, be applicable to different phonetic, tone user's use, and it also is applicable to the identification of different dialects, as Guangdong language, the south of Fujian Province language etc., this system also is applicable to the identification of main flow foreign language simultaneously, as English, French, German, Japanese etc., and this system also has the function of the various different languages in the automatic voice command recognition, as in the statement voice command, having used Chinese simultaneously as the user and when English, this system can automatically identify Chinese in this voice command and English, and forms correct voice command.Therefore above-mentioned advantage makes this system further improve the user experience of vehicle-mounted service, makes the user of different regions use its dialect to operate this system, this for those mandarins not too the user of standard be particularly advantageous; Because this system can allow to use simultaneously in the user's voice order Chinese and English, this is very favorable for the higher white collar of those levels of cultures, the user who particularly possesses the multilingual ability to exchange for those, because they are mingled with English or Japanese etc. in the Chinese of being everlasting, the function of this automatic identification different language of system makes them not need to convert unfamiliar Japanese or English to corresponding Chinese order, greatly facilitate user's use, also improved the operating efficiency of this system simultaneously.Because the driver when driving, only need press a key, just can obtain value-added service by voice command control, and terminal equipment can show the value-added service data of obtaining by the display unit on the vehicle, make the driver not need the operation terminal device of taking sb's mind off sth, reduced danger on the run.Because this display device can be with the information mapping on the terminal equipment to this display device, make user/driver in rest or stop off, come terminal equipment is carried out any operation by this display device, making this system can be used as a removable computer uses, making the driver can loosen mood on the one hand recreates, simultaneously because this system has possessed function of surfing the Net, make the driver can get in touch by this system and the external world whenever and wherever possible, make that the driving road is no longer dull.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme in the embodiment of the invention is clearly and completely described, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that is obtained under the creative work prerequisite.
In order to solve the operating procedure complexity that the user carries out vehicle-mounted service, the problem of vehicle-mounted service experience difference, the embodiment of the invention provide a kind of vehicle-mounted service system and method based on voice command control.
As shown in Figure 1, the vehicle-mounted service system based on voice command control that the embodiment of the invention provides comprises: one-touch control device 101, terminal equipment 102, cloud computing platform server 103 and display unit 104;
Wherein, one-touch control device 101, be installed on the fixed part of vehicle, be used for after the user presses start key, connect by direct or short haul connection mode and terminal equipment 102, and drive terminal equipment 102 by direct or short haul connection mode and connect with cloud computing platform server 103;
Operate for the ease of the user, as preferred embodiment, the fixed part of vehicle is specially steering wheel, yet, in the use of reality, the present invention does not do qualification to the fixed part of vehicle, and the fixed part of vehicle can also not given unnecessary details for other are convenient to the parts that the user touches on the vehicle herein one by one.
In the present embodiment, terminal equipment can be mobile phone or PDA, and in the use of reality, terminal equipment can also can carry out radio communication for other, and obtains the equipment of value-added service from wireless carriers.
In the present embodiment, the short haul connection mode can be WiFi, WiMax, bluetooth, infrared and other privately owned wireless protocols.
Terminal equipment 102 after being used for connecting with one-touch control device 101, is set up voice conversation by voice call switching network or multiple radio data network with the cloud computing platform server 103 of network side and is connected; Receive first information of voice prompt that cloud computing platform server 103 sends, play this first information of voice prompt to the user, receive the voice command of the startup value-added service that the user sends according to first information of voice prompt, and the voice command that will start value-added service sends to cloud computing platform server 103; Receive the value-added service voice directive command that the user sends, and this value-added service voice directive command is sent to cloud computing platform server 103; Receive the value-added service control information that cloud computing platform server 103 sends, start corresponding value-added service according to this value-added service control information, connect with the server that described value-added service is provided, obtain the value-added service data from this server, these value-added service data are sent to display unit 104 by communication;
In the present embodiment, value-added service can include but not limited to navigation Service and look voice playing service etc.If value-added service is a navigation Service, value-added service voice directive command is specially the voice directive command of purpose navigation address; If value-added service is for looking the voice playing service, value-added service voice directive command is specially and comprises the voice directive command that purpose is looked audio description information, for example: the voice indication information that comprises song or video frequency program title, perhaps comprise the voice indication information of singer's name etc., do not give unnecessary details one by one herein.
Cloud computing platform server 103 comprises the unspecified person sound identification module, and cloud computing platform server 103 is used for sending first information of voice prompt to terminal equipment 102, and this first information of voice prompt is used to indicate the user to import the value-added service type; The voice command of the startup value-added service that receiving terminal apparatus 102 sends, by the unspecified person sound identification module voice command that starts value-added service is resolved, obtain startup value-added service order, start value-added service order according to this and start corresponding value-added service; The value-added service voice directive command that receiving terminal apparatus 102 sends, by the unspecified person sound identification module this value-added service voice directive command is resolved, obtain the relevant indication information of this value-added service, the indication information relevant according to described value-added service generates the value-added service control information; The mode that adopts note to issue or set up the mobile data passage sends to terminal equipment 102 with this value-added service control information.
Display unit 104 is used for establishing a communications link by communication and terminal equipment 102, receives the also value-added service data of display terminal's 102 transmissions.
For example: when value-added service is navigation Service, the navigation information (traffic route etc.) that display unit 104 receives and display terminal 102 obtains from navigation server; When value-added service for looking voice playing when service, the video image that display unit 104 receives and display terminal 102 obtains from video server perhaps receives and the lyrics of the song that display terminal 102 obtains from audio server etc.
In the present embodiment, display device 104 can be related with terminal equipment 102 by multiple wireless environment (including but not limited to WiFi, WiMax, bluetooth and other privately owned wireless protocols), and can communicate to realize the communication protocol and the terminal equipment 102 that define by open or encrypting traffic.
Further, in the present embodiment, store multiple wide spectrum phonetic feature storehouse on the cloud computing platform server 103 in advance, for example: the wide spectrum phonetic feature storehouse that is provided with according to place name, wide spectrum phonetic feature storehouse that is provided with according to the audio frequency and video title and the wide spectrum phonetic feature storehouse that is provided with according to name etc.The unspecified person sound identification module specifically is used for the voice command that starts value-added service is resolved, extract the first phonetic feature information, according to this first phonetic feature information searching, first wide spectrum phonetic feature storehouse, obtain the startup value-added service order corresponding with this first phonetic feature information; And, specifically be used for value-added service voice directive command is resolved, extract the second phonetic feature information,, obtain the value-added service relevant indication information corresponding with this second phonetic feature information according to this second phonetic feature information searching, second wide spectrum phonetic feature storehouse.
Wherein, have the first wide spectrum phonetic feature information corresponding in the described first wide spectrum phonetic feature storehouse, have the second wide spectrum phonetic feature information corresponding in the described second wide spectrum phonetic feature storehouse with the affiliated second phonetic feature information with the affiliated first phonetic feature information.
Wherein, the above-mentioned first and second phonetic feature information comprise spectrum distribution information, time domain waveform information, speech frame short-time spectrum, formant frequency and bandwidth, nasal sound associating feature, spectrum correlated characteristic, tonality feature, power spectrum, frame energy, voice intensity and the variation track feature lamp thereof of voice command, and the other first and second phonetic feature information also can be to use the one or more combination in the above-mentioned various features information.
For example: when value-added service is navigation Service, the unspecified person sound identification module is resolved the voice command that starts navigation Service, extract the first corresponding phonetic feature information (as spectrum distribution information etc.), according to the wide spectrum phonetic feature storehouse that this first phonetic feature information searching is provided with according to the starting command keyword, the startup navigation Service order of therefrom obtaining this first phonetic feature information correspondence; The unspecified person sound identification module is resolved the voice directive command of purpose navigation address, extract the second corresponding phonetic feature information (as spectrum distribution information etc.), according to the wide spectrum phonetic feature storehouse that place name is provided with, therefrom obtain the purpose navigation address of this second phonetic feature information correspondence according to this second phonetic feature information searching.
Wherein, further, the optimal way of above-mentioned navigation Service also can be: when the user selects the value-added service of this system to be navigation Service, the user sends voice command (as " I will navigate "), the unspecified person sound identification module is resolved the voice command (as " I will navigate ") that starts navigation Service, extract the first corresponding phonetic feature information (as the spectrum distribution information of this voice command " I will navigate " etc.), according to the wide spectrum phonetic feature storehouse of this first phonetic feature information searching that extracts according to the setting of starting command keyword, from this wide spectrum phonetic feature storehouse, obtain the startup navigation Service order (as " I will navigate ") of this first phonetic feature information correspondence, thereby further start corresponding navigation Service according to this voice command (as " I will navigate ") that identifies (promptly obtaining) according to the setting of starting command keyword; After navigation Service starts, the unspecified person sound identification module is resolved the voice directive command (as " HaiLong Building ") of purpose navigation address, extract the second phonetic feature information corresponding (as spectrum distribution information etc.) with this voice directive command (as " HaiLong Building "), according to the wide spectrum phonetic feature storehouse of this second phonetic feature information searching according to the place name setting, from this wide spectrum phonetic feature storehouse, obtain the place name (as " HaiLong Building ") of this second phonetic feature information correspondence, obtain the pairing navigation of this place name address (as the address at " HaiLong Building " place) according to this place name that identifies then according to the place name setting.
And for example: when value-added service is served for looking Audio on Demand, the voice command that the unspecified person sound identification module is looked the Audio on Demand service to startup is resolved, extract the first corresponding phonetic feature information (as spectrum distribution information etc.), according to the wide spectrum phonetic feature storehouse that this first phonetic feature information searching is provided with according to the starting command keyword, the startup navigation Service order of therefrom obtaining this first phonetic feature information correspondence; The unspecified person sound identification module is looked the voice directive command of audio description information and is resolved comprising purpose, extract the second corresponding phonetic feature information (as spectrum distribution information etc.), according to looking the wide spectrum phonetic feature storehouse of audio description information setting, therefrom obtain the audio description information of looking of this second phonetic feature information correspondence according to this second phonetic feature information searching.
Wherein, further, the above-mentioned optimal way of looking Audio on Demand service service also can be: when user-selected value-added service is served for looking Audio on Demand, the user sends (as " watching video ") behind the voice command, the voice command (as " watching video ") that the unspecified person sound identification module is looked the Audio on Demand service to startup is resolved, extract with this and look the first corresponding phonetic feature information of voice command (as " watching video ") that Audio on Demand serves (as spectrum distribution information etc.), according to the wide spectrum phonetic feature storehouse of this first phonetic feature information searching according to the setting of starting command keyword, from this wide spectrum phonetic feature storehouse, obtain the startup corresponding and look Audio on Demand service command (as " watching video "), thereby start the corresponding Audio on Demand service of looking with this first phonetic feature information according to the setting of starting command keyword; After looking Audio on Demand service startup, the unspecified person sound identification module is looked the voice directive command of audio description information (as " love of thornbuss ") and is resolved comprising purpose, extract the second phonetic feature information corresponding (as spectrum distribution information etc.) with this voice directive command (as " love of thornbuss "), look the wide spectrum phonetic feature storehouse of audio description information setting according to this second phonetic feature information searching basis, from this basis is looked the wide spectrum phonetic feature storehouse of audio description information setting, obtain the audio description information of looking (as " love of thornbuss ") of this second phonetic feature information correspondence, obtain information on services pairing (as the film " love of thornbuss " that can play) then with it.
Need to prove, the wide spectrum phonetic feature storehouse that present embodiment provides is by gathering the whole of China various places, various people and these people behind the sound of (different noise background) under the varying environment, the set of the wide spectrum phonetic feature that essence extracts, this wide spectrum phonetic feature storehouse only depends on the information in existing " phonetic feature storehouse ", and does not rely on someone's phonetic feature training result.Its advantage is: the selected sample in (1) this wide spectrum phonetic feature storehouse is extensive, comprises the people's of the different regions of country variant pronunciation in the world.For example, in China, chosen the almost people's in each area, province county and town pronunciation of the whole nation, and the people of national different regions is divided into several big classes, as North China, the Northeast, language area, the south of Fujian Province, Guangdong language area etc., the said mandarin of the people of these different regions has the local dialect, its feature has nothing in common with each other, after they are sorted out respectively, the people in the area that the local dialect pronunciation is similar substantially is classified as a class, has so both considered that the completeness of sample has also been taken into account the least possible redundant information of structure database generation; (2) sound under the varying environment (noise background) or voice command have been carried out extracting its phonetic feature information, as the voice command that starts the back to be produced in automobile engine, after opening, automobile window produces the voice command that wind-dryness and tire are made an uproar down and produced, the voice command that under other people such as chip in suddenly at disturbed condition, is produced, the voice command that behind tail-off, is produced etc.; (3) this wide spectrum phonetic feature storehouse comprises mandarin feature database and the local dialect feature database, and wherein the local dialect storehouse comprises the south of Fujian Province repertorie, Guangdong language storehouse, Shanghai native language storehouse etc.
Considered at least a under the above-mentioned at least multiple situation in the above-mentioned first and/or second phonetic feature information, as people's the situation of different regions or the situation under the varying environment etc. have been considered, be the phonetic feature information that sound or voice command extracted that the above-mentioned first and/or second phonetic feature information is based on the people of different regions, or the above-mentioned first and/or second phonetic feature information is based on the people's who is under the varying environment the phonetic feature information that sound or voice command extracted.Improved discrimination like this to the user of different regions or driver's voice command.
Further, this wide spectrum phonetic feature storehouse also comprises outer repertorie, wherein should have the external language librarys of main flow such as English storehouse, method repertorie, German storehouse, day repertorie in the outer repertorie.This system also has the automatic identification module of a feature database, and its voice command analysis that is used for that the user is sent is distinguished the pairing feature database of this voice command, and selects corresponding feature database automatically.Use the language of country variant to send voice command thereby make the user to mix, these language can mix use without screening in advance, and it is Chinese or foreign language on earth that the automatic identification module of this storehouse feature database can automatically identify this voice command.
By the above-mentioned advantage of wide spectrum phonetic feature lab setting in above-mentioned cloud computing platform server of setting up is, reduced dependence to the system of terminal equipment, the collecting device of terminal equipment in face of the speaker being used as a kind of sound or voice command, the transfer of data of the sound that collects or voice command is gone identification to background server group such as cloud computing platform server, the high-performance identification that so both can bring into play under the multiserver aggregated structure is calculated, simultaneously also can use above-mentioned large-scale phonetic feature storehouse, and not need terminal equipment to possess speech recognition capabilities.
In the present embodiment, can identify 95% voice messaging by the unspecified person sound identification module, identify user's voice information in order to guarantee 100%, further improve the user experience of vehicle-mounted service, alternatively, as shown in Figure 1, cloud computing platform server 103 can also comprise unspecified person speech recognition operator attendance module, this unspecified person speech recognition operator attendance module, the unspecified person sound identification module is used for when can't be discerned the voice command that starts value-added service, voice command to this startup value-added service is discerned, obtain corresponding startup value-added service order, and/or, be used for when the unspecified person sound identification module can't be discerned value-added service voice directive command, this value-added service voice directive command is discerned, obtained the relevant indication information of described value-added service.
The vehicle-mounted service system that the embodiment of the invention provides based on voice command control, the user only need press the start key of the one-touch control device on the fixed part of vehicle of setting, can connect by the cloud computing platform server of this one-touch control device terminal equipment and network side, obtain value-added service by the voice control mode, and these value-added service data are sent to display unit show, reached and simplified the operating procedure that the user carries out vehicle-mounted service, improved the purpose of the user experience of vehicle-mounted service.Because the cloud computing platform server can be resolved the voice command that terminal equipment sends by the unspecified person sound identification module, make that the versatility of the technical scheme that the embodiment of the invention provides is better, be applicable to different regions, user with different phonetic, the local dialect uses, and has further improved the user experience of vehicle-mounted service.Because the driver when driving, only need press a key, just can obtain value-added service by voice command control, and terminal equipment can show the value-added service data of obtaining by the display unit on the vehicle, make the driver not need the operation terminal device of taking sb's mind off sth, reduced danger on the run.
Another embodiment of the present invention also provides a kind of vehicle-mounted service system based on voice command control, this system is basic identical with the vehicle-mounted service system based on voice command control as shown in Figure 1, its difference is, the vehicle-mounted service system that present embodiment provides based on voice command control, cloud computing platform server 103, can also be used for connecting to terminal equipment 102 transmissions second information of voice prompt by voice conversation, this second information of voice prompt is used to indicate the user to import value-added service voice directive command; Terminal equipment 102 can also be used for playing second information of voice prompt to the user.
The vehicle-mounted service system that the embodiment of the invention provides based on voice command control, the user only need press the start key of the one-touch control device on the fixed part of vehicle of setting, can connect by the cloud computing platform server of this one-touch control device terminal equipment and network side, obtain value-added service by the voice control mode, and these value-added service data are sent to display unit show, reached and simplified the operating procedure that the user carries out vehicle-mounted service, improved the purpose of the user experience of vehicle-mounted service.Because the cloud computing platform server can be resolved the voice command that terminal equipment sends by the unspecified person sound identification module, make that the versatility of the technical scheme that the embodiment of the invention provides is better, be applicable to different regions, user with different phonetic, tone uses, and has further improved the user experience of vehicle-mounted service.Because the driver when driving, only need press a key, just can obtain value-added service by voice command control, and terminal equipment can show the value-added service data of obtaining by the display unit on the vehicle, make the driver not need the operation terminal device of taking sb's mind off sth, reduced danger on the run.Further, because the cloud computing platform server sends second information of voice prompt by terminal equipment to the user, make the user to send value-added service voice directive command according to this second information of voice prompt, avoided causing the cloud computing platform server info to handle mistake owing to communication failure (causing the cloud computing platform server not receive the voice command of the startup value-added service of user's transmission) occurring as channel block, whole problem of paralysing based on the vehicle-mounted service system of voice command control, and then improved reliability based on the vehicle-mounted service system of voice command control, ensured the user experience of vehicle-mounted service.
Further embodiment of this invention also provides a kind of vehicle-mounted service system based on voice command control, this system is basic identical with the vehicle-mounted service system based on voice command control as shown in Figure 1, its difference is, the vehicle-mounted service system that present embodiment provides based on voice command control, cloud computing platform server 103 can also be used for terminal equipment 102 is verified, the cloud computing platform server will resulting startup value-added service from terminal equipment voice command feed back to the user again, and point out the user to confirm, after the positive reply that obtains the user, just carry out the voice command of this transmission; Behind the negative reply that obtains the user, the cloud computing platform server resends this voice command, and when carrying out still can not get user's positive reply after the limited number of time circulation, this system turns to unspecified person speech recognition operator attendance module, uses this operator attendance module that the voice command of this startup value-added service is discerned.The circulation of this limited number of time can be 1 time or more times.
The vehicle-mounted service system that the embodiment of the invention provides based on voice command control, simplifying user's operation, improve on the user experience basis of vehicle-mounted service, further can verify, thereby guarantee fail safe and reliability based on the vehicle-mounted service system of voice command control to terminal equipment.
Yet another embodiment of the invention also provides a kind of vehicle-mounted service system based on voice command control, this system is basic identical with the vehicle-mounted service system based on voice command control as shown in Figure 1, and its difference is: terminal equipment 102 can also be used for the operating state of display unit 104 is connected and controlling its information demonstration etc. by communication.
Further, display unit 104 can comprise key area and/or touch-screen feedback areas, described display unit 104 can also be used for receiving by key area and/or touch-screen feedback areas user's operational order, this operational order is sent to terminal equipment 102, and the value-added service that reception and display terminal 102 send is new data more; Terminal equipment 102, can also be used for the operational order that receiving and displaying device 102 sends, obtain more new data of value-added service according to this operational order from the server that provides value added service, more new data or this terminal equipment send to display unit 104 in real time according to this realtime graphic that more new data upgraded with this value-added service.
For example: when value-added service is the video playback service, when the value-added service data are video stream data, display unit 104 can receive F.F. or the fast reverse operation instruction that the user sends from crossing key area and/or touch-screen feedback areas, this operational order is sent to terminal equipment 102, terminal equipment 102 obtains F.F. or the later video stream data of rewind down time point according to this operational order to video server, and this video stream data is sent to display unit 104 shows.
The vehicle-mounted service system that yet another embodiment of the invention provides based on voice command control, on the beneficial effect basis that scheme shown in Figure 1 reaches, can carry out interoperability between display unit and the terminal equipment, thereby it is more simple and convenient to make that the user carries out the operation of vehicle-mounted service, improve the user and carried out the experience of vehicle-mounted service, and, further ensured driver's traffic safety owing to simplified vehicle-mounted service operations.
As shown in Figure 2, the embodiment of the invention also provides a kind of vehicle-mounted method of servicing based on voice command control, it is characterized in that, comprising:
201, after the user presses the start key of one-touch control device, one-touch control device connects by direct or short haul connection mode and terminal equipment, wherein, one-touch control device is arranged on the fixed part of vehicle, and one-touch control device drives terminal equipment by direct or short haul connection mode and the cloud computing platform server connects.
Operate for the ease of the user, as preferred embodiment, the fixed part of vehicle is specially steering wheel, yet, in the use of reality, the present invention does not do qualification to the fixed part of vehicle, and the fixed part of vehicle can also not given unnecessary details for other are convenient to the parts that the user touches on the vehicle herein one by one.
In the present embodiment, terminal equipment can be mobile phone or PDA, and in the use of reality, terminal equipment can also can carry out radio communication for other, and obtains the equipment of value-added service from wireless carriers.
In the present embodiment, the short haul connection mode can be WiFi, WiMax, bluetooth, infrared and other privately owned wireless protocols.
202, terminal equipment is set up voice conversation by voice call switching network or multiple radio data network with the cloud computing platform server of network side and is connected.
203, the cloud computing platform server sends first information of voice prompt by the voice conversation connection to terminal equipment, and described first information of voice prompt is used to indicate the user to import the value-added service type.
In the present embodiment, value-added service type can include but not limited to: navigation Service and look voice playing service etc.
204, terminal equipment is play first information of voice prompt to the user, receives the voice command of the startup value-added service that the user sends according to first information of voice prompt, and the voice command that will start value-added service sends to the cloud computing platform server.
205, the cloud computing platform server adopts the unspecified person speech recognition technology that the voice command that starts value-added service is resolved, and obtains to start the value-added service order, starts the value-added service order according to this and starts corresponding value-added service.
Particularly, as shown in Figure 3,205 can comprise:
2051, the cloud computing platform server is resolved the voice command of described startup value-added service, extracts the first phonetic feature information;
2052, the cloud computing platform server obtains the startup value-added service order corresponding with the described first phonetic feature information according to the first phonetic feature information searching, the first wide spectrum phonetic feature storehouse from the first wide spectrum phonetic feature storehouse.
206, terminal equipment receives the value-added service voice directive command that the user sends, and this value-added service voice directive command is sent to the cloud computing platform server.
In the present embodiment, if value-added service is a navigation Service, value-added service voice directive command is specially the voice directive command of purpose navigation address; If value-added service is for looking the voice playing service, value-added service voice directive command is specially and comprises the voice directive command that purpose is looked audio description information, for example: the voice indication information that comprises song or video frequency program title, perhaps comprise the voice indication information of singer's name etc., do not give unnecessary details one by one herein.
207, the cloud computing platform server adopts the unspecified person speech recognition technology that value-added service voice directive command is resolved, obtain the relevant indication information of value-added service, the indication information relevant according to described value-added service generates the value-added service control information, and the mode that adopts note to issue or set up the mobile data passage sends to described terminal equipment with this value-added service control information.
The cloud computing platform server adopts the unspecified person speech recognition technology that value-added service voice directive command is resolved in this step, the step of obtaining the relevant indication information of value-added service can comprise: the cloud computing platform server is resolved value-added service voice directive command, extract the second phonetic feature information, according to the second phonetic feature information searching, the second wide spectrum phonetic feature storehouse, from this second wide spectrum phonetic feature storehouse, obtain the value-added service relevant indication information corresponding with the described second phonetic feature information.
Wherein, the above-mentioned first and second phonetic feature information comprise spectrum distribution information, time domain waveform information, speech frame short-time spectrum, formant frequency and bandwidth, nasal sound associating feature, spectrum correlated characteristic, tonality feature, power spectrum, frame energy, voice intensity and the variation track feature lamp thereof of voice command, and the other first and second phonetic feature information also can be to use the one or more combination in the above-mentioned various features information.
208, terminal equipment starts corresponding value-added service according to this value-added service control information, connect with the server that provides value added service, obtain the value-added service data from this server, these value-added service data are sent to display unit by communication.
209, the value-added service data of display unit display terminal transmission.
Need to prove, the wide spectrum phonetic feature storehouse that present embodiment provides is by gathering the whole of China various places, various people and these people behind the sound of (different noise background) under the varying environment, the set of the wide spectrum phonetic feature that essence extracts, this wide spectrum phonetic feature storehouse only depends on the information in existing " phonetic feature storehouse ", and does not rely on someone's phonetic feature training result.
Its advantage is: the selected sample in (1) this wide spectrum phonetic feature storehouse is extensive, comprises the people's of the different regions of country variant pronunciation in the world.For example, in China, chosen the almost people's in each area, province county and town pronunciation of the whole nation, and the people of national different regions is divided into several big classes, as North China, the Northeast, language area, the south of Fujian Province, Guangdong language area etc., the said mandarin of the people of these different regions has the local dialect, its feature has nothing in common with each other, after they are sorted out respectively, the people in the area that the local dialect pronunciation is similar substantially is classified as a class, has so both considered that the completeness of sample has also been taken into account the least possible redundant information of structure database generation; (2) sound under the varying environment (noise background) or voice command have been carried out extracting its phonetic feature information, as the voice command that starts the back to be produced in automobile engine, after opening, automobile window produces the voice command that wind-dryness and tire are made an uproar down and produced, the voice command that under other people such as chip in suddenly at disturbed condition, is produced, the voice command that behind tail-off, is produced etc.; (3) this wide spectrum phonetic feature storehouse comprises mandarin feature database and the local dialect feature database, and wherein the local dialect storehouse comprises the south of Fujian Province repertorie, Guangdong language storehouse, Shanghai native language storehouse etc.
Further, this wide spectrum phonetic feature storehouse also comprises outer repertorie, wherein should have the external language librarys of main flow such as English storehouse, method repertorie, German storehouse, day repertorie in the outer repertorie.This system also has the automatic identification module of a feature database, and its voice command analysis that is used for that the user is sent is distinguished the pairing feature database of this voice command, and selects corresponding feature database automatically.Use the language of country variant to send voice command thereby make the user to mix, these language can mix use without screening in advance, and it is Chinese or foreign language on earth that the automatic identification module of this storehouse feature database can automatically identify this voice command.
Considered at least a under the above-mentioned at least multiple situation in the above-mentioned first and/or second phonetic feature information, as people's the situation of different regions or the situation under the varying environment etc. have been considered, be the phonetic feature information that sound or voice command extracted that the above-mentioned first and/or second phonetic feature information is based on the people of different regions, or the above-mentioned first and/or second phonetic feature information is based on the people's who is under the varying environment the phonetic feature information that sound or voice command extracted.Improved discrimination like this to the user of different regions or driver's voice command.
In the present embodiment, can identify 95% voice messaging by the unspecified person speech recognition technology, identify user's voice information in order to guarantee 100%, further improve the user experience of vehicle-mounted service, alternatively, the vehicle-mounted method of servicing based on voice command control that the embodiment of the invention provides can also comprise:
When the cloud computing platform server can't be discerned the voice command of described startup value-added service by the unspecified person speech recognition technology, the cloud computing platform server is discerned the voice command of this startup value-added service by unspecified person speech recognition operator attendance module, obtain corresponding startup value-added service order, and/or
When the cloud computing platform server can't be discerned value-added service voice directive command by the unspecified person speech recognition technology, the cloud computing platform server is discerned this value-added service voice directive command by unspecified person speech recognition operator attendance module, obtains the relevant indication information of value-added service.
The vehicle-mounted service system based on voice command control that the vehicle-mounted method of servicing specific implementation based on voice command control that the embodiment of the invention provides can provide referring to the embodiment of the invention as shown in Figure 1 is described, repeats no more herein.
The vehicle-mounted method of servicing that the embodiment of the invention provides based on voice command control, the user only need press the start key of the one-touch control device on the fixed part of vehicle of setting, can connect by the cloud computing platform server of this one-touch control device terminal equipment and network side, obtain value-added service by the voice control mode, and these value-added service data are sent to display unit show, reached and simplified the operating procedure that the user carries out vehicle-mounted service, improved the purpose of the user experience of vehicle-mounted service.Because the cloud computing platform server can be resolved the voice command that terminal equipment sends by the unspecified person sound identification module, make that the versatility of the technical scheme that the embodiment of the invention provides is better, be applicable to different regions, user with different phonetic, tone uses, and has further improved the user experience of vehicle-mounted service.Because the driver when driving, only need press a key, just can obtain value-added service by voice command control, and terminal equipment can show the value-added service data of obtaining by the display unit on the vehicle, make the driver not need the operation terminal device of taking sb's mind off sth, reduced danger on the run.
Another embodiment of the present invention also provides a kind of vehicle-mounted method of servicing based on voice command control, and this method is basic identical with the vehicle-mounted method of servicing based on voice command control as shown in Figure 2, and its difference is, as shown in Figure 4, after 205, before 206, can also comprise:
210, the cloud computing platform server sends second information of voice prompt by the described terminal equipment of voice conversation link box, and second information of voice prompt is used to indicate described user to import value-added service voice directive command;
211, terminal equipment is play described second information of voice prompt to the user.
The vehicle-mounted method of servicing that the embodiment of the invention provides based on voice command control, the user only need press the start key of the one-touch control device on the fixed part of vehicle of setting, can connect by the cloud computing platform server of this one-touch control device terminal equipment and network side, obtain value-added service by the voice control mode, and these value-added service data are sent to display unit show, reached and simplified the operating procedure that the user carries out vehicle-mounted service, improved the purpose of the user experience of vehicle-mounted service.Because the cloud computing platform server can be resolved the voice command that terminal equipment sends by the unspecified person sound identification module, make that the versatility of the technical scheme that the embodiment of the invention provides is better, be applicable to different regions, user with different phonetic, tone uses, and has further improved the user experience of vehicle-mounted service.Because the driver when driving, only need press a key, just can obtain value-added service by voice command control, and terminal equipment can show the value-added service data of obtaining by the display unit on the vehicle, make the driver not need the operation terminal device of taking sb's mind off sth, reduced danger on the run.Further, because the cloud computing platform server sends second information of voice prompt by terminal equipment to the user, make the user to send value-added service voice directive command according to this second information of voice prompt, avoided causing the cloud computing platform server info to handle mistake owing to communication failure (causing the cloud computing platform server not receive the voice command of the startup value-added service of user's transmission) occurring as channel block, whole problem of paralysing based on the vehicle-mounted service system of voice command control, and then improved reliability based on the vehicle-mounted service system of voice command control, ensured the user experience of vehicle-mounted service.
Further embodiment of this invention also provides a kind of vehicle-mounted method of servicing based on voice command control, this method is basic identical with the vehicle-mounted method of servicing based on voice command control as shown in Figure 2, its difference is, after 202, before 203, can also comprise: the cloud computing platform server is verified described terminal equipment.Then this moment, 203 are: when checking was passed through, the cloud computing platform server sent first information of voice prompt by the voice conversation connection to described terminal equipment.
The vehicle-mounted method of servicing that the embodiment of the invention provides based on voice command control, simplifying user's operation, improve on the user experience basis of vehicle-mounted service, further can verify, thereby guarantee fail safe and reliability based on the vehicle-mounted method of servicing of voice command control to terminal equipment.
Yet another embodiment of the invention also provides a kind of vehicle-mounted method of servicing based on voice command control, this method is basic identical with the vehicle-mounted method of servicing based on voice command control as shown in Figure 2, and its difference is: the vehicle-mounted method of servicing based on voice command control that present embodiment provides can also comprise: the step that terminal equipment is controlled the operating state of display unit by communication.
Further, the vehicle-mounted method of servicing based on voice command control that present embodiment provides also comprises: display unit sends to described terminal equipment by key area and/or touch-screen feedback areas reception user's operational order with this operational order; Terminal equipment obtains more new data of value-added service according to described operational order from the server that described value-added service is provided, and more new data or this terminal equipment send to described display unit in real time according to this realtime graphic that more new data upgraded with this value-added service; And display unit shows the more step of new data of described value-added service.
The vehicle-mounted method of servicing that yet another embodiment of the invention provides based on voice command control, on the beneficial effect basis that scheme shown in Figure 2 reaches, can carry out interoperability between display unit and the terminal equipment, thereby it is more simple and convenient to make that the user carries out the operation of vehicle-mounted service, improve the user and carried out the experience of vehicle-mounted service, and, further ensured driver's traffic safety owing to simplified vehicle-mounted service operations.
Vehicle-mounted service system and method based on voice command control that the embodiment of the invention provides can be applied in the vehicles such as automobile, realize obtaining when driving the purpose of vehicle-mounted service.
Through the above description of the embodiments, the those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential common hardware, can certainly pass through hardware, but the former is better execution mode under a lot of situation.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in the storage medium that can read, floppy disk as computer, hard disk or CD etc., comprise some instructions with so that computer equipment (can be personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
The above; only be the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, anyly is familiar with those skilled in the art in the technical scope that the present invention discloses; can expect easily changing or replacing, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion by described protection range with claim.