CN107107846B - For providing system, device, the method and computer program product of information via vehicle - Google Patents

For providing system, device, the method and computer program product of information via vehicle Download PDF

Info

Publication number
CN107107846B
CN107107846B CN201580073006.4A CN201580073006A CN107107846B CN 107107846 B CN107107846 B CN 107107846B CN 201580073006 A CN201580073006 A CN 201580073006A CN 107107846 B CN107107846 B CN 107107846B
Authority
CN
China
Prior art keywords
user
vehicle
processor
information
output equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201580073006.4A
Other languages
Chinese (zh)
Other versions
CN107107846A (en
Inventor
S·格兰措
周碧云
H·Y·云
W·江
赖胜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bayerische Motoren Werke AG
Original Assignee
Bayerische Motoren Werke AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bayerische Motoren Werke AG filed Critical Bayerische Motoren Werke AG
Publication of CN107107846A publication Critical patent/CN107107846A/en
Application granted granted Critical
Publication of CN107107846B publication Critical patent/CN107107846B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3605Destination input or retrieval
    • G01C21/3608Destination input or retrieval using speech input, e.g. using speech recognition
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3629Guidance using speech or audio output, e.g. text-to-speech
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
    • B60R16/0373Voice control

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Computational Linguistics (AREA)
  • Navigation (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A kind of system, device, method and computer program product for via vehicle offer information.System for providing information via vehicle includes: speech interface, is configured to user's input voice information from outside vehicle;Processor is configured to receive voice messaging from speech interface, speech recognition is executed to the voice messaging that receives and the result based on speech recognition obtains result information;And output equipment, it is configured to export result information to the user of outside vehicle, wherein processor is connected to both output equipment and speech interface.For example, result information can be shown to the user of outside vehicle by display, result information can also be said by loudspeaker to the user of outside vehicle.

Description

For providing system, device, the method and computer program product of information via vehicle
Technical field
Present invention relates generally to the fields via vehicle offer information, and are more particularly related to mention via vehicle For the system of information, device, method and computer program product.
Background technique
In recent years, speech recognition and speech control system increased popularity.Speech recognition and speech control system are understood that The verbal commands of user control different functions.In addition, speech recognition and speech control system can also be subject in the car It utilizes, to control the different vehicle equipment such as radio, CD, omniselector with verbal commands.In addition, speech recognition and Speech control system is understood that the synonym of verbal commands.For example, speech recognition and speech control system are understood that spoken language Order " amplification (zoom in) " and verbal order " increasing (Enlarge) ".In addition, speech recognition and speech control system can To allow user that speech recognition is individually fitted to the specific sound and/or intonation of user.
Now, more and more people obtain using the portable terminal of such as smart phone or tablet computer and browse letter Breath.In addition, in order to easily customize the appearance of vehicle, it has been suggested that in the disposed outside display of vehicle, to show such as The various graph datas of customized " skin " etc.Portable terminal can be used to download customized " skin " in user, And then customized " skin " of acquisition is transferred on the display for being arranged in outside vehicle, to change the outer of vehicle It sees.
Summary of the invention
But in the prior art, speech recognition and speech control system are typically mounted in vehicle, and are therefore only had When user enters and is located in vehicle, speech recognition and speech control system is just can be used in user.Therefore, when user is located at When outside vehicle, he/her may not be able to use speech recognition and speech control system in vehicle.
In addition, in the prior art, the display for being arranged in outside vehicle is only used for showing customized " skin ", so as to Change the appearance of vehicle.But it cannot be interacted with user, and therefore cannot provide a user useful information.
Although portable terminal usually has in addition, user can obtain via portable terminal and browse information Much smaller display, therefore user has poor general survey to the information presented.
It is an aspect of the invention to provide can solve one or more of above and other prior art problem to ask Topic, for via vehicle provide information system, device, method and computer program product.
An exemplary embodiment of the present invention is provided for providing the system of information via vehicle, comprising: voice connects Mouthful, it is configured to user's input voice information from outside vehicle;Processor is configured to receive voice letter from speech interface Breath executes speech recognition and the result acquisition result information based on speech recognition to the voice messaging received;And output Equipment is configured to export result information to the user of outside vehicle, and wherein processor is connected to output equipment and speech interface The two.
In the example of the present embodiment, output equipment includes at least one of display and loudspeaker.
In the example of the present embodiment, display is configured to towards outside vehicle.
In the example of the present embodiment, display is transparent display.
In another example of the present embodiment, speech interface includes at least one microphone.
In another example of the present embodiment, processor is additionally configured to be waken up by voice messaging.
In another example of the present embodiment, input voice information includes user query, and result information includes using All relevant informations of family inquiry.
In another example of the present embodiment, user query include the inquiry about point of interest, and relevant information packet Include at least one of cartographic information relevant to point of interest, route information and menu item.
In another example of the present embodiment, processor is additionally configured to the current location based on user and between point of interest Distance recommend to be walking or by bus to point of interest to user.
In another example of the present embodiment, processor is further configured such that the headlight of vehicle is flashed as to user's Response.
In another example of the present embodiment, processor is additionally configured to downloading to result information into the portable terminal of user End.
Another exemplary embodiment in accordance with the present invention is provided including the system according to any one of aforementioned Vehicle.
Another exemplary embodiment in accordance with the present invention provides and provides the method for information, the method via vehicle It include: to receive voice messaging from speech interface by processor, wherein speech interface is configured to input language from the user of outside vehicle Message breath;Speech recognition is executed to the voice messaging received by processor;It is obtained by processor based on the result of speech recognition Result information;And result information is exported from output equipment to the user of outside vehicle, wherein processor is connected to output equipment Both with speech interface.
Another exemplary embodiment in accordance with the present invention provides and provides the device of information via vehicle, comprising: receives Unit, for receiving voice messaging from speech interface by processor, wherein speech interface is configured to defeated from the user of outside vehicle Enter voice messaging;Execution unit, for executing speech recognition to the voice messaging received by processor;Acquiring unit is used for Result information is obtained based on the result of speech recognition by processor;And output unit, for from output equipment to outside vehicle User export result information, wherein processor is connected to both display and speech interface.
Another exemplary embodiment in accordance with the present invention is provided for providing the computer program of information via vehicle Product, the computer program product include the computer readable storage medium with the program instruction wherein realized, wherein institute Stating program instruction can be read by processor, so that the processor executes a kind of method, which comprises connect from speech interface Voice messaging is received, wherein speech interface is configured to user's input voice information from outside vehicle;To the voice messaging received Execute speech recognition;The result information that result based on speech recognition obtains;And from output equipment to the user of outside vehicle Result information is exported, wherein processor is connected to both output equipment and speech interface.
Another exemplary embodiment in accordance with the present invention is provided for providing the device of information via vehicle, described Device includes: the memory for storing program instruction;And be configured to execute the processor of described program instruction, wherein when the journey When sequence instruction is executed by the processor, described program instruction executes described device: voice messaging is received from speech interface, Middle speech interface is configured to user's input voice information from outside vehicle;Speech recognition is executed to the voice messaging received; Result based on speech recognition obtains result information;And result information is exported from output equipment to the user of outside vehicle, Middle processor is connected to both output equipment and speech interface.
The present invention can be interacted with the user of outside vehicle, and provide information to the user of outside vehicle, and therefore More conveniences can be brought for user.
From detailed description given below, other scope of applications of the invention be will become obvious.It is to be understood, however, that Although detailed description and specific examples indicate the preferred embodiment of the present invention, their modes as just explanation It provides, because from the following detailed description, various changes and modifications within the spirit and scope of the present invention are for this field skill Art personnel will become obvious.
Detailed description of the invention
From the detailed description below in conjunction with the exemplary embodiment of attached drawing, the above and other aspect of the invention and advantage It will become obvious, wherein attached drawing is shown as example the principle of the present invention.
Fig. 1 shows the signal of the system for providing information via vehicle of an exemplary embodiment according to the present invention Figure;
Fig. 2 shows the frames of the system for providing information via vehicle of an exemplary embodiment according to the present invention Figure;
Fig. 3 shows the flow chart of the method that information is provided via vehicle of an exemplary embodiment according to the present invention;
Fig. 4 shows the frame of the device for providing information via vehicle of an exemplary embodiment according to the present invention Figure;And
Fig. 5 is to show can executing for an exemplary embodiment according to the present invention to provide the method for information via vehicle Calculating equipment hardware configuration block diagram.
Specific embodiment
In the following detailed description, numerous specific details are set forth to provide to the thorough of described exemplary embodiment Understand.But for those skilled in the art it will be obvious that, can be in some or all of these details In the case of practice described embodiment.In other exemplary embodiments of the invention, well-known structure or processing are not described in detail Step, to avoid idea of the invention is unnecessarily obscured.
Referring initially to Fig. 1, be shown an exemplary embodiment according to the present invention for being provided via vehicle The schematic diagram of the system of information.
As shown in Figure 1,1002 station of user is in the outside of vehicle 1000.Vehicle 1000 includes an example according to the present invention Property embodiment for via vehicle provide information system.User 1002 can be with such as " hello!(Hello!) " etc Voice messaging wakes up the system being integrated in vehicle 1000.When receiving and identifying from the voice messaging of user 1002, Operating status can be entered by being integrated in system in vehicle 1000, and with such as " what I can do for you? " etc response Information is greeted to user 1001.Then, user 1002 can be with the system interaction that is integrated in vehicle 1000.For example, user 1002 can be with voice messaging to the system input inquiry being integrated in vehicle 1000, and in response to input voice information, collection Result information can be obtained at the system in vehicle 1000 and result information is supplied to user.
In addition, between the system in addition to being integrated in vehicle 1000 and user 1002 via the interaction of voice other than, user 1002 can also be via the system interaction other interactive modes such as touch, gesture and be integrated in vehicle 1000.Namely It says, user 1002 not only via voice but also via other interactive modes such as touch, gesture and can be integrated in vehicle System interaction in 1000.In this way, various interactive modes will bring more conveniences for user 1002.
In addition, in addition to via display by the result information for the system being integrated in vehicle 1000 be supplied to user 1002 it Outside, the system being integrated in vehicle 1000 can also will be tied via other presentation modes such as voice outputs (such as loudspeaker) Fruit information is supplied to user 1002.That is, the system being integrated in vehicle 1002 not only can be via display but also can Result information is supplied to user 1002 via other presentation modes such as voice outputs (such as loudspeaker).With this side The various presentation modes of formula, result information will bring more conveniences for user 1002.
Herein, vehicle 1000 can be car rental.For example, vehicle 1000, which can be, has " Car sharing (DRIVENOW) " car rental serviced.Alternatively, vehicle 1000 is also possible to private vehicle.In this case, if The owner of private vehicle allows other users to interact with private vehicle and obtains information via private vehicle, then private vehicle The owner can be awarded.
In such an embodiment, when 1002 station of user is at the outside of vehicle 1000, the system being integrated in vehicle 1000 It can be interacted with the user of outside vehicle, and provide information to the user of outside vehicle, and therefore can brought more for user More conveniences.
Hereinafter, being used for via vehicle an of exemplary embodiment according to the present invention is described in detail in reference Fig. 2 The configuration of the system of information is provided.Fig. 2 shows an exemplary embodiments according to the present invention for providing letter via vehicle The block diagram of the system of breath.
As shown in Fig. 2, an exemplary embodiment according to the present invention is used to provide the system of information via vehicle 2000 may include speech interface 2002, output equipment 2004 and processor 2006.Processor 2006 may be coupled to voice and connect Both mouth 2002 and output equipment 2004.
Speech interface 2002 in system 2000 is configurable to input voice letter from the user 1002 outside vehicle 1000 Breath.
In one example, the speech interface 2002 in system 2000 can be arranged in the outside of vehicle 1000.For example, language Sound interface 2002 can be arranged in outside vehicle 1000 at the position that user 1002 can provide easy access to.For example, speech interface 2002 can be arranged in outside vehicle 1000 around the door and window of vehicle 1000.In another example, if vehicle 1000 is Back (hatchback) vehicle is lifted, then speech interface 2002 can also be arranged in outside vehicle 1000 around rear seat windscreen.
In another example, the speech interface 2002 in system 2000 can be arranged in the outside of vehicle 1000.For example, Speech interface 2002 in system 2000 can be arranged in the top antenna of vehicle 1000 or enter in the air of vehicle 1000 In mouth/exit portion.
In an example of the present embodiment, speech interface may include at least one microphone.Speech interface is not limited to Microphone, and can be any other equipment that can pick up sound.It is noted that although only one microphone can be real Existing function of the invention.But the quantity of microphone is not limited to a microphone.
In a preferred embodiment of the invention, speech interface may include being arranged in array to reduce ambient noise Two or more microphones.Vehicle 1000 is usually parked in the side in street and 1002 station of user is in the outer of vehicle 1000 Face, therefore ambient noise is relatively large.Ambient noise can be reduced using microphone array and improves pickup quality.
Referring again to FIGS. 2, the processor 2006 in system 2000 is configurable to receive voice letter from speech interface 2002 Breath executes speech recognition and the result acquisition result information based on speech recognition to the voice messaging received.
In an example of the invention, processor 2006 can be arranged in vehicle 1000.In another of the invention In example, processor 2006 is desirably integrated into the outside of vehicle 1000.Processor 2006 is connected to speech interface 2002, and Therefore processor 2006 can receive voice messaging from speech interface 2002.
Processor 2006 can execute speech recognition to the voice messaging received.For example, processor 2006 can use Available any audio recognition method executes speech recognition to the voice messaging received in this field.After speech recognition, The voice messaging received can be identified as such as text information.That is, the result of speech recognition can be such as text This information.
Processor 2006 can obtain result information based on the result of speech recognition.For example, processor 2006 can be via The network connection of internet, Intranet, local area network (LAN) etc. is to background system.In this case, processor 2006 can To retrieve background system with speech recognition result, to obtain result information.In another example of the invention, processor 2006 may be coupled to local repository database.In this illustration, processor 2006 can be retrieved with speech recognition result Local repository database, to obtain result information.
Processor 2006 is connected to output equipment 2004, and therefore processor 2006 result information can be supplied to it is defeated Equipment 2004 out.
Referring again to FIGS. 2, the output equipment 2004 in system 2000 is configurable to the user outside vehicle 1000 1002 output result informations.
In an example of the invention, output equipment 2004 includes at least one of display and loudspeaker.
In example of the invention, display is configured to the outside towards vehicle 1000.
In this example, display can be arranged in outside vehicle 1000 at the position that user 1002 can provide easy access to. For example, display can be arranged in outside vehicle 1000 around the door and window of vehicle 1000.In another example, if vehicle 1000 be to lift back vehicle, then display can also be arranged in around the rear seat windscreen outside vehicle 1000.
In another example, display can be arranged in the inside of vehicle 1000 and the outside towards vehicle 1000. For example, display can be arranged in behind the window of vehicle 1000.
An exemplary embodiment of the present invention, display can be transparent display.For example, display can be LED Display, LCD display, OLED display etc..
Display is configurable to the outside towards vehicle 1000, to show to the user 1002 outside vehicle 1000 Result information.In an embodiment of the present invention, display from 2006 reception result information of processor and can show result information Show to the user 1002 outside vehicle 1000.Since display has the portable terminal than smart phone, tablet computer etc. Bigger display area is held, therefore user there can be better general survey to the information presented.In addition, display can be to vehicle User 1002 outside 1000 provides more useful result information.
In addition, in addition between the system 2000 being integrated in vehicle 1000 and user 1002 via the interaction of voice other than, User 1002 can also hand over via other interactive modes such as touch, gesture and the system 2000 being integrated in vehicle 1002 Mutually.That is, user 1002 not only can via voice and also can via other interactive modes such as touch, gesture with The interaction of system 2000 being integrated in vehicle 1002.In this way, various interactive modes will be brought more for user 1002 It is convenient.
In addition, in addition to via display by the result information for the system being integrated in vehicle 1000 be supplied to user 1002 it Outside, the system 2000 being integrated in vehicle 1002 can also be via other presentation modes such as voice outputs (such as loudspeaker) Result information is supplied to user 1002.That is, the system 2000 being integrated in vehicle 1002 not only can be via display Device 2004 and result information can be supplied to user via other presentation modes such as voice outputs (such as loudspeaker) 1002.In this way, the various presentation modes of result information will bring more conveniences for user 1002.
For example, when voice messaging is input in system 2000 by user 1002 via speech interface 2002, system 2000 In processor 2006 can be received from speech interface 2002 voice messaging, the voice messaging that receives is executed speech recognition, And obtain result information.Then, result information can be shown to the user 1002 outside vehicle 1000, loudspeaker by display Result information can be said to the user 1002 outside vehicle 1000.
In this example, loudspeaker can be arranged in the outside of vehicle 1000.For example, loudspeaker can be arranged in vehicle 1000 Outside at the position that user 1002 can provide easy access to.For example, loudspeaker can be arranged in outside vehicle 1000 in vehicle Around 1000 door and window.In another example, if vehicle 1000 is to lift back vehicle, loudspeaker can also be arranged in vehicle Around rear seat windscreen outside 1000.
In another example, loudspeaker can be arranged in the outside of vehicle 1000.For example, loudspeaker can be arranged in vehicle In 1000 top antenna or in the air inlet/outlet part of vehicle 1000.
An exemplary embodiment according to the present invention, processor 2006 are also configured as being waken up by voice messaging.Example Such as, the speech interface 2002 as user 1002 into system 2000 says such as that " hello!" etc voice messaging when, system Processor 2006 in 2000 can be waken up, and with such as " what I can do for you? " etc response message to user 1001 greet.In this way, if interacted without user with system 2000, system 2000 will be in standby, And it therefore can save the overall power of system 2000.
An exemplary embodiment according to the present invention, input voice information may include user query, and result is believed Breath may include all relevant informations of user query.
For example, user 1002 can be via speech interface 2002 to system 2000 if user 1002 browses sight spot Inquiry is about travel information related with sight spot.Processor 2006 in system 2000 can be received from speech interface 2002 about The inquiry at sight spot, to receive about sight spot query execution speech recognition and based on about sight spot inquiry acquisition and scape The relevant travel information of point.Then, the output equipment 2004 in system 2000 can export travel information relevant to sight spot To the user 1002 outside vehicle 1000.For example, display can show have with sight spot to the user 1002 outside vehicle 1000 The travel information of pass, loudspeaker can say travel information relevant to sight spot to the user 1002 outside vehicle 1000.Pay attention to , output equipment 2004 is not limited to display and loudspeaker.
In another example, user 1002 can inquire turning over about foreign language to system 2000 via speech interface 2002 It translates.Processor 2006 in system 2000 can receive the inquiry of the translation about foreign language, to receiving from speech interface 2002 About foreign language translation query execution speech recognition and obtain the translation of foreign language.Then, the output equipment in system 2000 2004 can export the translation of foreign language to the user 1002 outside vehicle 1000.For example, display can be to outside vehicle 1000 User 1002 show the translation of foreign language, loudspeaker can say the translation of foreign language to the user 1002 outside vehicle 1000.Note Meaning, output equipment 2004 are not limited to display and loudspeaker.
An exemplary embodiment according to the present invention, user query may include the inquiry about point of interest, and phase Closing information may include at least one of cartographic information related with point of interest, route information and menu item.
For example, user 1002 can inquire welcome local cinema or meal to system 2000 via speech interface 2002 Shop.Processor 2006 in system 2000 can be received from speech interface 2002 about welcome local cinema or restaurant Inquiry, to receiving the query execution speech recognition about welcome local cinema or restaurant and obtain welcome Local cinema or restaurant position, to welcome local cinema or restaurant route and/or with welcome locality The related discount coupon of cinema or restaurant.Then, the output equipment 2004 in system 2000 can be to the use outside vehicle 1000 Family 1002 export welcome local cinema or restaurant position, to welcome local cinema or restaurant route and/ Or discount coupon related with welcome local cinema or restaurant.For example, display can be to the user outside vehicle 1000 The position of the 1002 welcome local cinemas or restaurant of display, to welcome local cinema or restaurant route and/or Discount coupon relevant to welcome local cinema or restaurant, loudspeaker can be said to the user 1002 outside vehicle 1000 The position of welcome local cinema or restaurant, to welcome local cinema or restaurant route and/or with it is welcome The related discount coupon of local cinema or restaurant.It is noted that output equipment 2004 is not limited to display and loudspeaker.
An exemplary embodiment of the present invention, processor are also configured as current location and point of interest based on user The distance between recommend to be walking or by bus to point of interest to user.
For example, the processor 2006 in system 2000 can calculate between the current location and point of interest of user 1002 away from From.If processor 2006 determines distance in all such as less than walking distances of 2KM, processor 2006 can be to user 1002 recommend to go to point of interest.On the other hand, if processor 2006 determines that distance is more than the walking distance such as more than 2KM, So processor 2006 can be recommended to arrive point of interest by bus to user 1002.
An exemplary embodiment of the present invention, processor are additionally configured to make the headlight of vehicle to flash as the sound to user It answers.
For example, when the language that user 1002 says voice messaging into speech interface 2002 and the identification of processor 2006 inputs When message ceases, processor 2006 is configurable to flash the headlight of vehicle 1000 to indicate that system 2000 understands from user 1002 voice messaging.This will make the interaction between user 1002 and system 2000 more lively and interesting.
An exemplary embodiment according to the present invention, processor are additionally configured to downloading to result information into the portable of user Formula terminal.
For example, user 1002 is also when output equipment 2004 exports result information to the user 1002 outside vehicle 1000 Result information can be downloaded to his/her portable terminal, smart phone, tablet computer etc..This will be user 1002 Bring more conveniences.
It is the method via vehicle offer information for showing an exemplary embodiment according to the present invention with reference to Fig. 3, Fig. 3 Flow chart.This method starts at step 3000.After step 3000, this method proceeds to step 3002.
At step 3002, voice messaging is received from speech interface by processor, wherein speech interface is configured to from vehicle External user's input voice information.
After step 3002, this method proceeds to step 3004.At step 3004, by processor to the language received Message breath executes speech recognition.
After step 3004, this method proceeds to step 3006.At step 3006, speech recognition is based on by processor Result obtain result information.
After step 3006, this method proceeds to step 3008.At step 3008, through output equipment to outside vehicle The user in portion exports result information, and wherein processor is connected to both output equipment and speech interface.For example, display can be passed through Result information is shown to the user of outside vehicle by device, and result information can also be said from loudspeaker to the user of outside vehicle. It is noted that output equipment 2004 is not limited to display and loudspeaker.
Finally, this method terminates at step 3010.
In addition, in addition between the system 2000 being integrated in vehicle 1000 and user 1002 via the interaction of voice other than, User 1002 can also hand over via other interactive modes such as touch, gesture and the system 2000 being integrated in vehicle 1002 Mutually.That is, user 1002 not only can via voice and also can via other interactive modes such as touch, gesture with The interaction of system 2000 being integrated in vehicle 1002.In this way, various interactive modes will be brought more for user 1002 It is convenient.
In addition, in addition to via display by the result information for the system being integrated in vehicle 1000 be supplied to user 1002 it Outside, the system 2000 being integrated in vehicle 1002 can also be via other presentation modes such as voice outputs (such as loudspeaker) Result information is supplied to user 1002.That is, the system 2000 being integrated in vehicle 1002 not only can be via display Device and result information can be supplied to user 1002 via other presentation modes such as voice outputs (such as loudspeaker). In this way, the various presentation modes of result information will bring more conveniences for user 1002.
An exemplary embodiment according to the present invention, output equipment may include at least one in display and loudspeaker It is a.
An exemplary embodiment according to the present invention, display are configurable to the outside towards vehicle.
An exemplary embodiment according to the present invention, display can be transparent display.
An exemplary embodiment according to the present invention, speech interface may include at least one microphone.
An exemplary embodiment according to the present invention, this method can also include by voice messaging wake-up processor Step.
An exemplary embodiment according to the present invention, input voice information may include user query, and result is believed Breath may include all relevant informations of user query.
An exemplary embodiment according to the present invention, user query may include the inquiry about point of interest, and phase Closing information may include at least one of cartographic information relevant to point of interest, route information and menu item.
An exemplary embodiment according to the present invention, this method may also comprise the following steps:: being based on using by processor The distance between the current location at family and point of interest recommend to be walking or arrive point of interest by bus to user.
An exemplary embodiment according to the present invention, this method can also include being made by the headlight of processor flashing vehicle The step of for response to user.
An exemplary embodiment according to the present invention, this method can also include being downloaded to result information by processor The step of portable terminal of user.
Embodiment according to the present invention can execute the interaction with the user of outside vehicle, and can be to vehicle External user provides information, and more conveniences therefore can be brought to user.
Fig. 4 shows the frame of the device for providing information via vehicle of an exemplary embodiment according to the present invention Figure.The frame of device 4000 can be realized by hardware, software, firmware, or any combination thereof, to execute the principle of the present invention.Ability The technical staff in domain is it is understood that Fig. 4 can be combined or separate into sub- frame to realize original present invention as described above Reason.Therefore, description herein can support any possible combination of each frame as described herein or separate or further define.
Further, since with reference to the method discussed about Fig. 3, the operation of some components of device 4000 can become it is aobvious and It is clear to, therefore, hereafter will be briefly described device 4000.
With reference to Fig. 4, device 4000 may include receiving unit 4002, execution unit 4004, acquiring unit 4006 and output Unit 4008.Receiving unit 4002 is configurable to receive voice messaging from speech interface by processor, and wherein speech interface is matched It is set to user's input voice information from outside vehicle.Execution unit 4004 is configurable to be executed by processor to receiving The speech recognition of voice messaging.Acquiring unit 4006 is configurable to the result based on speech recognition and obtains result letter by processor Breath.Output unit 4008 is configurable to the user from output equipment to outside vehicle and exports result information, and wherein processor connects It is connected to both output equipment and speech interface.For example, result information can be shown to the user of outside vehicle by display, Result information can also be said from loudspeaker to the user of outside vehicle.It is noted that output equipment 2004 is not limited to display And loudspeaker.
In addition, in addition between the system 2000 being integrated in vehicle 1000 and user 1002 via the interaction of voice other than, User 1002 can also hand over via other interactive modes such as touch, gesture and the system 2000 being integrated in vehicle 1000 Mutually.That is, user 1002 not only can via voice and also can via other interactive modes such as touch, gesture with The interaction of system 2000 being integrated in vehicle 1000.In this way, various interactive modes will be brought more for user 1002 It is convenient.
In addition, in addition to via display by the result information for the system being integrated in vehicle 1000 be supplied to user 1002 it Outside, the system 2000 being integrated in vehicle 1000 can also be via other presentation modes such as voice outputs (such as loudspeaker) Result information is supplied to user 1002.That is, the system 2000 being integrated in vehicle 1000 not only can be via display Device and result information can be supplied to user 1002 via other presentation modes such as voice outputs (such as loudspeaker). In this way, the various presentation modes of result information will bring more conveniences for user 1002.
An exemplary embodiment according to the present invention, output equipment may include at least one in display and loudspeaker It is a.
An exemplary embodiment according to the present invention, display are configurable to the outside towards vehicle.
An exemplary embodiment according to the present invention, display can be transparent display.
An exemplary embodiment according to the present invention, speech interface may include at least one microphone.
An exemplary embodiment according to the present invention, the device can also include for being handled by voice messaging wake-up The device of device.
An exemplary embodiment according to the present invention, input voice information may include user query, and result is believed Breath may include all relevant informations of user query.
An exemplary embodiment according to the present invention, user query may include the inquiry about point of interest, and phase Closing information may include at least one of cartographic information relevant to point of interest, route information and menu item.
An exemplary embodiment according to the present invention, the device can also include for the working as based on user by processor The distance between front position and point of interest recommend the device for being walking or arriving point of interest by bus to user.
An exemplary embodiment according to the present invention, the device can also include for by processor flash vehicle before Device of the lamp as the response to user.
An exemplary embodiment according to the present invention, the device can also include for will be under result information by processor It is downloaded to the device of the portable terminal of user.
Those skilled in the art can know clearly that the present invention can be by having necessary hardware from above embodiments Software, or realized by hardware, firmware etc..Based on this understanding, the embodiment of the present invention can partly in a software form It realizes.Computer software can store the readable storage medium storing program for executing of the floppy disk in such as computer, hard disk, CD or flash memories In.Computer software includes making computer (for example, personal computer, service station or network terminal) each reality according to the present invention It applies example and executes method or part thereof of series of instructions.
Fig. 5 is to show can executing for an exemplary embodiment of the present invention to provide the meter of the method for information via vehicle Calculate the block diagram of the hardware configuration of equipment.
Calculate equipment 5000 may include may via one or more Interface & Bus 5002 connect or with bus 5002 The element of communication.For example, calculate equipment 5000 may include bus 5002 and one or more processors 5004, one or Multiple input equipments 5006 and one or more output equipments 5008.One or more processors 5004 can be any kind of Processor, and can include but is not limited to one or more general processors and/or one or more application specific processors (such as Dedicated processes chip).Input equipment 5006 can be any kind of equipment that information can be inputted to calculating equipment, and can To include but is not limited to mouse, keyboard, touch screen, microphone and/or remote controler.Output equipment 5008, which can be, can be presented information Any kind of equipment, and can include but is not limited to display, loudspeaker, video/audio output end, vibrator and/ Or printer.Calculating equipment 5000 can also include that non-transitory stores equipment 5010, or stores equipment with non-transitory 5010 connections, any storage equipment that non-transitory storage equipment can be non-transitory and that data storage may be implemented, And it can include but is not limited to disk drive, optical storage apparatus, solid-state storage device, floppy disk, flexible disk, hard disk, tape Or any other magnetic medium, CD or any other optical medium, ROM (read-only memory), RAM (random access memory), Cache memory and/or any other memory chip or box and/or computer can be read from data, instruction and/ Or any other medium of code.Non-transitory storage equipment 5010 can be can be from interface disassembly.Non-transitory storage is set The standby 5010 data/commands/codes that can have for realizing the above method and step.It can also include logical for calculating equipment 5000 Believe equipment 5012.Communication equipment 5012, which can be, can enable with external device (ED) and/or set with any kind of of network communication Standby or system, and can include but is not limited to modem, network card, infrared communication device, wireless telecom equipment and/or Such as BluetoothTMThe chipset of equipment, 1302.11 equipment, WiFi equipment, WiMax equipment, cellular communication facility etc..
Calculating equipment 5000 can also include working storage 5014, and can be can store for processor 5004 Any kind of working storage of the instruction and/or data that work useful, and can include but is not limited to arbitrary access and deposit Reservoir/or read-only storage equipment.
Software element can be located in working storage 5014, including but not limited to operating system 5016, one or more Application program 5018, driver and/or other data and code.Instruction for executing the above method and step may include In one or more application program 5018, and the various units of aforementioned device 4000 can be read and be held by processor 5004 The instruction of row one or more application program 5018 is realized.More specifically, the receiving unit of aforementioned device 4,000 4002 It such as can be by processor 5004 when executing the application 5018 with the instruction for executing the step 3002 in preceding method 3000 It realizes.In addition, the execution unit of aforementioned device 4000 can for example executed with execution by processor 5004 in preceding method It is realized when the application 5018 of the instruction of the step 3004 in 3000.Other units of aforementioned device 4000 also for example can be by handling Device 5004 is realized when executing the application 5018 with the instruction for executing one or more steps in aforementioned each step.Software The executable code or source code of the instruction of element can store in the non-of such as above-mentioned (one or more) storage equipment 5010 In temporary computer readable storage medium, and working storage can be read into possibly by compiling and/or installation In 5014.The executable code or source code of the instruction of software element can also be downloaded from remote location.
It is further appreciated that variation can be made according to specific requirement.For example, it is also possible to using the hardware of customization, And/or particular element can be realized with hardware, software, firmware, middleware, microcode, hardware description language or any combination thereof. Furthermore, it is possible to use the connection of the other calculating equipment of such as network inputs/output equipment.For example, disclosed method and Some or all of equipment can by using according to the logic of the disclosure and algorithm by with assembler language or hardware programming Language (such as VERILOG, VHDL, C++) to hardware (e.g., including field programmable gate array (FPGA) and/or programmable patrol Collect the programmable logic circuit system of array (PLA)) it is programmed to realize.
Although describing all aspects of this disclosure by reference to attached drawing, the above method, system and device are only to show Example property example, and the scope of the present invention is not limited by terms of these, but only limited by appended claims and its equivalent It is fixed.Various elements can be omitted or can be replaced by equivalent elements.In addition, step can with described in the disclosure Order in a different order executes.In addition, various elements can combine in various ways.It is equally important that with the hair of technology Exhibition, the equivalent elements that described many elements can be occurred after the disclosure replace.

Claims (14)

1. a kind of for providing the system of information via vehicle, comprising:
Speech interface is configured to user's input voice information from outside vehicle;
Processor, be configured to receive voice messaging from speech interface, speech recognition executed to the voice messaging that receives and Result based on speech recognition obtains result information;And
Output equipment is configured to export result information to the user of outside vehicle,
Wherein, processor is connected to both output equipment and speech interface,
Wherein, the output equipment includes at least one of display and loudspeaker.
2. the system as claimed in claim 1, which is characterized in that the display is configured to the outside towards vehicle.
3. system as claimed in claim 1 or 2, which is characterized in that the display is transparent display.
4. the system as claimed in claim 1, which is characterized in that the speech interface includes at least one microphone.
5. the system as claimed in claim 1, which is characterized in that the processor is additionally configured to be waken up by voice messaging.
6. the system as claimed in claim 1, which is characterized in that the voice messaging of input includes user query, and the knot Fruit information includes all relevant informations of user query.
7. system as claimed in claim 6, which is characterized in that the user query include the inquiry about point of interest, and The relevant information includes at least one of cartographic information relevant to point of interest, route information and menu item.
8. system as claimed in claim 7, which is characterized in that the processor be additionally configured to current location based on user and The distance between point of interest is recommended to be walking or arrives point of interest by bus to user.
9. the system as claimed in claim 1, which is characterized in that the processor is additionally configured to make the headlight of vehicle to flash conduct Response to user.
10. the system as claimed in claim 1, which is characterized in that the processor is additionally configured to result information downloading to use The portable terminal at family.
11. a kind of vehicle, including the system as described in any one of claim 1-10.
12. a kind of provide the method for information by vehicle, comprising:
Voice messaging is received from speech interface by processor, wherein speech interface is configured to input language from the user of outside vehicle Message breath;
Speech recognition is executed to the voice messaging received by processor;
Result information is obtained based on the result of speech recognition by processor;And
Result information is exported from output equipment to the user of outside vehicle,
Wherein, processor is connected to both output equipment and speech interface,
Wherein, the output equipment includes at least one of display and loudspeaker.
13. a kind of for providing the computer program product of information via vehicle, the computer program product includes having it The computer readable storage medium of the program instruction of middle realization, wherein described program instruction can be read by processor, so that described Processor executes a kind of method, comprising:
Voice messaging is received from speech interface, wherein speech interface is configured to user's input voice information from outside vehicle;
Speech recognition is executed to the voice messaging received;
Result based on speech recognition obtains result information;And
Result information is exported from output equipment to the user of outside vehicle,
Wherein, processor is connected to both output equipment and speech interface,
Wherein, the output equipment includes at least one of display and loudspeaker.
14. a kind of for providing the device of information via vehicle, comprising:
Store the memory of program instruction;And
It is configured to execute the processor of described program instruction, wherein described when described program instruction is executed by the processor Program instruction executes described device:
Voice messaging is received from speech interface, wherein speech interface is configured to user's input voice information from outside vehicle;
Speech recognition is executed to the voice messaging received;
Result based on speech recognition obtains result information;And
Result information is exported from output equipment to the user of outside vehicle, wherein processor is connected to output equipment and voice connects Both mouthful,
Wherein, the output equipment includes at least one of display and loudspeaker.
CN201580073006.4A 2015-03-25 2015-03-25 For providing system, device, the method and computer program product of information via vehicle Active CN107107846B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/075011 WO2016149915A1 (en) 2015-03-25 2015-03-25 System, apparatus, method and computer program product for providing information via vehicle

Publications (2)

Publication Number Publication Date
CN107107846A CN107107846A (en) 2017-08-29
CN107107846B true CN107107846B (en) 2019-10-18

Family

ID=56977752

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580073006.4A Active CN107107846B (en) 2015-03-25 2015-03-25 For providing system, device, the method and computer program product of information via vehicle

Country Status (3)

Country Link
CN (1) CN107107846B (en)
DE (1) DE112015006350T5 (en)
WO (1) WO2016149915A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019120839A (en) * 2018-01-09 2019-07-22 トヨタ自動車株式会社 Voice output device, method for voice output, and voice output program
DE102018208707A1 (en) 2018-06-04 2019-12-05 Audi Ag Method for operating a sound output device of a motor vehicle, speech analysis and control device, motor vehicle, and server-external server device
US20200047687A1 (en) * 2018-08-10 2020-02-13 SF Motors Inc. Exterior speech interface for vehicle
JP7396792B2 (en) * 2018-09-19 2023-12-12 トヨタ自動車株式会社 Information provision device, information provision method, and program
DE102019206198A1 (en) * 2019-04-30 2020-11-05 Volkswagen Aktiengesellschaft Method for personalizing a motor vehicle
CN115118816B (en) * 2021-10-22 2023-11-17 博泰车联网科技(上海)股份有限公司 Voice interaction method and system based on position
CN115103160B (en) * 2022-06-21 2023-08-01 润芯微科技(江苏)有限公司 Vehicle-mounted real-time communication system based on TTS technology

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072304A (en) * 2006-05-09 2007-11-14 上海中策工贸有限公司 Automobile pick-up head media input and video traveling system
EP1884421A1 (en) * 2006-08-04 2008-02-06 Harman Becker Automotive Systems GmbH Method and system for processing voice commands in a vehicle enviroment
CN101159096A (en) * 2006-10-02 2008-04-09 哈曼贝克自动系统股份有限公司 Sound control of vehicle elements outside driver's cab
CN101178850A (en) * 2007-11-27 2008-05-14 张涛 Vehicle agility device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104175950A (en) * 2013-05-23 2014-12-03 北京千橡网景科技发展有限公司 Method and equipment for communication between personnel in vehicle and outside

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072304A (en) * 2006-05-09 2007-11-14 上海中策工贸有限公司 Automobile pick-up head media input and video traveling system
EP1884421A1 (en) * 2006-08-04 2008-02-06 Harman Becker Automotive Systems GmbH Method and system for processing voice commands in a vehicle enviroment
CN101159096A (en) * 2006-10-02 2008-04-09 哈曼贝克自动系统股份有限公司 Sound control of vehicle elements outside driver's cab
CN101178850A (en) * 2007-11-27 2008-05-14 张涛 Vehicle agility device

Also Published As

Publication number Publication date
DE112015006350T5 (en) 2017-11-30
WO2016149915A1 (en) 2016-09-29
CN107107846A (en) 2017-08-29

Similar Documents

Publication Publication Date Title
CN107107846B (en) For providing system, device, the method and computer program product of information via vehicle
US11243087B2 (en) Device and method for providing content to user
US20200125322A1 (en) Systems and methods for customization of augmented reality user interface
US20160321368A1 (en) Speech Searching Method And Speech Searching Device
CN104303177B (en) Execute the method and earphone computing device of real-time phonetic translation
US9418657B2 (en) Communication system and method for an ear worn communication device
US10593326B2 (en) System, method, and apparatus for location-based context driven speech recognition
US20130325447A1 (en) Speech recognition adaptation systems based on adaptation data
CN109036396A (en) A kind of exchange method and system of third-party application
US20130325446A1 (en) Speech recognition adaptation systems based on adaptation data
CN110136705A (en) A kind of method and electronic equipment of human-computer interaction
CN109102802A (en) System for handling user spoken utterances
CN107046553B (en) Vehicle service processing method and mobile terminal
CN108496220A (en) Electronic equipment and its audio recognition method
CN110033294A (en) A kind of determination method of business score value, business score value determining device and medium
KR101896236B1 (en) Method for providing commercial service based on digital signage using wireless communication
US11704753B2 (en) Order post to enable parallelized order taking using artificial intelligence engine(s)
Radde Digital Guest Experience: Tools to help hotels to manage and optimize the digital guest experience
US20200090656A1 (en) Sensor Based Semantic Object Generation
CN105938392A (en) Electronic device with wearable part and operation method thereof
KR101229110B1 (en) System and method for providing tour information
CN109302492A (en) Method, equipment and computer readable storage medium for recommendation service position
CN111712870A (en) Information processing apparatus, mobile apparatus, method, and program
CN103177674A (en) Interactive advertisement system
US10901756B2 (en) Context-aware application

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant