WO2016149915A1 - System, apparatus, method and computer program product for providing information via vehicle - Google Patents

System, apparatus, method and computer program product for providing information via vehicle Download PDF

Info

Publication number
WO2016149915A1
WO2016149915A1 PCT/CN2015/075011 CN2015075011W WO2016149915A1 WO 2016149915 A1 WO2016149915 A1 WO 2016149915A1 CN 2015075011 W CN2015075011 W CN 2015075011W WO 2016149915 A1 WO2016149915 A1 WO 2016149915A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
information
voice
user
processor
Prior art date
Application number
PCT/CN2015/075011
Other languages
French (fr)
Inventor
Sebastian Granzow
Biyun ZHOU
Hae Young Yun
Wanli Jiang
Sheng Lai
Original Assignee
Bayerische Motoren Werke Aktiengesellschaft
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bayerische Motoren Werke Aktiengesellschaft filed Critical Bayerische Motoren Werke Aktiengesellschaft
Priority to DE112015006350.1T priority Critical patent/DE112015006350T5/en
Priority to PCT/CN2015/075011 priority patent/WO2016149915A1/en
Priority to CN201580073006.4A priority patent/CN107107846B/en
Publication of WO2016149915A1 publication Critical patent/WO2016149915A1/en

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3605Destination input or retrieval
    • G01C21/3608Destination input or retrieval using speech input, e.g. using speech recognition
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34Route searching; Route guidance
    • G01C21/36Input/output arrangements for on-board computers
    • G01C21/3626Details of the output of route guidance instructions
    • G01C21/3629Guidance using speech or audio output, e.g. text-to-speech
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel
    • B60R16/0373Voice control

Definitions

  • the present invention relates in general to the field of providing information via a vehicle, and in more particular, to a system, an apparatus, a method and a computer program product for providing information via a vehicle.
  • the voice recognition and speech control system can understand spoken commands of a user to control different functions. Furthermore, the voice recognition and speech control system can also be utilized in a vehicle so as to control different vehicle equipments such as radio, CD, navigator and so on with spoken commands. Moreover, the voice recognition and speech control system can understand synonyms of the spoken commands. For example, the voice recognition and speech control system can understand the spoken command "zoom in” as well as the spoken command "Enlarge” . In addition, the voice recognition and speech control system can allow the user to individually adapt the voice recognition to the specific sound and/or intonation of the user.
  • a portable terminal such as a smart phone or a tablet to obtain and browse the information.
  • a display on the exterior of the vehicle so as to display various graphical data such as customizable "skins” .
  • the user can use the portable terminal to download the customizable "skins” and then transfer the obtained customizable "skins” to the display arranged on the exterior of the vehicle so as to change the appearance of the vehicle.
  • the voice recognition and speech control system is typically installed within the vehicle, and thus the user can use the voice recognition and speech control system only when the user enters into and locates within the vehicle. As a result, when the user locates outside of the vehicle, he/she may be not able to use the voice recognition and speech control system within the vehicle.
  • the display arranged on the exterior of the vehicle is only used to display customizable "skins" so as to change the appearance of the vehicle.
  • it cannot interact with the user and thus cannot provide useful information to the user.
  • the portable terminal in general has a much smaller display, and thus the user may have a worse overview over the information which is presented.
  • An aspect of the present invention is to provide as system, an apparatus, a method and a computer program product for providing information via a vehicle that can address one or more of the above and other prior art problems.
  • a system for providing information via a vehicle comprising: a voice interface configured to input voice information from a user outside of the vehicle; a processor configured to receive the voice information from the voice interface, perform voice recognition on the received voice information, and obtain resultant information based on a result of the voice recognition; and an output device configured to output the result information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
  • the output device comprises at least one of a display and a speaker.
  • the display is configured to face to the outside of the vehicle.
  • the display is a transparent display.
  • the voice interface comprises at least one microphone.
  • the processor is further configured to be woken up by the voice information.
  • the input voice information includes a user inquiry and the resultant information includes all the relevant information to the user inquiry.
  • the user inquiry comprises an inquiry about a place of interest and the relevant information includes at least one of map information, route information and menu items relating to the place of interest.
  • the processor is further configured to recommend to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
  • the processor is further configured to make the vehicle's headlights twinkle as a response to the user.
  • the processor is further configured to download the resultant information to a portable terminal of the user.
  • a method of providing information via a vehicle comprising: receiving, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; performing, by the processor, voice recognition on the received voice information; obtaining, by the processor, resultant information based on a result of the voice recognition; and outputting, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
  • an apparatus of providing information via a vehicle comprising: receiving unit for receiving, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; performing unit for performing, by the processor, voice recognition on the received voice information; obtaining unit for obtaining, by the processor, resultant information based on a result of the voice recognition; and outputting unit for outputting, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the display and the voice interface.
  • a computer program product for providing information via a vehicle
  • the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the program instructions are readable by a processor to cause the processor to perform a method comprising: receiving voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; performing voice recognition on the received voice information; obtaining resultant information based on a result of the voice recognition; and outputting, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
  • an apparatus for providing information via a vehicle comprising: a memory storing program instructions; and a processor configured to execute the programs instructions, wherein the program instructions, when executed by the processor, cause the apparatus to perform: receive voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; perform voice recognition on the received voice information; obtain resultant information based on a result of the voice recognition; and output, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
  • the present invention can interact with the user outside of the vehicle and provide information to the user outside of the vehicle, and thus can bring the user with more convenience.
  • Fig. 1 illustrates a schematic diagram of a system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention
  • Fig. 2 illustrates a block diagram of the system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention
  • Fig. 3 illustrates a flow chart showing a method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention
  • Fig. 4 illustrates a block diagram of an apparatus for providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • Fig. 5 is a block diagram illustrating a hardware configuration of a computing device which can perform the method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • FIG. 1 there is shown a schematic diagram of a system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • a user 1002 stands outside of a vehicle 1000.
  • the vehicle 1000 comprises a system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • the user 1002 can wake up the system integrated in the vehicle 1000 with the voice information such as "Hello! " .
  • the system integrated in the vehicle 1000 can enter into operation state and greet the user 1001 with response information such as "What can I do for you? " .
  • the user 1002 can interact with the system integrated in the vehicle 1000.
  • the user 1002 can input inquiries to the system integrated in the vehicle 1000 with voice information, and the system integrated in the vehicle 1000 can obtain and provide the resultant information to the user in response to the input voice information.
  • the user 1002 may also interact with the system integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
  • the system integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as voice output (e.g. a speaker) and so on. That is to say, the system integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display but also via the other provision manners such as voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
  • other provision manners such as voice output (e.g. a speaker) and so on.
  • the vehicle 1000 can be a rental vehicle.
  • the vehicle 1000 can be a rental vehicle with "DRIVENOW" service.
  • the vehicle 1000 can be also a private vehicle.
  • the owner of the private vehicle can be rewarded if he/she allows the other users to interact with the private vehicle and obtain the information via the private vehicle.
  • the system integrated in the vehicle 1000 can interact with the user outside of the vehicle and provide information to the user outside of the vehicle, and thus can bring the user with more convenience.
  • Fig. 2 illustrates a block diagram of the system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • the system 2000 for providing information via a vehicle in accordance with an exemplary embodiment of the present invention can comprises a voice interface 2002, an output device 2004 and a processor 2006.
  • the processor 2006 can be connected to both the voice interface 2002 and the output device 2004.
  • the voice interface 2002 in the system 2000 can be configured to input voice information from a user 1002 outside of the vehicle 1000.
  • the voice interface 2002 in the system 2000 can be arranged on the exterior of the vehicle 1000.
  • the voice interface 2002 can be arranged on the exterior of the vehicle 1000 at a position where the user 1002 can easily approach to.
  • the voice interface 2002 can be arranged on the exterior of the vehicle 1000 around door windows of the vehicle 1000.
  • the voice interface 2002 can also be arranged on the exterior of the vehicle 1000 around the rear windshield.
  • the voice interface 2002 in the system 2000 can be arranged in the exterior of the vehicle 1000.
  • the voice interface 2002 in the system 2000 may be arranged within a roof antenna of the vehicle 1000 or within an air inlet/outlet part of the vehicle 1000.
  • the voice interface may comprise at least one microphone.
  • the voice interface is not limited to the microphone, and can be any other device which can pick up the sound. Note that only one microphone can implement the function of the present invention. However, the number of microphone is not limited to one microphone.
  • the voice interface may comprise two or more microphones arranged in an array so as to reduce the environment noise.
  • the vehicle 1000 is generally parked on the side of the street and the user 1002 stands outside of the vehicle 1000, and thus the environment noise is relatively large.
  • the utilization of the array of microphones can reduce the environment noise and improve the quality of the picked-up sound.
  • the processor 2006 in the system 2000 can be configured to receive the voice information from the voice interface 2002, perform voice recognition on the received voice information, and obtain resultant information based on a result of the voice recognition.
  • the processor 2006 can be arranged within the vehicle 1000. In another example of the present invention, the processor 2006 can be integrated into the exterior of the vehicle 1000.
  • the processor 2006 is connected to the voice interface 2002, and thus the processor 2006 can receive the voice information from the voice interface 2002.
  • the processor 2006 can perform voice recognition on the received voice information.
  • the processor 2006 can utilize any voice recognition method available in the art to perform the voice recognition on the received voice information.
  • the received voice information can be recognized as, for example, text information. That is to say, a result of the voice recognition may be for example text information.
  • the processor 2006 can obtain resultant information based on a result of the voice recognition.
  • the processor 2006 can be connected to a backbend system via a network such as Internet, Intranet, Local Area Network (LAN) and so on.
  • the processor 2006 can retrieve the backbend system with the result of the voice recognition so as to obtain the resultant information.
  • the processor 2006 can be connected to a local repository database. In this example, the processor 2006 can retrieve the local repository database with the result of the voice recognition so as to obtain the resultant information.
  • the processor 2006 is connected to an output device 2004, and thus the processor 2006 can provide the resultant information to the output device 2004.
  • the output device 2004 in the system 2000 can be configured to output the resultant information to the user 1002 outside of the vehicle 1000.
  • the output device 2004 comprises at least one of a display and a speaker.
  • the display is configured to face to the outside of the vehicle 1000.
  • the display can be arranged on the exterior of the vehicle 1000 at a position where the user 1002 can easily approach to.
  • the display can be arranged on the exterior of the vehicle 1000 around door windows of the vehicle 1000.
  • the display can also be arranged on the exterior of the vehicle 1000 around the rear windshield.
  • the display can be arranged inside the vehicle 1000 and face to the outside of the vehicle 1000.
  • the display can be arranged behind the window of the vehicle 1000.
  • the display can be a transparent display.
  • the display may be LED display, LCD display, OLED display or the like.
  • the display can be configured to face to the outside of the vehicle 1000 so as to display the resultant information to the user 1002 outside of the vehicle 1000.
  • the display can receive the resultant information from the processor 2006 and display the resultant information to the user 1002 outside of the vehicle 1000.
  • the display has larger display area than the portable terminal such as smart phone, tablet or the like, the user can have a better overview over the information which is presented. Furthermore, the display can provide more useful resultant information to the user 1002 outside of the vehicle 1000.
  • the user 1002 may also interact with the system 2000 integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system 2000 integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
  • the system 2000 integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as the voice output (e.g. a speaker) and so on. That is to say, the system 2000 integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display 2004 but also via the other provision manners such as the voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
  • other provision manners such as the voice output (e.g. a speaker) and so on.
  • the processor 2006 in the system 2000 can receive the voice information from the voice interface 2002, perform voice recognition on the received voice information, and obtain the resultant information. Then, the display can display the resultant information to the user 1002 outside of the vehicle 1000, the speaker can speak out the resultant information to the user 1002 outside of the vehicle 1000.
  • the speaker can be arranged on the exterior of the vehicle 1000.
  • the speaker can be arranged on the exterior of the vehicle 1000 at a position where the user 1002 can easily approach to.
  • the speaker can be arranged on the exterior of the vehicle 1000 around door windows of the vehicle 1000.
  • the speaker can also be arranged on the exterior of the vehicle 1000 around the rear windshield.
  • the speaker can be arranged in the exterior of the vehicle 1000.
  • the speaker may be arranged within a roof antenna of the vehicle 1000 or within an air inlet/outlet part of the vehicle 1000.
  • the processor 2006 can be further configured to be woken up by the voice information. For example, when the user 1002 speaks the voice information such as "Hello! " to the voice interface 2002 in the system 2000, the processor 2006 in the system 2000 can be woken up and greet the user 1001 with response information such as "What can I do for you? " . In this way, if there are no users to interact with the system 2000, the system 2000 will be in a standby state, and thus the entire power consumption of the system 2000 can be saved.
  • the input voice information may include a user inquiry and the resultant information may include all the relevant information to the user inquiry.
  • the user 1002 can inquiry the system 2000 about the tourist information relating to the scenic spot via the voice interface 2002.
  • the processor 2006 in the system 2000 can receive the inquiry about the scenic spot from the voice interface 2002, perform voice recognition on the received inquiry about the scenic spot, and obtain the tourist information relating to the scenic spot based on the inquiry about the scenic spot.
  • the output device 2004 in the system 2000 can output the tourist information relating to the scenic spot to the user 1002 outside of the vehicle 1000.
  • the display can display the tourist information relating to the scenic spot to the user 1002 outside of the vehicle 1000
  • the speaker can speak out the tourist information relating to the scenic spot to the user 1002 outside of the vehicle 1000.
  • the output device 2004 is not limited to the display and the speaker.
  • the user 1002 can inquiry the system 2000 about the translation of a foreign language via the voice interface 2002.
  • the processor 2006 in the system 2000 can receive the inquiry about the translation of the foreign language from the voice interface 2002, perform voice recognition on the received inquiry about the translation of the foreign language, and obtain the translation of the foreign language.
  • the output device 2004 in the system 2000 can output the translation of the foreign language to the user 1002 outside of the vehicle 1000.
  • the display can display the translation of the foreign language to the user 1002 outside of the vehicle 1000
  • the speaker can speak out the translation of the foreign language to the user 1002 outside of the vehicle 1000.
  • the output device 2004 is not limited to the display and the speaker.
  • the user inquiry may comprise an inquiry about a place of interest and the relevant information may include at least one of map information, route information and menu items relating to the place of interest.
  • the user 1002 can inquiry the system 2000 about the popular local cinema or restaurant via the voice interface 2002.
  • the processor 2006 in the system 2000 can receive the inquiry about the popular local cinema or restaurant from the voice interface 2002, perform voice recognition on the received inquiry about the popular local cinema or restaurant, and obtain the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant.
  • the output device 2004 in the system 2000 can output the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant to the user 1002 outside of the vehicle 1000.
  • the display can display the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant to the user 1002 outside of the vehicle 1000
  • the speaker can speak out the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant to the user 1002 outside of the vehicle 1000.
  • the output device 2004 is not limited to the display and the speaker.
  • the processor may be further configured to recommend to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
  • the processor 2006 in the system 2000 can calculate the distance between the current position of the user 1002 and the place of interest. If the processor 2006 determines that the distance is within a walking distance such as less than 2 KM, the processor 2006 may recommend the user 1002 to walk to the place of interest. On the other hand, if the processor 2006 determines that the distance is beyond the walking distance such as more than 2 KM, the processor 2006 may recommend the user 1002 to take the car to the place of interest.
  • the processor is further configured to make the vehicle's headlights twinkle as a response to the user.
  • the processor 2006 can be configured to make the headlight of the vehicle 1000 twinkle to indicate that the system 2000 understands the voice information from the user 1002. This will make the interaction between the user 1002 and the system 2000 more vivid and interesting.
  • the processor is further configured to download the resultant information to a portable terminal of the user.
  • the output device 2004 when the output device 2004 outputs the resultant information to the user 1002 outside of the vehicle 1000, the user 1002 can also download the resultant information to his/her portable terminal such as smart phone, tablet or the like. This will bring more convenience to the user 1002.
  • his/her portable terminal such as smart phone, tablet or the like. This will bring more convenience to the user 1002.
  • FIG. 3 it is a flow chart showing a method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • the method starts at step 3000. After step 3000, the method proceeds to step 3002.
  • voice information is received from a voice interface by a processor, wherein the voice interface is configured to input the voice information from a user outside of the vehicle.
  • step 3002 the method proceeds to step 3004.
  • voice recognition is performed on the received voice information by the processor.
  • step 3004 the method proceeds to step 3006.
  • step 3006 resultant information is obtained based on a result of the voice recognition by the processor.
  • step 3008 the resultant information is output to the user outside of the vehicle by an output device, wherein the processor is connected to both the output device and the voice interface.
  • the resultant information can be displayed to the user outside of the vehicle by a display, the resultant information can be also spoken out to the user outside of the vehicle by a speaker.
  • the output device 2004 is not limited to the display and the speaker.
  • the user 1002 may also interact with the system 2000 integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system 2000 integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
  • the system 2000 integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as the voice output (e.g. a speaker) and so on. That is to say, the system 2000 integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display but also via the other provision manners such as the voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
  • other provision manners such as the voice output (e.g. a speaker) and so on.
  • the output device may comprise at least one of a display and a speaker.
  • the display may be configured to face to the outside of the vehicle.
  • the display may be a transparent display.
  • the voice interface may comprise at least one microphone.
  • the method may further comprise the step of waking up the processor by the voice information.
  • the input voice information may include a user inquiry and the resultant information may include all the relevant information to the user inquiry.
  • the user inquiry may comprise an inquiry about a place of interest and the relevant information may include at least one of map information, route information and menu items relating to the place of interest.
  • the method may further comprise the step of recommending, by the processor, to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
  • the method may further comprise the step of twinkling, by the processor, the vehicle's headlights as a response to the user.
  • the method may further comprise the step of downloading, by the processor, the resultant information to a portable terminal of the user.
  • interaction with the user outside of the vehicle can be performed and information can be provide to the user outside of the vehicle, and thus the use can be brought with more convenience.
  • Fig. 4 illustrates a block diagram of an apparatus for providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • the blocks of the apparatus 4000 may be implemented by hardware, software, firmware, or any combination thereof to carry out the principles of the present invention. It is understood by those skilled in the art that the blocks described in Fig. 4 may be combined or separated into sub-blocks to implement the principles of the invention as described above. Therefore, the description herein may support any possible combination or separation or further definition of the blocks described herein.
  • the apparatus 4000 may include a receiving unit 4002, a performing unit 4004, an obtaining unit 4006 and an outputting unit 4008.
  • the receiving unit 4002 may be configured to receive, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle.
  • the performing unit 4004 may be configured to perform, by the processor, voice recognition on the received voice information.
  • the obtaining unit 4006 may be configured to obtain, by the processor, resultant information based on a result of the voice recognition.
  • the outputting unit 4008 may be configured to output, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
  • the resultant information can be displayed to the user outside of the vehicle by a display, the resultant information can be also spoken out to the user outside of the vehicle by a speaker.
  • the output device 2004 is not limited to the display and the speaker.
  • the user 1002 may also interact with the system 2000 integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system 2000 integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
  • the system 2000 integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as the voice output (e.g. a speaker) and so on. That is to say, the system 2000 integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display but also via the other provision manners such as the voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
  • other provision manners such as the voice output (e.g. a speaker) and so on.
  • the output device may comprise at least one of a display and a speaker.
  • the display may be configured to face to the outside of the vehicle.
  • the display may be a transparent display.
  • the voice interface may comprise at least one microphone.
  • the apparatus may further comprise means for waking up the processor by the voice information.
  • the input voice information may include a user inquiry and the resultant information may include all the relevant information to the user inquiry.
  • the user inquiry may comprise an inquiry about a place of interest and the relevant information may include at least one of map information, route information and menu items relating to the place of interest.
  • the apparatus may further comprise means for recommending, by the processor, to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
  • the apparatus may further comprise means for twinkling, by the processor, the vehicle's headlights as a response to the user.
  • the apparatus may further comprise means for downloading, by the processor, the resultant information to a portable terminal of the user.
  • the present invention may be implemented by software with necessary hardware, or by hardware, firmware and the like. Based on such understanding, the embodiments of the present invention may be embodied in part in a software form.
  • the computer software may be stored in a readable storage medium such as a floppy disk, a hard disk, an optical disk or a flash memory of the computer.
  • the computer software comprises a series of instructions to make the computer (e.g., a personal computer, a service station or a network terminal) execute the method or a part thereof according to respective embodiments of the present invention.
  • Fig. 5 is a block diagram illustrating a hardware configuration of a computing device which can perform the method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
  • the computing device 5000 may comprise elements that are connected with or in communication with a bus 5002, possibly via one or more interfaces.
  • the computing device 5000 may comprise the bus 5002, and one or more processors 5004, one or more input devices 5006 and one or more output devices 5008.
  • the one or more processors 5004 may be any kinds of processors, and may comprise but are not limited to one or more general-purpose processors and/or one or more special-purpose processors (such as special processing chips) .
  • the input devices 5006 may be any kinds of devices that can input information to the computing device, and may comprise but are not limited to a mouse, a keyboard, a touch screen, a microphone and/or a remote control.
  • the output devices 5008 may be any kinds of devices that can present information, and may comprise but are not limited to display, a speaker, a video/audio output terminal, a vibrator and/or a printer.
  • the computing device 5000 may also comprise or be connected with non-transitory storage devices 5010 which may be any storage devices that are non-transitory and can implement data stores, and may comprise but are not limited to a disk drive, an optical storage device, a solid-state storage, a floppy disk, a flexible disk, hard disk, a magnetic tape or any other magnetic medium, a compact disc or any other optical medium, a ROM (Read Only Memory) , a RAM (Random Access Memory) , a cache memory and/or any other memory chip or cartridge, and/or any other medium from which a computer may read data, instructions and/or code.
  • non-transitory storage devices 5010 which may be any storage devices that are non-transitory and can implement data stores, and may comprise but are not limited to a disk drive, an optical
  • the non-transitory storage devices 5010 may be detachable from an interface.
  • the non-transitory storage devices 5010 may have data/instructions/code for implementing the methods and steps which are described above.
  • the computing device 5000 may also comprise a communication device 5012.
  • the communication device 5012 may be any kinds of device or system that can enable communication with external apparatuses and/or with a network, and may comprise but are not limited to a modem, a network card, an infrared communication device, a wireless communication device and/or a chipset such as a Bluetooth TM device, 1302.11 device, WiFi device, WiMax device, cellular communication facilities and/or the like.
  • the computing device 5000 may also comprise a working memory 5014, which may be any kind of working memory that may store instructions and/or data useful for the working of the processor 5004, and may comprise but is not limited to a random access memory and/or a read-only memory device.
  • working memory 5014 may be any kind of working memory that may store instructions and/or data useful for the working of the processor 5004, and may comprise but is not limited to a random access memory and/or a read-only memory device.
  • Software elements may be located in the working memory 5014, including but are not limited to an operating system 5016, one or more application programs 5018, drivers and/or other data and codes. Instructions for performing the methods and steps described in the above may be comprised in the one or more application programs 5018, and the various units of the aforementioned apparatus 4000 may be implemented by the processor 5004 reading and executing the instructions of the one or more application programs 5018. More specifically, the receiving unit 4002 of the aforementioned apparatus 4000 may, for example, be implemented by the processor 5004 when executing an application 5018 having instructions to perform step 3002 in the aforementioned method 3000.
  • the performing unit of the aforementioned apparatus 4000 may, for example, be implemented by the processor 5004 when executing an application 5018 having instructions to perform the step 3004 in the aforementioned method 3000.
  • Other units of the aforementioned apparatus 4000 may also, for example, be implemented by the processor 5004 when executing an application 5018 having instructions to perform one or more of the aforementioned respective steps.
  • the executable codes or source codes of the instructions of the software elements may be stored in a non-transitory computer-readable storage medium, such as the storage device (s) 5010 described above, and may be read into the working memory 5014 possibly with compilation and/or installation.
  • the executable codes or source codes of the instructions of the software elements may also be downloaded from a remote location.

Landscapes

  • Engineering & Computer Science (AREA)
  • Remote Sensing (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • Artificial Intelligence (AREA)
  • Navigation (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A system, an apparatus, a method and a computer program product for providing information via a vehicle. The system for providing information via a vehicle, comprising: a voice interface configured to input voice information from a user outside of the vehicle; a processor configured to receive the voice information from the voice interface, perform voice recognition on the received voice information, and obtain resultant information based on a result of the voice recognition; and an output device configured to output the result information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface. For example, the resultant information can be displayed to the user outside of the vehicle by a display, the resultant information can be also spoken out to the user outside of the vehicle by a speaker.

Description

SYSTEM, APPARATUS, METHOD AND COMPUTER PROGRAM PRODUCT FOR PROVIDING INFORMATION VIA VEHICLE FIELD OF THE INVENTION
The present invention relates in general to the field of providing information via a vehicle, and in more particular, to a system, an apparatus, a method and a computer program product for providing information via a vehicle.
BACKGROUND OF THE INVENTION
In recent years, a voice recognition and speech control system is increasingly popular. The voice recognition and speech control system can understand spoken commands of a user to control different functions. Furthermore, the voice recognition and speech control system can also be utilized in a vehicle so as to control different vehicle equipments such as radio, CD, navigator and so on with spoken commands. Moreover, the voice recognition and speech control system can understand synonyms of the spoken commands. For example, the voice recognition and speech control system can understand the spoken command "zoom in" as well as the spoken command "Enlarge" . In addition, the voice recognition and speech control system can allow the user to individually adapt the voice recognition to the specific sound and/or intonation of the user.
Nowadays, more and more people use a portable terminal such as a smart phone or a tablet to obtain and browse the information. Furthermore, in order to easily customize the appearance of a vehicle, it has been proposed to arrange a display on the exterior of the vehicle so as to display various graphical data such as customizable "skins" . The user can use the portable terminal to download the customizable "skins" and then transfer the obtained customizable "skins" to the display arranged on the exterior of the vehicle so as to change the appearance of the vehicle.
SUMMARY OF THE INVENTION
However, in the prior art, the voice recognition and speech control system is  typically installed within the vehicle, and thus the user can use the voice recognition and speech control system only when the user enters into and locates within the vehicle. As a result, when the user locates outside of the vehicle, he/she may be not able to use the voice recognition and speech control system within the vehicle.
Furthermore, in the prior art, the display arranged on the exterior of the vehicle is only used to display customizable "skins" so as to change the appearance of the vehicle. However, it cannot interact with the user and thus cannot provide useful information to the user.
Moreover, although the user can obtain and browse the information via the portable terminal, the portable terminal in general has a much smaller display, and thus the user may have a worse overview over the information which is presented.
An aspect of the present invention is to provide as system, an apparatus, a method and a computer program product for providing information via a vehicle that can address one or more of the above and other prior art problems.
In accordance with an exemplary embodiment of the present invention, there is provided a system for providing information via a vehicle, comprising: a voice interface configured to input voice information from a user outside of the vehicle; a processor configured to receive the voice information from the voice interface, perform voice recognition on the received voice information, and obtain resultant information based on a result of the voice recognition; and an output device configured to output the result information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
In an example of the present embodiment, the output device comprises at least one of a display and a speaker.
In an example of the present embodiment, the display is configured to face to the outside of the vehicle.
In an example of the present embodiment, the display is a transparent display.
In another example of the present embodiment, the voice interface comprises at least one microphone.
In another example of the present embodiment, the processor is further  configured to be woken up by the voice information.
In another example of the present embodiment, the input voice information includes a user inquiry and the resultant information includes all the relevant information to the user inquiry.
In another example of the present embodiment, the user inquiry comprises an inquiry about a place of interest and the relevant information includes at least one of map information, route information and menu items relating to the place of interest.
In another example of the present embodiment, the processor is further configured to recommend to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
In another example of the present embodiment, the processor is further configured to make the vehicle's headlights twinkle as a response to the user.
In another example of the present embodiment, the processor is further configured to download the resultant information to a portable terminal of the user.
In accordance with another exemplary embodiment of the present invention, there is provided a vehicle comprising the system according to any one of preceding claims.
In accordance with another exemplary embodiment of the present invention, there is provided a method of providing information via a vehicle, comprising: receiving, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; performing, by the processor, voice recognition on the received voice information; obtaining, by the processor, resultant information based on a result of the voice recognition; and outputting, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
In accordance with another exemplary embodiment of the present invention, there is provided an apparatus of providing information via a vehicle, comprising: receiving unit for receiving, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; performing unit for performing, by the processor, voice recognition on the received voice information; obtaining unit for obtaining, by the processor, resultant information based on a  result of the voice recognition; and outputting unit for outputting, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the display and the voice interface.
In accordance with another exemplary embodiment of the present invention, there is provided a computer program product for providing information via a vehicle, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the program instructions are readable by a processor to cause the processor to perform a method comprising: receiving voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; performing voice recognition on the received voice information; obtaining resultant information based on a result of the voice recognition; and outputting, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
In accordance with another exemplary embodiment of the present invention, there is provided an apparatus for providing information via a vehicle, comprising: a memory storing program instructions; and a processor configured to execute the programs instructions, wherein the program instructions, when executed by the processor, cause the apparatus to perform: receive voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle; perform voice recognition on the received voice information; obtain resultant information based on a result of the voice recognition; and output, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface.
The present invention can interact with the user outside of the vehicle and provide information to the user outside of the vehicle, and thus can bring the user with more convenience.
Further scope of applicability of the present invention will become apparent from the detailed description given hereinafter. However, it should be understood that the detailed description and specific examples, while indicating preferred embodiments of the  invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art from the following detailed description.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other aspects and advantages of the present invention will become apparent from the following detailed description of exemplary embodiments taken in conjunction with the accompanying drawings which illustrate, by way of example, the principles of the invention.
Fig. 1 illustrates a schematic diagram of a system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention;
Fig. 2 illustrates a block diagram of the system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention;
Fig. 3 illustrates a flow chart showing a method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention;
Fig. 4 illustrates a block diagram of an apparatus for providing information via a vehicle in accordance with an exemplary embodiment of the present invention; and
Fig. 5 is a block diagram illustrating a hardware configuration of a computing device which can perform the method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
In the following detailed description, numerous specific details are set forth to provide a thorough understanding of the described exemplary embodiments. It will be apparent, however, to one skilled in the art that the described embodiments can be practiced without some or all of these specific details. In other exemplary embodiments, well known structures or process steps have not been described in detail in order to avoid unnecessarily obscuring the concept of the present invention.
Referring firstly to Fig. 1, there is shown a schematic diagram of a system for providing information via a vehicle in accordance with an exemplary embodiment of the  present invention.
As shown in Fig. 1, a user 1002 stands outside of a vehicle 1000. The vehicle 1000 comprises a system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention. The user 1002 can wake up the system integrated in the vehicle 1000 with the voice information such as "Hello! " . Upon receiving and recognizing the voice information from the user 1002, the system integrated in the vehicle 1000 can enter into operation state and greet the user 1001 with response information such as "What can I do for you? " . Then, the user 1002 can interact with the system integrated in the vehicle 1000. For example, the user 1002 can input inquiries to the system integrated in the vehicle 1000 with voice information, and the system integrated in the vehicle 1000 can obtain and provide the resultant information to the user in response to the input voice information.
Furthermore, in addition to the interaction between the system integrated in the vehicle 1000 and the user 1002 via the voice, the user 1002 may also interact with the system integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
Moreover, in addition to the provision of the resultant information from the system integrated in the vehicle 1000 to the user 1002 via a display, the system integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as voice output (e.g. a speaker) and so on. That is to say, the system integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display but also via the other provision manners such as voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
Herein, the vehicle 1000 can be a rental vehicle. For example, the vehicle 1000 can be a rental vehicle with "DRIVENOW" service. Alternatively, the vehicle 1000 can be also a private vehicle. In this case, the owner of the private vehicle can be rewarded if  he/she allows the other users to interact with the private vehicle and obtain the information via the private vehicle.
In this embodiment, as the user 1002 stands outside of the vehicle 1000, the system integrated in the vehicle 1000 can interact with the user outside of the vehicle and provide information to the user outside of the vehicle, and thus can bring the user with more convenience.
In the following, the configuration of the system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention will be described in details with reference to Fig. 2. Fig. 2 illustrates a block diagram of the system for providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
As shown in Fig. 2, the system 2000 for providing information via a vehicle in accordance with an exemplary embodiment of the present invention can comprises a voice interface 2002, an output device 2004 and a processor 2006. The processor 2006 can be connected to both the voice interface 2002 and the output device 2004.
The voice interface 2002 in the system 2000 can be configured to input voice information from a user 1002 outside of the vehicle 1000.
In an example, the voice interface 2002 in the system 2000 can be arranged on the exterior of the vehicle 1000. For example, the voice interface 2002 can be arranged on the exterior of the vehicle 1000 at a position where the user 1002 can easily approach to. For example, the voice interface 2002 can be arranged on the exterior of the vehicle 1000 around door windows of the vehicle 1000. In another example, if the vehicle 1000 is a hatchback vehicle, the voice interface 2002 can also be arranged on the exterior of the vehicle 1000 around the rear windshield.
In another example, the voice interface 2002 in the system 2000 can be arranged in the exterior of the vehicle 1000. For example, the voice interface 2002 in the system 2000 may be arranged within a roof antenna of the vehicle 1000 or within an air inlet/outlet part of the vehicle 1000.
In an example of the present embodiment, the voice interface may comprise at least one microphone. The voice interface is not limited to the microphone, and can be any  other device which can pick up the sound. Note that only one microphone can implement the function of the present invention. However, the number of microphone is not limited to one microphone.
In a preferable embodiment of the present invention, the voice interface may comprise two or more microphones arranged in an array so as to reduce the environment noise. The vehicle 1000 is generally parked on the side of the street and the user 1002 stands outside of the vehicle 1000, and thus the environment noise is relatively large. The utilization of the array of microphones can reduce the environment noise and improve the quality of the picked-up sound.
Referring again to Fig. 2, the processor 2006 in the system 2000 can be configured to receive the voice information from the voice interface 2002, perform voice recognition on the received voice information, and obtain resultant information based on a result of the voice recognition.
In an example of the present invention, the processor 2006 can be arranged within the vehicle 1000. In another example of the present invention, the processor 2006 can be integrated into the exterior of the vehicle 1000. The processor 2006 is connected to the voice interface 2002, and thus the processor 2006 can receive the voice information from the voice interface 2002.
The processor 2006 can perform voice recognition on the received voice information. For example, the processor 2006 can utilize any voice recognition method available in the art to perform the voice recognition on the received voice information. After voice recognition, the received voice information can be recognized as, for example, text information. That is to say, a result of the voice recognition may be for example text information.
The processor 2006 can obtain resultant information based on a result of the voice recognition. For example, the processor 2006 can be connected to a backbend system via a network such as Internet, Intranet, Local Area Network (LAN) and so on. In this case, the processor 2006 can retrieve the backbend system with the result of the voice recognition so as to obtain the resultant information. In another example of the present invention, the processor 2006 can be connected to a local repository database. In this example, the processor  2006 can retrieve the local repository database with the result of the voice recognition so as to obtain the resultant information.
The processor 2006 is connected to an output device 2004, and thus the processor 2006 can provide the resultant information to the output device 2004.
Referring again to Fig. 2, the output device 2004 in the system 2000 can be configured to output the resultant information to the user 1002 outside of the vehicle 1000.
In an example of the present invention, the output device 2004 comprises at least one of a display and a speaker.
In an example of the present invention, the display is configured to face to the outside of the vehicle 1000.
In an example, the display can be arranged on the exterior of the vehicle 1000 at a position where the user 1002 can easily approach to. For example, the display can be arranged on the exterior of the vehicle 1000 around door windows of the vehicle 1000. In another example, if the vehicle 1000 is a hatchback vehicle, the display can also be arranged on the exterior of the vehicle 1000 around the rear windshield.
In another example, the display can be arranged inside the vehicle 1000 and face to the outside of the vehicle 1000. For example, the display can be arranged behind the window of the vehicle 1000.
In accordance with an exemplary embodiment of the present invention, the display can be a transparent display. For example, the display may be LED display, LCD display, OLED display or the like.
The display can be configured to face to the outside of the vehicle 1000 so as to display the resultant information to the user 1002 outside of the vehicle 1000. In the embodiment of the present invention, the display can receive the resultant information from the processor 2006 and display the resultant information to the user 1002 outside of the vehicle 1000. As the display has larger display area than the portable terminal such as smart phone, tablet or the like, the user can have a better overview over the information which is presented. Furthermore, the display can provide more useful resultant information to the user 1002 outside of the vehicle 1000.
Furthermore, in addition to the interaction between the system 2000 integrated  in the vehicle 1000 and the user 1002 via the voice, the user 1002 may also interact with the system 2000 integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system 2000 integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
Moreover, in addition to the provision of the resultant information from the system integrated in the vehicle 1000 to the user 1002 via the display, the system 2000 integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as the voice output (e.g. a speaker) and so on. That is to say, the system 2000 integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display 2004 but also via the other provision manners such as the voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
For example, when the user 1002 input the voice information into the system 2000 via the voice interface 2002, the processor 2006 in the system 2000 can receive the voice information from the voice interface 2002, perform voice recognition on the received voice information, and obtain the resultant information. Then, the display can display the resultant information to the user 1002 outside of the vehicle 1000, the speaker can speak out the resultant information to the user 1002 outside of the vehicle 1000.
In an example, the speaker can be arranged on the exterior of the vehicle 1000. For example, the speaker can be arranged on the exterior of the vehicle 1000 at a position where the user 1002 can easily approach to. For example, the speaker can be arranged on the exterior of the vehicle 1000 around door windows of the vehicle 1000. In another example, if the vehicle 1000 is a hatchback vehicle, the speaker can also be arranged on the exterior of the vehicle 1000 around the rear windshield.
In another example, the speaker can be arranged in the exterior of the vehicle 1000. For example, the speaker may be arranged within a roof antenna of the vehicle 1000 or within an air inlet/outlet part of the vehicle 1000.
In accordance with an exemplary embodiment of the present invention, the  processor 2006 can be further configured to be woken up by the voice information. For example, when the user 1002 speaks the voice information such as "Hello! " to the voice interface 2002 in the system 2000, the processor 2006 in the system 2000 can be woken up and greet the user 1001 with response information such as "What can I do for you? " . In this way, if there are no users to interact with the system 2000, the system 2000 will be in a standby state, and thus the entire power consumption of the system 2000 can be saved.
In accordance with an exemplary embodiment of the present invention, the input voice information may include a user inquiry and the resultant information may include all the relevant information to the user inquiry.
For example, if the user 1002 tours a scenic spot, the user 1002 can inquiry the system 2000 about the tourist information relating to the scenic spot via the voice interface 2002. The processor 2006 in the system 2000 can receive the inquiry about the scenic spot from the voice interface 2002, perform voice recognition on the received inquiry about the scenic spot, and obtain the tourist information relating to the scenic spot based on the inquiry about the scenic spot. Then, the output device 2004 in the system 2000 can output the tourist information relating to the scenic spot to the user 1002 outside of the vehicle 1000. For example, the display can display the tourist information relating to the scenic spot to the user 1002 outside of the vehicle 1000, the speaker can speak out the tourist information relating to the scenic spot to the user 1002 outside of the vehicle 1000. It is noted that the output device 2004 is not limited to the display and the speaker.
In another example, the user 1002 can inquiry the system 2000 about the translation of a foreign language via the voice interface 2002. The processor 2006 in the system 2000 can receive the inquiry about the translation of the foreign language from the voice interface 2002, perform voice recognition on the received inquiry about the translation of the foreign language, and obtain the translation of the foreign language. Then, the output device 2004 in the system 2000 can output the translation of the foreign language to the user 1002 outside of the vehicle 1000. For example, the display can display the translation of the foreign language to the user 1002 outside of the vehicle 1000, the speaker can speak out the translation of the foreign language to the user 1002 outside of the vehicle 1000. It is noted that the output device 2004 is not limited to the display and the speaker.
In accordance with an exemplary embodiment of the present invention, the user inquiry may comprise an inquiry about a place of interest and the relevant information may include at least one of map information, route information and menu items relating to the place of interest.
For example, the user 1002 can inquiry the system 2000 about the popular local cinema or restaurant via the voice interface 2002. The processor 2006 in the system 2000 can receive the inquiry about the popular local cinema or restaurant from the voice interface 2002, perform voice recognition on the received inquiry about the popular local cinema or restaurant, and obtain the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant. Then, the output device 2004 in the system 2000 can output the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant to the user 1002 outside of the vehicle 1000. For example, the display can display the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant to the user 1002 outside of the vehicle 1000, the speaker can speak out the location of the popular local cinema or restaurant, the route to the popular local cinema or restaurant, and/or discount coupon relating to the popular local cinema or restaurant to the user 1002 outside of the vehicle 1000. It is noted that the output device 2004 is not limited to the display and the speaker.
In accordance with an exemplary embodiment of the present invention, the processor may be further configured to recommend to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
For example, the processor 2006 in the system 2000 can calculate the distance between the current position of the user 1002 and the place of interest. If the processor 2006 determines that the distance is within a walking distance such as less than 2 KM, the processor 2006 may recommend the user 1002 to walk to the place of interest. On the other hand, if the processor 2006 determines that the distance is beyond the walking distance such  as more than 2 KM, the processor 2006 may recommend the user 1002 to take the car to the place of interest.
In accordance with an exemplary embodiment of the present invention, the processor is further configured to make the vehicle's headlights twinkle as a response to the user.
For example, when the user 1002 speaks the voice information into the voice interface 2002 and the processor 2006 recognizes the input voice information, the processor 2006 can be configured to make the headlight of the vehicle 1000 twinkle to indicate that the system 2000 understands the voice information from the user 1002. This will make the interaction between the user 1002 and the system 2000 more vivid and interesting.
In accordance with an exemplary embodiment of the present invention, the processor is further configured to download the resultant information to a portable terminal of the user.
For example, when the output device 2004 outputs the resultant information to the user 1002 outside of the vehicle 1000, the user 1002 can also download the resultant information to his/her portable terminal such as smart phone, tablet or the like. This will bring more convenience to the user 1002.
With reference to Fig. 3, it is a flow chart showing a method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention. The method starts at step 3000. After step 3000, the method proceeds to step 3002.
At step 3002, voice information is received from a voice interface by a processor, wherein the voice interface is configured to input the voice information from a user outside of the vehicle.
After step 3002, the method proceeds to step 3004. At step 3004, voice recognition is performed on the received voice information by the processor.
After step 3004, the method proceeds to step 3006. At step 3006, resultant information is obtained based on a result of the voice recognition by the processor.
After step 3006, the method proceeds to step 3008. At step 3008, the resultant information is output to the user outside of the vehicle by an output device, wherein the processor is connected to both the output device and the voice interface. For example, the  resultant information can be displayed to the user outside of the vehicle by a display, the resultant information can be also spoken out to the user outside of the vehicle by a speaker. It is noted that the output device 2004 is not limited to the display and the speaker.
Finally, the method ends at step 3010.
Furthermore, in addition to the interaction between the system 2000 integrated in the vehicle 1000 and the user 1002 via the voice, the user 1002 may also interact with the system 2000 integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system 2000 integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
Moreover, in addition to the provision of the resultant information from the system integrated in the vehicle 1000 to the user 1002 via the display, the system 2000 integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as the voice output (e.g. a speaker) and so on. That is to say, the system 2000 integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display but also via the other provision manners such as the voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
In accordance with an exemplary embodiment of the present invention, the output device may comprise at least one of a display and a speaker.
In accordance with an exemplary embodiment of the present invention, the display may be configured to face to the outside of the vehicle.
In accordance with an exemplary embodiment of the present invention, the display may be a transparent display.
In accordance with an exemplary embodiment of the present invention, the voice interface may comprise at least one microphone.
In accordance with an exemplary embodiment of the present invention, the method may further comprise the step of waking up the processor by the voice information.
In accordance with an exemplary embodiment of the present invention, the  input voice information may include a user inquiry and the resultant information may include all the relevant information to the user inquiry.
In accordance with an exemplary embodiment of the present invention, the user inquiry may comprise an inquiry about a place of interest and the relevant information may include at least one of map information, route information and menu items relating to the place of interest.
In accordance with an exemplary embodiment of the present invention, the method may further comprise the step of recommending, by the processor, to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
In accordance with an exemplary embodiment of the present invention, the method may further comprise the step of twinkling, by the processor, the vehicle's headlights as a response to the user.
In accordance with an exemplary embodiment of the present invention, the method may further comprise the step of downloading, by the processor, the resultant information to a portable terminal of the user.
According to the embodiment of the present invention, interaction with the user outside of the vehicle can be performed and information can be provide to the user outside of the vehicle, and thus the use can be brought with more convenience.
Fig. 4 illustrates a block diagram of an apparatus for providing information via a vehicle in accordance with an exemplary embodiment of the present invention. The blocks of the apparatus 4000 may be implemented by hardware, software, firmware, or any combination thereof to carry out the principles of the present invention. It is understood by those skilled in the art that the blocks described in Fig. 4 may be combined or separated into sub-blocks to implement the principles of the invention as described above. Therefore, the description herein may support any possible combination or separation or further definition of the blocks described herein.
Further, since operations of some components of the apparatus 4000 may become apparent with reference to the methods discussed in relation to Fig. 3, the apparatus 4000 will be described briefly hereinafter.
Referring to Fig. 4, the apparatus 4000 may include a receiving unit 4002, a performing unit 4004, an obtaining unit 4006 and an outputting unit 4008. The receiving unit 4002 may be configured to receive, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle. The performing unit 4004 may be configured to perform, by the processor, voice recognition on the received voice information. The obtaining unit 4006 may be configured to obtain, by the processor, resultant information based on a result of the voice recognition. The outputting unit 4008 may be configured to output, by an output device, the resultant information to the user outside of the vehicle, wherein the processor is connected to both the output device and the voice interface. For example, the resultant information can be displayed to the user outside of the vehicle by a display, the resultant information can be also spoken out to the user outside of the vehicle by a speaker. It is noted that the output device 2004 is not limited to the display and the speaker.
Furthermore, in addition to the interaction between the system 2000 integrated in the vehicle 1000 and the user 1002 via the voice, the user 1002 may also interact with the system 2000 integrated in the vehicle 1002 via other interaction manners such as touch, gesture and so on. That is to say, the user 1002 may interact with the system 2000 integrated in the vehicle 1002 not only via the voice but also via the other interaction manners such as touch, gesture and so no. In this way, the various interaction manners will bring more convenience to the user 1002.
Moreover, in addition to the provision of the resultant information from the system integrated in the vehicle 1000 to the user 1002 via the display, the system 2000 integrated in the vehicle 1002 may also provide the resultant information to the user 1002 via other provision manners such as the voice output (e.g. a speaker) and so on. That is to say, the system 2000 integrated in the vehicle 1002 may provide the resultant information to the user 1002 not only via the display but also via the other provision manners such as the voice output (e.g. a speaker) and so no. In this way, the various provision manners of the resultant information will bring more convenience to the user 1002.
In accordance with an exemplary embodiment of the present invention, the output device may comprise at least one of a display and a speaker.
In accordance with an exemplary embodiment of the present invention, the display may be configured to face to the outside of the vehicle.
In accordance with an exemplary embodiment of the present invention, the display may be a transparent display.
In accordance with an exemplary embodiment of the present invention, the voice interface may comprise at least one microphone.
In accordance with an exemplary embodiment of the present invention, the apparatus may further comprise means for waking up the processor by the voice information.
In accordance with an exemplary embodiment of the present invention, the input voice information may include a user inquiry and the resultant information may include all the relevant information to the user inquiry.
In accordance with an exemplary embodiment of the present invention, the user inquiry may comprise an inquiry about a place of interest and the relevant information may include at least one of map information, route information and menu items relating to the place of interest.
In accordance with an exemplary embodiment of the present invention, the apparatus may further comprise means for recommending, by the processor, to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
In accordance with an exemplary embodiment of the present invention, the apparatus may further comprise means for twinkling, by the processor, the vehicle's headlights as a response to the user.
In accordance with an exemplary embodiment of the present invention, the apparatus may further comprise means for downloading, by the processor, the resultant information to a portable terminal of the user.
Those skilled in the art may clearly know from the above embodiments that the present invention may be implemented by software with necessary hardware, or by hardware, firmware and the like. Based on such understanding, the embodiments of the present invention may be embodied in part in a software form. The computer software may be stored in a readable storage medium such as a floppy disk, a hard disk, an optical disk or a  flash memory of the computer. The computer software comprises a series of instructions to make the computer (e.g., a personal computer, a service station or a network terminal) execute the method or a part thereof according to respective embodiments of the present invention.
Fig. 5 is a block diagram illustrating a hardware configuration of a computing device which can perform the method of providing information via a vehicle in accordance with an exemplary embodiment of the present invention.
The computing device 5000 may comprise elements that are connected with or in communication with a bus 5002, possibly via one or more interfaces. For example, the computing device 5000 may comprise the bus 5002, and one or more processors 5004, one or more input devices 5006 and one or more output devices 5008. The one or more processors 5004 may be any kinds of processors, and may comprise but are not limited to one or more general-purpose processors and/or one or more special-purpose processors (such as special processing chips) . The input devices 5006 may be any kinds of devices that can input information to the computing device, and may comprise but are not limited to a mouse, a keyboard, a touch screen, a microphone and/or a remote control. The output devices 5008 may be any kinds of devices that can present information, and may comprise but are not limited to display, a speaker, a video/audio output terminal, a vibrator and/or a printer. The computing device 5000 may also comprise or be connected with non-transitory storage devices 5010 which may be any storage devices that are non-transitory and can implement data stores, and may comprise but are not limited to a disk drive, an optical storage device, a solid-state storage, a floppy disk, a flexible disk, hard disk, a magnetic tape or any other magnetic medium, a compact disc or any other optical medium, a ROM (Read Only Memory) , a RAM (Random Access Memory) , a cache memory and/or any other memory chip or cartridge, and/or any other medium from which a computer may read data, instructions and/or code. The non-transitory storage devices 5010 may be detachable from an interface. The non-transitory storage devices 5010 may have data/instructions/code for implementing the methods and steps which are described above. The computing device 5000 may also comprise a communication device 5012. The communication device 5012 may be any kinds of device or system that can enable communication with external apparatuses and/or with a  network, and may comprise but are not limited to a modem, a network card, an infrared communication device, a wireless communication device and/or a chipset such as a BluetoothTM device, 1302.11 device, WiFi device, WiMax device, cellular communication facilities and/or the like.
The computing device 5000 may also comprise a working memory 5014, which may be any kind of working memory that may store instructions and/or data useful for the working of the processor 5004, and may comprise but is not limited to a random access memory and/or a read-only memory device.
Software elements may be located in the working memory 5014, including but are not limited to an operating system 5016, one or more application programs 5018, drivers and/or other data and codes. Instructions for performing the methods and steps described in the above may be comprised in the one or more application programs 5018, and the various units of the aforementioned apparatus 4000 may be implemented by the processor 5004 reading and executing the instructions of the one or more application programs 5018. More specifically, the receiving unit 4002 of the aforementioned apparatus 4000 may, for example, be implemented by the processor 5004 when executing an application 5018 having instructions to perform step 3002 in the aforementioned method 3000. In addition, the performing unit of the aforementioned apparatus 4000 may, for example, be implemented by the processor 5004 when executing an application 5018 having instructions to perform the step 3004 in the aforementioned method 3000. Other units of the aforementioned apparatus 4000 may also, for example, be implemented by the processor 5004 when executing an application 5018 having instructions to perform one or more of the aforementioned respective steps. The executable codes or source codes of the instructions of the software elements may be stored in a non-transitory computer-readable storage medium, such as the storage device (s) 5010 described above, and may be read into the working memory 5014 possibly with compilation and/or installation. The executable codes or source codes of the instructions of the software elements may also be downloaded from a remote location.
It should also be appreciated that variations may be made in accordance with specific requirements. For example, customized hardware might also be used, and/or particular elements might be implemented in hardware, software, firmware, middleware,  microcode, hardware description languages, or any combination thereof. Further, connection to other computing devices such as network input/output devices may be employed. For example, some or all of the disclosed methods and devices may be implemented by programming hardware (for example, a programmable logic circuitry including field-programmable gate arrays (FPGA) and/or programmable logic arrays (PLA) ) with an assembler language or a hardware programming language (such as VERILOG, VHDL, C++) by using the logic and algorithm according to the present disclosure.
Although aspects of the present disclosures have been described by far with reference to the drawings, the methods, systems, and apparatuses described above are merely exemplary examples, and the scope of the present invention is not limited by these aspects, but is only defined by the appended claims and equivalents thereof. Various elements may be omitted or may be substituted by equivalent elements. In addition, the steps may be performed in an order different from what is described in the present disclosures. Furthermore, various elements may be combined in various manners. What is also important is that as the technology evolves, many of the elements described may be substituted by equivalent elements which emerge after the present disclosure.

Claims (15)

  1. A system for providing information via a vehicle, comprising:
    a voice interface configured to input voice information from a user outside of the vehicle;
    a processor configured to receive the voice information from the voice interface, perform voice recognition on the received voice information, and obtain resultant information based on a result of the voice recognition; and
    an output device configured to output the resultant information to the user outside of the vehicle,
    wherein the processor is connected to both the output device and the voice interface.
  2. The system according to claim 1, wherein the output device comprises at least one of a display and a speaker.
  3. The system according to claim 2, wherein the display is configured to face to the outside of the vehicle.
  4. The system according to claim 2 or 3, wherein the display is a transparent display.
  5. The system according to claim 1, wherein the voice interface comprises at least one microphone.
  6. The system according to claim 1, wherein the processor is further configured to be woken up by the voice information.
  7. The system according to claim 1, wherein the input voice information includes a user inquiry and the resultant information includes all the relevant information to the user inquiry.
  8. The system according to claim 7, wherein the user inquiry comprises an inquiry about a place of interest and the relevant information includes at least one of map information, route information and menu items relating to the place of interest.
  9. The system according to claim 8, wherein the processor is further configured to recommend to the user whether to walk or take cars to the place of interest based on a distance between the user's current position and the place of interest.
  10. The system according to claim 1, wherein the processor is further configured to make the vehicle's headlights twinkle as a response to the user.
  11. The system according to claim 1, wherein the processor is further configured to download the resultant information to a portable terminal of the user.
  12. A vehicle comprising the system according to any one of claims 1-11.
  13. A method of providing information via a vehicle, comprising:
    receiving, by a processor, voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle;
    performing, by the processor, voice recognition on the received voice information;
    obtaining, by the processor, resultant information based on a result of the voice recognition; and
    outputting, by an output device, the resultant information to the user outside of the vehicle,
    wherein the processor is connected to both the output device and the voice interface.
  14. A computer program product for providing information via a vehicle, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the program instructions are readable by a processor to cause the processor to perform a method comprising:
    receiving voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle;
    performing voice recognition on the received voice information;
    obtaining resultant information based on a result of the voice recognition; and
    outputting, by an output device, the resultant information to the user outside of the vehicle,
    wherein the processor is connected to both the output device and the voice interface.
  15. An apparatus for providing information via a vehicle, comprising:
    a memory storing program instructions; and
    a processor configured to execute the programs instructions, wherein the program instructions, when executed by the processor, cause the apparatus to perform:
    receive voice information from a voice interface, wherein the voice interface is configured to input the voice information from a user outside of the vehicle;
    perform voice recognition on the received voice information;
    obtain resultant information based on a result of the voice recognition; and
    output, by an output device, the resultant information to the user outside of the vehicle,
    wherein the processor is connected to both the output device and the voice interface.
PCT/CN2015/075011 2015-03-25 2015-03-25 System, apparatus, method and computer program product for providing information via vehicle WO2016149915A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
DE112015006350.1T DE112015006350T5 (en) 2015-03-25 2015-03-25 SYSTEM, DEVICE, METHOD AND COMPUTER PROGRAM PRODUCT FOR PROVIDING INFORMATION ON A VEHICLE
PCT/CN2015/075011 WO2016149915A1 (en) 2015-03-25 2015-03-25 System, apparatus, method and computer program product for providing information via vehicle
CN201580073006.4A CN107107846B (en) 2015-03-25 2015-03-25 For providing system, device, the method and computer program product of information via vehicle

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/075011 WO2016149915A1 (en) 2015-03-25 2015-03-25 System, apparatus, method and computer program product for providing information via vehicle

Publications (1)

Publication Number Publication Date
WO2016149915A1 true WO2016149915A1 (en) 2016-09-29

Family

ID=56977752

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/075011 WO2016149915A1 (en) 2015-03-25 2015-03-25 System, apparatus, method and computer program product for providing information via vehicle

Country Status (3)

Country Link
CN (1) CN107107846B (en)
DE (1) DE112015006350T5 (en)
WO (1) WO2016149915A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020221602A1 (en) * 2019-04-30 2020-11-05 Volkswagen Aktiengesellschaft Method for personalizing a motor vehicle
US11302304B2 (en) 2018-06-04 2022-04-12 Audi Ag Method for operating a sound output device of a motor vehicle using a voice-analysis and control device
CN115103160A (en) * 2022-06-21 2022-09-23 润芯微科技(江苏)有限公司 Vehicle-mounted real-time communication system based on TTS technology

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10479300B2 (en) * 2017-10-06 2019-11-19 Ford Global Technologies, Llc Monitoring of vehicle window vibrations for voice-command recognition
JP2019120839A (en) * 2018-01-09 2019-07-22 トヨタ自動車株式会社 Voice output device, method for voice output, and voice output program
US20200047687A1 (en) * 2018-08-10 2020-02-13 SF Motors Inc. Exterior speech interface for vehicle
JP7396792B2 (en) * 2018-09-19 2023-12-12 トヨタ自動車株式会社 Information provision device, information provision method, and program
CN115118816B (en) * 2021-10-22 2023-11-17 博泰车联网科技(上海)股份有限公司 Voice interaction method and system based on position

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1884421A1 (en) * 2006-08-04 2008-02-06 Harman Becker Automotive Systems GmbH Method and system for processing voice commands in a vehicle enviroment
EP1908640A1 (en) * 2006-10-02 2008-04-09 Harman Becker Automotive Systems GmbH Voice control of vehicular elements from outside a vehicular cabin
CN104175950A (en) * 2013-05-23 2014-12-03 北京千橡网景科技发展有限公司 Method and equipment for communication between personnel in vehicle and outside

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101072304A (en) * 2006-05-09 2007-11-14 上海中策工贸有限公司 Automobile pick-up head media input and video traveling system
CN100495470C (en) * 2007-11-27 2009-06-03 张涛 Vehicle agility device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1884421A1 (en) * 2006-08-04 2008-02-06 Harman Becker Automotive Systems GmbH Method and system for processing voice commands in a vehicle enviroment
EP1908640A1 (en) * 2006-10-02 2008-04-09 Harman Becker Automotive Systems GmbH Voice control of vehicular elements from outside a vehicular cabin
CN104175950A (en) * 2013-05-23 2014-12-03 北京千橡网景科技发展有限公司 Method and equipment for communication between personnel in vehicle and outside

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11302304B2 (en) 2018-06-04 2022-04-12 Audi Ag Method for operating a sound output device of a motor vehicle using a voice-analysis and control device
WO2020221602A1 (en) * 2019-04-30 2020-11-05 Volkswagen Aktiengesellschaft Method for personalizing a motor vehicle
CN115103160A (en) * 2022-06-21 2022-09-23 润芯微科技(江苏)有限公司 Vehicle-mounted real-time communication system based on TTS technology

Also Published As

Publication number Publication date
CN107107846A (en) 2017-08-29
CN107107846B (en) 2019-10-18
DE112015006350T5 (en) 2017-11-30

Similar Documents

Publication Publication Date Title
WO2016149915A1 (en) System, apparatus, method and computer program product for providing information via vehicle
US20210216276A1 (en) Speech recognition method and apparatus with activation word based on operating environment of the apparatus
US9211854B2 (en) System and method for incorporating gesture and voice recognition into a single system
CN108829235B (en) Voice data processing method and electronic device supporting the same
US11211033B2 (en) Agent device, method of controlling agent device, and storage medium for providing service based on vehicle occupant speech
KR102261552B1 (en) Providing Method For Voice Command and Electronic Device supporting the same
US9899023B2 (en) Audio video navigation device, vehicle and method for controlling the audio video navigation device
US10290300B2 (en) Text rule multi-accent speech recognition with single acoustic model and automatic accent detection
JP6289448B2 (en) Instant translation system
US10083003B2 (en) Audio video navigation (AVN) apparatus, vehicle, and control method of AVN apparatus
US9704487B2 (en) Speech recognition solution based on comparison of multiple different speech inputs
KR20140007282A (en) Speech recognition apparatus and method thereof
CN103038818A (en) Communication system and method between an on-vehicle voice recognition system and an off-vehicle voice recognition system
US20240070213A1 (en) Vehicle driving policy recommendation method and apparatus
US20200320997A1 (en) Agent apparatus, agent apparatus control method, and storage medium
CN111667824A (en) Agent device, control method for agent device, and storage medium
US20200321006A1 (en) Agent apparatus, agent apparatus control method, and storage medium
KR101681988B1 (en) Speech recognition apparatus, vehicle having the same and speech recongition method
CN111731320A (en) Agent system, agent server, control method thereof, and storage medium
JP2014065359A (en) Display control device, display system and display control method
JP2020153917A (en) Vehicle control system, agent device, vehicle control method, and program
CN112259091B (en) Method for generating auxiliary operation voice, vehicle-mounted terminal and computer storage medium
CN114889552B (en) Control method and system applied to vehicle, electronic device and storage medium
WO2023236691A1 (en) Control method based on vehicle external audio system, vehicle intelligent marketing method, electronic apparatus, and storage medium
CN114582335A (en) Vehicle information interaction method and related device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15885854

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 112015006350

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15885854

Country of ref document: EP

Kind code of ref document: A1