WO2019114718A1 - 人车交互方法、装置、车载智能控制器及系统 - Google Patents

人车交互方法、装置、车载智能控制器及系统 Download PDF

Info

Publication number
WO2019114718A1
WO2019114718A1 PCT/CN2018/120432 CN2018120432W WO2019114718A1 WO 2019114718 A1 WO2019114718 A1 WO 2019114718A1 CN 2018120432 W CN2018120432 W CN 2018120432W WO 2019114718 A1 WO2019114718 A1 WO 2019114718A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
intelligent controller
information
output
preset
Prior art date
Application number
PCT/CN2018/120432
Other languages
English (en)
French (fr)
Inventor
陈颖瑞
Original Assignee
蔚来汽车有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 蔚来汽车有限公司 filed Critical 蔚来汽车有限公司
Priority to EP18888631.1A priority Critical patent/EP3726342B1/en
Publication of WO2019114718A1 publication Critical patent/WO2019114718A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/26—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using acoustic output
    • B60K35/265—Voice
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/28—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/50—Instruments characterised by their means of attachment to or integration in the vehicle
    • B60K35/53—Movable instruments, e.g. slidable
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R22/00—Safety belts or body harnesses in vehicles
    • B60R22/48—Control systems, alarms, or interlock systems, for the correct application of the belt or harness
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/141—Activation of instrument input devices by approaching fingers or pens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/16—Type of output information
    • B60K2360/164—Infotainment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77—Instrument locations other than the dashboard
    • B60K2360/774—Instrument locations other than the dashboard on or in the centre console
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/77—Instrument locations other than the dashboard
    • B60K2360/794—Instrument locations other than the dashboard on or in doors
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R22/00—Safety belts or body harnesses in vehicles
    • B60R22/48—Control systems, alarms, or interlock systems, for the correct application of the belt or harness
    • B60R2022/4808—Sensing means arrangements therefor
    • B60R2022/4816—Sensing means arrangements therefor for sensing locking of buckle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R22/00—Safety belts or body harnesses in vehicles
    • B60R22/48—Control systems, alarms, or interlock systems, for the correct application of the belt or harness
    • B60R2022/4866—Displaying or indicating arrangements thereof
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B60W2040/0881—Seat occupation; Driver or passenger presence
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143—Alarm means
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146—Display means

Definitions

  • the invention belongs to the technical field of vehicles, and particularly relates to a method and device for interacting with people and vehicles, an intelligent controller and system for vehicles.
  • an aspect of the present invention provides a human-car interaction method, including:
  • an action output and/or information output of the onboard intelligent controller of the vehicle is controlled to interact with the user.
  • action output and/or information output includes:
  • the action output includes a rotation of a screen of the in-vehicle intelligent controller, and/or a body, and/or a head; and/or
  • the information output includes an emoticon animation, and/or voice, and/or text.
  • the step of "controlling the action output and/or information output of the onboard intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information" comprises:
  • Detecting a door opening action and detecting that the corresponding seat is in an occupied state controlling the screen of the in-vehicle intelligent controller to turn to the corresponding seat, and/or displaying a preset farewell emoticon, and/or outputting a preset farewell speech Information, and/or output of preset farewell text information;
  • the step of "controlling the action output and/or information output of the onboard intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information" comprises:
  • the expression animation of the onboard intelligent controller screen is selected and controlled to be displayed according to a preset correspondence relationship.
  • the step of "controlling the action output and/or information output of the onboard intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information" comprises:
  • the screen of the in-vehicle intelligent controller is controlled to turn to the preset detection bit.
  • the step of "controlling the action output and/or information output of the onboard intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information" comprises:
  • the safety belt is not reminded to include the screen of the onboard intelligent controller turning to a corresponding seat, and/or displaying a preset seat belt reminder emoticon animation, and/or outputting a preset seat belt reminding voice information, and/or output
  • the default seat belt reminds the text message.
  • the in-vehicle intelligent controller when there are a plurality of seat belt unrequested tasks, the in-vehicle intelligent controller is controlled to follow the driving position, the passenger position, the rear row from left to right, or from right to left. The seat belt was not reminded.
  • an in-vehicle intelligent controller including:
  • An acquisition module configured to acquire vehicle sensor information and/or user behavior information
  • An interaction module configured to control an action output and/or information output of an onboard intelligent controller of the vehicle to interact with the user based on the acquired vehicle sensor information and/or user behavior information.
  • a third aspect of the present invention provides an in-vehicle intelligent control system including an acquisition device, a control device, and an execution device;
  • Acquiring means configured to acquire vehicle sensor information and/or user behavior information
  • control device configured to transmit a control instruction to the execution device based on the acquired vehicle sensor information and/or user behavior information
  • An execution device configured to control an action output and/or information output of an onboard intelligent controller of the vehicle in accordance with the control command.
  • action output and/or information output includes:
  • the action output includes a rotation of a screen of the in-vehicle intelligent controller, and/or a body, and/or a head; and/or
  • the information output includes an emoticon animation, and/or voice, and/or text.
  • control device further includes a first control unit and a second control unit, where
  • the first control unit is configured to detect a door opening action, and detect that the corresponding seat is in an occupied state, then control the screen of the in-vehicle intelligent controller to turn to the corresponding seat, and/or display a preset farewell emoticon, And/or outputting preset farewell voice information, and/or outputting preset farewell text information;
  • the second control unit is configured to detect a door opening action and detect that the corresponding seat is in an idle state, then control a screen of the in-vehicle intelligent controller to turn to the door, and/or display a preset welcome emoticon, and / or output preset welcome voice messages, and / or output preset welcome text messages.
  • control device further includes a third control unit configured to select and control a screen of the in-vehicle intelligent controller according to a rhythm and style of the music played by the vehicle.
  • the expression animation is displayed in accordance with the preset correspondence.
  • control device further includes a fourth control unit, the fourth control unit configured to control the vehicle when a preset detection position in the vehicle detects an object approaching The screen of the intelligent controller turns to the preset detection bit.
  • control device further includes a fifth control unit, where the fifth control unit is configured to:
  • the safety belt is not reminded to include the screen of the onboard intelligent controller turning to a corresponding seat, and/or displaying a preset seat belt reminder emoticon animation, and/or outputting a preset seat belt reminding voice information, and/or output
  • the default seat belt reminds the text message.
  • the fifth control unit is further configured to:
  • the in-vehicle intelligent controller is sequentially controlled to perform the seat belt uninstruction in the order of the driving position, the passenger seat position, the rear row from left to right, or from right to left.
  • the present invention provides a human-car interaction method, including controlling an action output and/or information output of a vehicle-mounted intelligent controller of a vehicle based on the acquired vehicle sensor information and/or user behavior information. To interact with the user.
  • the method of the present invention can output corresponding actions and information according to the information of the sensor of the vehicle and/or the behavior information of the user, and display corresponding information according to the behavior of the user, which can well interact with the user. Interact and enhance the user experience.
  • FIG. 1 is a schematic diagram showing main processes of a human-car interaction method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram showing the main structure of a vehicle-mounted intelligent controller according to an embodiment of the present invention
  • FIG. 3 is a schematic diagram showing the main structure of an in-vehicle intelligent control system according to an embodiment of the present invention.
  • FIG. 1 exemplarily shows the main flow of the human-car interaction method in this embodiment.
  • the human-car interaction method in this embodiment includes the following steps:
  • Step S1 acquiring sensor information and/or user behavior information of the vehicle
  • the human-car interaction method runs in the vehicle-mounted intelligent controller.
  • the vehicle intelligent controller may be internally provided with a camera and/or a voice receiving device, or may be connected to the camera and/or the voice receiving device, thereby being able to observe the user's expression and receive the user's voice.
  • the vehicle intelligent controller can directly or indirectly connect with the sensor of the vehicle through a wired or wireless manner, and can acquire data of the vehicle sensor and/or behavior information of the user; the vehicle intelligent controller can also pass through, for example, an ECU (Electronic Control) with the vehicle. Unit, electronic control unit) or VCU (Vehicle Control Unit) or in-vehicle control system such as on-board computer system is connected to obtain vehicle sensor data from the vehicle control system.
  • ECU Electronic Control
  • VCU Vehicle Control Unit
  • in-vehicle control system such as on-board computer system is connected to obtain vehicle sensor data from the vehicle control system.
  • the user behavior information includes gesture information of the user, and/or emotional information.
  • the built-in or connected camera of the vehicle intelligent controller can observe the behavior information of the user, wherein the behavior information of the user can include gesture information of the user, and/or emotional information.
  • the user can implement the human-car interaction through the preset gesture control of the vehicle-mounted intelligent controller. For example, the user can slide from left to right horizontally by hand in the front end of the vehicle-mounted intelligent controller or its connected camera during music playback. After receiving the gesture information of the user, the in-vehicle intelligent controller performs a corresponding operation.
  • the gesture information may be used to control the multimedia to play the next music, and accordingly, the horizontally slides from right to left to control the multimedia. Play the previous music.
  • the user behavior information may further include emotion information
  • the vehicle-mounted intelligent controller may display a corresponding emoticon animation or play music to adjust the user's emotion according to the emotion of the user in the screen of the in-vehicle intelligent controller.
  • Step S2 Control the action output and/or information output of the vehicle-mounted intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information to interact with the user.
  • an interaction strategy may be set in advance, and the interaction strategy may be set according to data acquired by the onboard intelligent controller, and the vehicle sensor information and/or information acquired by the onboard intelligent controller may be The user behavior information is mapped to the expression, and/or voice, and/or text preset in the vehicle intelligent controller.
  • the corresponding action and information may be output according to the mapping relationship.
  • action output and/or information output includes:
  • the motion output includes a screen of the in-vehicle intelligent controller, and/or rotation of the body, and/or the head; and/or
  • Information output includes emoticons, and/or voice, and/or text.
  • the vehicle-mounted intelligent controller can be installed above the central control panel of the vehicle, has a rotatable head, the head can be provided with a display screen, the display can display text and expression information, and can have a voice output function. Or connect to a voice output device, such as a car stereo or speaker.
  • the vehicle intelligent controller interacts with the user according to the acquired information and the interaction strategy, the head can be rotated to drive the display screen to rotate, and the corresponding text and expression animation can be displayed in the display screen, and/or the corresponding output can be output. Voice and user communication, etc.
  • the preset vehicle sensor information and/or the user can be set.
  • the behavior information is mapped to an expression, and/or voice, and/or text preset by the vehicle intelligent controller. For example, when the preset vehicle sensors are the door detection sensor and the seat occupancy sensor, and the information displayed by the two sensors is that the door is closed to open, and the seat state is occupied to idle, the user may be considered to leave at this time.
  • the vehicle and the vehicle intelligent controller bid farewell to the user, and establish a mapping relationship between the vehicle sensor information and the farewell expression, the farewell voice and the farewell text preset by the vehicle intelligent controller, so that the user can generate the feeling of the vehicle intelligence and enhance the user experience.
  • the step of "controlling the action output and/or information output of the onboard intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information" may include:
  • the screen of the in-vehicle intelligent controller is controlled to turn to the corresponding seat, and/or the preset farewell emoticon animation is displayed, and/or the preset farewell voice information is output, And/or output preset farewell text information;
  • the vehicle sensor information includes door switch information of the vehicle, and/or seat occupancy information, and/or multimedia information.
  • the vehicle intelligent controller can be connected to the door detection sensor and the seat occupancy sensor by wire or wirelessly, and by analyzing the data of the sensor, analyzing the change of the data, or directly Get the corresponding user behavior and interact with the user.
  • the vehicle intelligent controller acquires the data of the door detection sensor and analyzes that the door is in an open state, at this time, the user may have three situations of getting on, getting off, or staying in the seat, in order to further analyze the behavior of the user.
  • the vehicle intelligent controller can obtain the data of the seat occupancy sensor.
  • the vehicle intelligent control is performed at this time.
  • the device can bid farewell to the user by means of a combination of voice and expression. Specifically, the user can bid farewell to the user by voice, and display the farewell expression on the vehicle intelligent controller; if the data of the seat occupancy sensor is analyzed by "idle" In the "occupied” state, you can analyze that the user is going to get on the bus. At this time, the in-vehicle intelligent controller can welcome the user by means of a combination of voice and expression.
  • the specific form can refer to the above-mentioned farewell situation, and will not be described here;
  • the data of the seat occupancy sensor is always in the "occupied” state, then it can be analyzed Users just open the door and did not get off, this time onboard intelligent controller can display a happy face, giving the user an intelligent and friendly user experience.
  • the step of: controlling the action output and/or information output of the in-vehicle intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information may further include:
  • the expression animation of the on-board intelligent controller screen is selected and controlled according to the preset correspondence relationship.
  • the multimedia information can be BPM (Beat Per Minute) information and ID3 information (located in the beginning and end of the MP3 file, with MP3 singer, title, style, etc.); on-board intelligent control
  • the system can obtain the related information of the music being played by the multimedia, analyze the style information of the music being played, and display the expression animation corresponding to the music style on the screen of the vehicle intelligent controller, and the user can enjoy the music while generating the animation with the expression. Emotional resonance.
  • the vehicle sensor information may further include other people skilled in the art to obtain information by virtue of their experience and capabilities, which is not limited herein.
  • the step of: controlling the action output and/or information output of the in-vehicle intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information may further include:
  • the screen of the in-vehicle intelligent controller is controlled to turn to the preset detection bit.
  • a proximity sensor is installed under the control panel of the vehicle.
  • the vehicle intelligent controller can control the screen to turn to the detection position, and can display the corresponding smile on the screen.
  • emoticon animation, etc. interact with the user, so that when the user controls the screen, the user can also have the feeling of interacting with the intelligent robot to enhance the user experience.
  • the step of: controlling the action output and/or information output of the in-vehicle intelligent controller of the vehicle based on the acquired vehicle sensor information and/or user behavior information may further include:
  • the seat belt is not reminded to include the on-board smart controller's screen to turn to the corresponding seat, and/or to output a preset seat belt reminder emoticon animation, and/or to output a preset seat belt reminder voice message, and/or to output a preset security. With reminder text message.
  • the sequence is sequentially reminded in the order of the driver's seat, the passenger's seat, the rear row from left to right, or from right to left.
  • the vehicle intelligent controller can also detect the sensor information related to the seat belt. When it is detected that the user does not wear the seat belt, the vehicle intelligent controller can promptly remind the user to fasten the seat belt by voice, and play the security on the screen. With reminder emoticons and corresponding reminder text information, in addition, the car intelligent controller can also rotate the head and turn it to the user who is not wearing a seat belt, further reminding the user that when multiple users are not wearing the seat belt, Remind in the order of the driver's seat, the first officer's seat, the rear row from left to right, or right to left until all users are wearing seat belts. The user is fastened in an easy and entertaining way to ensure the safety of the user.
  • the central control panel is exemplarily used in the embodiments of the present application as a display screen of various functions such as in-game infotainment, navigation, weather, mileage display, or the like.
  • the in-vehicle intelligent controller is not limited to use only on a vehicle, and may be used in other scenarios than vehicles.
  • the vehicle intelligent controller can be fixedly installed at a position that the user can observe, or can be detachably installed at a position that the user can observe.
  • the connection interface of the vehicle intelligent controller can be reserved at the position above the control panel of the vehicle.
  • the connection interface can be electrically connected or communicated with the vehicle intelligent controller, and the vehicle intelligent controller can also be wirelessly connected with the vehicle. Make a limit.
  • the in-vehicle intelligent controller can be placed in the vehicle as a stand-alone device or used in other scenarios than the vehicle, and the in-vehicle intelligent controller can include a fixing device that can enable the in-vehicle intelligent controller to travel on the vehicle or the user is inconvenient to hold The scene is fixed, wherein the circuit device can be provided with a circuit interface, and the circuit interface can be connected with a connection interface reserved in the vehicle, and the vehicle intelligent controller can be detachably connected with the fixing device, and the device can exist independently from the fixing device.
  • the steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both.
  • the software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.
  • Figure 2 exemplarily shows the main structure of the in-vehicle intelligent controller in this embodiment.
  • the vehicle intelligent controller in this embodiment includes:
  • An obtaining module 21 configured to acquire vehicle sensor information and/or user behavior information
  • the interaction module 22 is configured to control an action output and/or information output of the onboard intelligent controller of the vehicle to interact with the user based on the acquired vehicle sensor information and/or user behavior information.
  • Figure 3 exemplarily shows the main structure of the in-vehicle intelligent control system in this embodiment.
  • the vehicle intelligent control system in this embodiment includes an acquisition device 31, a control device 32 and an execution device 33;
  • An obtaining device 31 configured to acquire vehicle sensor information and/or user behavior information
  • Control device 32 configured to send a control command to execution device 33 based on the acquired vehicle sensor information and/or user behavior information
  • the executing device 33 is configured to control an action output and/or information output of the onboard intelligent controller of the vehicle in accordance with the control command.
  • the obtaining device 31 may be a camera disposed inside the vehicle intelligent controller, and/or a voice receiving device, and/or a sensor of the vehicle, capable of observing the expression of the user, receiving the voice of the user, and collecting the vehicle.
  • the control device 32 may be an onboard control system such as an ECU (Electronic Control Unit) or a VCU (Vehicle Control Unit) or an onboard computer system
  • the execution device 33 may be a screen of the onboard intelligent controller And/or the body, and/or the head, and/or the car audio or speaker, in particular, when the vehicle intelligent controller interacts with the user according to the acquired information, the head can be rotated to drive the display to rotate. You can also display the corresponding text and emoticons in the display, and / or you can output the corresponding voice and user communication.
  • action output and/or information output includes:
  • the motion output includes a screen of the in-vehicle intelligent controller, and/or rotation of the body, and/or the head; and/or
  • Information output includes emoticons, and/or voice, and/or text.
  • the vehicle-mounted intelligent controller can be installed above the central control panel of the vehicle, has a rotatable head, the head can be provided with a display screen, the display can display text and expression information, and can have a voice output function. Or connect to a voice output device, such as a car stereo or speaker.
  • the vehicle intelligent controller interacts with the user according to the acquired information and the interaction strategy, the head can be rotated to drive the display screen to rotate, and the corresponding text and expression animation can be displayed in the display screen, and/or the corresponding output can be output. Voice and user communication, etc.
  • control device 32 further includes a first control unit and a second control unit, wherein
  • the first control unit is configured to detect a door opening action and detect that the corresponding seat is in an occupied state, then control the screen of the in-vehicle intelligent controller to turn to the corresponding seat, and/or display a preset farewell emoticon, and/or output Prescribing a farewell voice message, and/or outputting a preset farewell text message;
  • the second control unit is configured to detect the door opening action and detect that the corresponding seat is in an idle state, then control the screen of the in-vehicle intelligent controller to turn to the door, and/or display a preset welcome emoticon, and/or output pre- The welcome voice message is set, and/or the preset welcome text message is output.
  • the vehicle sensor information includes door switch information of the vehicle, and/or seat occupancy information, and/or multimedia information.
  • the vehicle intelligent controller can be connected to the door detection sensor and the seat occupancy sensor by wire or wirelessly, and by analyzing the data of the sensor, analyzing the change of the data, or directly Get the corresponding user behavior and interact with the user.
  • the vehicle intelligent controller acquires the data of the door detection sensor and analyzes that the door is in an open state, at this time, the user may have three situations of getting on, getting off, or staying in the seat, in order to further analyze the behavior of the user.
  • the vehicle intelligent controller can obtain the data of the seat occupancy sensor.
  • the vehicle intelligent control is performed at this time.
  • the device can bid farewell to the user by means of a combination of voice and expression. Specifically, the user can bid farewell to the user by voice, and display the farewell expression on the vehicle intelligent controller; if the data of the seat occupancy sensor is analyzed by "idle" In the "occupied” state, you can analyze that the user is going to get on the bus. At this time, the in-vehicle intelligent controller can welcome the user by means of a combination of voice and expression.
  • the specific form can refer to the above-mentioned farewell situation, and will not be described here;
  • the data of the seat occupancy sensor is always in the "occupied” state, then it can be analyzed Users just open the door and did not get off, this time onboard intelligent controller can display a happy face, giving the user an intelligent and friendly user experience.
  • control device 32 further includes a third control unit configured to select and control an emoticon animation of the screen of the in-vehicle intelligent controller according to the rhythm and style of the music played by the vehicle. The preset correspondence is displayed.
  • the multimedia information may be BPM (Beat Per Minute) information and ID3 information (located in the beginning and end of the MP3 file, and the singer, title, style, and the like of the MP3 are added);
  • the vehicle intelligent control system can acquire the related information of the music being played by the multimedia, analyze the style information of the music being played, and display the expression animation corresponding to the music style on the screen of the vehicle intelligent controller, and the user can enjoy the music while Expression animations resonate with emotions.
  • the vehicle sensor information may further include other people skilled in the art to obtain information by virtue of its experience and capabilities, which is not limited herein.
  • control device 32 further includes a fourth control unit configured to control the screen of the in-vehicle intelligent controller when the preset detection position in the vehicle detects that the object is approaching Turn to the preset detection bit.
  • a proximity sensor is installed under the control panel of the vehicle.
  • the vehicle intelligent controller can control the screen to turn to the detection position, and can display a corresponding smile or expression on the screen. Animation, etc., interact with the user, so that when the user controls the screen, the user can also have the feeling of interacting with the intelligent robot to enhance the user experience.
  • control device 32 further comprises a fifth control unit, the fifth control unit being configured to:
  • the vehicle intelligent controller When the vehicle is in the running state, it is detected that the seat is in the occupied state, and when the seat belt of the corresponding seat is detected is not tied, the vehicle intelligent controller is controlled to perform the seat belt not being reminded;
  • the seat belt is not reminded to include the on-board smart controller's screen to turn to the corresponding seat, and/or to display a preset seat belt reminder emoticon animation, and/or to output a preset seat belt reminder voice message, and/or to output a preset security With reminder text message.
  • the fifth control unit is further configured to:
  • the in-vehicle intelligent controller controls the seat belts in the order of the driver's seat, the passenger's seat, the rear row from left to right, or right to left.
  • the vehicle intelligent controller can also detect the sensor information related to the seat belt. When it is detected that the user does not wear the seat belt, the vehicle intelligent controller can promptly remind the user to attach the seat belt by voice, and is in the screen. Play the reminder emoticon animation of the seat belt and the corresponding reminder text information.
  • the in-vehicle intelligent controller can also rotate the head and turn it to the user who is not wearing the seat belt, further reminding the user that when there are multiple users not wearing the seat belt.
  • the driver's seat, the first officer's seat, the rear row from left to right or right to left may be reminded in order, until all users are wearing seat belts.
  • the user is fastened in an easy and entertaining way to ensure the safety of the user.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Automation & Control Theory (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

本发明属于车辆技术领域，具体涉及一种人车交互方法、车辆智能控制器及系统。旨在解决现有技术用户与车辆交互机会少且交互方案不够智能的问题。本发明的人车交互方法包括基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。本发明的人车交互方法能够针对用户的行为显示或者输出相应的信息，能够很好地与用户进行交互，提升用户体验。本发明的车载智能控制器和车载智能控制系统同样具有上述效果。

Description

人车交互方法、装置、车载智能控制器及系统 技术领域
本发明属于车辆技术领域，具体涉及一种人车交互方法、装置、车载智能控制器及系统。
背景技术
随着车辆技术的发展，消费者不再一味地只关注车辆本身的性能，而开始越来越注重在驾驶过程中人与车辆的交互体验。而现有技术的人车交互主要是基于传统的多媒体系统的简单交互，用户与车辆交互的机会少且交互方案不够智能，导致用户体验不佳，随着用户对驾驶体验的要求越来越高，如何提出一种高效智能的人车交互方案是本领域技术人员目前需要解决的问题。
发明内容
为了解决现有技术中的上述问题，即为了解决现有技术用户与车辆交互机会少且交互方案不够智能的问题，本发明的一方面提供了一种人车交互方法，包括：
基于所获取的车辆传感器信息和/或用户行为信息，控制所述车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
在上述方法的优选技术方案中，“动作输出和/或信息输出”包括：
所述动作输出包括所述车载智能控制器的屏幕、、和/或躯体、和/或头部的转动；和/或
所述信息输出包括表情动画、和/或语音、和/或文字。
在上述方法的优选技术方案中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
检测到车门开启动作，且检测到对应座位为占用状态，则控制所述车载智能控制器的屏幕转向该对应座位、和/或显示预设的告别表情动画、和/或输出预设的告别语音信息、和/或输出预设的告别文字信息；
和/或检测到车门开启动作，且检测到对应座位为空闲状态，则控制所述车载智能控制器的屏幕转向该车门、和/或显示预设的欢迎表情动画、和/或输出预设的欢迎语音信息、和/或输出预设的欢迎文字信息。
在上述方法的优选技术方案中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
根据所述车辆播放音乐的节奏、风格，选择并控制所述车载智能控制器屏幕的表情动画按照预设对应关系进行显示。
在上述方法的优选技术方案中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
当所述车辆内预设的检测位检测到物体接近时，则控制所述车载智能控制器的屏幕转向该预设的检测位。
在上述方法的优选技术方案中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
在车辆行驶状态下，检测到座位处于占用状态，并且检测到对应座位的安全带未系时，则控制所述车载智能控制器进行安全带未系提醒；
所述安全带未系提醒包括所述车载智能控制器的屏幕转向对应座位、和/或显示预设的安全带提醒表情动画、和/或输出预设的安全带提醒语音信息、和/或输出预设的安全带提醒文字信息。
在上述方法的优选技术方案中，存在多个进行安全带未系提醒任务时，控制所述车载智能控制器按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序顺次进行安全带未系提醒。
本发明的另一方面提供了一种车载智能控制器，包括：
获取模块，所述获取模块被配置为获取车辆传感器信息和/或用户行为信息；
交互模块，所述交互模块被配置为基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
本发明的第三方面提供了一种车载智能控制系统，所述车载智能控制系统包括获取装置、控制装置以及执行装置；
获取装置，所述获取装置被配置为用于获取车辆传感器信息和/或用户行为信息；
控制装置，所述控制装置被配置为基于所获取的车辆传感器信息和/或用户行为信息，向所述执行装置发送控制指令；
执行装置，所述执行装置被配置为根据所述控制指令控制车辆的车载智能控制器的动作输出和/或信息输出。
在上述方法的优选技术方案中，“动作输出和/或信息输出”包括：
所述动作输出包括所述车载智能控制器的屏幕、和/或躯体、和/或头部的转动；和/或
所述信息输出包括表情动画、和/或语音、和/或文字。
在上述方案的优选技术方案中，所述控制装置还包括第一控制单元和第二控制单元，其中，
所述第一控制单元被配置为检测到车门开启动作，且检测到对应座位为占用状态，则控制所述车载智能控制器的屏幕转向该对应座位、和/或显示预设的告别表情动画、和/或输出预设的告别语音信息、和/或输出预设的告别文字信息；
所述第二控制单元被配置为检测到车门开启动作，且检测到对应座位为空闲状态，则控制所述车载智能控制器的屏幕转向该车门、和/或显示预设的欢迎表情动画、和/或输出预设的欢迎语音信息、和/或输出预设的欢迎文字信息。
在上述方案的优选技术方案中，所述控制装置还包括第三控制单元，所述第三控制单元被配置为根据车辆播放音乐的节奏、风格，选择并控制所述车载智能控制器的屏幕的表情动画按照预设对应关系进行显示。
在上述方案的优选技术方案中，所述控制装置还包括第四控制单元，所述第四控制单元被配置为当所述车辆内预设的检测位检测到物体接近时，则控制所述车载智能控制器的屏幕转向该预设的检测位。
在上述方案的优选技术方案中，所述控制装置还包括第五控制单元，所述第五控制单元被配置为：
在车辆行驶状态下，检测到座位处于占用状态，并且检测到对应座位的安全带未系时，则控制所述车载智能控制器进行安全带未系提醒；
所述安全带未系提醒包括所述车载智能控制器的屏幕转向对应座位、和/或显示预设的安全带提醒表情动画、和/或输出预设的安全带提醒语音信息、和/或输出预设的安全带提醒文字信息。
在上述方案的优选技术方案中，所述第五控制单元进一步配置为：
存在多个进行安全带未系提醒任务时，控制所述车载智能控制器按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序顺次进行安全带未系提醒。与最接近的现有技术相比，本发明提供一种人车交互方法，包括基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
上述技术方案至少具有如下有益效果：本发明的方法能够根据车辆的传感器的信息和/或用户的行为信息，输出相应的动作和信息，针对用户的行为显示相应的信息，能够很好地与用户进行交互，提升用户体验。
附图说明
图1为按照本发明一种实施例的人车交互方法的主要流程示意图；
图2为按照本发明一种实施例的车载智能控制器的主要结构示意图；
图3为按照本发明一种实施例的车载智能控制系统的主要结构示意图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围
下面参照附图来描述本发明的优选实施方式。本领域技术人员应当理解的是，这些实施方式仅仅用于解释本发明的技术原理，并非旨在限制本发明的保护范围。
参阅附图1，图1示例性的给出了本实施例中人车交互方法的主要流程。如图1所示，本实施例中人车交互方法包括下述步骤：
步骤S1：获取车辆的传感器信息和/或用户行为信息；
在本实施例中，人车交互方法运行于车载智能控制器中。车载智能控制器内部可以设置有摄像头和/或语音接收装置，或者可以连接到摄像头和/或语音接收装置，从而能够观察用户的表情、接收用户的语音。车载智能控制器能够通过有线或者无线方式与车辆的传感器进行直接或者间接连接，并且能够获取车辆传感器的数据和/或用户的行为信息；车载智能控制器还可以通过与车辆的例如ECU(Electronic Control Unit，电子控制单元)或VCU(Vehicle Control Unit，车辆控制单元)或车载计算机系统等的车载控制系统连接，从车辆控制系统上获取车辆传感器的数据。
在本发明的一种优选实施例中，用户行为信息包括用户的手势信息、和/或情绪信息。车载智能控制器内置或连接的摄像头能够观察用户的行为信息，其中，用户的行为信息可以包括用户的手势信息、和/或情绪信息。具体地，用户可以通过车载智能控制器预设的手势控制实现人车交互，例如，用户可以在音乐播放时，在车载智能控制器或其连接的摄像头前端通过用手水平从左往右滑，车载智能控制器接收到用户的手势信息之后，执行相应的操作，在本发明实施例中，该手势信息可以为控制多媒体播放下一首音乐，相应地，水平从右往左滑，可以控制多媒体播放上一首音乐。除此之外，用户行为信息还可以包括情绪信息，车载智能控制器可以根据用户的情绪在车载智能控制器的屏幕中显示相应的表情动画或者播放音乐调节用户情绪。
步骤S2：基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
在本实施例中，为了能够提高用户的交互体验，可以预先设置好交互策略，交互策略可以根据车载智能控制器获取的数据进行设定，在车载智能控制器能够获取的车辆传感器信息和/或用户行为信息，与预 置在车载智能控制器内部的表情、和/或语音、和/或文字建立映射关系，当车载智能控制器获取的信息确定时，可以根据映射关系输出相应的动作和信息与用户进行交互，从而达到可以根据用户行为进行合适的交互，让用户体验到新奇的同时，还能够产生车辆“懂我”的想法，提高用户体验。
在本发明的一种优选实施例中，“动作输出和/或信息输出”包括：
动作输出包括车载智能控制器的屏幕、和/或躯体、和/或头部的转动；和/或
信息输出包括表情动画、和/或语音、和/或文字。
在实际应用中，车载智能控制器可以安装于车辆中控屏的上方，具有可转动的头部，头部可以设置有显示屏，显示屏上能够显示文字和表情信息，且可以具有语音输出功能或连接到语音输出装置，例如车载音响或者扬声器。当车载智能控制器根据获取的信息和交互策略与用户进行交互时，可以转动其头部，带动显示屏的转动，还可以在显示屏中显示相应的文字和表情动画，并且/或者可以输出相应的语音与用户沟通等。
为了能够更加智能的与用户进行交互，需要根据车载智能控制器可以获取的数据，高效准确地根据已有的参数与用户进行交互，具体地，可以将预先设定的车辆传感器信息和/或用户行为信息，与车载智能控制器预置的表情、和/或语音、和/或文字建立映射关系。例如，当预先设定的车辆传感器为车门检测传感器和座椅占用传感器，且两个传感器显示的信息分别为车门由关闭到打开、座椅状态由占用到空闲，则可以认为用户此时将离开车辆，车载智能控制器向用户告别，将该车辆传感器信息与车载智能控制器预置的告别表情、告别语音和告别文字建立映射关系，让用户能够产生车辆智能的感觉，提升用户体验。
在本发明的一种优选实施例中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤可以包括：
检测到车门开启动作，且检测到对应座位为占用状态，则控制车载智能控制器的屏幕转向该对应座位、和/或显示预设的告别表情动画、和/或输出预设的告别语音信息、和/或输出预设的告别文字信息；
和/或检测到车门开启动作，且检测到对应座位为空闲状态，则控制车载智能控制器的屏幕转向该车门、和/或显示预设的欢迎表情动画、和/或输出预设的欢迎语音信息、和/或输出预设的欢迎文字信息。
车辆传感器信息包括车辆的车门开关信息、和/或座椅占用信息、和/或多媒体信息。以车门开关信息和座椅占用信息为例，车载智能控制器可以通过有线或者无线的方式与车门检测传感器和座椅占用传感器连接，通过获取上述传感器的数据，分析数据的变化，得出或者直接获取对应的用户行为，进而与用户进行交互。具体地，当车载智能控制器获取到车门检测传感器的数据，分析出车门处于打开的状态，此时，用户可能存在上车、下车或者依旧停留在座位三种情况，为了进一步分析用户的行为信息，车载智能控制器可以获取座椅占用传感器的数据，若分析出座椅占用传感器的数据是由“占用”到“空闲”状态的，则可以分析出用户将要下车，此时车载智能控制器可以用语音和表情相结合的方式向用户告别，具体地，可以通过语音向用户告别，同时在车载智能控制器上显示告别的表情；若分析出座椅占用传感器的数据是由“空闲”到“占用”状态的，则可以分析出用户将要上车，此时车载智能控制器可以用语音和表情结合的方式欢迎用户，具体形式可以参照上述告别的情况，在此不再赘述；若分析出座椅占用传感器的数据始终处于“占用”的状态，则可以分析出用户只是打开车门，并没有下车，此时车载智能控制器可以显示开心的表情，给用户一种智能且亲切的用户体验。
在本发明的一种优选实施例中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤还可以包括：
根据车辆播放音乐的节奏、风格，选择并控制车载智能控制器屏幕的表情动画按照预设对应关系进行显示。
多媒体信息可以为音乐的BPM(Beat Per Minute，每分钟节拍数)信息和ID3信息(位于MP3文件的开头和末尾的字节内，附加了MP3的歌手、标题、风格等信息)；车载智能控制系统可以获取多媒体正在播放音乐的相关信息，分析出正在播放音乐的风格信息，并在车载智能控制器的屏幕中显示与音乐风格对应的表情动画，用户可以在享受音乐的同时，与表情动画产生感情共鸣。除了在本发明实施例中记载的 内容外，车辆传感器信息还可以包括其他本领域技术人员凭借其经验和能力能够获取信息，在此不做限定。
在本发明的一种优选实施例中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤还可以包括：
当车辆内预设的检测位检测到物体接近时，则控制车载智能控制器的屏幕转向该预设的检测位。
在实际应用中，在车辆中控屏下方安装有接近传感器，当用户的手或者其他物体接近中控屏时，车载智能控制器能够控制屏幕转向该检测位，并且可以在屏幕上显示相应的笑脸或者表情动画等，与用户产生互动，让用户在控制中控屏时，还能够产生有智能机器人与自己交互的感受，提升用户体验。
在本发明的一种优选实施例中，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤还可以包括：
车辆在行驶状态，检测到座位处于占用状态时，并且检测到对应座位的安全带未系，则控制车载智能控制器进行安全带未系提醒；
安全带未系提醒包括车载智能控制器的屏幕转向对应座位、和/或输出预设的安全带提醒表情动画、和/或输出预设的安全带提醒语音信息、和/或输出预设的安全带提醒文字信息。
在本发明的一种优选实施例中，存在多个进行安全带未系提醒任务时，按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序进行顺次提醒。
车载智能控制器还可以检测与安全带相关的传感器信息，当检测到有用户未系安全带时，车载智能控制器可以通过语音的方式提醒用户将安全带系上，并且在屏幕中播放系安全带的提醒表情动画以及相应的提醒文字信息，此外，车载智能控制器还可以旋转头部，将其转向未系安全带的用户，进一步提醒用户，当有多个用户未系安全带时，可以按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序依次进行提醒，直至所有的用户都系上安全带。通过一种轻松、娱乐的方式让用户系上安全带，保证了用户的行车安全。
本发明实施例中，中控屏在本申请的各实施例中示例性地为驾驶室内信息娱乐、导航、天气、里程显示等多种功能或其组合的显示屏。在实际应用中，车载智能控制器不限定于只在车辆上使用，也可以在除车辆以外的其他场景中使用。车载智能控制器可以固定安装于用户可以观察的位置，也可以可拆卸的安装于用户可以观察的位置。可以在车辆中控屏上方的位置预留出车载智能控制器的连接接口，连接接口可以与车载智能控制器进行电连接或者通信连接，车载智能控制器也可以与车辆进行无线连接，在此不做限定。
此外，车载智能控制器可以作为独立装置放置于车辆中或者在除车辆以外的其他场景中使用，车载智能控制器可以包括固定装置，固定装置能够让车载智能控制器在车辆行驶或者用户不方便手持的场景下固定，其中，固定装置内部可以设置电路接口，电路接口可以与车辆中预留的连接接口进行连接，车载智能控制器可以与固定装置可拆卸连接，脱离固定装置独立存在。
结合本文中所公开的实施例描述的方法或算法的步骤可以用硬件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。
参阅附图2，图2示例性的给出了本实施例中车载智能控制器的主要结构。如图2所示，本实施例中车载智能控制器包括：
获取模块21，获取模块21被配置为获取车辆传感器信息和/或用户行为信息；
交互模块22，交互模块22被配置为基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
所属技术领域的技术人员可以清楚地了解到，为了描述的方便和简洁，本发明实施例的车载智能控制器的具体工作过程以及相关说明，可以参考前述人车交互方法实施例中的对应过程，且与上述人车交互方法具有相同的有益效果，在此不再赘述。
参阅附图3，图3示例性的给出了本实施例中车载智能控制系统的主要结构。如图3所示，本实施例中车载智能控制系统包括获取装置31、控制装置32以及执行装置33；
获取装置31，检测装置31被配置为获取车辆传感器信息和/或用户行为信息；
控制装置32，控制装置32被配置为基于所获取的车辆传感器信息和/或用户行为信息，向执行装置33发送控制指令；
执行装置33，执行装置33被配置为根据控制指令控制车辆的车载智能控制器的动作输出和/或信息输出。
在本发明实施例中，获取装置31可以是设置于车载智能控制器内部的摄像头、和/或语音接收装置、和/或车辆的传感器，能够观察用户的表情、接收用户的语音以及采集车辆的相关数据；控制装置32可以是ECU(Electronic Control Unit，电子控制单元)或VCU(Vehicle Control Unit，车辆控制单元)或车载计算机系统等的车载控制系统；执行装置33可以是车载智能控制器的屏幕、和/或躯体、和/或头部、和/或车载音响或者扬声器，具体地，当车载智能控制器根据获取的信息与用户进行交互时，可以转动其头部，带动显示屏的转动，还可以在显示屏中显示相应的文字和表情动画，并且/或者可以输出相应的语音与用户沟通等。
在本发明的一种优选实施例中，“动作输出和/或信息输出”包括：
动作输出包括车载智能控制器的屏幕、和/或躯体、和/或头部的转动；和/或
信息输出包括表情动画、和/或语音、和/或文字。
在实际应用中，车载智能控制器可以安装于车辆中控屏的上方，具有可转动的头部，头部可以设置有显示屏，显示屏上能够显示文字和表情信息，且可以具有语音输出功能或连接到语音输出装置，例如车载音响或者扬声器。当车载智能控制器根据获取的信息和交互策略与用户进行交互时，可以转动其头部，带动显示屏的转动，还可以在显示屏中显示相应的文字和表情动画，并且/或者可以输出相应的语音与用户沟通等。
在本发明的一种优选实施例中，控制装置32还包括第一控制单元和第二控制单元，其中，
第一控制单元被配置为检测到车门开启动作，且检测到对应座位为占用状态，则控制车载智能控制器的屏幕转向该对应座位、和/或显示预设的告别表情动画、和/或输出预设的告别语音信息、和/或输出预设的告别文字信息；
第二控制单元被配置为检测到车门开启动作，且检测到对应座位为空闲状态，则控制车载智能控制器的屏幕转向该车门、和/或显示预设的欢迎表情动画、和/或输出预设的欢迎语音信息、和/或输出预设的欢迎文字信息。
具体地，车辆传感器信息包括车辆的车门开关信息、和/或座椅占用信息、和/或多媒体信息。以车门开关信息和座椅占用信息为例，车载智能控制器可以通过有线或者无线的方式与车门检测传感器和座椅占用传感器连接，通过获取上述传感器的数据，分析数据的变化，得出或者直接获取对应的用户行为，进而与用户进行交互。具体地，当车载智能控制器获取到车门检测传感器的数据，分析出车门处于打开的状态，此时，用户可能存在上车、下车或者依旧停留在座位三种情况，为了进一步分析用户的行为信息，车载智能控制器可以获取座椅占用传感器的数据，若分析出座椅占用传感器的数据是由“占用”到“空闲”状态的，则可以分析出用户将要下车，此时车载智能控制器可以用语音和表情相结合的方式向用户告别，具体地，可以通过语音向用户告别，同时在车载智能控制器上显示告别的表情；若分析出座椅占用传感器的数据是由“空闲”到“占用”状态的，则可以分析出用户将要上车，此时车载智能控制器可以用语音和表情结合的方式欢迎用户，具体形式可以参照上述告别的情况，在此不再赘述；若分析出座椅占用传感器的数据始终处于“占用”的状态，则可以分析出用户只是打开车门，并没有下车，此时车载智能控制器可以显示开心的表情，给用户一种智能且亲切的用户体验。
在本发明的一种优选实施例中，控制装置32还包括第三控制单元，第三控制单元被配置为根据车辆播放音乐的节奏、风格，选择并控制车载智能控制器的屏幕的表情动画按照预设对应关系进行显示。
具体地，多媒体信息可以为音乐的BPM(Beat Per Minute，每分钟节拍数)信息和ID3信息(位于MP3文件的开头和末尾的字节内，附加了MP3的歌手、标题、风格等信息)；车载智能控制系统可以获取多媒体正在播放音乐的相关信息，分析出正在播放音乐的风格信息，并在车载智能控制器的屏幕中显示与音乐风格对应的表情动画，用户可以在享受音乐的同时，与表情动画产生感情共鸣。除了在本发明实施例中记载的内容外，车辆传感器信息还可以包括其他本领域技术人员凭借其经验和能力能够获取信息，在此不做限定。
在本发明的一种优选实施例中，控制装置32还包括第四控制单元，第四控制单元被配置为当车辆内预设的检测位检测到物体接近时，则控制车载智能控制器的屏幕转向该预设的检测位。
具体地，在车辆中控屏下方安装有接近传感器，当用户的手或者其他物体接近中控屏时，车载智能控制器能够控制屏幕转向该检测位，并且可以在屏幕上显示相应的笑脸或者表情动画等，与用户产生互动，让用户在控制中控屏时，还能够产生有智能机器人与自己交互的感受，提升用户体验。
在本发明的一种优选实施例中，控制装置32还包括第五控制单元，第五控制单元被配置为：
在车辆行驶状态下，检测到座位处于占用状态，并且检测到对应座位的安全带未系时，则控制车载智能控制器进行安全带未系提醒；
安全带未系提醒包括车载智能控制器的屏幕转向对应座位、和/或显示预设的安全带提醒表情动画、和/或输出预设的安全带提醒语音信息、和/或输出预设的安全带提醒文字信息。
在本发明的一种优选实施例中，第五控制单元进一步配置为：
存在多个进行安全带未系提醒任务时，控制车载智能控制器按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序顺次进行安全带未系提醒。
具体地，车载智能控制器还可以检测与安全带相关的传感器信息，当检测到有用户未系安全带时，车载智能控制器可以通过语音的方式提醒用户将安全带系上，并且在屏幕中播放系安全带的提醒表情动画以及相应的提醒文字信息，此外，车载智能控制器还可以旋转头部，将其转向未系安全带的用户，进一步提醒用户，当有多个用户未系安全 带时，可以按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序依次进行提醒，直至所有的用户都系上安全带。通过一种轻松、娱乐的方式让用户系上安全带，保证了用户的行车安全。
本领域技术人员应该能够意识到，结合本文中所公开的实施例描述的各示例的方法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明电子硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以电子硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。本领域技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本发明的范围。
需要说明的是，本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不是用于描述或表示特定的顺序或先后次序。应该理解这样使用的数据在适当的情况下可以互换，以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。
至此，已经结合附图所示的优选实施方式描述了本发明的技术方案，但是，本领域技术人员容易理解的是，本发明的保护范围显然不局限于这些具体实施方式。在不偏离本发明的原理的前提下，本领域技术人员可以对相关技术特征做出等同的更改或替换，这些更改或替换之后的技术方案都将落入本发明的保护范围之内。

Claims (15)

  1. 一种人车交互方法，其特征在于，包括：
    基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
  2. 根据权利要求1所述的方法，其特征在于，“动作输出和/或信息输出”包括：
    所述动作输出包括所述车载智能控制器的屏幕、和/或躯体、和/或头部的转动；和/或
    所述信息输出包括表情动画、和/或语音、和/或文字。
  3. 根据权利要求2所述的方法，其特征在于，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
    检测到车门开启动作，且检测到对应座位为占用状态，则控制所述车载智能控制器的屏幕转向该对应座位、和/或显示预设的告别表情动画、和/或输出预设的告别语音信息、和/或输出预设的告别文字信息；
    和/或检测到车门开启动作，且检测到对应座位为空闲状态，则控制所述车载智能控制器的屏幕转向该车门、和/或显示预设的欢迎表情动画、和/或输出预设的欢迎语音信息、和/或输出预设的欢迎文字信息。
  4. 根据权利要求3所述的方法，其特征在于，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
    根据车辆播放音乐的节奏、风格，选择并控制所述车载智能控制器的屏幕的表情动画按照预设对应关系进行显示。
  5. 根据权利要求4所述的方法，其特征在于，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
    当所述车辆内预设的检测位检测到物体接近时，则控制所述车载智能控制器的屏幕转向该预设的检测位。
  6. 根据权利要求5所述的方法，其特征在于，“基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出”的步骤包括：
    在车辆行驶状态下，检测到座位处于占用状态，并且检测到对应座位的安全带未系时，则控制所述车载智能控制器进行安全带未系提醒；
    所述安全带未系提醒包括所述车载智能控制器的屏幕转向对应座位、和/或显示预设的安全带提醒表情动画、和/或输出预设的安全带提醒语音信息、和/或输出预设的安全带提醒文字信息。
  7. 根据权利要求6所述的方法，其特征在于，存在多个进行安全带未系提醒任务时，控制所述车载智能控制器按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序顺次进行安全带未系提醒。
  8. 一种车载智能控制器，其特征在于，包括：
    获取模块，所述获取模块被配置为获取车辆传感器信息和/或用户行为信息；
    交互模块，所述交互模块被配置为基于所获取的车辆传感器信息和/或用户行为信息，控制车辆的车载智能控制器的动作输出和/或信息输出，以与用户进行交互。
  9. 一种车载智能控制系统，其特征在于，所述车载智能控制系统包括获取装置、控制装置以及执行装置；
    获取装置，所述获取装置被配置为获取车辆传感器信息和/或用户行为信息；
    控制装置，所述控制装置被配置为基于所获取的车辆传感器信息和/或用户行为信息，向所述执行装置发送控制指令；
    执行装置，所述执行装置被配置为根据所述控制指令控制车辆的车载智能控制器的动作输出和/或信息输出。
  10. 根据权利要求9所述的系统，其特征在于，“动作输出和/或信息输出”包括：
    所述动作输出包括所述车载智能控制器的屏幕、和/或躯体、和/或头部的转动；和/或
    所述信息输出包括表情动画、和/或语音、和/或文字。
  11. 根据权利要求10所述的系统，其特征在于，所述控制装置还包括第一控制单元和第二控制单元，其中，
    所述第一控制单元被配置为检测到车门开启动作，且检测到对应座位为占用状态，则控制所述车载智能控制器的屏幕转向该对应座位、和/或显示预设的告别表情动画、和/或输出预设的告别语音信息、和/或输出预设的告别文字信息；
    所述第二控制单元被配置为检测到车门开启动作，且检测到对应座位为空闲状态，则控制所述车载智能控制器的屏幕转向该车门、和/或显示预设的欢迎表情动画、和/或输出预设的欢迎语音信息、和/或输出预设的欢迎文字信息。
  12. 根据权利要求11所述的系统，其特征在于，所述控制装置还包括第三控制单元，所述第三控制单元被配置为根据车辆播放音乐的节奏、风格，选择并控制所述车载智能控制器的屏幕的表情动画按照预设对应关系进行显示。
  13. 根据权利要求12所述的系统，其特征在于，所述控制装置还包括第四控制单元，所述第四控制单元被配置为当所述车辆内预设的检测位检测到物体接近时，则控制所述车载智能控制器的屏幕转向该预设的检测位。
  14. 根据权利要求13所述的系统，其特征在于，所述控制装置还包括第五控制单元，所述第五控制单元被配置为：
    在车辆行驶状态下，检测到座位处于占用状态，并且检测到对应座 位的安全带未系时，则控制所述车载智能控制器进行安全带未系提醒；
    所述安全带未系提醒包括所述车载智能控制器的屏幕转向对应座位、和/或显示预设的安全带提醒表情动画、和/或输出预设的安全带提醒语音信息、和/或输出预设的安全带提醒文字信息。
  15. 根据权利要求14所述的系统，其特征在于，所述第五控制单元进一步配置为：
    存在多个进行安全带未系提醒任务时，控制所述车载智能控制器按照驾驶位、副驾驶位、后排从左到右或者从右到左的顺序顺次进行安全带未系提醒。
PCT/CN2018/120432 2017-12-15 2018-12-12 人车交互方法、装置、车载智能控制器及系统 WO2019114718A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18888631.1A EP3726342B1 (en) 2017-12-15 2018-12-12 Human-vehicle interaction method and system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201711353827.0 2017-12-15
CN201711353827 2017-12-15
CN201810346945.7 2018-04-18
CN201810346945.7A CN108664123A (zh) 2017-12-15 2018-04-18 人车交互方法、装置、车载智能控制器及系统

Publications (1)

Publication Number Publication Date
WO2019114718A1 true WO2019114718A1 (zh) 2019-06-20

Family

ID=63779995

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/120432 WO2019114718A1 (zh) 2017-12-15 2018-12-12 人车交互方法、装置、车载智能控制器及系统

Country Status (3)

Country Link
EP (1) EP3726342B1 (zh)
CN (3) CN108664123A (zh)
WO (1) WO2019114718A1 (zh)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110834338A (zh) * 2019-11-04 2020-02-25 深圳勇艺达机器人有限公司 一种车载机器人及其控制方法
CN111736700A (zh) * 2020-06-23 2020-10-02 上海商汤临港智能科技有限公司 基于数字人的车舱交互方法、装置及车辆
CN112034989A (zh) * 2020-09-04 2020-12-04 华人运通(上海)云计算科技有限公司 一种智能交互系统
CN112130547A (zh) * 2020-09-28 2020-12-25 广州小鹏汽车科技有限公司 一种车辆交互的方法和装置
CN112169309A (zh) * 2020-09-21 2021-01-05 北京汽车股份有限公司 车载游戏控制方法、系统和车载游戏控制器
CN112918381A (zh) * 2019-12-06 2021-06-08 广州汽车集团股份有限公司 一种车载机器人迎送宾方法、装置及系统
CN114435132A (zh) * 2022-01-13 2022-05-06 重庆长安汽车股份有限公司 汽车仪表开关机逻辑方法、系统及车辆
CN115079811A (zh) * 2021-03-11 2022-09-20 上海擎感智能科技有限公司 交互方法、交互系统、终端、汽车及计算机可读存储介质
CN115123143A (zh) * 2022-06-22 2022-09-30 重庆长安汽车股份有限公司 车辆个性化迎宾方法、系统、车辆及介质
CN116653998A (zh) * 2023-07-28 2023-08-29 安徽中科星驰自动驾驶技术有限公司 一种自动驾驶车辆的人车交互方法及系统
CN116755564A (zh) * 2023-08-16 2023-09-15 吉林藤兴科技有限公司 一种车辆生态智能控制交互设备、对接终端及主机

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108664123A (zh) * 2017-12-15 2018-10-16 蔚来汽车有限公司 人车交互方法、装置、车载智能控制器及系统
CN109366497A (zh) * 2018-11-12 2019-02-22 奇瑞汽车股份有限公司 车载机器人、车载机器人的控制方法、装置及存储介质
CN111210540A (zh) * 2018-11-22 2020-05-29 上海擎感智能科技有限公司 车辆、车机设备及其人机交互方法
JP6999540B2 (ja) * 2018-12-28 2022-01-18 本田技研工業株式会社 情報処理装置及びプログラム
CN109960407A (zh) * 2019-03-06 2019-07-02 中山安信通机器人制造有限公司 一种车载机器人主动交互的方法、计算机装置以及计算机可读存储介质
CN112009395A (zh) * 2019-05-28 2020-12-01 北京车和家信息技术有限公司 一种交互控制方法、车载终端及车辆
CN110329276A (zh) * 2019-05-29 2019-10-15 中山安信通机器人制造有限公司 智能汽车人机互动系统
CN110377377A (zh) * 2019-06-06 2019-10-25 北京梧桐车联科技有限责任公司 显示方法及装置、电子设备及存储介质
CN112078447A (zh) * 2019-06-12 2020-12-15 杭州海康威视数字技术股份有限公司 安全座椅、驾乘系统及信息获取方法
CN110395269B (zh) * 2019-07-25 2021-04-13 广州小鹏汽车科技有限公司 一种基于车辆的人机交互方法及系统、车辆
CN110428834A (zh) * 2019-07-31 2019-11-08 北京梧桐车联科技有限责任公司 一种操作车辆部件的方法和装置
CN110465956B (zh) * 2019-07-31 2022-04-01 东软集团股份有限公司 一种车辆机器人、车机、方法及机器人系统
CN110641476A (zh) * 2019-08-16 2020-01-03 广汽蔚来新能源汽车科技有限公司 基于车载机器人的交互方法、装置、控制器和存储介质
CN110502116A (zh) * 2019-08-20 2019-11-26 广东远峰汽车电子有限公司 汽车情感机器人与乘车人员的互动方法及装置
CN110633011A (zh) * 2019-08-21 2019-12-31 中国第一汽车股份有限公司 一种车载机器人、控制方法、控制装置及存储介质
CN110459217B (zh) * 2019-08-21 2022-03-08 中国第一汽车股份有限公司 一种车载问答方法、系统、车辆及存储介质
CN110682921A (zh) * 2019-10-09 2020-01-14 广州小鹏汽车科技有限公司 车辆交互方法、装置、车辆及机器可读介质
CN110932862A (zh) * 2019-10-22 2020-03-27 安信通科技（澳门）有限公司 一种车辆中的车载设备登录管理方法及装置
CN110728256A (zh) * 2019-10-22 2020-01-24 上海商汤智能科技有限公司 基于车载数字人的交互方法及装置、存储介质
CN110931003B (zh) * 2019-10-22 2023-07-07 安信通科技（澳门）有限公司 一种语音功能的控制交互方法及系统
CN110843796B (zh) * 2019-10-23 2021-10-26 上海能塔智能科技有限公司 车辆的互动式语音识别方法及装置、终端、车辆
CN112829763A (zh) * 2019-11-05 2021-05-25 北京新能源汽车股份有限公司 一种语音交互处理方法、系统及汽车
CN110989831B (zh) * 2019-11-15 2021-04-27 歌尔股份有限公司 音频设备的控制方法、音频设备及存储介质
CN110989900B (zh) * 2019-11-28 2021-11-05 北京市商汤科技开发有限公司 交互对象的驱动方法、装置、设备以及存储介质
CN110956958A (zh) * 2019-12-04 2020-04-03 深圳追一科技有限公司 搜索方法、装置、终端设备及存储介质
CN112655000B (zh) * 2020-04-30 2022-10-25 华为技术有限公司 车内用户定位方法、车载交互方法、车载装置及车辆
CN111736699A (zh) * 2020-06-23 2020-10-02 上海商汤临港智能科技有限公司 基于车载数字人的交互方法及装置、存储介质
CN111739201A (zh) * 2020-06-24 2020-10-02 上海商汤临港智能科技有限公司 车辆的交互方法及装置、电子设备、存储介质和车辆
CN111885769A (zh) * 2020-06-29 2020-11-03 武汉海微科技有限公司 基于led光环显示的车载智能交互系统
CN112026790B (zh) * 2020-09-03 2022-04-15 上海商汤临港智能科技有限公司 车载机器人的控制方法及装置、车辆、电子设备和介质
CN114187863A (zh) * 2020-09-15 2022-03-15 比亚迪半导体股份有限公司 一种led点阵屏、车辆及车辆控制方法
CN112420045A (zh) * 2020-12-11 2021-02-26 奇瑞汽车股份有限公司 一种汽车车载语音交互系统及方法
CN112721834B (zh) * 2021-01-13 2022-09-23 浙江智马达智能科技有限公司 一种车辆控制方法及控制系统
CN113147771A (zh) * 2021-05-10 2021-07-23 前海七剑科技(深圳)有限公司 基于车载虚拟机器人的主动交互方法及装置
CN113276861B (zh) * 2021-06-21 2023-03-28 上汽通用五菱汽车股份有限公司 车辆控制方法、车辆控制系统及存储介质
CN113669572A (zh) * 2021-07-01 2021-11-19 华人运通(江苏)技术有限公司 车载屏幕的调节装置、车载显示装置和车辆
CN114056343B (zh) * 2022-01-11 2022-05-10 广州小鹏汽车科技有限公司 车载系统功能的处理方法、服务器及存储介质
CN115431762A (zh) * 2022-03-25 2022-12-06 北京罗克维尔斯科技有限公司 多屏幕交互方法、装置、设备及计算机可读存储介质
CN115190199B (zh) * 2022-07-08 2023-07-21 润芯微科技(江苏)有限公司 一种通过移动端扫码操作车机功能的方法
CN115610349B (zh) * 2022-10-21 2024-05-17 阿维塔科技(重庆)有限公司 一种基于多模融合的智能交互方法及装置
CN116163620B (zh) * 2023-02-28 2024-08-06 重庆长安汽车股份有限公司 一种车辆门窗智慧开关方法、系统、设备及介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324100A (zh) * 2013-05-02 2013-09-25 郭海锋 一种信息驱动的情感车载机器人
CN104252179A (zh) * 2013-06-27 2014-12-31 比亚迪股份有限公司 一种车载智能机器人的控制方法、控制装置及控制系统
CN105584412A (zh) * 2016-01-15 2016-05-18 黎凯华 一种汽车门禁感应装置
CN106803423A (zh) * 2016-12-27 2017-06-06 智车优行科技（北京）有限公司 基于用户情绪状态的人机交互语音控制方法、装置及车辆
CN108664123A (zh) * 2017-12-15 2018-10-16 蔚来汽车有限公司 人车交互方法、装置、车载智能控制器及系统

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003252127A (ja) * 2001-12-28 2003-09-10 Pioneer Electronic Corp 駆動制御装置および駆動制御方法
CN201254147Y (zh) * 2008-07-22 2009-06-10 深圳市北科瑞声科技有限公司 应用于汽车电子通讯和多媒体娱乐的人机交互系统
WO2014060054A1 (de) * 2012-10-16 2014-04-24 Audi Ag Spracherkennung in einem kraftfahrzeug
CN203119951U (zh) * 2013-03-06 2013-08-07 杭州冠啸电子科技有限公司 一种基于Android的车载娱乐信息系统
CN103309356B (zh) * 2013-06-24 2016-02-17 深圳市科松电子有限公司 车载机器人
US20150088489A1 (en) * 2013-09-20 2015-03-26 Abdelhalim Abbas Systems and methods for providing man-machine communications with etiquette
CN104002818A (zh) * 2014-05-27 2014-08-27 昆山市智汽电子科技有限公司 一种集互动与自动为一体的车载系统
CN104199321A (zh) * 2014-08-07 2014-12-10 刘松珍 一种情感交互型车载机器人
CN205630647U (zh) * 2016-02-19 2016-10-12 竺林坤 一种设于汽车中控台的智能机器人
CN107220591A (zh) * 2017-04-28 2017-09-29 哈尔滨工业大学深圳研究生院 多模态智能情绪感知系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324100A (zh) * 2013-05-02 2013-09-25 郭海锋 一种信息驱动的情感车载机器人
CN104252179A (zh) * 2013-06-27 2014-12-31 比亚迪股份有限公司 一种车载智能机器人的控制方法、控制装置及控制系统
CN105584412A (zh) * 2016-01-15 2016-05-18 黎凯华 一种汽车门禁感应装置
CN106803423A (zh) * 2016-12-27 2017-06-06 智车优行科技（北京）有限公司 基于用户情绪状态的人机交互语音控制方法、装置及车辆
CN108664123A (zh) * 2017-12-15 2018-10-16 蔚来汽车有限公司 人车交互方法、装置、车载智能控制器及系统

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3726342A4 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110834338A (zh) * 2019-11-04 2020-02-25 深圳勇艺达机器人有限公司 一种车载机器人及其控制方法
CN112918381A (zh) * 2019-12-06 2021-06-08 广州汽车集团股份有限公司 一种车载机器人迎送宾方法、装置及系统
CN112918381B (zh) * 2019-12-06 2023-10-27 广州汽车集团股份有限公司 一种车载机器人迎送宾方法、装置及系统
CN111736700A (zh) * 2020-06-23 2020-10-02 上海商汤临港智能科技有限公司 基于数字人的车舱交互方法、装置及车辆
CN112034989A (zh) * 2020-09-04 2020-12-04 华人运通(上海)云计算科技有限公司 一种智能交互系统
CN112169309A (zh) * 2020-09-21 2021-01-05 北京汽车股份有限公司 车载游戏控制方法、系统和车载游戏控制器
CN112130547A (zh) * 2020-09-28 2020-12-25 广州小鹏汽车科技有限公司 一种车辆交互的方法和装置
CN112130547B (zh) * 2020-09-28 2024-05-03 广州小鹏汽车科技有限公司 一种车辆交互的方法和装置
CN115079811A (zh) * 2021-03-11 2022-09-20 上海擎感智能科技有限公司 交互方法、交互系统、终端、汽车及计算机可读存储介质
CN114435132A (zh) * 2022-01-13 2022-05-06 重庆长安汽车股份有限公司 汽车仪表开关机逻辑方法、系统及车辆
CN114435132B (zh) * 2022-01-13 2024-05-14 重庆长安汽车股份有限公司 汽车仪表开关机逻辑方法、系统及车辆
CN115123143A (zh) * 2022-06-22 2022-09-30 重庆长安汽车股份有限公司 车辆个性化迎宾方法、系统、车辆及介质
CN115123143B (zh) * 2022-06-22 2024-02-27 重庆长安汽车股份有限公司 车辆个性化迎宾方法、系统、车辆及介质
CN116653998A (zh) * 2023-07-28 2023-08-29 安徽中科星驰自动驾驶技术有限公司 一种自动驾驶车辆的人车交互方法及系统
CN116653998B (zh) * 2023-07-28 2023-10-20 安徽中科星驰自动驾驶技术有限公司 一种自动驾驶车辆的人车交互方法及系统
CN116755564A (zh) * 2023-08-16 2023-09-15 吉林藤兴科技有限公司 一种车辆生态智能控制交互设备、对接终端及主机
CN116755564B (zh) * 2023-08-16 2023-12-08 吉林藤兴科技有限公司 一种车辆生态智能控制交互设备、对接终端及主机

Also Published As

Publication number Publication date
EP3726342A4 (en) 2021-09-08
EP3726342B1 (en) 2023-04-12
CN109720355A (zh) 2019-05-07
CN108664123A (zh) 2018-10-16
CN109710055A (zh) 2019-05-03
EP3726342A1 (en) 2020-10-21

Similar Documents

Publication Publication Date Title
WO2019114718A1 (zh) 人车交互方法、装置、车载智能控制器及系统
EP3496098B1 (en) Generating personalized audio content based on mood
EP3158392B1 (en) System and method for responding to driver state
US20200001714A1 (en) Driving assistance apparatus and driving assistance method
US10878787B2 (en) Driver assistance system
JP4441887B2 (ja) 自動車用ユーザーもてなしシステム
US11820228B2 (en) Control system and method using in-vehicle gesture input
CN108688677A (zh) 车辆驾驶支援系统以及车辆驾驶支援方法
JP4525925B2 (ja) 自動車用ユーザーもてなしシステム
US20180093673A1 (en) Utterance device and communication device
JP5045302B2 (ja) 自動車用情報提供装置
US20230186878A1 (en) Vehicle systems and related methods
CN109087636A (zh) 交互设备
CN107466223A (zh) 用于电子多功能装置的控制
WO2022048118A1 (zh) 车载机器人的控制方法及装置、车辆、电子设备和介质
WO2019198179A1 (ja) 搭乗者状態判定装置、警告出力制御装置及び搭乗者状態判定方法
JP2007145226A (ja) 自動車用ユーザーもてなしシステム
CN108228729A (zh) 内容提供装置和内容提供方法
CN113415250A (zh) 设备控制方法、装置、电子设备及存储介质
JP2024041746A (ja) 情報処理装置
JP7238824B2 (ja) 車室内照明システム
CN111736700A (zh) 基于数字人的车舱交互方法、装置及车辆
CN110944149A (zh) 车辆用儿童看护系统以及方法
CN109828520A (zh) 一种智能电动汽车hmi人机交互系统
CN110251800A (zh) 用于使车辆内部的婴儿平静的装置和方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18888631

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018888631

Country of ref document: EP

Effective date: 20200715