CN115556691A - Method and system for vehicle to occupant information interaction - Google Patents

Method and system for vehicle to occupant information interaction Download PDF

Info

Publication number
CN115556691A
CN115556691A CN202211395475.6A CN202211395475A CN115556691A CN 115556691 A CN115556691 A CN 115556691A CN 202211395475 A CN202211395475 A CN 202211395475A CN 115556691 A CN115556691 A CN 115556691A
Authority
CN
China
Prior art keywords
occupant
information
vehicle
passenger
identity information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211395475.6A
Other languages
Chinese (zh)
Inventor
李和安
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mercedes Benz Group AG
Original Assignee
Mercedes Benz Group AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mercedes Benz Group AG filed Critical Mercedes Benz Group AG
Priority to CN202211395475.6A priority Critical patent/CN115556691A/en
Publication of CN115556691A publication Critical patent/CN115556691A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/037—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for occupant comfort, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)

Abstract

The invention relates to a method for vehicle-to-occupant information interaction, comprising: acquiring facial feature information and position information of at least one occupant of a vehicle (S1); determining whether identity information of the occupant is verified based on facial feature information of the occupant (S2); if the identity information of the occupant is verified, the identity information and/or the position information of the occupant is displayed, and an in-vehicle function mode matching the identity information of the occupant is provided based on the position information of the occupant (S3). The invention also relates to a system and a computer program product for vehicle to occupant information interaction. According to the invention, the vehicle-mounted function mode according with the using habit and/or preference information of the passenger can be provided for the verified passenger without frequently and manually adjusting the control parameters of the vehicle-mounted function mode by the passenger, so that the riding experience of the passenger is improved.

Description

Method and system for vehicle to occupant information interaction
Technical Field
The present invention relates to the field of vehicles, in particular to a method for a vehicle to interact with an occupant, a system for a vehicle to interact with an occupant, and a computer program product for performing the steps of the method according to the invention.
Background
In the driving process, a driver can set each vehicle-mounted function mode of the vehicle according to the comfort level experience and/or the actual demand of the driver, but considering that other passengers in the vehicle may have difference with the comfort level experience and/or the actual demand of the driver, the other passengers usually need to communicate with the driver orally and/or perform frequent information interaction with a vehicle-mounted control system to be able to adjust the vehicle-mounted function modes suitable for the other passengers, such as a vehicle-mounted air conditioning function, a vehicle-mounted seat function and the like. Furthermore, different occupants often have individualized requirements for the individual vehicle-mounted functional modes. Each time an occupant enters the vehicle, the occupant needs to readjust the setup parameters for each vehicle-mounted functional mode, which can result in a poor ride experience for the occupant.
Therefore, how to effectively perform information interaction between the vehicle and the occupant becomes a technical problem to be solved at present.
Disclosure of Invention
It is an object of the present invention to provide a method for vehicle to occupant information interaction, a system for vehicle to occupant information interaction, and a computer program product for performing the steps of the method according to the present invention to at least partially solve the problems of the prior art.
According to a first aspect of the invention, there is provided a method for a vehicle to interact with an occupant, the method comprising:
step S1: acquiring facial feature information and location information of at least one occupant of a vehicle;
step S2: determining whether the identity information of the occupant is verified based on the facial feature information of the occupant; and
and step S3: if the identity information of the occupant is verified, displaying the identity information and/or the position information of the occupant, and providing an in-vehicle function mode matched with the identity information of the occupant based on the position information of the occupant.
The core concept of the invention is that: the method comprises the steps of identifying identity information of an occupant through facial feature information of the occupant acquired through an in-vehicle camera, displaying the identity information and/or position information of the occupant when the verified occupant is identified, and providing an in-vehicle function mode matched with the identity information of the occupant based on the position information of the occupant. According to the invention, the vehicle-mounted function mode according with the use habit and/or preference information of the passenger can be provided for the verified passenger without frequently and manually adjusting the control parameters of the vehicle-mounted function mode by the passenger, so that the riding experience of the passenger is improved.
According to an alternative embodiment of the invention, the identity information of the occupant may be identified by a trained image processing model based on facial feature information of the occupant, for example comprising an object classifier and/or a convolutional neural network. The identity information of the occupant is verified if the identity information of the occupant can be identified. Optionally, the identity information of the occupant may include, for example, name information, gender information, age information, and/or identity grouping information of the occupant.
According to an alternative embodiment of the invention, the vehicle functions may for example comprise a vehicle entertainment function, a vehicle air conditioning function and/or a vehicle seat function, etc., wherein the vehicle seat functions may for example comprise a vehicle seat adjusting function, a vehicle seat heating function and/or a vehicle seat massaging function, etc.
According to an alternative embodiment of the invention, the method may further comprise:
and step S4: verifying the identity information of the occupant based on the facial feature information of the occupant if the identity information of the occupant is unverified; and
step S5: upon completion of the verification process, the identity information of the occupant is marked as verified.
In this way, after the passenger is subjected to primary verification, the image processing model can identify the identity information of the passenger based on the facial characteristic information of the passenger, so that the identity information of the passenger is automatically identified to be verified when the customized vehicle-mounted function mode is started next time, and the vehicle-mounted function mode matched with the identity information of the passenger is automatically called for the passenger.
According to an alternative embodiment of the present invention, the step S4 may include:
step S41: if the identity information of the passenger is not verified, sending verification prompt information to the passenger and prompting the passenger to input the identity information;
step S42: after the identity information of the passenger is input, acquiring facial feature information of the passenger, and training an image processing model for verifying the identity information of the passenger based on the collected facial feature information of the passenger; and
step S43: after the image processing model completes training, sending notification information about completion of verification to the occupant.
According to an alternative embodiment of the invention, the method may further comprise:
step S6: the control parameters of the vehicle-mounted function mode adjusted by the occupant are recorded in a manner matched with the identity information of the occupant.
In this way, the vehicle-mounted function profile matched with the identity of the passenger can be updated correspondingly, so that the vehicle-mounted function mode is more consistent with the use habit and/or preference information of the passenger.
According to a second aspect of the invention, a system for vehicle to occupant information interaction is provided for performing the method according to the invention. The system may include the following components: an in-vehicle camera configured to acquire and/or collect facial feature information and/or location information of an occupant of a vehicle; a human-computer interaction module configured to send prompt information to the occupant, and/or acquire identity information input by the occupant, and/or display the identity information and/or position information of the occupant, for example, the human-computer interaction module includes a vehicle-mounted voice device, an instrument panel, a head-up display screen, and/or a central control display screen; and an in-vehicle control module configured to determine identity information of the occupant based on the facial feature information of the occupant, and control an in-vehicle function mode based on the position information and/or the identity information of the occupant.
According to an alternative embodiment of the invention, the system may further comprise a seat sensor configured for acquiring position information of the occupant.
According to a third aspect of the invention, a computer program product, such as a computer-readable program carrier, is provided, containing computer program instructions which, when executed by a processor, implement the steps of the method according to the invention.
Drawings
The principles, features and advantages of the present invention may be better understood by describing the invention in more detail below with reference to the accompanying drawings. The figures show:
FIG. 1 illustrates a workflow diagram of a method for vehicle to occupant information interaction according to an exemplary embodiment of the present invention;
FIG. 2 shows a workflow diagram of a method for vehicle information interaction with an occupant according to another exemplary embodiment of the invention;
FIG. 3 shows a workflow diagram of a method for vehicle to occupant information interaction according to another exemplary embodiment of the invention;
FIG. 4 shows a workflow diagram of a method for vehicle to occupant information interaction according to another exemplary embodiment of the invention; and
FIG. 5 shows a block diagram of a system for vehicle information interaction with an occupant, according to an example embodiment of the invention.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects of the present invention more apparent, the present invention will be described in further detail with reference to the accompanying drawings and exemplary embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and do not limit the scope of the invention.
Fig. 1 shows a workflow diagram of a method for vehicle information interaction with an occupant according to an exemplary embodiment of the invention. The following exemplary examples describe the process according to the invention in more detail.
The method may comprise steps S1 to S3. In step S1, facial feature information and position information of at least one occupant of the vehicle are acquired. In the present embodiment of the invention, there may be one or more occupants in the vehicle, which may include not only the driver but also passengers who do not participate in the driving of the vehicle. Step S1 may be entered whenever at least one of the occupants selects to activate the customized vehicle function mode. If the occupant does not select the in-vehicle function mode, the process may proceed to step S1 in a default mode. Here, the facial feature information and the position information of all the occupants in the vehicle may be acquired by the in-vehicle camera 11. One or more in-vehicle cameras 11 facing respective occupants may be mounted in the vehicle, whereby the accuracy of the acquired information can be improved. Alternatively, the position information of the occupant can also be acquired by a seat sensor 14, and the seat sensor 14 can be triggered to send a corresponding position signal when the occupant sits on the vehicle seat.
In step S2, it is determined whether the identity information of the occupant is verified based on the facial feature information of the occupant. In the present embodiment of the invention, a trained image processing model, for example comprising an object classifier and/or a convolutional neural network, is stored in the onboard control module 13. The image processing model has been trained on a sufficient number of facial image sequences of the verified occupant, so that the verified occupant can be identified by means of the image processing model based on facial feature information of the occupant, thereby determining whether the occupant is verified or unverified.
If the identity information of the occupant is verified, the identity information and/or the position information of the occupant is displayed in step S3, and an in-vehicle function mode matching the identity information of the occupant is provided based on the position information of the occupant. In this case, the position information and/or the identity information of the verified occupant can be displayed by means of a head-up display and/or a central control display, wherein the position information can be detected by means of the vehicle camera 11 and/or the seat sensor 14 and the identity information can be input by the occupant by means of voice control and/or touch screen control. The identity information includes, in particular, name information of the passenger, by means of which the verified passenger identity at the respective position in the vehicle cabin can be clearly and unambiguously noted in the head-up display and/or the central control display.
In this case, an onboard function profile can be created for the verified passenger on the basis of the identity information, which onboard function profile can be automatically called upon recognition of the verified passenger, said onboard function profile matching the identity information of the passenger. Optionally, the identity information may further include gender information, age information, and/or identity grouping information, which may provide a basis for selecting the vehicle-mounted function mode. The identity grouping information may be selected, in particular, by the occupant on the basis of his preference information, so that frequent manual adjustment of the control parameters of the vehicle-mounted function mode by the occupant is avoided. Here, the in-vehicle functions may include, for example, an in-vehicle entertainment function, an in-vehicle air conditioning function, and/or an in-vehicle seat function, and the like. The vehicle seat function may include, for example, a vehicle seat adjustment function, a vehicle seat heating function, and/or a vehicle seat massage function, etc. For example, a group for turning on the entertainment function and a group for not turning on the entertainment function may be set for the in-vehicle entertainment function; a cold bias group, a hot bias group, and the like may be set for the in-vehicle air conditioning function.
According to the invention, the identity information of the passenger is judged through the passenger image acquired by the in-vehicle camera, so that the in-vehicle function mode which accords with the use habit and/or preference information of the passenger can be provided for the verified passenger without frequent manual adjustment of the passenger, and the riding experience of the passenger is improved.
Fig. 2 shows a workflow diagram of a method for vehicle information interaction with an occupant according to another exemplary embodiment of the invention. Only the differences from the embodiment shown in fig. 1 are set forth below, and the description of the same steps is not repeated for the sake of brevity.
The method may further comprise steps S4 and S5. If it is determined in step S2 that the identity information of the occupant is not verified, the identity information of the occupant is verified based on the facial feature information of the occupant in step S4. The facial feature information of the passenger who is not verified can be collected, the image processing model is trained on the basis of the collected facial feature information, and the trained image processing model can identify the identity information of the passenger, so that the verification process of the identity information of the passenger is completed. This verification process is elaborated in an alternative embodiment shown in fig. 3.
As shown in fig. 3, the step S4 may include steps S41 to S43. If the identity information of the occupant is not verified, that is, the image processing model cannot recognize the identity information of the occupant because of not training the image information of the occupant, verification prompt information is sent to the occupant and the occupant is prompted to input the identity information in step S41. Here, for example, the acoustic prompt information for starting the authentication and the acoustic prompt information for inputting the identity information may be sent to the passenger through the vehicle-mounted voice device, and then the passenger may prepare for the authentication and input the identity information thereof through the vehicle-mounted voice device; the optical prompt to start authentication and the optical prompt to enter identity information may also be sent to the occupant through the instrument panel, the head-up display, and/or the central display, and the occupant may enter his identity information through a touch screen operation.
After the identity information of the occupant is input, facial feature information of the occupant is acquired in step S42, and an image processing model for verifying the identity information of the occupant is trained based on the collected facial feature information of the occupant. In this case, a sufficient number of facial image sequences of the occupant, which can be used for training the image processing model, can be captured by the in-vehicle camera 11 facing the occupant, for example.
After the image processing model completes training, notification information about completion of verification is sent to the occupant in step S43. In this case, optical and/or acoustic notification information can likewise be transmitted via the vehicle-mounted speech device, the dashboard, the head-up display and/or the central control display.
After the verification process is completed, the identity information of the occupant is marked as verified in step S5. It is understood that after the occupant is primarily authenticated, the image processing model can identify the identity information of the occupant based on the facial characteristic information of the occupant, so that the identity information of the occupant is automatically identified as authenticated when the customized vehicle-mounted function mode is turned on next time, and the vehicle-mounted function mode matched with the identity information of the occupant is automatically called for the occupant.
Fig. 4 shows a workflow diagram of a method for vehicle information interaction with an occupant according to another exemplary embodiment of the invention. Only the differences from the embodiment shown in fig. 1 are set forth below, and the description of the same steps is not repeated for the sake of brevity.
The method may further comprise step S6. In step S6, control parameters of the vehicle-mounted function mode adjusted by the occupant are recorded in accordance with the identity information of the occupant. It can be understood that, after providing the vehicle-mounted function mode matched with the identity information of the passenger, the passenger can adjust the control parameters of the vehicle-mounted function mode in real time according to the comfort experience and/or the actual demand of the passenger during the riding process. By recording the control parameters adjusted by the occupant and updating the vehicle-mounted function profile matched with the occupant identity accordingly, the vehicle-mounted function mode can be more in line with the use habits and/or preference information of the occupant, thereby improving the user experience.
In addition, it should be noted that the sequence numbers of the steps described herein do not necessarily represent a sequential order, but merely one kind of reference numeral, and the order may be changed according to circumstances as long as the technical object of the present invention can be achieved.
FIG. 5 shows a block diagram of a system for vehicle information interaction with an occupant, according to an example embodiment of the invention.
As shown in fig. 5, the system 1 may comprise the following components: an in-vehicle camera 11, the in-vehicle camera 11 being configured to acquire and/or collect facial feature information and/or location information of an occupant of a vehicle; a human-machine interaction module 12, wherein the human-machine interaction module 12 is configured to send prompt information to the occupant, and/or acquire identity information input by the occupant, and/or display the identity information and/or position information of the occupant, and the human-machine interaction module 12 for example comprises an in-vehicle voice device, an instrument panel, a head-up display screen and/or a central control display screen; and an in-vehicle control module 13, wherein the in-vehicle control module 13 is configured to judge the identity information of the passenger based on the facial feature information of the passenger and control an in-vehicle function mode based on the position information and/or the identity information of the passenger.
Optionally, the system 1 may further comprise a seat sensor 14, the seat sensor 14 being configured to acquire position information of the occupant.
Although specific embodiments of the invention have been described herein in detail, they have been presented for purposes of illustration only and are not to be construed as limiting the scope of the invention. Various alternatives and modifications can be devised without departing from the spirit and scope of the present invention.

Claims (10)

1. A method for a vehicle to interact information with an occupant, the method comprising:
step S1: acquiring facial feature information and location information of at least one occupant of a vehicle;
step S2: determining whether identity information of the occupant is verified based on facial feature information of the occupant; and
and step S3: and if the identity information of the passenger is verified, displaying the identity information and/or the position information of the passenger, and providing a vehicle-mounted function mode matched with the identity information of the passenger based on the position information of the passenger.
2. The method of claim 1, wherein the method further comprises:
and step S4: verifying the identity information of the occupant based on the facial feature information of the occupant if the identity information of the occupant is unverified; and
step S5: upon completion of the verification process, marking the identity information of the occupant as verified.
3. The method according to any of the preceding claims, wherein said step S4 comprises:
step S41: if the identity information of the passenger is not verified, sending verification prompt information to the passenger and prompting the passenger to input the identity information;
step S42: after the identity information of the passenger is input, acquiring the facial feature information of the passenger, and training an image processing model for verifying the identity information of the passenger based on the collected facial feature information of the passenger; and
step S43: after the image processing model completes training, sending notification information about completion of verification to the occupant.
4. The method according to any of the preceding claims, wherein the method further comprises:
step S6: the control parameters of the vehicle-mounted function mode adjusted by the occupant are recorded in a manner matched with the identity information of the occupant.
5. The method according to any one of the preceding claims, wherein the identity information of the occupant is identified by a trained image processing model based on facial feature information of the occupant, the identity information of the occupant being verified if the identity information of the occupant can be identified; and/or
The image processing model includes an object classifier and/or a convolutional neural network.
6. The method according to any one of the preceding claims, wherein the vehicle functions comprise vehicle entertainment functions, vehicle air conditioning functions and/or vehicle seat functions, wherein the vehicle seat functions comprise vehicle seat adjustment functions, vehicle seat heating functions and/or vehicle seat massage functions.
7. The method according to any of the preceding claims, wherein the identity information of the occupant comprises name information, gender information, age information and/or identity grouping information of the occupant.
8. A system (1) for vehicle-to-occupant information interaction, the system (1) being adapted to perform the method according to any one of the preceding claims, wherein the system (1) comprises the following components:
an in-vehicle camera (11), the in-vehicle camera (11) being configured for acquiring and/or collecting facial feature information and/or position information of an occupant of a vehicle;
a human-computer interaction module (12), wherein the human-computer interaction module (12) is configured to send prompt information to the passenger, and/or acquire the identity information input by the passenger, and/or display the identity information and/or the position information of the passenger; and
an in-vehicle control module (13), the in-vehicle control module (13) being configured to determine identity information of the occupant based on the facial feature information of the occupant and to control an in-vehicle function mode based on the position information and/or the identity information of the occupant.
9. The system (1) according to claim 8, wherein the system (1) further comprises a seat sensor (14), the seat sensor (14) being configured for acquiring position information of an occupant; and/or
The man-machine interaction module (12) comprises a vehicle-mounted voice device, an instrument panel, a head-up display screen and/or a central control display screen.
10. A computer program product, such as a computer-readable program carrier, containing computer program instructions which, when executed by a processor, at least auxiliarily implement the steps of the method according to any one of claims 1 to 8.
CN202211395475.6A 2022-11-07 2022-11-07 Method and system for vehicle to occupant information interaction Pending CN115556691A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211395475.6A CN115556691A (en) 2022-11-07 2022-11-07 Method and system for vehicle to occupant information interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211395475.6A CN115556691A (en) 2022-11-07 2022-11-07 Method and system for vehicle to occupant information interaction

Publications (1)

Publication Number Publication Date
CN115556691A true CN115556691A (en) 2023-01-03

Family

ID=84769279

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211395475.6A Pending CN115556691A (en) 2022-11-07 2022-11-07 Method and system for vehicle to occupant information interaction

Country Status (1)

Country Link
CN (1) CN115556691A (en)

Similar Documents

Publication Publication Date Title
US9573541B2 (en) Systems, methods, and apparatus for identifying an occupant of a vehicle
CN109515361B (en) Cabin adjustment system and vehicle
CN108725357B (en) Parameter control method and system based on face recognition and cloud server
US20170327082A1 (en) End-to-end accommodation functionality for passengers of fully autonomous shared or taxi-service vehicles
WO2019205642A1 (en) Emotion recognition-based soothing method, apparatus and system, computer device, and computer-readable storage medium
US20140266623A1 (en) Systems, methods, and apparatus for learning the identity of an occupant of a vehicle
US10042432B2 (en) Programmable onboard interface
JP2006219009A (en) Automatic adjustment system for vehicular equipment
CN103678456A (en) Voice stamp-driven in-vehicle functions
CN113207104B (en) Vehicle-mounted information system
CN110556113A (en) Vehicle control method based on voiceprint recognition and cloud server
CN111717083B (en) Vehicle interaction method and vehicle
CN110816448A (en) Adjusting control system and method for seat and rearview mirror
CN108216087B (en) Method and apparatus for identifying a user using identification of grip style of a door handle
CN110297576A (en) A kind of information display method, device and vehicle
JP2018501998A (en) System and method for controlling automotive equipment
CN115556691A (en) Method and system for vehicle to occupant information interaction
CN112918381B (en) Vehicle-mounted robot welcome method, device and system
CN110103977A (en) Occupant's monitoring arrangement of vehicle
WO2022213516A1 (en) Method and system for displaying seat, and medium
WO2018134197A1 (en) Interface apparatus and method
JP6534587B2 (en) Judgment device
CN112905292A (en) Display method and device and vehicle
CN110103978A (en) Occupant's monitoring arrangement of vehicle
US20230007094A1 (en) Method, Device, Computer Program and Computer-Readable Storage Medium for Operating a Vehicle

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication