KR20230054009A - System for controlling vehicle display based on occupant's gaze deviation - Google Patents

Abstract

The present invention relates to a system for controlling a vehicle display screen on which content is being played using at least one of gaze information, voice information, and seat occupancy status information of an occupant. A system for determining an occupant's gaze deviation and controlling a vehicle display according to the present invention comprises an occupant information recognition unit for recognizing display screen viewing-related behavior information of an occupant in a vehicle, and a display control unit for controlling the vehicle display using the display screen viewing-related behavior information, wherein the display control unit determines that the occupant's gaze deviates from the display screen area by analyzing the display screen viewing-related behavior information and performs control of the display accordingly.

Description

Occupant gaze departure determination and vehicle display control system {SYSTEM FOR CONTROLLING VEHICLE DISPLAY BASED ON OCCUPANT'S GAZE DEVIATION}

The present invention relates to a system for controlling a vehicle display screen on which contents are reproduced using at least one of occupant gaze information, voice information, and seat seating state information.

A vehicle occupant may gaze at an object of interest (eg, a tree, a building, another vehicle, a bicycle, a motorcycle, etc.) among various objects seen outside the vehicle while driving and want to check information on the object of interest.

According to the prior art (Korean Patent Laid-open Publication No. 10-2012-0066472), a configuration for synthesizing and outputting augmented reality content to a forward object that is likely to be watched by a driver is disclosed.

According to the prior art, a configuration for minimizing a driver's gaze movement is disclosed, but there is a problem in that it is difficult to meet various needs related to checking an external object of a passenger.

The present invention has been proposed to solve the above problems, and an object of the present invention is to provide a system for controlling a vehicle display screen by monitoring a state of a passenger in a vehicle.

According to the present invention, a system for determining departure of an occupant's gaze and controlling a vehicle display includes an occupant information recognizing unit for recognizing behavioral information related to viewing a display screen of an occupant in a vehicle and a display for controlling a vehicle display using behavioral information related to viewing a display screen. Including a control unit, the display control unit analyzes behavioral information related to viewing the display screen, determines that the passenger's gaze departs from the display screen area, and controls the display accordingly.

The occupant information recognizing unit includes an occupant's gaze recognizing unit that obtains gaze information of the occupant in the vehicle and recognizes whether the occupant's gaze departs from the display screen area and a departure duration time.

The display control unit controls to dimly display the screen of video content when the duration of the occupant's gaze deviating from the display screen area exceeds a preset time.

The occupant information recognition unit further includes a voice recognition unit that obtains in-vehicle voice information, and the display control unit determines that a call or in-vehicle conversation is in progress using the in-vehicle voice information, and thus displays video content corresponding to video playback. Control to pause for playback.

The occupant information recognition unit further includes a voice recognition unit that obtains in-vehicle voice information, and the display control unit determines that a call or in-vehicle conversation is in progress using the in-vehicle voice information and reduces the playback volume of video content. control the

The display control unit controls to display a background screen instead of video content when the duration of the departure lasts longer than a preset time.

The occupant information recognizing unit further includes a seating state recognizing unit recognizing an occupant's sitting state with respect to a seat in the vehicle, and the display control unit identifies a occupant approaching the seat so that a first occupant with initiative sits on the seat. In this case, the video content is controlled to be played automatically.

When it is confirmed that the second occupant who does not have the initiative sits on the seat, the display controller allocates a portion of the display screen area to the second occupant.

The display control unit controls to display external interest information of the second occupant over an area allocated to the second occupant in consideration of at least one of the first occupant's authority setting information and the first occupant's boarding status information. .

When the first occupant leaves the vehicle, the display control unit displays a function previously used by the second occupant on the screen in consideration of use history information of the second occupant.

A method for determining departure of an occupant's gaze and controlling a vehicle display according to the present invention includes (a) obtaining at least one of information on the gaze of an occupant in a vehicle, voice information, and seated state information; and (b) the information obtained in step (a). and confirming that the occupant's intention is to stop viewing the display screen by using , and controlling the vehicle display.

When the gaze information of the occupant in the vehicle is acquired in the step (a), the gaze information including whether or not the gaze of the occupant in the vehicle leaves the display screen area and the duration of the departure is acquired.

In the step (b), when the duration of the departure exceeds a predetermined time, the screen of the video content is controlled to be dimmed.

When the voice information is obtained in the step (a), the step (b) determines that a call or a conversation in the vehicle is in progress using the voice information, and controls the video content corresponding to video playback to be paused. do.

When the voice information is obtained in the step (a), the step (b) determines that a call or an in-vehicle conversation is in progress using the voice information, and controls to reduce the playback volume of the video content.

In the step (b), it is confirmed that the occupant's intention is to stop viewing the display screen, and control is performed so that the background screen, not the video content, is displayed.

When the seated state information is recognized in the step (a), the step (b) automatically reproduces video content depending on whether the initiative is given to the occupant sitting on the seat.

If it is confirmed in the step (a) that the occupant who is not given the initiative is seated, in the step (b), a portion of the display screen area is allocated to the occupant who is not given the initiative.

In the step (b), external interest information is transmitted beyond the area allocated to the non-initiative passenger in consideration of at least one of authority setting information of the passenger to whom initiative is granted and boarding status information of the passenger to whom initiative is granted. control to express.

When it is confirmed that the occupant to whom initiative is granted in step (a) leaves the vehicle and the occupant to whom initiative is not granted is seated, step (b) uses the usage history information of the occupant who is not given initiative to determine the previous Control to display the used function on the screen.

According to the present invention, the condition of the occupant in the vehicle is monitored, and content is reproduced on the display screen of the vehicle using at least one of the information on the gaze of the occupant, the voice information, and the seat sitting state information. By controlling the display screen in such a way, it is possible to provide continuity of content viewing and to provide a passenger viewing area through division/switching of the vehicle display screen.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

1 illustrates a vehicle control system based on occupant intent according to an embodiment of the present invention.
2 to 4 illustrate indoor layout change based on occupant intention according to an embodiment of the present invention.
5 illustrates a vehicle control method based on occupant's intention according to an embodiment of the present invention.
6 illustrates a vehicle display control system based on an occupant's gaze according to another embodiment of the present invention.
FIG. 7 illustrates vehicle windshield display control for each area considering priority according to another embodiment of the present invention.
FIG. 8 illustrates control of a vehicle windshield display for each region in consideration of priorities in relative movement of an external object of interest according to another embodiment of the present invention.
9 illustrates a vehicle display control method based on a passenger's gaze according to another embodiment of the present invention.
10 illustrates a vehicle display control system and determination of an external interest information display area based on a passenger's gaze according to another embodiment of the present invention.
11 illustrates determination of an external interest information display area and display control according to another embodiment of the present invention.
12 illustrates a method for determining an external interest information display area and controlling a vehicle display based on an occupant's gaze according to another embodiment of the present invention.
13 illustrates an occupant's gaze departure determination and vehicle display control system according to another embodiment of the present invention.
14 to 17 illustrate examples of controlling a vehicle display in a driver's gaze deviation situation according to another embodiment of the present invention.
18 illustrates an example of vehicle display control when a control right is deviating according to another embodiment of the present invention.
19 illustrates a method for determining occupant gaze deviation and controlling a vehicle display according to another embodiment of the present invention.
20 illustrates a button display control and initiative control system in a vehicle display based on an occupant's gaze according to another embodiment of the present invention.
21, 22 and 23 show button display control according to another embodiment of the present invention.
24 illustrates transition of initiative when another passenger participates according to another embodiment of the present invention.
25 illustrates division of a screen area and display control based on gaze information when another passenger participates according to another embodiment of the present invention.
26 illustrates a button display control and initiative control method in a vehicle display based on an occupant's gaze according to another embodiment of the present invention.
27 illustrates a vehicle display control system for delivering external interest information according to another embodiment of the present invention.
28 illustrates external interest information display and external interest information display area control according to another embodiment of the present invention.
29 illustrates a vehicle display control method for transmitting external interest information according to another embodiment of the present invention.
30 illustrates a vehicle display control system synthesizing and displaying external interest information according to another embodiment of the present invention.
31 and 32 illustrate external interest information rotation display according to another embodiment of the present invention.
33 illustrates a vehicle display control method for synthesizing and displaying external interest information according to another embodiment of the present invention.
34 illustrates a vehicle display control system for storing and sharing external interest information according to another embodiment of the present invention.
35 illustrates a process of capturing external interest information according to another embodiment of the present invention.
36 illustrates a process of sharing external interest information to a smartphone according to another embodiment of the present invention.
37 illustrates a process of storing and checking external interest information for each occupant through sliding of a transparent display according to another embodiment of the present invention.
38 illustrates sharing of external interest information between displays according to another embodiment of the present invention.
39 illustrates a vehicle display control method for storing and sharing external interest information according to another embodiment of the present invention.
40 illustrates a vehicle display area control system for external interest information according to another embodiment of the present invention.
41 illustrates a process of controlling a vehicle display area for external interest information according to another embodiment of the present invention.
42 illustrates a method for controlling a vehicle display area for external interest information according to another embodiment of the present invention.
43 illustrates a vehicle display control system for displaying and storing external interest information according to another embodiment of the present invention.
44 illustrates external interest information display according to another embodiment of the present invention.
45 illustrates a vehicle display control method for displaying and storing external interest information according to another embodiment of the present invention.

The foregoing and other objects, advantages and characteristics of the present invention, and a method of achieving them will become clear with reference to the detailed embodiments described below in conjunction with the accompanying drawings.

However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms, and only the following embodiments provide the purpose of the invention, As only provided to easily inform the configuration and effect, the scope of the present invention is defined by the description of the claims.

Meanwhile, terms used in this specification are for describing the embodiments and are not intended to limit the present invention. In this specification, singular forms also include plural forms unless specifically stated otherwise in a phrase. As used herein, “comprises” and/or “comprising” means the presence of one or more other components, steps, operations, and/or elements in which a stated component, step, operation, and/or element is present. or added.

1 illustrates a vehicle control system based on occupant intent according to an embodiment of the present invention.

A vehicle control system based on occupant's intention according to an embodiment of the present invention includes a passenger's gaze recognizing unit 101 for recognizing the gaze of a passenger riding in a vehicle, and external objects viewed through a side window of the vehicle in consideration of the gaze of the occupant, It includes a POI determining unit 103 that determines a POI and a seat position controller 105 that changes a seat position of an occupant so that continuous gaze at the POI is possible according to the movement of the vehicle.

The passenger intention-based vehicle control system according to the present invention further includes a passenger gesture recognition unit 102 recognizing at least one of a passenger's touch input signal applied to a side window of a vehicle composed of a transparent display and an air gesture of the passenger, , the POI determining unit 103 determines the POI according to recognizing at least one of a touch input signal and an air gesture.

The seat position control unit 105 transmits a control signal for rotating the seat on which the occupant sits in consideration of the driving direction and driving speed of the vehicle.

The seat position control unit 105 considers the line of sight of a plurality of vehicle occupants staring at the same point of interest, transmits a control signal for rotating the seat of the first occupant, and slides forward or backward with respect to the seat of the second occupant. Sends a control signal to rotate.

In the vehicle control system based on occupant intention according to the present invention, when it is determined that the view of a second occupant is blocked by the first occupant by checking the eyes of a plurality of occupants of the vehicle gazing at the same point of interest, the first occupant is seated The display controller 104 controls to display an external area seen through the first side window close to the seated position through the second side window close to the seating position of the second occupant. At this time, the seat position control unit 105 transmits a control signal for rotating the seat of the first occupant in a first direction and transmits a control signal for rotating the seat of the second occupant in a second direction opposite to the first direction. send.

2 to 4 illustrate indoor layout change based on occupant intention according to an embodiment of the present invention.

Referring to FIGS. 2 to 4 , it is assumed that there is a first occupant sitting in the left rear seat and a second occupant sitting in the right rear seat among the passengers in the vehicle traveling forward.

The first occupant is a person riding close to the transparent display on the left side window and performs a touch operation on the transparent display, and the second occupant is a person riding far from the transparent display on the left side window and performs manipulation through air gestures. carry out

According to an embodiment of the present invention, the gaze of the occupant is recognized, and based on the gaze information, personalized AR information for each occupant is displayed through the transparent display on the left side window.

Referring to FIG. 2 , when the first occupant inputs a touch signal to an area of an isolated spire seen through the transparent display of the left side window, the POI determining unit 103 determines the first occupant's line of sight and the second occupant's line of sight. 1 It is determined that a specific external object is an object of interest in consideration of the area to which the touch signal of the occupant is applied.

The display controller 104 displays specific information of the object of interest in the form of text, images, icons, etc. through the transparent display of the left side window.

In addition, it is possible to provide information on the object of interest as a sound source through a speaker, and at this time, it is possible to independently provide the corresponding sound source to the first occupant through a directional speaker or a headrest speaker disposed in the left rear seat. .

As the driving vehicle drives forward, the external object of interest viewed through the left side window is relatively moved in the left rear direction with respect to the vehicle body.

When it is determined that the gaze of the first occupant stays on the object of interest and the first occupant turns his or her head in the left rear direction to continuously gaze at the object of interest, the seat position control unit 105 determines whether the first occupant is on board. The seat of the left rear seat is rotated counterclockwise so that the first occupant can continuously gaze at the object of interest in a more comfortable posture.

At this time, the seat position control unit 105 continuously controls the first occupant to look at the object of interest when the duration of the first occupant's gaze on the object of interest acquired through the occupant's gaze recognition unit 101 is equal to or longer than a preset time. It is determined that there is a need to gaze, and the rotational speed of the seat of the left rear seat in which the first occupant sits is controlled according to the traveling speed of the driving vehicle and the relative moving speed of the object of interest.

When the seat position control unit 105 rotates the seat according to the relative movement of the external object of interest while driving at a high speed equal to or higher than a preset speed (eg, 50 Km/h), it is expected that rapid seat rotation will be required. When an occupant is expected to feel uncomfortable, the seat rotation operation is not performed.

The prediction of occurrence of discomfort is determined based on a preset reference seat rotation speed.

At this time, the seat position control unit 105 determines whether to perform a seat rotation operation based on distance information between an external object of interest and the vehicle as well as the driving speed of the driving vehicle.

For example, in a situation where there is an external object of interest 50 meters away from the driving vehicle, when the seat is rotated so that the first occupant can continuously gaze at the external object of interest according to the driving speed, rapid seat rotation is required, whereas the driving vehicle If there is an external object of interest 500 meters away from the vehicle, even if the first occupant rotates the seat so that the first occupant can continuously gaze at the external object of interest according to the driving speed, rapid seat rotation is not required.

Therefore, the seat position control unit 105 comprehensively considers the driving speed of the driving vehicle and the distance between the driving vehicle and the external object of interest that the first occupant wants to continuously gaze at, so that the first occupant does not turn his or her head. It is determined whether or not to rotate the seat position of the first occupant so that he can comfortably gaze at an external object of interest.

If it is determined that the object of interest is out of the first occupant's field of view as the driving vehicle moves forward, the seat position control unit 105 rotates the seat of the left rear seat in which the first occupant sits clockwise, return to the position of

In addition, the seat position control unit 105 determines the position of the left rear seat in which the first occupant rides when the time during which the gaze information obtained through the occupant gaze recognition unit 101 no longer stays on the object of interest is maintained for a predetermined period of time or longer. Rotate the seat clockwise to return it to its original position.

Referring to FIG. 3 , the first occupant inputs a touch signal to the corresponding area while looking at an external object (isolated spire) shown through the transparent display of the left side window, and the second occupant sees it through the transparent display of the left side window. It is assumed that Ji looks at the same external object (isolated spire) and performs a preset air gesture.

That is, the first passenger and the second passenger designate the same external object as an external POI.

The point-of-interest determining unit 103 determines that a specific external object is an object of interest by considering the gaze of the first occupant, the touch signal application area of the first occupant, the gaze of the second occupant, and the air gesture of the second occupant. .

The display controller 104 displays specific information of the object of interest in the form of text, images, icons, etc. through the transparent display of the left side window.

In addition, it is possible to provide information on the object of interest as a sound source through a speaker, and at this time, through a directional speaker facing rear seat occupants, a headrest speaker disposed in the left rear seat, and a headrest speaker disposed in the right rear seat, It is possible to provide sound sources to the first and second occupants.

As the driving vehicle drives forward, the external object of interest viewed through the left side window is relatively moved in the left rear direction with respect to the vehicle body.

When it is confirmed that the gazes of the first and second passengers stay on the object of interest, and the first and second passengers turn their heads in the left rear direction and continuously gaze at the object of interest, the seat position control unit 105 rotates the seat of the left rear seat on which the first occupant sits in a counterclockwise direction so that the first occupant can continuously gaze at the object of interest in a more comfortable posture.

In addition, as the external object of interest is relatively moved, the seat position control unit 105 considers the view of the second occupant covered by the first occupant, and sets the seat of the right rear seat on which the second occupant sits on the basis of the vehicle body. It slides backward and rotates counterclockwise so that the second occupant can continuously gaze at the object of interest more easily.

If it is determined that the object of interest is out of the field of view of the first and second passengers as the driving vehicle moves forward, the seat position control unit 105 moves the seat of the left rear seat in which the first passenger sits clockwise. , and the seat of the right rear seat seated by the second occupant is slid forward and rotated clockwise to return to the original seat position.

Referring to FIG. 4 , the first occupant inputs a touch signal to the corresponding area while looking at an external object (isolated spire) shown through the transparent display on the left side window, and the second occupant sees it through the transparent display on the left side window. It is assumed that Ji looks at the same external object (isolated spire) and performs a preset air gesture.

That is, the first passenger and the second passenger designate the same external object as an external POI.

The point-of-interest determining unit 103 determines that a specific external object is an object of interest by considering the gaze of the first occupant, the touch signal application area of the first occupant, the gaze of the second occupant, and the air gesture of the second occupant. .

The display controller 104 displays specific information of the object of interest in the form of text, images, icons, etc. through the transparent display of the left side window.

In addition, it is possible to provide information on the object of interest as a sound source through a speaker, and at this time, through a directional speaker facing rear seat occupants, a headrest speaker disposed in the left rear seat, and a headrest speaker disposed in the right rear seat, It is possible to provide sound sources to the first and second occupants.

As the driving vehicle drives forward, the external object of interest viewed through the left side window is relatively moved in the left rear direction with respect to the vehicle body.

When it is determined that the gaze of the first occupant stays on the object of interest and the first occupant turns her head in the left rear direction and continuously gazes at the object of interest, the seat position control unit 105 controls the left side where the first occupant is on board. The seat of the rear seat is rotated counterclockwise so that the first occupant can continuously gaze at the object of interest in a more comfortable posture.

In addition, as the external object of interest is relatively moved, in consideration of the second occupant's view blocked by the first occupant, the display controller 104 displays the external scenery seen through the left side window transparent display through the right side window display. The screen is duplicated and displayed, and the seat position control unit 105 rotates the seat of the right rear seat on which the second occupant sits clockwise so that the second occupant can continuously gaze at the object of interest through the right side window display more easily. make it possible

If it is determined that the object of interest is out of the field of view of the first and second passengers as the driving vehicle moves forward, the seat position control unit 105 moves the seat of the left rear seat in which the first passenger sits clockwise. and rotates the seat of the right rear seat on which the second occupant sits counterclockwise to return it to its original seat position.

5 illustrates a vehicle control method based on occupant's intention according to an embodiment of the present invention.

A method for controlling a vehicle based on occupant's intention according to an embodiment of the present invention includes obtaining gaze information of a passenger riding in a vehicle (S501), and determining a point of interest located outside the vehicle by using the gaze information (S502). and changing the seat position of the occupant so as to continuously gaze at the point of interest according to the movement of the vehicle (S503).

In step S503, the seat on which the occupant sits is rotated in consideration of the driving direction and driving speed of the vehicle.

In step S501, when the gaze information of the plurality of passengers is obtained, and in step S502, when it is determined that the points of interest of the plurality of passengers are the same, in step S503, the seat of the first passenger is rotated, and the seat of the first passenger is rotated forward or forward with respect to the seat of the second passenger. Rotate with rear sliding.

In the vehicle control method based on occupant intention according to the present invention, eye gaze information of a plurality of occupants is acquired in step S501, and when it is determined that the points of interest of the plurality of occupants are the same in step S502, the first occupant closest to the seating position of the first occupant is determined to be the same in step S502. The method may further include controlling to display an external area including the point of interest seen through the first side window through the second side window close to the seating position of the second occupant ( S504 ).

6 illustrates a vehicle display control system based on an occupant's gaze according to another embodiment of the present invention.

A vehicle display control system based on an occupant's gaze according to another embodiment of the present invention includes a first occupant's gaze recognizing unit 601 for recognizing the gaze of a first occupant in a vehicle, and a second occupant for recognizing a gaze of a second occupant in the vehicle. Determines interest information from the gaze recognition unit 602 and the gazes of the first occupant and the second occupant, determines whether areas displaying the interest information on the windshield cross each other, and determines display priorities It includes a checking and prioritizing unit 603 to determine whether an interest information display area is crossed, and a display control unit 604 to control a display according to display priorities.

The display controller 604 controls the display in consideration of predetermined initiative information when the interest information display area of the first occupant overlaps with the interest information display area of the second occupant.

When the first passenger is set to have the initiative over the second passenger, the display controller 604 controls the display so that the interest information display area of the first passenger covers the interest information display area of the second passenger and is displayed on top.

When the display controller 604 is set to have the initiative over the second occupant, the display controller 604 moves the interest information display area of the second occupant so that the interest information display area of the second occupant is the same as the interest information display area of the first occupant. Control the displays so that they do not overlap.

The display controller 604 controls the display in consideration of the importance of the interest information when the interest information display area of the first occupant overlaps with the interest information display area of the second occupant.

When the display control unit 604 determines that the interest information of the first passenger belongs to a category having a higher importance than the interest information of the second passenger, the display controller 604 does not display the interest information of the second passenger and displays the interest information of the first passenger. Controls the display to display information.

The display control unit 604 considers at least one of a type of content displayed on the display area allocated to the first passenger and an operation situation related to the display area allocated to the first passenger, and converts interest information of the second passenger to the first passenger. Determines whether or not to display in the display area allocated to the occupant.

FIG. 7 illustrates vehicle windshield display control for each area considering priority according to another embodiment of the present invention.

Referring to (a) of FIG. 7 , driver A and passenger B look at an external object through a front windshield of the vehicle.

At this time, when driver A gazes at the vehicle in front located in the area ① for a predetermined time or longer, driving-related information is displayed according to the result of driver A's eye tracking, for example, the distance to the vehicle in front and AR route guidance based on navigation information. Information and the like are displayed on the first area A-1 of the front windshield, which is a transparent display.

Passenger B gazes at the store located in the area ② for a predetermined amount of time or longer, and accordingly, the store information (eg summer sale, up to 70%) is displayed in the second area (B-1) of the front windshield, which is a transparent display. displayed on

Referring to (b) of FIG. 7, as driver A looks at a parking tower located in the area ① (eg, the corresponding parking tower is a destination set in a navigation route), information of the corresponding parking tower (eg, hourly parking) cost) is displayed on the second area B-1 of the front windshield, which is a transparent display.

At this time, as described above, the display area for store information (eg, summer sale, up to 70%) located in the area ② according to the gaze of passenger B (ie, the transparent display, the second area of the front windshield ( Some of B-1)) and the driver A's line of sight overlap the display area for parking tower information located in the area ①.

For example, the display controller 604 controls the driver A's external interest information region and the passenger B's external interest information region to be overlapped and displayed. At this time, in the opposite case, as the gaze of the passenger B gazes at the store located in the first area A-1, the information about the store located in the first area A-1 is displayed on the front windshield, which is a transparent display. In the case of display, if it is determined that the display area for the object that driver A is gazing at will overlap, the display controller 604 displays only the information on the object that driver A is gazing at, and the external interest information according to the gaze of passenger B. Control not to display.

As another example, the display controller 604 confirms that the priority of displaying information displayed on the transparent display according to the gaze of driver A is higher than the priority of displaying information displayed on the transparent display according to the gaze of passenger B, and The external interest information region of is displayed in front of the external interest information region of passenger B (that is, a part of the external interest information region of passenger B may be covered).

As another example, the display controller 604 confirms that the priority of displaying information displayed on the transparent display according to the gaze of driver A is higher than the priority of displaying information displayed on the transparent display according to the gaze of passenger B, and The display area for information of external interest of driver B is moved so that it does not overlap with the display area for information of external interest of driver A.

For example, in the case of (b) of FIG. 7 , the display area for store information (eg, summer sale, up to 70%) is moved to the lower right corner so that it does not overlap with the display area for parking tower information.

That is, when driver A has the initiative compared to passenger B, the display area for external interest information gazed at by driver A is controlled to be displayed in priority over the display area for external interest information gazed at by passenger B.

In addition, when the information provided according to the gaze recognition of the occupant is information related to driving and safety (eg, lane, speed limit, traffic lights, distance to the vehicle in front, etc.), the external interest information display area is set to other information (eg, shop information). etc.) Priority is given to the display area so that the display is controlled.

FIG. 8 illustrates control of a vehicle windshield display for each region in consideration of priorities in relative movement of an external object of interest according to another embodiment of the present invention.

Referring to (a) of FIG. 8 , the first occupant A and the second occupant B look at an external object through the windshield of the left side window of the vehicle.

At this time, the music player is displayed in the first area (A-1) according to the needs of the first passenger A, and the outline of the object of interest (Isolated Spire) is displayed in the second area (B) according to the needs of the second passenger B. -1) is displayed.

Referring to (b) of FIG. 8 , when the interest information of the second passenger B invades the display area A-1 of the first passenger A as the vehicle travels forward, the display controller 604 The display control for the first area A-1 and the second area B-1 is performed in consideration of the content properties and the result of monitoring the gaze of the first passenger A.

Referring to (b) of FIG. 8 , the content displayed on the display area A-1 of the first passenger A is not the external interest information based on the gaze information of the first passenger A (eg, music, weather, movies). etc.), it is determined whether to display the information of the external object of interest of the second passenger B in the first area A-1 according to the type of content or the screen manipulation state of the first passenger A.

When the first passenger A selects music in the first area A-1, the display control unit 604 controls not to display information on the external object of interest of the second passenger B in the first area A-1. , so as not to interfere with the screen operation of the first passenger A.

In addition, when the first passenger A is watching a movie in the first area A-1, the display controller 604 displays information on the external object of interest of the second passenger B in the first area A-1. It is controlled so as not to interfere with the first occupant A's movie viewing.

As another example, in a situation where the first passenger A is not performing an operation for content execution in the first area (A-1), the display control unit 604 provides information on the external interest object of the second passenger B. It is controlled to be displayed in area 1 (A-1).

In addition, if it is confirmed that the first passenger A is gazing at a different place for a certain period of time or longer as shown in ③, the display controller 604 displays the information on the external object of interest of the second passenger B in the first area A-1. Control.

9 illustrates a vehicle display control method based on a passenger's gaze according to another embodiment of the present invention.

A vehicle display control method based on the gaze of a passenger according to another embodiment of the present invention includes the steps of recognizing eye gaze information of a plurality of passengers in a vehicle (S901), and identifying interest information using the eye gaze information (S902). , checking whether the display areas of the information of interest displayed on the windshield, which is a transparent display, intersect (S903) and, if the display areas of the interest information intersect, controlling the display (S904).

In step S904, display control is performed in consideration of preset initiative information according to a result of confirming that the interest information display area of the first occupant overlaps with the interest information display area of the second occupant.

In step S904, when it is set that the first passenger has the initiative over the second passenger, the display control is performed so that the interest information display area of the first passenger covers the interest information display area of the second passenger and is displayed above.

In step S904, if it is set that the first occupant has the initiative over the second occupant, the interest information display area of the second occupant is moved so that the interest information display area of the second occupant does not overlap with the interest information display area of the first occupant. Perform display control.

In step S904, when the interest information display area of the first occupant and the interest information display area of the second occupant overlap, display control is performed in consideration of the importance of the interest information.

In step S904, when it is determined that the interest information of the first passenger belongs to a category having a higher importance than the interest information of the second passenger, the interest information of the second passenger is not displayed, and the interest information of the first passenger is not displayed. Perform display control to perform display.

In step S904, interest information of the second passenger is allocated to the first passenger in consideration of at least one of a type of content displayed on the display area allocated to the first passenger and an operation situation related to the display area allocated to the first passenger. Determines whether to display in the displayed display area.

10 illustrates a vehicle display control system and determination of an external interest information display area based on a passenger's gaze according to another embodiment of the present invention.

According to another embodiment of the present invention, an occupant's gaze-based external interest information display area determination and vehicle display control system includes a first occupant's gaze recognition unit 1001 recognizing a first occupant's gaze in a vehicle, and a first occupant's gaze recognition unit 1001 . A first occupant's external interest information identification unit 1003 that checks the first occupant's external interest information from the gaze, a second occupant's gaze recognition unit 1002 that recognizes the second occupant's gaze in the vehicle, and the second occupant's gaze recognition unit 1002 The second occupant's external interest information identification unit 1004 confirms the external interest information of the second occupant from the gaze of the second occupant, and the external interest information display area of the first occupant and the external interest information display area of the second occupant are checked. Considering the influence of the interest information display area identification unit 1005 and the external interest information display area of the second occupant, which has a relatively low importance of information display, on the external interest information display area of the first occupant, and a display control unit 1006 that determines priorities.

When the display control unit 1006 determines that the recognition influence is equal to or less than a preset value, the display control unit 1006 controls the display to display external interest information of the second occupant together with information of external interest of the first occupant.

When it is determined that the recognition influence exceeds a predetermined value, the display control unit 1006 controls the display to display only the external interest information of the first occupant without displaying the external interest information of the second occupant.

When the display control unit 1006 determines that the recognition effect exceeds a preset value, the display area for displaying information of external interest of the second occupant is moved so that the area for displaying information of external interest of the second occupant after the movement is displayed is the external interest of the first occupant. The display control is performed so as not to invade the information display area.

The display control unit 1006 controls to display contour information about the original position of the external object of interest of the second occupant.

11 illustrates determination of an external interest information display area and display control according to another embodiment of the present invention.

Referring to FIG. 11 , a driver A and a passenger B riding in a vehicle look at an external object through a front windshield of the vehicle.

Referring to (a) of FIG. 11 , when driver A gazes at a vehicle in front located in an area ① for a predetermined time or longer, driving-related information is displayed according to the result of eye tracking of driver A, for example, the distance to the vehicle in front. , AR road guidance information based on navigation information, etc. are displayed on the first area A-1 of the front windshield composed of a transparent display. Passenger B gazes at the store located in the area ② for a predetermined amount of time or longer, and accordingly, information (eg summer sale, up to 70%) of the store is displayed on the transparent display in the second area (B-1) of the front windshield. displayed on

Referring to (b) of FIG. 11 , according to the eye movement of the passenger B, the display area for the external interest information corresponding to ② is moved to the first area A-1.

At this time, if the display controller 1006 confirms that the display area for information of interest to the outside of passenger B does not overlap with the display area for information of interest to outside of driver A, the display controller 1006 displays the outside of passenger B in the first area A-1. Control to display information of interest.

Referring to (c) of FIG. 11 , according to driver A's gaze movement, a rear side warning notification corresponding to ① is displayed as driver A's external interest information.

In this case, it is determined that the display area for information of external interest of passenger B overlaps with the display area for information of external interest of driver A described in (b) of FIG. Decide whether or not to display information.

At this time, the display control unit 1006 monitors driver A's gaze information until the display area for driver A's external interest information does not overlap with the display area for passenger B's external interest information. Do not perform display of information of interest.

As another example, as shown in (c) of FIG. 11 , the display control unit 1006 controls the display area for the information of interest to passenger B to be outside from overlapping with the display area for information of interest to driver A. Moves the display area for the external interest information of .

As shown in (c) of FIG. 11 , the display controller 1006 moves the display area for the information of interest to the passenger B to the second area B-1 so that the driver A confirms the information of interest to the outside. Make sure that there are no obstructions in doing so.

The display control unit 1006 controls to display the external interest information of the passenger B in AR or as a camera image.

The display control unit 1006 continuously displays the position of the external object of interest to passenger B in a dotted line form so that the position is recognized and controlled so as not to interfere with driver A's line of sight.

12 illustrates a method for determining an external interest information display area and controlling a vehicle display based on an occupant's gaze according to another embodiment of the present invention.

According to another embodiment of the present invention, a method for determining an occupant's gaze-based external interest information display area and controlling a vehicle display includes the steps of recognizing gaze information of a first occupant and a second occupant in a vehicle (S1201); Checking the external interest information display area of the first occupant and the external interest information display area of the second occupant by using the gaze information of the second occupant (S1202) and the external area of the second occupant whose information display is relatively less important Controlling the display by determining a display priority in consideration of the effect of the interest information display area on the recognition of the first passenger's external interest information display area (S1203).

In operation S1203, when it is determined that the recognition influence is equal to or less than a predetermined value, the display is controlled to display external interest information of the second passenger along with information of external interest of the first passenger.

In step S1203, if it is determined that the recognition influence exceeds a predetermined value, the display is controlled to display only the external interest information of the first passenger without displaying the external interest information of the second passenger.

In step S1203, if it is determined that the recognition influence exceeds a preset value, the second occupant's external interest information display area is moved so that the second occupant's external interest information display area after movement is the first occupant's external interest information display area. Control the display so as not to invade the

Step S1203 controls the display to display contour information on the original position of the second occupant's external object of interest.

13 illustrates an occupant's gaze departure determination and vehicle display control system according to another embodiment of the present invention.

According to another embodiment of the present invention, the occupant's line of sight deviation determination and vehicle display control system uses the occupant information recognizing unit 1310 that recognizes behavioral information related to viewing a display screen of an occupant in a vehicle and the behavioral information related to viewing a display screen. The display controller 1320 includes a display controller 1320 that controls the display, and the display controller 1320 analyzes behavioral information related to viewing the display screen to determine that the passenger's gaze departs from the display screen area, and accordingly, the display controller 1320 determines carry out control

The occupant information recognizing unit 1310 includes an occupant gaze recognizing unit 1311 that obtains gaze information of the occupant in the vehicle and recognizes whether the occupant's gaze departs from the display screen area and the duration of the departure.

The display control unit 1320 controls to dimly display the screen of video content when the duration of the occupant's gaze departing from the display screen area exceeds a predetermined time period.

The occupant information recognition unit 1310 further includes a voice recognition unit 1312 that acquires in-vehicle voice information, and the display control unit 1320 confirms that a call or in-vehicle conversation is in progress using the in-vehicle voice information, Playback of video content corresponding to video playback is controlled to be paused.

The display control unit 1320 determines that a call or an in-vehicle conversation is in progress using the in-vehicle voice information, and controls the playback volume of the video content to be reduced.

The display control unit 1320 controls to display a background screen instead of video content when the duration of the departure lasts longer than a preset time.

The occupant information recognition unit 1310 further includes a seating state recognition unit 1313 for recognizing the occupant's sitting state on the seat in the vehicle, and the display control unit 1320 identifies the occupant approaching the seat and controls 1 When an occupant sits on the seat, video content is controlled to be played automatically.

When it is confirmed that the second occupant who does not have the initiative sits on the seat, the display controller 1320 allocates a portion of the display screen area to the second occupant.

The display controller 1320 controls the display of the second passenger's external interest information beyond the area allocated to the second passenger in consideration of at least one of the first passenger's authority setting information and the first passenger's boarding state information.

When the first occupant leaves the vehicle, the display controller 1320 controls a function previously used by the second occupant to be displayed on the screen in consideration of the use history information of the second occupant.

14 to 17 illustrate examples of controlling a vehicle display in a driver's gaze deviation situation according to another embodiment of the present invention.

Referring to FIG. 14 , when the gaze of an occupant (initiator) who is watching video content being played on the vehicle display deviates from the screen, the display controller 1320 blurs the screen of the vehicle display so that the occupant is displayed on the screen. It is controlled not to be interfered with by the video contents being used.

At this time, if it is determined that the occupant is making a phone call or having a conversation with another occupant in the vehicle, or if it is determined that the occupant has no intention of viewing the video content, such as when the occupant closes his eyes and leans on the seat, the display control unit 1320 controls to reduce the playback volume of video content.

At this time, when the video content corresponds to video playback rather than real-time playback, such as TV content, the display controller 1320 controls the video content to pause.

Referring to FIG. 15 , when an occupant watching video content being played on a vehicle display moves/moves, the occupant's gaze moves within a reference value even when the occupant's gaze deviates from a predetermined range or more (eg, screen area). (eg, the line of sight returns to the screen area within 3 seconds), the display controller 1320 controls the video content screen and playback sound to be reproduced as they are without any change.

When the occupant gets out of the seat, the display controller 1320 controls to reduce the playback volume of the video content, dims the vehicle display screen (at this time, adjusts the playback volume according to the lapse of time from the moment the occupant gets off the seat) It is controlled to gradually decrease sequentially and the screen gradually becomes blurry), and in the case of video playback, not real-time playback, control to pause.

If the occupant does not return after a predetermined time elapses from the moment the occupant leaves the seat, the display controller 1320 converts the screen on which video content is reproduced into a background screen so that other occupants cannot see it and controls the display to display it. .

Referring to FIG. 16 , in a state where a background screen is displayed on a vehicle display, when detecting that an occupant who has moved away from the seat approaches the seat, the display controller 1320 stops displaying the background screen and displays a previously paused image. Control the display of content.

At this time, if it is confirmed that the occupant sitting on the seat is a person with initiative, the video content is automatically played.

If the occupant approaching the seat is a person with initiative, but is in a state where only the gaze is within the screen and is not seated on the seat, the video content is played as the occupant clicks the play button.

Referring to FIG. 17 , as the gaze of the occupant deviates from the vehicle display screen for a predetermined period of time or longer, the background screen is displayed.

At this time, when another occupant without initiative approaches the seat, the display controller 1320 allocates a portion of the corresponding vehicle display screen area to the other occupant.

At this time, when the screen lock is set, control is performed not to display video content previously played in the area allocated to the occupant having the initiative.

The area provided to the other occupant (passenger B) who does not have the initiative is shown as the second area (B-1), and the area provided to the occupant (passenger A) who has the initiative is shown as the first area (A-1).

The display controller 1320 controls the information of passenger B's external interest to be displayed in the first area A-1 beyond the second area B-1, according to the boarding state of passenger A, or the passenger who has the initiative. Depending on whether A's permission is set, the information of interest to the outside of passenger B is also controlled to be displayed in the first area (A-).

18 illustrates an example of vehicle display control when a control right is deviating according to another embodiment of the present invention.

In a situation where video content is reproduced on the vehicle display, when a passenger with initiative leaves the vehicle, the display controller 1320 performs display control to display a background screen.

When an occupant with initiative leaves the vehicle, the display controller 1320 controls the display to display a function previously used by another occupant as another occupant without initiative approaches the display.

19 illustrates a method for determining occupant gaze deviation and controlling a vehicle display according to another embodiment of the present invention.

According to another embodiment of the present invention, the method for determining the departure of the occupant's gaze and controlling the vehicle display includes obtaining at least one of information on the gaze of the occupant in the vehicle, voice information, and seated state information (S1901) and information acquired in the step S1901. and confirming that the occupant's intention is to stop viewing the display screen by using , and controlling the vehicle display (S1902).

When the gaze information of the occupant in the vehicle is acquired in step S1901, gaze information including whether or not the gaze of the occupant in the vehicle departs from the display screen area and the duration of the departure is acquired.

In step S1902, if the departure duration exceeds a preset time, the video content screen is dimmed.

When voice information is acquired in step S1901, step S1902 determines that a call or in-vehicle conversation is in progress using the voice information, and controls to pause video content corresponding to video playback.

When voice information is acquired in step S1901, step S1902 determines that a call or in-vehicle conversation is in progress using the voice information, and controls to reduce the playback volume of video content.

In step S1902, it is confirmed that the occupant's intention is to stop viewing the display screen, and control is performed so that the background screen, not the video content, is displayed.

When the seated state information is recognized in step S1901, in step S1902, video content is automatically reproduced according to whether the initiative is given to the occupant sitting on the seat.

If it is confirmed in step S1901 that the occupant who is not given initiative is seated, in step S1902, a portion of the display screen area is allocated to the occupant who is not given initiative.

In step S1902, the external interest information is displayed beyond the area allocated to the non-initiative passenger in consideration of at least one of the authority setting information of the passenger to whom initiative is granted and the boarding status information of the passenger to whom initiative is granted.

In step S1901, when it is confirmed that the occupant to whom initiative is granted leaves the vehicle and the occupant to whom initiative is not given is seated, in step S1902, functions previously used are displayed on the screen by using the use history information of the occupant to whom initiative is not granted. control to display.

20 illustrates a button display control and initiative control system in a vehicle display based on an occupant's gaze according to another embodiment of the present invention.

According to another embodiment of the present invention, a button display control and initiative control system in a vehicle display based on an occupant's gaze includes a first occupant's gaze recognition unit 2001 recognizing a first occupant's gaze within a vehicle display screen area and a first occupant's gaze recognition unit 2001 . A button display controller 2003 is included to control buttons to be displayed on the video content according to the gaze.

When the first occupant's gaze recognition unit 2001 determines that the first occupant's gaze stays on the preset screen area for a predetermined period of time or more, the button display control unit 2003 creates and displays a cursor, and moves the first occupant's gaze and controlling the movement and size change of the cursor according to the gaze distance of the first passenger.

When the first occupant's gaze recognition unit 2001 determines that the first occupant's gaze stays on the preset screen area for a predetermined period of time or more, the button display control unit 2003 selects at least one of the player button and the progress button of the video content. control to display.

A system for controlling the display of buttons in a vehicle display based on a passenger's gaze and initiative control according to another embodiment of the present invention further includes a second occupant's gaze recognizing unit 2002 recognizing the gaze of a second occupant participating in using the vehicle display. And, the button display control unit 2003 controls to display a button for initiative transfer.

According to another embodiment of the present invention, a button display control and initiative control system in a vehicle display based on an occupant's gaze is a display control unit for allocating a vehicle display screen area to a first occupant and a second occupant when approval for a change of initiative is made ( 2004) are further included.

According to the approval of the first passenger, the display control unit 2004 displays the external interest information of the second passenger in the first area allocated to the first passenger over the second area allocated to the second passenger.

The display controller 2004 controls the display of the video content to the entire vehicle display screen area when the second occupant gazes at the video content displayed on the first area for a predetermined period of time or longer.

21, 22 and 23 show button display control according to another embodiment of the present invention.

Referring to FIG. 21 , when it is confirmed that the occupant looks at a certain area on the video content screen reproduced on the vehicle display, a necessary button is generated.

The button display control unit controls the movement and size of the cursor based on the driver's gaze movement and the driver's gaze distance.

The occupant selects a function item by staring at a certain area on the screen for a predetermined period of time or by inputting a gesture on the mobile phone screen connected to the vehicle AVN.

The button display control unit displays player buttons (play, pause, forward, backward, volume, screen brightness, etc.) and progress buttons, and executes button display items for function execution by item selection.

Referring to FIG. 22, when the occupant gazes at the left area on the screen where video content is played, a cursor is created, the button display control unit changes the cursor to match the shape of the widget, and confirms that the gaze is made for a predetermined time or longer. Display the player button and progress button.

The button display control unit provides a widget to display a button in an area where the gaze of the occupant does not stay when the gaze of the occupant moves.

Referring to FIG. 23 , the button display control unit differently determines the size of the cursor according to the distance between the occupant and the vehicle display.

24 illustrates transition of initiative when another passenger participates according to another embodiment of the present invention.

In a situation where occupant A is watching video content reproduced on the vehicle display screen, when occupant B observes a specific area and participates in it, a button for switching the initiative is displayed.

At this time, as the passenger B selects the button for switching the initiative, the initiative is provided to the passenger B or a button for watching a video together is displayed.

When a change of initiative is requested by the gaze of passenger B, a button for consent of passenger A who currently has the initiative is provided on the screen.

When the transfer of initiative is approved at the request of passenger B, it is possible to configure a screen only for passenger B, which will be described with reference to FIG. 25 .

25 illustrates division of a screen area and display control based on gaze information when another passenger participates according to another embodiment of the present invention.

Passenger A is watching video content in a first area (A-1) of the vehicle display, and according to the participation of passenger B, a portion (B-1) of the vehicle display area is allocated to passenger B.

It is assumed that the video content selected by the passenger A is reproduced in the first area (A-1), and external interest information is displayed in the second area (B-1).

At this time, according to passenger A's approval, the external interest information is displayed in the first area A-1 beyond the second area B-1.

At this time, if the occupant B gazes at the video content for a certain period of time or more, it is determined that the occupant B has an intention to watch the video content instead of the external interest information, and the video content is displayed on the entire area of the vehicle display.

26 illustrates a button display control and initiative control method in a vehicle display based on an occupant's gaze according to another embodiment of the present invention.

According to another embodiment of the present invention, a button display control and initiative control method in a vehicle display based on an occupant's gaze includes the steps of recognizing a first occupant's gaze within a vehicle display screen area (S2601) and video content according to the first occupant's gaze. and controlling to display a button on top (S2602).

When it is confirmed in step S2601 that the first passenger's gaze stays on the preset screen area for a predetermined period of time or more, in step S2602, a cursor is generated and displayed, and the cursor is displayed according to the movement of the gaze of the first passenger and the gaze distance of the first passenger. Control movement and size changes.

When it is determined in step S2601 that the first passenger's gaze stays on the preset screen area for a predetermined period of time or more, in step S2602, at least one of a player button and a progress button of the video content is controlled to be displayed.

Step S2601 additionally recognizes the gaze of the second occupant participating in the use of the vehicle display, and step S2602 controls to display a button for switching initiative.

According to another embodiment of the present invention, a method for controlling display of buttons in a vehicle display and initiative control based on a passenger's gaze includes the steps of confirming approval of a first passenger in response to a second passenger's request to switch initiative, and performing initiative switching control (S2603 ) is further included.

According to another embodiment of the present invention, a button display control and initiative control method in a vehicle display based on an occupant's gaze divides and allocates a vehicle display screen area to a first occupant and a second occupant when a request for initiative change is approved, and A step of performing display control using gaze information of the first occupant and the second occupant (S2604) is further included.

In step S2604, according to the approval of the first passenger, the external interest information of the second passenger is also displayed in the first area allocated to the first passenger beyond the second area allocated to the second passenger.

In step S2604, when the second occupant gazes at the video content displayed on the first area for a predetermined period of time or more, the video content is displayed on the entire vehicle display screen area.

27 illustrates a vehicle display control system for delivering external interest information according to another embodiment of the present invention.

A vehicle display control system for transmitting external interest information according to another embodiment of the present invention includes an external interest information checking unit 2701 for checking external interest information of a first occupant in a vehicle and external interest information of a first occupant in a vehicle. It includes a display control unit 2703 that controls to be expressed through a display.

The external interest information identification unit 2701 identifies an external interest object using gaze information of the first occupant.

The external interest information identification unit 2701 identifies an external interest object using voice information and gaze information of the first occupant.

The external interest information identification unit 2701 identifies an external interest object using gesture information and gaze information of the first occupant.

The display controller 2703 controls to display the external interest information through at least one of a highlight display, an area display, a contour display, and an enlarged display.

A vehicle display control system for transmitting external interest information according to another embodiment of the present invention further includes a boarding position recognition unit 2702 for checking position information of a first occupant and a second occupant in a vehicle, and a display control unit ( 2703) controls to display external interest information through the display area perceivable to the second passenger in consideration of the location information.

28 illustrates external interest information display and external interest information display area control according to another embodiment of the present invention.

Referring to (a) of FIG. 28 , driver A recognizes an object of interest (eg, a bear) seen through the front windshield of the driving vehicle.

The external interest information checking unit checks the external interest information when driver A's gaze stays in a specific area for a predetermined period of time or longer.

The external interest information checking unit checks the external interest information based on driver A's speech information and gaze information when driver A utters "Did you see that?"

The external interest information checking unit checks the external interest information when the driver A's gaze stays in a specific area for a certain period of time or longer and performs a preset gesture (eg, pointing with a finger) to display the external interest information.

The display control unit controls to display the external interest information of the driver A through at least one of a highlight display, an area display, a contour display, and an enlarged display.

Referring to (a) of FIG. 28 , with respect to the area of the external object that the driver A is interested in, the display of the corresponding area is controlled to be displayed on the front windshield, which is a transparent display.

Referring to (b) of FIG. 28 , as described above, when driver A's external interest information is displayed on the front windshield, passengers B and passenger C located in the rear seat of driver A are covered by the driver A and are subject to the external interest information. It is assumed that the information is difficult to easily check.

At this time, the display control unit considers the seated position information of the passenger obtained through the boarding position recognition unit, so that passenger B and passenger C can easily check information of interest outside the left side window transparent display located near the seating position of passenger B. and controlled to be displayed on the right side-length transparent display located near the seating position of passenger C.

The boarding position recognition unit recognizes the position of the occupant in the vehicle using at least one of a seat sensor and an indoor camera, and the display control unit uses the corresponding position to display the display area that the passenger can comfortably see (the display area of the rear seat left window described above). , the rear seat right window display area) is determined, and external interest information is displayed in the determined area.

29 illustrates a vehicle display control method for transmitting external interest information according to another embodiment of the present invention.

A vehicle display control method for transmitting external interest information according to another embodiment of the present invention includes the steps of checking the external interest information of a first occupant in a vehicle (S2901), a first occupant in the vehicle, and a second occupant boarding. A step of checking the location (S2902) and a step of controlling to display external interest information through the vehicle display in consideration of the boarding position (S2903).

In step S2901, external interest information is identified using at least one of information on the gaze of the first occupant, voice information, and gesture information.

In step S2903, the external interest information is displayed through at least one of a highlight display, an area display, a contour display, and an enlarged display.

In step S2903, when it is determined that the view of the second occupant is not blocked using the boarding position, external interest information confirmed by the first occupant over the first display area is displayed on the first display area.

In step S2903, when it is determined that the second occupant's view is obstructed using the boarding position, control is performed to display external interest information confirmed by the first occupant over the first display area on a second display area different from the first display area. do.

30 illustrates a vehicle display control system synthesizing and displaying external interest information according to another embodiment of the present invention.

A vehicle display control system for synthesizing and displaying external interest information according to another embodiment of the present invention includes an external interest information checking unit 3001 for identifying an object of interest outside the vehicle that a passenger in the vehicle is interested in, and an external interest information A passenger operation information recognition unit 3002 for recognizing operation information of a passenger in the vehicle related to rotation and a display control unit 3002 synthesizing and displaying a 3D image of an object of interest outside the vehicle, rotating and displaying the 3D image according to the operation information ( 3003).

The external interest information checking unit 3001 checks an object of interest located in an area where the gaze of a passenger in the vehicle stays for a predetermined time or longer.

The passenger manipulation information recognizing unit 3002 recognizes at least one of a touch input, a gesture input, and a voice input as manipulation information.

The display controller 3003 determines the degree of rotation of the 3D image according to the manipulation information, rotates and displays the 3D image, and returns the 3D image to the actual position of the object of interest when there is no additional manipulation for a predetermined time or more.

31 and 32 illustrate external interest information rotation display according to another embodiment of the present invention.

Referring to FIG. 31 , an external object of interest is determined among objects visible over a vehicle windshield using gaze information of a passenger in a vehicle, and the object of interest is synthesized in a 3D form and displayed.

At this time, the external interest information synthesized in 3D form is displayed on the front windshield area, which is a transparent display.

When an occupant in the vehicle drags the synthesized external interest information in 3D form through a touch or gesture to the right, the external interest information synthesized in 3D form is rotated to the right by the dragged value.

After the external interest information synthesized in 3D form is rotated and displayed according to the operation of the occupant in the vehicle, the location of the external interest information synthesized in 3D form returns to the actual position of the external object of interest after a predetermined time elapses.

Referring to FIG. 32, an external object of interest is synthesized and displayed in a 3D form, but the corresponding 3D object is rotated 360 degrees up and down/left and right through multimodal interaction such as touch and gesture of a vehicle inside the vehicle as well as voice recognition. do.

33 illustrates a vehicle display control method for synthesizing and displaying external interest information according to another embodiment of the present invention.

A vehicle display control method for synthesizing and displaying external interest information according to another embodiment of the present invention includes the step of checking the external interest information of a passenger in the vehicle (S3301), and recognizing the passenger's operation information related to the rotation of the external interest information. (S3302) and synthesizing and displaying external interest information into a 3D image, and rotating and displaying the 3D image according to the manipulation information (S3303).

In step S3301 , external interest information on an external object located in an area where the gaze of the occupant in the vehicle stays for a predetermined time or longer is checked.

Step S3302 recognizes at least one operation information among touch input, gesture input, and voice input.

In step S3303, the 3D image is rotated and displayed according to the degree of rotation determined according to the manipulation information, and if there is no additional manipulation for a predetermined time or longer, the 3D image is returned to the actual position of the object of interest and displayed.

34 illustrates a vehicle display control system for storing and sharing external interest information according to another embodiment of the present invention.

A vehicle display control system for storing and sharing external interest information according to another embodiment of the present invention includes a passenger manipulation recognition unit 3401 receiving manipulation information for a vehicle occupant's request to store an image of an external object of interest, and a transparent display. and a display control unit 3402 that stores an image according to manipulation information on an external object of interest gazed at by a vehicle occupant over a vehicle windshield.

The passenger manipulation recognition unit 3401 receives manipulation information input using at least one of gaze information, voice information, gesture information, and touch information.

The display controller 3402 controls the display to display information on an external object of interest as AR information.

The display controller 3402 simultaneously captures and stores external foreground and AR information.

The display control unit 3402 performs white-out processing for a predetermined time and controls the display of the screen capture.

A vehicle display control system for storing and sharing external interest information according to another embodiment of the present invention transmits an image stored according to manipulation information to at least one of a divided area in a vehicle display, a mobile terminal of a vehicle occupant, and a mobile terminal of another user. An external interest information transmission unit 3403 for transmission is further included.

The display control unit 3402 divides and allocates a display area to a plurality of occupants in the vehicle, stores an external interest information image according to an image storage request made within each area, and stores the stored image in a preset area among the allocated display areas. control to display.

The display controller 3402 transmits control information for moving the transparent display in consideration of access control priority of a plurality of passengers.

The display controller 3402 controls the image information stored in the first passenger's preset area to be moved to the second passenger's preset area according to the passenger's request and sharing permission setting information.

Hereinafter, in FIGS. 35 to 38 , it is assumed that an occupant in a left rear seat in a vehicle gazes at the outside through a transparent display in the left rear seat window.

35 illustrates a process of capturing external interest information according to another embodiment of the present invention.

Referring to (a) of FIG. 35 , the display controller 3402 displays fixed information including at least one of location information, weather, battery information, and transparency of the transparent display through the transparent display.

Referring to (b) of FIG. 35 , the occupant manipulation recognition unit 3401 checks the area where the occupant's gaze stays for a certain period of time through the left rear seat window, and the display controller 3402 provides AR information based on the gaze tracking information. display

At this time, the display control unit 3402 transmits information such as mountain name, height, weather, distance, required time (time required for vehicle movement from the current position to the beginning of the mountain, time required to walk up from the beginning to the top of the mountain, etc.) to the AR. display with information

Referring to (c) of FIG. 35 , the passenger manipulation recognizing unit 3401 recognizes various manipulation information of the passenger and determines the intention of storing the information of interest to the outside.

Gaze Recognition and save button touch within mobile app, Gaze Recognition and bottom swipe touch within mobile app, Gaze Recognition and specific voice commands (e.g. save, capture this), Gaze Recognition and specific gestures, Gaze Recognition and display Requests to store the corresponding external interest information in various ways, such as a swipe-down touch.

Referring to (d) of FIG. 35 , the display control unit 3402 cuts and stores the outside foreground and AR information (as another example, only the region of interest to the outside) according to the storage request received from the passenger manipulation recognition unit. possible) at the same time, and at this time, the capture information may include photos, videos, AR information, and GPS location information.

When capturing a screen, the display controller 3402 performs a white out process for a preset time (eg, 1 second).

The display controller 3402 controls the screen shot to be displayed in a specific area (eg, lower left corner) of the display in a predetermined size (eg, 15 cm x 15 cm) and for a predetermined period of time (eg, 3 seconds).

36 illustrates a process of sharing external interest information to a smartphone according to another embodiment of the present invention.

In a situation where information of external interest is displayed in AR through the transparent display of the rear seat side window according to the eye tracking of the occupant, the occupant's manipulation recognition unit (3401 ) is received, the display control unit 3402 captures according to a preset method (eg, external foreground and AR information at the same time), and when capturing the screen, whites out for a preset time (eg, 1 second). ) process.

The external interest information transmitter 3403 transmits the captured screen to the passenger's mobile device, and the passenger can check whether the desired captured image is normally transmitted through an app (eg, album) of the mobile device.

Passengers can flip through the images displayed on the portable terminal through manipulation in the album, and by pressing a specific button (share button), the image to be shared is transmitted to another person's smartphone or vehicle.

37 illustrates a process of storing and checking external interest information for each occupant through sliding of a transparent display according to another embodiment of the present invention.

Referring to (a) of FIG. 37 , passenger A is seated on the left side of the back seat of the driving vehicle, and passenger B is seated on the right side of the rear seat of the driving vehicle, and passengers A and B look outward through the rear seat side window.

The rear seat side window is composed of a transparent display and provides an area allocated to each occupant.

For example, the first area A-1 is allocated to the occupant A and the second area B-1 is allocated to the occupant B in consideration of the passenger's viewing angle.

As another example, it is possible to allocate a display area based on the location of an external object that the occupant is currently gazing at. That is, as an example different from that shown in (a) of FIG. 37 , when passenger A gazes at an isolated spire as an object of interest and passenger B gazes at a double spire as an object of interest, the second area is directed to passenger A, It is also possible to assign the first area to passenger B.

Referring again to (a) of FIG. 37 , when the passenger A gazes at the double spire shown over the first area A-1 as an object of interest and swipe down on the display, the display control unit 3402 ) stores and displays the captured image in a specific personalized area at the bottom of the display area. In addition, since passenger B is a person who is farther away from the left window of the rear seat than passenger A, the intention to capture is conveyed through gaze recognition and air gestures, and the display control unit 3402 displays a specific personalized area at the bottom of the display area as requested by passenger B. Save and display the captured image.

Referring to (b) of FIG. 37 , in an autonomous driving situation, the driving control right is in the autonomous driving mode, the passenger C located in the driver's seat enjoys the outside scenery through the left window, and the driver C's left window display access control right is the passenger B It is assumed that the priority is higher (the priority for display access control is assumed to be higher for a display closer to the boarding position).

At this time, the transparent display corresponding to the second area (B-1) is slid forward and is disposed on the left side of the occupant C, and the second area (B-1) is transferred to the third area (C-1). assigned to C.

Passenger C requests storage of the external interest information through a swipe-down display, and the display control unit 3402 displays that the external interest information is stored as a captured image in a specific area at the bottom of the display.

Referring to (c) of FIG. 37 , authentication is performed for each occupant in consideration of the face ID camera and seat location information disposed in the vehicle, and when the authentication is completed, a personalized content history is displayed in the lower area of the display area allocated to each occupant. display

In the content history display, image/video files are displayed in the order of captured time.

38 illustrates sharing of external interest information between displays according to another embodiment of the present invention.

Referring to FIG. 38 , the first area A-1 is allocated to passenger A and the second area B-1 is allocated to passenger B, and the content history of each passenger is displayed in a specific area at the bottom of each area.

Referring to (a) of FIG. 38 , passenger B selects a specific content from the content history (selection is possible through a long press or gesture), drags the corresponding object, and requests delivery to passenger A's display.

Referring to (b) of FIG. 38 , the display control unit 3402 considers the information sharing authority setting information of passenger A and displays the specific content to be moved to the personalization area of passenger A when information sharing is approved. do.

At this time, when dragging and dropping, the display control unit 3402 drags and drops not only the display on the same side (rear seat left window), but also the front or opposite side (rear seat rear window) display according to the request of the occupant and information sharing permission setting. The display is controlled to share external interest information according to the directionality of .

Referring to (c) of FIG. 38 , the specific content shared by passenger B's manipulation is added to and stored in the personalization area of passenger A.

39 illustrates a vehicle display control method for storing and sharing external interest information according to another embodiment of the present invention.

A vehicle display control method for storing and sharing external interest information according to another embodiment of the present invention includes the steps of receiving a request for storing an image of an external object of interest from a vehicle occupant (S3901), and displaying information over a vehicle windshield composed of a transparent display. and performing image storage and display control on an external object of interest gazed at by a vehicle occupant (S3902).

Step S3901 receives an image storage request input using at least one of gaze information, voice information, gesture information, and touch information.

In step S3902, display control is performed to display information on an external object of interest as AR information.

Step S3902 simultaneously captures and stores external foreground and AR information.

Step S3902 performs display control for screen capture by white-out processing for a preset time.

A vehicle display control method for storing and sharing external interest information according to another embodiment of the present invention transmits a stored image to at least one of a divided area in a vehicle display, a mobile terminal of a vehicle occupant, and a mobile terminal of another user, thereby transmitting an external interest information. A step of sharing information (S3903) is further included.

Step S3902 divides and allocates a display area to a plurality of occupants in the vehicle, stores an external interest information image according to an image storage request made in each area, and controls the stored image to be displayed in a preset area among the allocated display areas. do.

Step S3902 performs display control to move the transparent display in consideration of access control priority of a plurality of occupants.

In step S3902, the image information stored in the first passenger's preset area is moved to the second passenger's preset area according to the passenger's request and sharing authority setting information.

40 illustrates a vehicle display area control system for external interest information according to another embodiment of the present invention.

According to another embodiment of the present invention, a system for determining an external interest information display area based on an occupant's gaze and controlling a vehicle display includes an external interest information display area checker (4001 ) and a display controller 4002 that adjusts a display area of external interest information in consideration of at least one of initiative granted to a plurality of occupants and importance of external interest information.

When it is determined that the importance of the information of external interest of the first passenger is higher than the importance of the information of external interest of the second passenger, the display controller 4002 determines that the display area of the information of interest to the outside of the second passenger is changed to the external interest information of the first passenger. The display area of the external interest information of the second occupant is moved so as not to overlap with the display area of the second passenger.

The display control unit 4002 determines that the first occupant has the initiative and the display area of the external interest information of the first occupant and the display area of the external interest information of the second occupant overlap at least a certain portion, the second occupant Moves the display area of the external interest information of .

The display controller 4002 controls to display contour information on the original position of the second occupant's external information.

The display controller 4002 restores the display area of the second occupant's external interest information to the previous area in consideration of the first occupant's gaze information.

41 illustrates a process of controlling a vehicle display area for external interest information according to another embodiment of the present invention.

Referring to (a) of FIG. 41 , driver A and passenger B look at an external object through the front windshield of the vehicle.

At this time, when driver A gazes at the vehicle in front located in the area ① for a predetermined period of time or longer, driving-related information (e.g., distance to the vehicle ahead, AR guidance information based on navigation information) according to driver A's gaze tracking result. is displayed on the front windshield, which is a transparent display.

Passenger B gazes at the shop (cafι) located in the area of ② for a predetermined time or more, and accordingly, information (eg, phone number, floor number, menu) of the corresponding shop is displayed on the front windshield, which is a transparent display.

Referring to (b) of FIG. 41 , as the driver A looks at the stopped vehicle located in the area ①, the display area of the external interest information of the passenger B overlaps the display area of the external interest information of the driver A.

The display controller 4002 changes the location of the external interest information display area of the passenger B in order to prevent the driver A, who is the owner of the initiative, from being obstructed by such an overlapping phenomenon.

That is, while passenger B is gazing at cafe information on the first floor of a building, when driver A is provided with blind spot warning information and driver A is gazing at another vehicle, the display control unit 4002 responds according to the initiative and priority of the information. The cafe information is moved to the upper area of the building and displayed.

At this time, the display control unit 4002 continuously displays the location of the existing information of interest in a dotted line form to support recognizing the location.

Referring to (c) of FIG. 41 , when transmission of the rear cross-traffic warning information provided to driver A is no longer performed or driver A moves his/her gaze to another object (a vehicle in front), the display controller 4002 The position of the passenger B's external interest information display area is restored.

42 illustrates a method for controlling a vehicle display area for external interest information according to another embodiment of the present invention.

According to another embodiment of the present invention, a method for determining an occupant's gaze-based external interest information display area and vehicle display control method includes the step of identifying an occupant's external interest information display area in a vehicle (S4201) and initiative information granted to the occupant. and adjusting a position of an area displaying the external interest information in consideration of at least one of the importance of the external interest information (S4202).

In step S4202, if it is determined that the importance of the information of external interest of the first occupant is higher than the importance of the information of external interest of the second occupant, the display area of the information of external interest of the second occupant is changed to the display area of the information of external interest of the first occupant. The position of the display area of the external interest information of the second occupant is moved so as not to overlap with .

In step S4202, if it is confirmed that the first passenger has the initiative and the display area of the external interest information of the first passenger and the display area of the external interest information of the second passenger overlap at least a certain portion, the external interest of the second passenger Move the display area of information.

Step S4202 controls to display contour information on the original position of the second occupant's external interest information.

In step S4202, the display area of the external interest information of the second occupant is returned to the area before the movement in consideration of the gaze information of the first occupant.

43 illustrates a vehicle display control system for displaying and storing external interest information according to another embodiment of the present invention.

A vehicle display control system for displaying and storing external interest information according to another embodiment of the present invention includes an external object of interest identification unit 4301 for identifying an external object of interest of interest to a passenger in a driving vehicle and an external object of interest. A display for controlling the display of external interest information on the first display area, displaying the external interest information by moving it to the second display area according to the driving situation, and storing the external interest information in the external interest information storage unit 4303. A control unit 4302 is included.

The external object of interest identification unit 4301 identifies an external object of interest using at least one of information on the gaze of the occupant, voice information, and gesture information.

The display controller 4302 controls to simplify the external interest information and move the simplified external interest information to the second display area, which is a side window display, for display when the passenger's gaze deviates from the display area of the external interest information.

The display control unit 4302 controls to accumulate the simplified external interest information according to the time order and display it on the second display area.

A vehicle display control system for displaying and storing external interest information according to another embodiment of the present invention further includes a destination setting request receiving unit 4304 for receiving a destination setting request for simplified external interest information.

A vehicle display control system for displaying and storing external interest information according to another embodiment of the present invention further includes a route setting unit 4305 for setting a route to a selected external POI according to a destination setting request.

44 illustrates external interest information display according to another embodiment of the present invention.

Referring to (a) of FIG. 44 , a driver riding in a driving vehicle gazes at an object of interest (parking lot) among external objects visible over a front windshield configured of a transparent display for a predetermined time or longer, and accordingly external interest information (e.g. : parking lot name, location, cost information) are displayed as AR information.

At this time, the display control unit 4302 identifies an external object of interest using voice information, head movement information, and gesture information in addition to information on the gaze of the occupant, and controls information on the external object of interest to be displayed.

Referring to (a) of FIG. 44 , the display controller 4302 determines the external interest when the driver's field of view deviates from the external interest information display area or the external interest object moves out of the driver's field of view according to the movement of the driving vehicle. Simplify information (eg, distance from current location, parking cost, etc.), and display simplified external interest information in log form.

At this time, the display controller 4302 controls the simplified external interest information to be displayed on a preset area of the front display or side window display.

Referring to (b) of FIG. 44 , when the external POI relatively moves as the vehicle travels and deviates from the driver's field of view, the display controller 4302 displays the external interest information on a time-by-time basis on the side window display. That is, the display control unit 4302 accumulates and displays external interest information in the order of past time.

At this time, the display controller 4302 controls information on an external object of interest located in the front left with respect to the driving vehicle to be displayed through the left window display, and information on the external object of interest located in the front right with respect to the driving vehicle. is displayed through the right window display.

When a request for setting a destination for specific external interest information among a plurality of stored external interest information is received, the route setting unit 4305 sets a route from the current location to the location of the corresponding external interest information.

The destination setting request receiving unit 4304 receives a request for setting a destination using a touch, voice, air gesture, or mobile device for external interest information stored in the side window display.

45 illustrates a vehicle display control method for displaying and storing external interest information according to another embodiment of the present invention.

A vehicle display control method for displaying and storing external interest information according to another embodiment of the present invention includes the steps of identifying an external interest object of a vehicle occupant (S4501) and storing the external interest information on the external interest object in a first display area. and moving and displaying external interest information to a second display area according to driving conditions (S4502).

In step S4501, an external object of interest is identified using at least one of information on the gaze of the passenger, voice information, and gesture information.

In step S4502, when the gaze of the occupant of the driving vehicle deviates from the display area of the external interest information, the external interest information is simplified, and the simplified external interest information is moved to the second display area, which is a side window display, and displayed.

In step S4502, the simplified external interest information is accumulated according to a time sequence and displayed on the second display area.

A vehicle display control method for displaying and storing external interest information according to another embodiment of the present invention receives a destination setting request for simplified external interest information, and sets a route to a selected external POI according to the destination setting request. It further includes a step (S4503).

Meanwhile, the method according to the embodiment of the present invention may be implemented in a computer system or recorded on a recording medium. A computer system may include at least one processor, a memory, a user input device, a data communication bus, a user output device, and a storage. Each of the aforementioned components communicates data through a data communication bus.

The computer system may further include a network interface coupled to the network. The processor may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in memory and/or storage.

The memory and storage may include various types of volatile or non-volatile storage media. For example, memory may include ROM and RAM.

Therefore, the method according to the embodiment of the present invention can be implemented as a method executable on a computer. When the method according to an embodiment of the present invention is executed in a computer device, computer readable instructions may perform the method according to the present invention.

Meanwhile, the method according to the present invention described above may be implemented as computer readable codes on a computer readable recording medium. Computer-readable recording media includes all types of recording media in which data that can be decoded by a computer system is stored. For example, there may be read only memory (ROM), random access memory (RAM), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, and the like. In addition, the computer-readable recording medium may be distributed in computer systems connected through a computer communication network, and stored and executed as readable codes in a distributed manner.

Claims (20)

an occupant information recognizing unit recognizing behavioral information related to viewing a display screen of a occupant in the vehicle; and
Including a display control unit that performs control on the vehicle display using the behavioral information related to viewing the display screen,
The display control unit analyzes the behavioral information related to viewing the display screen, determines that the passenger's gaze departs from the display screen area, and controls the display accordingly.
In-passenger gaze departure determination and vehicle display control system.
According to claim 1,
The occupant information recognizing unit includes an occupant's gaze recognizing unit that obtains gaze information of the occupant in the vehicle and recognizes whether or not the occupant's gaze departs from the display screen area and a departure duration time.
In-passenger gaze departure determination and vehicle display control system.
According to claim 2,
The display control unit controls to dimly display the screen of the video content when the duration of the occupant's gaze departing from the display screen area exceeds a predetermined time period.
In-passenger gaze departure determination and vehicle display control system.
According to claim 2,
The occupant information recognition unit further includes a voice recognition unit that obtains voice information in the vehicle;
The display control unit determines that a call or an in-vehicle conversation is in progress using the in-vehicle voice information and controls to pause playback of video content corresponding to video playback.
In-passenger gaze departure determination and vehicle display control system.
According to claim 2,
The occupant information recognition unit further includes a voice recognition unit that obtains voice information in the vehicle;
The display control unit determines that a call or an in-vehicle conversation is in progress using the in-vehicle voice information and controls to reduce the playback volume of video content.
In-passenger gaze departure determination and vehicle display control system.
The method of any one of claims 4 and 5,
The display control unit controls to display a background screen, not video content, when the departure duration lasts longer than a preset time
In-passenger gaze departure determination and vehicle display control system.
According to claim 2,
The occupant information recognizing unit further includes a seating status recognizing unit recognizing a seating status of the occupant on a seat in the vehicle,
The display control unit identifies a passenger approaching the seat and controls the video content to be automatically played when the first passenger with initiative sits on the seat.
In-passenger gaze departure determination and vehicle display control system.
According to claim 7,
When it is confirmed that the second occupant who does not have the initiative is seated on the seat, the display controller allocates a portion of the display screen area to the second occupant.
In-passenger gaze departure determination and vehicle display control system.
According to claim 8,
The display control unit controls to display external interest information of the second occupant beyond an area allocated to the second occupant in consideration of at least one of the first occupant's authority setting information and the first occupant's boarding state information. thing
In-passenger gaze departure determination and vehicle display control system.
According to claim 8,
When the first occupant leaves the vehicle, the display control unit displays a function previously used by the second occupant on the screen in consideration of the use history information of the second occupant.
In-passenger gaze departure determination and vehicle display control system.
(a) acquiring at least one of eye gaze information, voice information, and seated state information of an occupant in the vehicle; and
(b) confirming that the occupant's intention is to stop viewing the display screen by using the information acquired in step (a), and controlling the vehicle display;
A method for determining occupant gaze deviation and controlling a vehicle display comprising:
According to claim 11,
When the gaze information of the occupant in the vehicle is obtained in the step (a), obtaining the gaze information including whether the gaze of the occupant in the vehicle leaves the display screen area and the departure duration time
Determination of occupant gaze deviation and vehicle display control method.
According to claim 12,
In the step (b), if the duration of the departure exceeds a predetermined time, controlling the screen of the video content to be dimly displayed.
Determination of occupant gaze deviation and vehicle display control method.
According to claim 11,
When the voice information is obtained in the step (a), the step (b) determines that a call or a conversation in the vehicle is in progress using the voice information, and controls the video content corresponding to video playback to be paused. to do
Determination of occupant gaze deviation and vehicle display control method.
According to claim 11,
When the voice information is acquired in the step (a), the step (b) determines that a call or an in-vehicle conversation is in progress using the voice information, and controls to reduce the playback volume of the video content.
Determination of occupant gaze deviation and vehicle display control method.
According to claim 11,
The step (b) is to confirm that the occupant's intention is to stop viewing the display screen, and to control the background screen instead of the video content to be displayed.
Determination of occupant gaze deviation and vehicle display control method.
According to claim 16,
When the seated state information is recognized in the step (a), the step (b) automatically plays video content depending on whether or not the initiative is given to the occupant sitting on the seat.
Determination of occupant gaze deviation and vehicle display control method.
According to claim 17,
If it is confirmed in step (a) that the occupant who is not given initiative is seated, in step (b), a part of the display screen area is allocated to the occupant who is not given initiative.
Determination of occupant gaze deviation and vehicle display control method.
According to claim 18,
In the step (b), external interest information is transmitted beyond the area allocated to the non-initiative passenger in consideration of at least one of authority setting information of the passenger to whom initiative is granted and boarding status information of the passenger to whom initiative is granted. to control the expression
Determination of occupant gaze deviation and vehicle display control method.
According to claim 18,
When it is confirmed that the occupant to whom initiative is granted in step (a) leaves the vehicle and the occupant to whom initiative is not granted is seated, step (b) uses the usage history information of the occupant who is not given initiative to determine the previous To control the display of used functions on the screen
Determination of occupant gaze deviation and vehicle display control method.

Images