KR20240066649A - A Display for displaying contents of call or message, a vehicle including them, and a method therefore - Google Patents

Abstract

A vehicle according to an embodiment of the present invention includes a display installed in the vehicle and displaying information related to the vehicle; A sensor for identifying a user riding in the vehicle; and a processor that controls the display, wherein the processor receives a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle, and communicates with the communication device or communication terminal according to information detected through the sensor. The associated user can be identified and the contents of the received call or message can be controlled to be displayed on the display of the vehicle associated with the user.

Description

A display for displaying call or message contents, a vehicle including them, and a vehicle control method therefor {A Display for displaying contents of call or message, a vehicle including them, and a method therefore}

The present invention relates to vehicles, and more specifically, to a display device installed in a vehicle for displaying vehicle-related information, a vehicle including the same, and a vehicle control method therefor.

SAE (Society of Automotive Engineers), the American Society of Automotive Engineers, divides autonomous driving levels into a total of 6 levels, from Level 0 to Level 5, as follows, for example.

Level 0 (No Automation) is the stage where the driver controls and takes responsibility for all aspects of driving. The driver always drives, and the vehicle's system only performs auxiliary functions such as emergency notification. The subject of driving control is a human, and the level of variable detection and driving responsibility during driving also lies with humans.

Level 1 (Driver Assistance) is the level that assists the driver through adaptive cruise control and lane keeping functions. By activating the system, it assists the driver by maintaining vehicle speed, distance between vehicles, and lane maintenance. The subjects of driving control are humans and the system, and the detection of variables that occur during driving and driving responsibility are all at the level of humans.

Level 2 (Partial Automation) is a stage where the vehicle can control the steering and acceleration/deceleration of the vehicle simultaneously with humans for a certain period of time within specific conditions. Steering in gentle curves and assist driving that maintains the distance from the car in front are possible. However, the level of variable detection and driving responsibility during driving lies with humans, so the driver must always monitor the driving situation, and in situations that the system cannot recognize, the driver must immediately intervene in driving.

Level 3 (Conditional Automation, Partial Automation) is a level where the system is responsible for driving in sections with specific conditions, such as highways, and the driver intervenes only in case of danger. The system is responsible for driving control and detecting variables during driving, and unlike level 2, the above monitoring is not required. However, if the system's requirements are exceeded, the system requests the driver's immediate intervention.

Level 4 (High Automation) allows autonomous driving on most roads. Driving control and driving responsibility are both in the system. Driver intervention is not required on most roads except in restricted situations. However, driver intervention may be requested under certain conditions such as bad weather, so a human-assisted driving control device is necessary.

Level 5 (Full Automation) is a level where a driver is not required and driving is possible with only passengers. The rider simply inputs the destination, and the system takes care of driving in all conditions. At level 5, control devices for steering, acceleration, and deceleration of the vehicle are unnecessary.

Meanwhile, in Korea, safety standards for level 3 were established in 2020, taking into account international trends being discussed at the UN's International Forum on Harmonization of Automotive Safety Standards (UN/ECE/WP.29).

As the level of autonomous driving becomes more advanced in the future, it is highly likely that the passenger experience within the vehicle will develop into a slightly different aspect. In other words, it is expected that an environment will be created where passengers can carry out work, entertainment, etc., instead of leaving the driving of the vehicle to the vehicle itself. Against this background, ways to increase the user experience within a vehicle are being discussed.

According to the above-mentioned background, an embodiment of the present invention seeks to provide a method for displaying the contents of a call or message received while riding a vehicle on a display.

Another embodiment of the present invention seeks to provide a method for displaying messages received while riding a vehicle to passengers and sending replies in response to them.

The object of the present invention is not limited to the problems described above. Other problems not described above can be understood by those skilled in the art from the description of the present invention below.

A vehicle according to an embodiment of the present invention includes a display installed in the vehicle and displaying information related to the vehicle; A sensor for identifying a user riding in the vehicle; and a processor that controls the display, wherein the processor receives a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle, and communicates with the communication device or communication terminal according to information detected through the sensor. The associated user can be identified and the contents of the received call or message can be controlled to be displayed on the display of the vehicle associated with the user.

Additionally or alternatively, the content of the call or message displayed on the display may include a summary of the entire content or a portion of the entire content of the call or message.

Additionally or alternatively, the processor may control the content of the received call or message to be displayed on the display at a rate that changes depending on the driving speed of the vehicle.

Additionally or alternatively, the processor may control the content of the received call or message not to be displayed on the display when the vehicle's driving speed exceeds a set value.

Additionally or alternatively, the processor acquires and recognizes the user's voice, corresponding to what is displayed on the display, converts the recognized user's voice into text, and when the user's operation signal is received, the processor The converted text can be controlled to be transmitted to the sender of the received call or message.

Additionally or alternatively, the display may include a head-up display of the vehicle.

Additionally or alternatively, the processor may use at least one of facial recognition of a user riding in the vehicle, a seat position of a user riding in the vehicle, or user information of the communication terminal to identify the user. .

A vehicle control method according to an embodiment of the present invention includes receiving a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle; identifying a user associated with the communication device or communication terminal; and displaying the contents of the received call or message on a display of the vehicle associated with the user.

Additionally or alternatively, the content of the call or message displayed on the display may include a summary of the entire content or a portion of the entire content of the call or message.

Additionally or alternatively, the content of the received call or message may be displayed on the display at a rate that changes depending on the speed of travel of the vehicle.

Additionally or alternatively, the content of the received call or message may not be displayed on the display if the vehicle's traveling speed exceeds a set value.

Additionally or alternatively, the method may include obtaining and recognizing the user's voice, corresponding to that displayed on the display; Converting the recognized user's voice into text; And when the user's operation signal is received, it may include transmitting the converted text to the sender of the received call or message.

Additionally or alternatively, the display may include a head-up display of the vehicle.

Additionally or alternatively, the step of identifying the user may include identifying the user using at least one of facial recognition of the user riding in the vehicle, seat position of the user riding in the vehicle, or user information of the communication terminal. It may include steps to:

A display device according to another embodiment of the present invention includes a display module that displays information related to a vehicle; A sensor for identifying a user riding in the vehicle; and a processor that controls the display module, wherein the processor receives a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle, and sends a call or message to the communication device or communication terminal according to information detected through the sensor. The user associated with the user can be identified and the contents of the received call or message can be controlled to be displayed on the display module associated with the user.

According to another embodiment of the present invention, a computer program stored in a computer-readable medium for performing the above-mentioned vehicle control method is proposed.

The solutions of the present invention described above are some of the embodiments of the present invention. Various solution methods other than those for solving the problems described above can be derived and understood based on the detailed description of the present invention, which will be described below.

The effects of the present invention described above are as follows.

By displaying the other party's call content in text form rather than voice within the vehicle, the privacy of passengers talking on the phone in the vehicle is protected.

In addition, by displaying the contents of messages received from passengers in the vehicle so that only the relevant passengers can see them, there is an effect of protecting the privacy of passengers sending and receiving messages while riding in the vehicle.

In addition, the reply corresponding to the received message is recognized as a voice, displayed on the display in the form of text, and transmitted, thereby ensuring safety by minimizing driving disruption.

The effects of the present invention are not limited to the effects described above. Other effects not described above can be understood by those skilled in the art from the description of the present invention below.

The accompanying drawings, which are included as part of the detailed description to aid understanding of the present invention, provide embodiments of the present invention and, together with the detailed description, explain the content of the present invention.
Figure 1 is an overall block diagram of an autonomous driving control system to which an autonomous driving device according to one of the embodiments of the present invention can be applied.
Figure 2 is an illustrative diagram showing an example of an autonomous driving device according to one of the embodiments of the present invention being applied to a vehicle.
Figures 3 and 4 show a method of displaying the contents of a call or message on a display according to the present invention.
Figure 5 shows a configuration within a vehicle for transmitting voice in the form of text to the other party while driving the vehicle according to the present invention.
Figure 6 shows a configuration for detecting or identifying vehicle occupants according to the present invention.
Figure 7 shows a flow chart related to a vehicle control method for displaying a received call or message on a display device according to the present invention.
Figure 8 shows a block diagram of a display device according to the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the attached drawings.

The embodiments described below are intended to aid understanding of the present invention, and therefore the present invention is not limited to the embodiments described below. Additionally, in the attached drawings, certain components may be exaggerated or reduced in order to facilitate understanding of the invention. The present invention is not limited to the form depicted in the attached drawings.

Throughout the specification, when a part is said to "include" a certain component, this means that it does not exclude other components but may further include other components unless specifically stated to the contrary.

Figure 1 is an overall block diagram of an autonomous driving control system to which an autonomous driving device according to one of the embodiments of the present invention can be applied.

Figure 2 is an illustrative diagram showing an example of an autonomous driving device according to one of the embodiments of the present invention being applied to a vehicle.

First, the structure and function of an autonomous driving control system (eg, autonomous vehicle) to which the autonomous driving device according to the present embodiments can be applied will be described with reference to FIGS. 1 and 2.

As shown in FIG. 1, the autonomous vehicle 1000 operates the vehicle through the driving information input interface 101, the driving information input interface 201, the occupant output interface 301, and the vehicle control output interface 401. It can be implemented around the autonomous driving integrated control unit 600, which transmits and receives data required for autonomous driving control. However, the autonomous driving integrated control unit 600 may be referred to as a controller, a processor, or simply a control unit in this specification.

The autonomous driving integrated control unit 600 may obtain driving information according to the passenger's manipulation of the user input unit 100 in the vehicle's autonomous driving mode or manual driving mode through the driving information input interface 101. As shown in FIG. 1, the user input unit 100 uses the driving mode switch 110 and the control panel 120 (e.g., a navigation terminal mounted on the vehicle, a smartphone or tablet PC carried by the passenger, etc.) Accordingly, the driving information may include driving mode information and navigation information of the vehicle.

For example, the driving mode of the vehicle determined according to the occupant's operation of the driving mode switch 110 (i.e., autonomous driving mode/manual driving mode or Sports Mode/Eco Mode/Safe Mode) (Safe Mode)/Normal Mode) may be transmitted to the autonomous driving integrated control unit 600 through the driving information input interface 101 as the above-described driving information.

In addition, navigation information such as the passenger's destination and the route to the destination (such as the shortest route or preferred route selected by the passenger among candidate routes to the destination) that the passenger inputs through the control panel 120 is the driving information. It may be transmitted to the autonomous driving integrated control unit 600 through the input interface 101.

Meanwhile, the control panel 120 may be implemented as a touch screen panel that provides a UI (User Interface) for the driver to input or modify information for autonomous driving control of the vehicle. In this case, the driving mode switch 110 described above ) may also be implemented as a touch button on the control panel 120.

Additionally, the autonomous driving integrated control unit 600 may obtain driving information indicating the driving state of the vehicle through the driving information input interface 201. Driving information includes the steering angle formed as the passenger operates the steering wheel, the accelerator pedal stroke or brake pedal stroke formed as the passenger presses the accelerator or brake pedal, and vehicle speed, acceleration, yaw, and pitch as the behavior formed in the vehicle. and roll, etc. may include various information indicating the driving state and behavior of the vehicle, and each of the driving information includes a steering angle sensor 210, an Accel Position Sensor (APS)/Pedal Travel Sensor (PTS), as shown in FIG. ) 220, vehicle speed sensor 230, acceleration sensor 240, and yaw/pitch/roll sensor 250 may be detected by the driving information detector 200.

Furthermore, the vehicle's driving information may include the vehicle's location information, and the vehicle's location information may be obtained through a Global Positioning System (GPS) receiver 260 applied to the vehicle. This driving information can be transmitted to the autonomous driving integrated control unit 600 through the driving information input interface 201 and used to control the driving of the vehicle in the vehicle's autonomous driving mode or manual driving mode.

Additionally, the autonomous driving integrated control unit 600 may transmit driving status information provided to the passenger in the vehicle's autonomous driving mode or manual driving mode to the output unit 300 through the passenger output interface 301. That is, the autonomous driving integrated control unit 600 transmits the vehicle's driving status information to the output unit 300, so that the occupants can select the vehicle's autonomous driving status or manual driving status based on the driving status information output through the output unit 300. The status can be checked, and the driving status information may include various information indicating the driving status of the vehicle, such as the current vehicle driving mode, shift range, and vehicle speed.

In addition, when the autonomous driving integrated control unit 600 determines that a warning is required to the driver in the vehicle's autonomous driving mode or manual driving mode along with the driving status information, the autonomous driving integrated control unit 600 outputs warning information through the passenger output interface 301. It can be transmitted to 300 so that the output unit 300 outputs a warning to the driver. In order to output such driving status information and warning information audibly and visually, the output unit 300 may include a speaker 310 and a display device 320 as shown in FIG. 1 . At this time, the display device 320 may be implemented as the same device as the control panel 120 described above, or may be implemented as a separate and independent device.

In addition, the autonomous driving integrated control unit 600 can transmit control information for driving control of the vehicle in the vehicle's autonomous driving mode or manual driving mode to the lower control system 400 applied to the vehicle through the vehicle control output interface 401. there is. The sub-control system 400 for driving control of the vehicle may include an engine control system 410, a braking control system 420, and a steering control system 430, as shown in FIG. 1, and an autonomous driving integrated control unit. 600 can transmit engine control information, braking control information, and steering control information as the control information to each lower control system 410, 420, and 430 through the vehicle control output interface 401. Accordingly, the engine control system 410 can control the vehicle speed and acceleration by increasing or decreasing the fuel supplied to the engine, and the braking control system 420 can control the braking of the vehicle by adjusting the braking force of the vehicle. The steering control system 430 may control the steering of the vehicle through a steering device applied to the vehicle (e.g., Motor Driven Power Steering (MDPS) system).

As described above, the autonomous driving integrated control unit 600 of this embodiment provides driving information according to the driver's operation and driving information indicating the driving state of the vehicle through the driving information input interface 101 and the driving information input interface 201, respectively. The driving state information and warning information generated according to the autonomous driving algorithm can be transmitted to the output unit 300 through the passenger output interface 301, and the control information generated according to the autonomous driving algorithm can be transmitted through the vehicle control output interface. It can be transmitted to the lower control system 400 through 401 and operated to control the driving of the vehicle.

Meanwhile, in order to ensure stable autonomous driving of the vehicle, it is necessary to continuously monitor the driving state by accurately measuring the driving environment of the vehicle and control driving according to the measured driving environment. To this end, the autonomous driving device of this embodiment is As shown in FIG. 1, it may include a sensor unit 500 for detecting objects around the vehicle, such as surrounding vehicles, pedestrians, roads, or fixed facilities (e.g., traffic lights, signposts, traffic signs, construction fences, etc.).

As shown in FIG. 1, the sensor unit 500 may include one or more of a lidar sensor 510, a radar sensor 520, and a camera sensor 530 to detect surrounding objects outside the vehicle.

The LiDAR sensor 510 can detect surrounding objects outside the vehicle by transmitting a laser signal to the surroundings of the vehicle and receiving a signal that is reflected and returned by the object, and has a predefined distance and setting according to its specifications. It is possible to detect surrounding objects located within the vertical field of view and the set horizontal field of view. The LiDAR sensor 510 may include a front LiDAR sensor 511, an upper LiDAR sensor 512, and a rear LiDAR sensor 513, which are installed at the front, top, and rear of the vehicle, respectively, but their installation locations and number of installations are not limited to specific embodiments. The threshold for determining the validity of the laser signal reflected by the object and returned may be pre-stored in the memory (not shown) of the autonomous driving integrated control unit 600, and the autonomous driving integrated control unit 600 uses a lidar sensor. The location (including the distance to the object), speed, and direction of movement of the object can be determined by measuring the time when the laser signal transmitted through 510 is reflected by the object and returns.

The radar sensor 520 can detect surrounding objects outside the vehicle by radiating electromagnetic waves around the vehicle and receiving signals that are reflected and returned by the object, and has a predefined distance and vertical angle of view according to its specifications. And surrounding objects located within the set horizontal angle of view can be detected. The radar sensor 520 may include a front radar sensor 521, a left radar sensor 521, a right radar sensor 522, and a rear radar sensor 523, which are installed on the front, left side, right side, and rear of the vehicle, respectively. However, the installation location and number of installations are not limited to specific embodiments. The autonomous driving integrated control unit 600 determines the location (including the distance to the object), speed, and direction of movement of the object by analyzing the power of electromagnetic waves transmitted and received through the radar sensor 520. can do.

The camera sensor 530 can detect surrounding objects outside the vehicle by capturing images around the vehicle, and can detect surrounding objects located within a predefined range of a set distance, a set vertical angle of view, and a set horizontal angle of view according to its specifications. .

The camera sensor 530 may include a front camera sensor 531, a left camera sensor 532, a right camera sensor 533, and a rear camera sensor 534 installed on the front, left side, right side, and rear of the vehicle, respectively. However, the installation location and number of installations are not limited to specific embodiments. The autonomous driving integrated control unit can determine the location (including the distance to the object), speed, and direction of movement of the object by applying predefined image processing to the image captured through the camera sensor 530. there is.

Additionally, an internal camera sensor 535 for capturing images of the inside of the vehicle may be mounted at a predetermined location inside the vehicle (e.g., a rearview mirror), and the autonomous driving integrated control unit 600 uses the internal camera sensor 535. Based on the image acquired through the vehicle, the occupant's behavior and status may be monitored and guidance or warnings may be output to the occupant through the above-mentioned output unit 300.

In addition to the lidar sensor 510, radar sensor 520, and camera sensor 530, the sensor unit 500 may further include an ultrasonic sensor 540 as shown in FIG. 1, along with the vehicle's Various types of sensors for detecting surrounding objects may be further employed in the sensor unit 500.

2 shows that the front lidar sensor 511 or the front radar sensor 521 is installed at the front of the vehicle, and the rear lidar sensor 513 or rear radar sensor 524 is installed at the rear of the vehicle to help understand this embodiment. It is installed in, and shows an example where the front camera sensor 531, left camera sensor 532, right camera sensor 533, and rear camera sensor 534 are installed on the front, left side, right side, and rear of the vehicle, respectively. , As described above, the installation location and number of each sensor are not limited to a specific embodiment.

Furthermore, the sensor unit 500 is used to detect the occupant's biological signals (e.g., heart rate, electrocardiogram, respiration, blood pressure, body temperature, brain wave, blood flow (pulse wave), and blood sugar, etc.) to determine the condition of the occupant in the vehicle. It may further include a biometric sensor, and the biometric sensor may include a heart rate sensor, an electrocardiogram sensor, a respiration sensor, a blood pressure sensor, a body temperature sensor, an electroencephalogram sensor, a blood flow sensor, and a blood sugar sensor. .

Lastly, the sensor unit 500 additionally includes a microphone 550, and the internal microphone 551 and external microphone 552 are used for different purposes.

The internal microphone 551 may be used, for example, to analyze the voice of a passenger in the autonomous vehicle 1000 based on AI or to immediately respond to a direct voice command.

On the other hand, the external microphone 552 can be used, for example, to appropriately respond to safe driving by analyzing various sounds generated outside the autonomous vehicle 1000 using various analysis tools such as deep learning.

For reference, the symbols shown in FIG. 2 may perform the same or similar functions as the symbols shown in FIG. 1, and FIG. 2 shows the relative positional relationship of each component (inside the autonomous vehicle 1000) compared to FIG. 1. (based on) is exemplified in more detail.

Figures 3 and 4 show a method of displaying the contents of a call or message on a display according to the present invention.

The display device 320 shown in FIGS. 3 and 4 may correspond to the display device 320 shown in FIGS. 1 and 2 . For example, the display device 320 may include a headup display (HUD) installed in a vehicle.

Figure 3 shows the contents of a call or message (T1) received through the vehicle's communication device or a user's communication terminal connected to the vehicle being displayed on the vehicle's HUD 320. This is to show the contents of the driver's calls or messages only to the driver in order to protect the driver's privacy or relieve the passengers' inconvenience when there are other passengers in the vehicle other than the driver.

The invention can be extended not only to protect the driver's privacy, but also for the same purpose for other passengers. If a display for each individual (seat) is installed in the vehicle, the vehicle (or vehicle control system) can identify the user and display the contents of the call or message on the display device 320 of the vehicle associated with the identified user. Additionally, even if it is not a display for each individual (seat), if the display device 320 of the vehicle has functions for controlling the directionality of the display, such as polarization control or display angle control, the vehicle (or vehicle control system) may use these functions. By using this, you can control the contents of conversations or messages to be visible only to specific users.

Hereinafter, the function of displaying the contents of a call or message described above in text form on the display is referred to as "Secret mode". In addition, the conditions under which secret mode can be activated will be explained.

Secret mode according to the present invention can be activated only when there is a passenger. To this end, the vehicle (or vehicle control system) can detect the presence of not only the driver but also other passengers. For detection of occupants of the vehicle, sensors may be used. The sensor may include a lidar sensor, radar sensor, camera sensor (or image sensor) for detecting objects inside and outside the vehicle, as mentioned above, and may include a weight pressure sensor installed on the vehicle seat.

Additionally, in the present invention, the secret mode can be activated regardless of whether there are passengers other than the driver.

While the secret mode according to the present invention is activated and functioning, the content of a call or message displayed on the display device 320 may be displayed in text form. The content of a call or message displayed on the display device 320 may be converted into text through a pre-designated or set voice recognition means.

At this time, the content in the form of text displayed on the display device 320 may be the entire call or message received through the vehicle's communication device or a communication terminal connected to the vehicle. For example, the entire content of a call or message may be displayed on the display 320, like subtitles for a foreign movie or drama. Alternatively, the text-type content displayed on the display 320 may be summary information of a call or message received through the vehicle's communication device or a communication terminal connected to the vehicle. The displayed summary information may include caller information, keywords extracted from call or message content, etc. The secret mode according to the present invention displays the contents of a received call or message. Since the voice or message of the user (driver or passenger) will be transmitted back to the sender, even if summary information is displayed, it is difficult to understand the contents of the call or message. There will be no major problems, and rather, the time delay due to voice recognition and text output can be reduced.

Figure 4 shows the contents of a call or message received through the vehicle's communication device or the user's communication terminal connected to the vehicle (T11) and the corresponding user's reply contents (T12) displayed on the vehicle's HUD 320. do.

Previously, it was explained that the contents of the user's other party's call or message can be displayed on the display 320. In response, the user may send a reply to the other party in the form of a text message. When the user inputs a response to the content received by voice, the vehicle (or vehicle control system) can convert the voice into text through voice recognition means. Then, the vehicle (or vehicle control system) can display the converted text on the display 320 and transmit it to the other party's communication terminal.

Referring to FIG. 4, the content of the conversation between the user and the other party displayed on the display device 320 is displayed in an accumulated manner, similar to a graphical user interface such as a text message or conversation messenger.

Figure 5 shows a user input control unit 130 in the vehicle for transmitting voice in text form to the other party while driving the vehicle according to the present invention.

Meanwhile, the vehicle (or vehicle control system) described with reference to FIG. 4 can display text converted from the user's voice on the display device 320 and then transmit it to the other party's communication terminal according to the user's input. Figure 5 shows a user input control unit 130 installed on the steering wheel for this purpose, and the user input control unit 130 may include at least one of a voice input button 131 or a transmission button 132.

When the user presses the voice input button 131 and a voice input signal is input, the vehicle (or vehicle control system) executes voice recognition means to perform voice recognition for the user, and displays the recognized voice in text form on a display device. It can be displayed at (320). Then, when the user presses the transmission button 132 and a transmission instruction signal is input, the vehicle (or vehicle control system) can transmit the contents in the form of characters displayed on the display device 320 as a message to the other party's communication terminal, etc. there is.

When only one of the transmission button 131 or the voice input button 132 is provided, the signal input by pressing the first button is used to initiate voice input, and the signal input by pressing the second button is used to input the voice converted text. It can be used to instruct transmission.

Meanwhile, it was previously explained that a vehicle (or vehicle control system) can detect or identify occupants (driver or passenger) riding in the vehicle. For this purpose, the vehicle (or vehicle control system) according to the present invention will be described.

Figure 6 shows a configuration for occupant detection or identification according to the present invention. The display device may include a cluster (instrument panel) 321 or a display 322 installed on or near the center fascia of the vehicle. In FIG. 6, means 536 and 537 for object recognition are shown installed near the display, but the installation location can be anywhere in the vehicle. The means for object recognition is for detecting or identifying occupants in a vehicle. Similar to what was previously described, the means for object recognition may be a sensor, and the sensor may include a lidar sensor, a radar sensor, a camera sensor (or image sensor), and a weight pressure sensor installed on the vehicle seat. there is.

A camera sensor may be desirable for occupant identification, and identification may be performed through facial recognition by analyzing images acquired with the camera sensor. At this time, it is desirable to store facial images of passengers who frequently ride the vehicle in advance. Additionally, it is desirable that the facial image and personal unique information (eg, name, user information of a personal communication terminal, etc.) are linked to each other.

Depending on whether it supports only occupant detection or additional identification, the operation of the vehicle (or vehicle control system) can be considered as follows.

- When only detecting passengers is supported

When only supporting detection of occupants, the driver or passenger may be detected and the vehicle (or vehicle control system) may decide accordingly whether to activate incognito mode. For example, if the driver and other passengers are detected, the vehicle (or vehicle control system) may activate incognito mode.

Alternatively, if only one occupant is detected, the vehicle (or vehicle control system) may display the contents of a call or message received through the vehicle's communication device or a communication terminal connected to the vehicle on the display device 320. . If a plurality of display devices 320 are provided in a vehicle, the vehicle (or vehicle control system) may display the contents of a received call or message on the display device 320 for the detected occupant. Additionally, if the directionality of the display device 320 can be controlled, the vehicle (or vehicle control system) can display the contents of a received call or message while controlling the directionality of the display for the detected occupant.

- In case of supporting identification of passengers

When supporting passenger identification, the vehicle (or vehicle control system) can perform more detailed display or control of the display device.

If only one occupant is detected and identified, the vehicle (or vehicle control system) may compare the identified occupant to the owner of the vehicle's communication device or communication terminal currently connected to the vehicle. If the occupant and the owner are the same, the vehicle (or vehicle control system) may display the contents of the received call or message on the display device 320. If the occupant and the owner are different, the vehicle (or vehicle control system) may not display the content of the received call or message on the display device 320.

If multiple occupants are detected and identified, the vehicle (or vehicle control system) may compare the identified occupants with the owner of the vehicle's communication device or communication terminal currently connected to the vehicle. If the owner is among the occupants, the vehicle (or vehicle control system) may display the content of the received call or message on the vehicle's display device 320 for the owner. If control of the directionality of the display device 320 is possible, the vehicle (or vehicle control system) can display the contents of a received call or message while controlling the directionality of the display device for the owner. If the owner is not among the occupants, the vehicle (or vehicle control system) may not display the content of the received call or message on the display device 320.

Additionally, the procedure for sending a reply to the content of a received call or message may also be performed as described with reference to FIGS. 4 and 5. That is, the display device that displays the contents of the received call or message and the contents of the reply will be designated as the display device for the owner. At this time, a user input manipulation unit 130 may be provided for each display device. Alternatively, the vehicle (or vehicle control system) may control the display device on which the content of the received call or message and the content of the reply are displayed to have directionality through a polarizing element or the like so that the content is displayed only toward the owner.

Configuration or location of the operating panel (e.g., touch icon, virtual button, etc.) for the user interface displayed on the display device through displaying the content of the received call or message, displaying the content of the reply, as well as detecting or identifying the occupant. may change. For example, when a driver or front passenger is detected, the vehicle (or vehicle control system) may display an operation unit for a user interface at a location close to the detected occupant within the display device. For example, when a driver or front passenger is detected and identified, the vehicle (or vehicle control system) may display an operating panel for a user interface configured for the identified occupant within the display device at a location close to the identified occupant. there is.

Figure 7 shows a flow chart related to a vehicle control method for displaying a received call or message on a display device according to the present invention.

The vehicle (or vehicle control system) may receive a call or message through the vehicle's communication device or a communication terminal connected to the vehicle (S710). Then, the vehicle (or vehicle control system) may identify the user associated with the communication device or communication terminal (S720). However, S710 and S720 may be performed in a different order or may be performed simultaneously. When identifying a user, the user may be identified using at least one of facial recognition of the user riding in the vehicle, the seat position of the user riding in the vehicle, or user information of the communication terminal.

The vehicle (or vehicle control system) may display the contents of the received call or message on the display device of the vehicle associated with the identified user (S730).

Here, the content of the call or message displayed on the display device may include a summary of the entire content or part of the entire content of the received call or message. That is, the entire received call or message may be displayed on the display device, or a portion of the entire content may be summarized and displayed.

Additionally, the speed at which the content of a received call or message is displayed on the display device may change depending on the driving speed of the vehicle. The speed at which text is displayed on a display device may mean the speed at which text content is sequentially displayed, or the time interval at which text content displayed on the display device is maintained on the display device. Additionally, a received call or message may not be displayed on the display device if the vehicle's driving speed exceeds a set value. This is for safety reasons, especially if the user is the driver, so as not to obstruct the driver's view as much as possible.

Additionally, the vehicle (or vehicle control system) may acquire and recognize the user's voice corresponding to the content of the call or message displayed on the display device. The vehicle (or vehicle control system) can convert the recognized user's voice into text. When a user's operation signal is received, the vehicle (or vehicle control system) can transmit the converted text to the sender of the received call or message.

Here, the display device may include a head-up display of a vehicle.

For operations or features related to vehicle control according to the present invention that are not described in relation to vehicle control according to the present invention described with reference to FIG. 7, refer to the description of FIGS. 1 to 6 described above.

Figure 8 shows a block diagram of a display device 320 according to the present invention. The display device 320 may include a display 323, a processor 324, and a sensor 325.

The display 323 is installed in the vehicle and can display information related to the vehicle. The sensor 325 can identify the user boarding the vehicle. The processor 324 controls the display and the sensor, and can perform control operations of the vehicle or vehicle system according to the present invention according to sensing information received from the sensor. The processor receives a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle, identifies a user associated with the communication device or communication terminal according to information detected through the sensor, and identifies the received call or message. The content of the message can be controlled to be displayed on the display of the vehicle associated with the user.

For operations or features according to the configuration of the display device that are not described in relation to the display device according to the present invention described with reference to FIG. 8, refer to the description of FIGS. 1 to 6 described above.

In the above specification, the "vehicle (or vehicle control system)" is described as carrying out the invention, but the "vehicle" and its components are only names and the scope of rights is not dependent thereon.

In other words, the present invention can be carried out under other names other than vehicles and systems, and in addition, the method or methods described above can be carried out by software for vehicle control or codes that can be read by computers or other machines, devices, etc. there is.

In addition, as another aspect of the present invention, the operation of the proposal or invention described above is a "computer" (a comprehensive concept including a system on chip (SoC) or (micro) processor, etc.) It may also be provided as a code that can be implemented, implemented, or executed by, or as a computer-readable storage medium or computer program product that stores or contains the code. The scope of the present invention can be extended to the code or a computer-readable storage medium or computer program product that stores or includes the code.

In addition, as another aspect of the present invention, the operation of the above-described proposal or invention, or a device for performing the same (eg, a vehicle control device) may be included and provided as a “vehicle.” The vehicle 1 according to the present invention is not limited to any type of vehicle.

The detailed description of the preferred embodiments of the present invention disclosed above is provided to enable anyone skilled in the art to implement and practice the present invention.

Although the present invention has been described above with reference to preferred embodiments, those skilled in the art will understand that various modifications and changes can be made to the present invention as set forth in the claims below.

Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (16)

A display installed in a vehicle and displaying information related to the vehicle;
A sensor for identifying a user riding in the vehicle; and
Includes a processor that controls the display,
The processor receives a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle, identifies a user associated with the communication device or communication terminal according to information detected through the sensor, and identifies the received call or message. Controlling the vehicle to display the content of a message on a display of the vehicle associated with the user. The vehicle according to claim 1, wherein the content of the call or message displayed on the display includes a summary of the entire content or part of the entire content of the call or message. The vehicle according to claim 1, wherein the processor controls the contents of the received call or message to be displayed on the display at a speed that changes depending on the driving speed of the vehicle. The vehicle according to claim 1, wherein the processor controls not to display the contents of the received call or message on the display when the driving speed of the vehicle exceeds a set value. The method of claim 1, wherein the processor acquires and recognizes the user's voice corresponding to what is displayed on the display,
Converting the recognized user's voice into text,
When the user's operation signal is received, the vehicle is controlled to transmit the converted text to the sender of the received call or message. According to paragraph 1,
A vehicle, wherein the display includes a head-up display of the vehicle. The vehicle according to claim 1, wherein the processor uses at least one of facial recognition of a user riding in the vehicle, a seat position of a user riding in the vehicle, or user information of the communication terminal to identify the user. . Receiving a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle;
identifying a user associated with the communication device or communication terminal; and
A vehicle control method comprising displaying the contents of the received call or message on a display of the vehicle associated with the user. The vehicle control method according to claim 8, wherein the content of the call or message displayed on the display includes a summary of the entire content or part of the entire content of the call or message. According to clause 8,
A vehicle control method, wherein the speed of the content of the received call or message is changed on the display according to the driving speed of the vehicle. The vehicle control method according to claim 8, wherein the content of the received call or message is not displayed on the display when the driving speed of the vehicle exceeds a set value. The method of claim 8, further comprising: acquiring and recognizing the user's voice, corresponding to what is displayed on the display;
Converting the recognized user's voice into text; and
When the user's operation signal is received, a vehicle control method comprising transmitting the converted text to the sender of the received call or message. According to clause 8,
A vehicle control method, wherein the display includes a head-up display of the vehicle. According to clause 8,
The step of identifying the user is,
A vehicle control method comprising identifying the user using at least one of facial recognition of the user riding the vehicle, seat position of the user riding the vehicle, or user information of the communication terminal. a display module that displays information related to the vehicle;
A sensor for identifying a user riding in the vehicle; and
Including a processor that controls the display module,
The processor receives a call or message through a communication device in the vehicle or a communication terminal connected to the vehicle, identifies a user associated with the communication device or communication terminal according to information detected through the sensor, and identifies the received call or message. A display device that controls the content of a message to be displayed on the display module associated with the user. A computer program stored in a computer-readable medium for performing the vehicle control method according to claim 8.