JP2021162569A - Information providing device - Google Patents

Abstract

To provide high value-added information for occupants of a vehicle even when the occupants of the vehicle are in chat communication.SOLUTION: An information providing device 300 includes a display unit (MIP87) provided on its own vehicle M) and having a display area 331 of information and a display control unit 171 that performs display control of the MIP87, and provides occupants with information displayed on the MIP87. The information providing device 300 further includes a communication unit 311 that performs chat communication and an extraction unit 313 that extracts key content from conversation contents related to the chat communication. The MIP87 has a digital content display area 333 and a chat display area 335 where content related to the chart communication is displayed. The display control unit 171 changes a display mode related to digital content based on the key content extracted by the extraction unit 313.SELECTED DRAWING: Figure 5

Description

The present invention relates to an information providing device that provides information based on the conversation content of a moving occupant.

For example, Patent Document 1 discloses an invention of a route guidance system that makes it possible to provide a variety of services beyond the scope of ordinary route guidance when providing route guidance to a destination.

In the route guidance system according to Patent Document 1, the destination setting unit sets the destination. The route setting unit sets the route to the destination. The waypoint setting unit sets the waypoints according to the route to the destination by a voice dialogue method automatically selected from a plurality of modes. The route guidance unit interrupts the route guidance to the destination, guides the route to the waypoint, and executes notification and inquiry to the user.
For example, the waypoint setting unit according to Patent Document 1 analyzes the conversation contents of the vehicle occupants (drivers and passengers) and automatically selects and sets the waypoints according to the air at the place (Patent). See paragraph number 0042 of Reference 1).

According to the invention of the route guidance system according to Patent Document 1, the convenience of the user is improved by providing a variety of services according to the conversation contents of the vehicle occupants (drivers and passengers). Can be done.

Japanese Unexamined Patent Publication No. 2019-027911

However, in the route guidance system according to Patent Document 1, it is also disclosed that when the occupant of the own vehicle is communicating using chat, which is a real-time communication tool, information related to digital contents based on the communication contents is provided. No suggestion has been made.

Therefore, in the route guidance system according to Patent Document 1, in the case where the occupant of the own vehicle is in chat communication, the information related to the communication content cannot be provided to the occupant of the own vehicle. Then, for example, when there is a store that matches the hobbies and tastes of the occupants near the current position of the own vehicle, it is not possible to provide information on the service content, let alone the existence of the store.
As a result, there is a risk that the occupants of the mobile body such as the own vehicle lose the opportunity to enjoy high-value-added information for the occupants of the mobile body during chat communication (opportunity loss).

The present invention has been made in view of the above circumstances, and provides an information providing device capable of providing high value-added information to a mobile occupant even when the mobile occupant is in chat communication. The challenge is to provide.

In order to solve the above problems, the information providing device according to the present invention (1) includes a display unit provided on the moving body and provided with an information display area, and a display control unit that controls the display of the display unit. , An information providing device that provides the information displayed on the display unit to the occupants, and further includes a communication unit that performs chat communication and an extraction unit that extracts key content from the conversation content related to the chat communication. The display area provided in the display unit includes a digital content display area and a chat display area for displaying conversation contents related to the chat communication, and the display control unit is a key content extracted by the extraction unit. The most important feature is to change the display mode of the digital content based on the above.

According to the present invention, even in the case where the occupant of the mobile body is in chat communication, it is possible to provide information having high added value for the occupant of the mobile body.

It is an overall block diagram of the self-driving car provided with the vehicle control device provided with the information providing device which concerns on embodiment of this invention. It is a functional block block diagram which shows the structure of the vehicle control device provided with the information providing device which concerns on embodiment of this invention, and its peripheral part. It is a schematic block diagram of HMI provided in a vehicle control device. It is a figure which shows the front part structure of the passenger compartment of the self-driving car. It is a block block diagram which conceptually represents the key content display function which the information providing apparatus which concerns on embodiment of this invention has. It is a flowchart which provides the operation explanation of the information providing apparatus. It is a figure which conceptually shows the state that the digital content and the content related to chat communication are displayed in parallel on the multi-information panel. It is a figure which conceptually shows the state that the digital content and the content related to chat communication are displayed in parallel on the multi-information panel. It is a figure which conceptually shows the state that the digital content and the content related to chat communication are displayed in parallel on the multi-information panel. It is a figure which conceptually shows the state that the digital content and the content related to chat communication are displayed in parallel on the multi-information panel. It is a figure which conceptually shows the state that the digital content and the content related to chat communication are displayed in parallel on the multi-information panel. It is a block block diagram which conceptually represents the key content display function which the information providing apparatus which concerns on the modification of this invention has. It is a flowchart which provides the explanation of the concealment processing operation of the information providing apparatus which concerns on the modification of this invention.

Hereinafter, the information providing device according to the embodiment of the present invention will be described in detail with reference to the drawings.
In the drawings shown below, members having a common function shall be designated by a common reference numeral. Further, the size and shape of the member may be deformed or exaggerated schematically for convenience of explanation.
In the description of the self-driving vehicle (hereinafter, may be referred to as "own vehicle" or "vehicle") M including the vehicle control device 100 provided with the information providing device 300 according to the embodiment of the present invention, the own vehicle M is left and right. When the expression of is used, the front of the own vehicle M in the traveling direction is used as a reference. Specifically, for example, the own vehicle M is placed in a case with a right-hand steering wheel, and the driver's seat side is called the right side and the passenger's seat side is called the left side.

[Structure of self-driving car (own vehicle) M]
First, the configuration of the autonomous driving vehicle M including the vehicle control device 100 provided with the information providing device 300 according to the embodiment of the present invention will be described with reference to FIG.
FIG. 1 is an overall configuration diagram of an autonomous driving vehicle M including a vehicle control device 100 provided with an information providing device 300 according to an embodiment of the present invention.
As shown in FIG. 1, the own vehicle M on which the vehicle control device 100 provided with the information providing device 300 according to the embodiment of the present invention is mounted is, for example, a two-wheeled vehicle, a three-wheeled vehicle, a four-wheeled vehicle, or the like.
The own vehicle M includes an automobile powered by an internal combustion engine such as a diesel engine or a gasoline engine, an electric vehicle powered by an electric motor, a hybrid automobile having both an internal combustion engine and an electric motor, and the like. Of these, the electric vehicle is driven by using the electric power discharged by a battery such as a secondary battery, a hydrogen fuel cell, a metal fuel cell, or an alcohol fuel cell.

As shown in FIG. 1, the own vehicle M has an external world sensor 10 having a function of detecting external world information about a target including an object or a sign existing around the own vehicle M, and the current position of the own vehicle M on a map. Equipped with a navigation device 20 having a function of mapping and providing route guidance to a destination, and a vehicle control device 100 having a function of autonomous driving control of the own vehicle M including steering / acceleration / deceleration of the own vehicle M. Has been done.
These devices and devices are configured to be connected to each other so as to be capable of data communication via a communication medium such as CAN (Controller Area Network).

[External sensor 10]
The external sensor 10 includes a camera 11, a radar 13, and a rider 15.
The camera 11 has an optical axis inclined diagonally downward in front of the own vehicle, and has a function of capturing an image of the traveling direction of the own vehicle M. As the camera 11, for example, a CMOS (Complementary Metal Oxide Semiconductor) camera, a CCD (Charge Coupled Device) camera, or the like can be appropriately used. The camera 11 is provided in the vicinity of the rear-view mirror (not shown) in the vehicle interior of the own vehicle M, and in the front right door, the front left door, and the like outside the vehicle interior of the own vehicle M.

For example, the camera 11 periodically and repeatedly captures the front, right rear side, and left rear side of the own vehicle M in the traveling direction. In the present embodiment, the camera 11 provided in the vicinity of the rear-view mirror includes a pair of monocular cameras arranged side by side. The camera 11 may be a stereo camera.
The image information of the own vehicle M in the traveling direction forward, right rear side, and left rear side captured by the camera 11 is sent to the vehicle control device 100 via the communication medium.

The radar 13 irradiates the target including the preceding vehicle to be followed traveling in front of the own vehicle M with the radar wave, and receives the radar wave reflected by the target to reach the target. It has a function to acquire distribution information of the target including the direction of the target and the target. As the radar wave, a laser, a microwave, a millimeter wave, an ultrasonic wave or the like can be appropriately used.
In the present embodiment, as shown in FIG. 1, three radars 13 are provided on the front side and two radars 13 are provided on the rear side. The distribution information of the target by the radar 13 is sent to the vehicle control device 100 via the communication medium.

The lidar 15 (LIDAR: Light Detection and Ranging) has a function of detecting the presence or absence of a target and the distance to the target by measuring the time required for detecting the scattered light with respect to the irradiation light, for example. In the present embodiment, as shown in FIG. 1, two riders 15 are provided on the front side and three on the rear side. The distribution information of the target by the rider 15 is sent to the vehicle control device 100 via the communication medium.

[Navigation device 20]
The navigation device 20 includes a GNSS (Global Navigation Satellite System) receiver, map information (navigation map), a touch panel type internal display device 61 that functions as a human machine interface, a speaker 63 (see FIG. 3 for all), a microphone, and the like. It is composed of. The navigation device 20 plays a role of determining the current position of the own vehicle M by the GNSS receiver and deriving a route from the current position to the destination specified by the user.

The route derived by the navigation device 20 is provided to the target lane determination unit 110 (described later) of the vehicle control device 100. The current position of the own vehicle M may be specified or complemented by an INS (Inertial Navigation System) using the output of the vehicle sensor 30 (see FIG. 2). Further, the navigation device 20 provides guidance by voice or map display on the route to the destination when the vehicle control device 100 is executing the manual driving mode.

The function for determining the current position of the own vehicle M may be provided independently of the navigation device 20. Further, the navigation device 20 may be realized by the function of a terminal device such as a smartphone or a tablet terminal carried by the user, for example. In this case, information is transmitted and received between the terminal device and the vehicle control device 100 by wireless or wired communication.

[Vehicle control device 100 provided with the information providing device 300 and its peripheral configuration]
Next, a vehicle control device 100 equipped with the information providing device 300 according to the embodiment of the present invention mounted on the own vehicle M and a peripheral portion configuration thereof will be described with reference to FIG.
FIG. 2 is a functional block configuration diagram showing a configuration of a vehicle control device 100 provided with an information providing device 300 according to an embodiment of the present invention and a peripheral portion thereof.
In addition to the external world sensor 10, the navigation device 20, and the vehicle control device 100 described above, the own vehicle M includes a communication device 25, a vehicle sensor 30, an HMI (Human Machine Interface) 35, and a traveling drive, as shown in FIG. A force output device 200, a steering device 210, and a braking device 220 are mounted.
The communication device 25, the vehicle sensor 30, the HMI 35, the traveling driving force output device 200, the steering device 210, and the braking device 220 are connected to and from the vehicle control device 100 via a communication medium so as to be capable of data communication. Has been done.

[Communication device 25]
The communication device 25 has a function of communicating via a wireless communication medium such as a cellular network, a Wi-Fi network, Bluetooth (registered trademark), or DSRC (Dedicated Short Range Communication).
The communication device 25 wirelessly communicates with an information providing server of a system for monitoring road traffic conditions such as VICS (Vehicle Information and Communication System) (registered trademark), and the vehicle M is traveling on the road or traveling. Obtain traffic information that shows the traffic conditions of the planned road. Traffic information includes traffic jam information ahead, time required to pass a traffic jam point, accident / breakdown vehicle / construction information, speed regulation / lane regulation information, parking lot location information, parking lot / service area / parking area. Information such as full / empty information is included.
Even if the communication device 25 acquires the traffic information by communicating with a wireless beacon provided on a side band of a road or by performing inter-vehicle communication with another vehicle traveling around the own vehicle M. good.

Further, the communication device 25 performs wireless communication with, for example, an information providing server of a signal information utilization driving support system (TSPS: Traffic Signal Prediction Systems), and a traffic light provided on a road on which the own vehicle M is traveling or is scheduled to travel. Acquire signal information related to. The TSPS plays a role of supporting the operation for smoothly passing through the signalized intersection by using the signal information of the traffic light.
Even if the communication device 25 acquires the signal information by communicating with an optical beacon provided on a side band of a road or by performing inter-vehicle communication with another vehicle traveling around the own vehicle M. good.

[Vehicle sensor 30]
The vehicle sensor 30 has a function of detecting various information about the own vehicle M. The vehicle sensor 30 detects a vehicle speed sensor that detects the vehicle speed of the own vehicle M, an acceleration sensor that detects the acceleration of the own vehicle M, a yaw rate sensor that detects an angular speed around the vertical axis of the own vehicle M, and a direction of the own vehicle M. It includes an orientation sensor, an inclination angle sensor that detects the inclination angle of the own vehicle M, an illuminance sensor that detects the illuminance of the place where the own vehicle M exists, a raindrop sensor that detects the amount of raindrops at the place where the own vehicle M exists, and the like.

[Structure of HMI35]
Next, the HMI 35 will be described with reference to FIGS. 3 and 4.
FIG. 3 is a schematic configuration diagram of an HMI 35 connected to the vehicle control device 100 according to the embodiment of the present invention. FIG. 4 is a diagram showing a front structure of a vehicle interior of a vehicle M including a vehicle control device 100.
As shown in FIG. 3, the HMI 35 includes a component of a driving operation system and a component of a non-driving operation system. These boundaries are not clear, and a configuration in which the components of the driving operation system have the functions of the non-driving operation system (or vice versa) may be adopted.

As shown in FIG. 3, the HMI 35 shifts the accelerator pedal 41, the accelerator opening sensor 43, the accelerator pedal reaction force output device 45, the brake pedal 47, and the brake depression sensor 49 as constituent members of the driving operation system. It includes a lever 51, a shift position sensor 53, a steering wheel 55, a steering steering angle sensor 57, a steering torque sensor 58, and other driving operation devices 59.

The accelerator pedal 41 is an acceleration operator for receiving an acceleration instruction (or a deceleration instruction by a return operation) by the driver. The accelerator opening sensor 43 detects the amount of depression of the accelerator pedal 41 and outputs an accelerator opening signal indicating the amount of depression to the vehicle control device 100.
Instead of outputting the accelerator opening signal to the vehicle control device 100, a configuration may be adopted in which the accelerator opening signal is directly output to the traveling driving force output device 200, the steering device 210, or the brake device 220. The same applies to the configurations of other operation operation systems described below. The accelerator pedal reaction force output device 45 outputs a force (operation reaction force) in the direction opposite to the operation direction to the accelerator pedal 41 in response to an instruction from, for example, the vehicle control device 100.

The brake pedal 47 is a deceleration operator for receiving a deceleration instruction by the driver. The brake pedal amount sensor 49 detects the depression amount (or depression force) of the brake pedal 47, and outputs a brake signal indicating the detection result to the vehicle control device 100.

The shift lever 51 is a shift controller for receiving an instruction to change the shift stage by the driver. The shift position sensor 53 detects the shift stage instructed by the driver and outputs a shift position signal indicating the detection result to the vehicle control device 100.

The steering wheel 55 is a steering operator for receiving a turning instruction by the driver. The steering steering angle sensor 57 detects the operating angle of the steering wheel 55 and outputs a steering steering angle signal indicating the detection result to the vehicle control device 100. The steering torque sensor 58 detects the torque applied to the steering wheel 55 and outputs a steering torque signal indicating the detection result to the vehicle control device 100.

The other driving operation device 59 is, for example, a joystick, a button, a dial switch, a GUI (Graphical User Interface) switch, or the like. The driving operation device 59 receives an acceleration instruction, a deceleration instruction, a turning instruction, and the like, and outputs the instruction to the vehicle control device 100.

As shown in FIG. 3, the HMI 35 includes, for example, an internal display device 61, a speaker 63, a contact operation detection device 65, a content reproduction device 67, various operation switches 69, a seat 73, and the components of the non-operation operation system. The seat drive device 75, the window glass 77, the window drive device 79, the vehicle interior camera 81, and the external display device 83 are included.

The internal display device 61 is preferably a touch panel type display device having a function of displaying various information to the occupants in the vehicle interior. As shown in FIG. 4, the internal display device 61 is provided in the instrument panel 60 so as to face the meter panel 85 provided at a position facing the driver's seat and the driver's seat and the passenger's seat in the vehicle width direction. It includes a horizontally long multi-information panel 87 (in the Y-axis direction in FIG. 4), a right panel 89a provided on the driver's seat side in the vehicle width direction, and a left panel 89b provided on the passenger seat side in the vehicle width direction. The internal display device 61 may be additionally provided at a position facing the rear seats (all on the back side of the seats).

On the meter panel 85, for example, a speedometer, a tachometer, an odometer, shift position information, lighting status information of lights, and the like are displayed.
On the multi-information panel 87, for example, content related to chat communication, digital content including key content extracted based on conversation content related to chat communication (details will be described later), map information around the own vehicle M, and on the map. Current position information of own vehicle M, traffic information (including signal information) regarding the current travel route / planned route of own vehicle M, traffic participants (pedestrians, bicycles, motorcycles, other vehicles, etc.) around the own vehicle M. Information on traffic participants, various information such as messages sent to traffic participants, etc. are displayed.
On the right panel 89a, image information of the rear side and the lower side on the right side of the own vehicle M captured by the camera 11 provided on the right side of the own vehicle M is displayed.
On the left panel 89b, image information of the rear side and the lower side on the left side of the own vehicle M captured by the camera 11 provided on the left side of the own vehicle M is displayed.

The internal display device 61 is not particularly limited, but is composed of, for example, an LCD (Liquid Crystal Display), an organic EL (Electroluminescence), or the like. The internal display device 61 may be configured by a HUD (Head Up Display) that projects a required image onto the window glass 77.
The speaker 63 has a function of outputting sound. An appropriate number of speakers 63 are provided at appropriate positions such as an instrument panel 60, a door panel, and a rear parcel shelf (all not shown) in the vehicle interior.
The contact operation detection device 65 has a function of detecting a touch position on the display screen of the internal display device 61 and outputting the detected touch position information to the vehicle control device 100 when the internal display device 61 is a touch panel type. .. If the internal display device 61 is not a touch panel type, the contact operation detection device 65 can omit this.

The content playback device 67 includes, for example, a DVD (Digital Versatile Disc) playback device, a CD (Compact Disc) playback device, a television receiver, and various guidance image generation devices. The internal display device 61, the speaker 63, the contact operation detection device 65, and the content reproduction device 67 may have a configuration in which a part or all of them are common to the navigation device 20.

The various operation switches 69 are arranged at appropriate positions in the vehicle interior. The various operation switches 69 include an automatic operation changeover switch 71 for instructing immediate start (or future start) and stop of automatic operation. The automatic operation changeover switch 71 may be either a GUI (Graphical User Interface) switch or a mechanical switch. Further, the various operation switches 69 may include a switch for driving the seat drive device 75 and the window drive device 79.

The seat 73 is a seat on which the occupant of the own vehicle M is seated. The seat driving device 75 freely drives the reclining angle, the position in the front-rear direction, the yaw angle, and the like of the seat 73. The window glass 77 is provided on each door, for example. The window driving device 79 drives the window glass 77 to open and close.

The vehicle interior camera 81 is a digital camera that uses a solid-state image sensor such as a CCD or CMOS. The vehicle interior camera 81 is located at a position where at least the heads of the occupant (driver) and the passenger seat occupant seated in the driver's seat can be imaged, such as the rear-view mirror, the steering boss (not shown), and the instrument panel 60. It is provided in. The vehicle interior camera 81 periodically and repeatedly captures the state of the vehicle interior including the driver and the passenger seat occupant.

The external display device 83 has a function of displaying various information to traffic participants (including pedestrians, bicycles, motorcycles, other vehicles, etc.) existing around the own vehicle M. The external display device 83 is a front display provided between the right front lighting portion and the left front lighting portion provided apart from each other in the vehicle width direction and the left and right front lighting portions of the front grille of the own vehicle M. A part (all not shown) is provided.

[Structure of vehicle control device 100]
Next, returning to FIG. 2, the configuration of the vehicle control device 100 will be described.
The vehicle control device 100 is realized by, for example, one or more processors or hardware having equivalent functions. The vehicle control device 100 is configured by combining a processor such as a CPU (Central Processing Unit), a storage device, an ECU (Electronic Control Unit) to which a communication interface is connected by an internal bus, an MPU (Micro-Processing Unit), and the like. It may be.

The vehicle control device 100 includes a target lane determination unit 110, a driving support control unit 120, a travel control unit 160, an HMI control unit 170, and a storage unit 180.
The functions of each unit of the target lane determination unit 110 and the driving support control unit 120, and some or all of the functions of the travel control unit 160 are realized by the processor executing a program (software). Further, some or all of these functions may be realized by hardware such as LSI (Large Scale Integration) or ASIC (Application Specific Integrated Circuit), or may be realized by a combination of software and hardware. good.

In the following description, when the main body is described as "○○ part is", the driving support control unit 120 reads each program from ROM / EEPROM (Electrically Erasable Programmable Read-Only Memory) as necessary and then loads it into RAM. Then, each function (described later) shall be executed. Each program may be stored in the storage unit 180 in advance, or may be incorporated into the vehicle control device 100 as necessary via another storage medium or communication medium.

[Target lane determination unit 110]
The target lane determination unit 110 is realized by, for example, an MPU (Micro Processing Unit). The target lane determination unit 110 divides the route provided by the navigation device 20 into a plurality of blocks (for example, divides the route every 100 [m] with respect to the vehicle traveling direction), and refers to the high-precision map information 181 for each block. Determine the target lane. The target lane determination unit 110 determines, for example, which lane from the left to drive. The target lane determination unit 110 determines the target lane so that the own vehicle M can travel on a reasonable travel route to proceed to the branch destination, for example, when there is a branch point or a merging point on the route. .. The target lane determined by the target lane determination unit 110 is stored in the storage unit 180 as the target lane information 182.

[Driving support control unit 120]
The driving support control unit 120 includes a driving support mode control unit 130, a recognition unit 140, and a switching control unit 150.

<Driving support mode control unit 130>
The driving support mode control unit 130 is automatically executed by the driving support control unit 120 based on the driver's operation on the HMI 35, the event determined by the action plan generation unit 144, the driving mode determined by the track generation unit 147, and the like. Determine the operation mode (automatic driving support state). The automatic operation mode is notified to the HMI control unit 170.

In any of the automatic operation modes, it is possible to switch (override) to a lower automatic operation mode by operating the components of the operation operation system in the HMI 35.
The override is, for example, when the driver of the own vehicle M continues to operate the components of the driving operation system of the HMI 35 for more than a predetermined time, a predetermined operation change amount (for example, the accelerator opening by the accelerator pedal 41, the brake pedal). It is started when the brake depression amount by 47, the steering steering angle by the steering wheel 55) is exceeded, or when the operation on the components of the driving operation system is performed more than a predetermined number of times.

<Recognition unit 140>
The recognition unit 140 includes a vehicle position recognition unit 141, an outside world recognition unit 142, an area identification unit 143, an action plan generation unit 144, and a track generation unit 147.

<Own vehicle position recognition unit 141>
The own vehicle position recognition unit 141 is based on the high-precision map information 181 stored in the storage unit 180 and the information input from the camera 11, the radar 13, the rider 15, the navigation device 20, or the vehicle sensor 30. It recognizes the traveling lane in which the vehicle M is traveling and the relative position of the own vehicle M with respect to the traveling lane.

The own vehicle position recognition unit 141 recognizes the road marking line pattern (for example, the arrangement of solid lines and broken lines) recognized from the high-precision map information 181 and the roads around the own vehicle M recognized from the image captured by the camera 11. By comparing with the pattern of the lane marking, the traveling lane is recognized. In this recognition, the current position of the own vehicle M acquired from the navigation device 20 and the processing result by the INS may be added.

<External world recognition unit 142>
As shown in FIG. 2, the outside world recognition unit 142 is based on the outside world information input from the outside world sensor 10 including the camera 11, the radar 13, and the rider 15, for example, the outside world state including the position, vehicle speed, and acceleration of peripheral vehicles. Recognize. The peripheral vehicle is, for example, a vehicle traveling around the own vehicle M and another vehicle (a front-running vehicle and a rear-running vehicle; details described later) traveling in the same direction as the own vehicle M.
The position of the peripheral vehicle may be represented by a representative point such as the center of gravity or a corner of another vehicle, or may be represented by an area represented by the outline of the other vehicle. The state of the peripheral vehicle may include the speed / acceleration of the peripheral vehicle and whether or not the vehicle is changing lanes (or whether or not the vehicle is trying to change lanes), which is grasped based on the information of the various devices. Further, the outside world recognition unit 142 may adopt a configuration that recognizes the positions of a target including a guard rail, an electric pole, a parked vehicle, a pedestrian, and a traffic sign in addition to peripheral vehicles including a front-running vehicle and a rear-running vehicle. good.
In the embodiment of the present invention, among the peripheral vehicles, a vehicle that travels in the same traveling lane as the own vehicle M and travels immediately in front of the own vehicle M and is a tracking target in the follow-up travel control is referred to as a "preceding vehicle". .. Further, among the peripheral vehicles, a vehicle having a traveling lane common to the own vehicle M and traveling immediately after the own vehicle M is referred to as a "rear vehicle".

<Area identification part 143>
The area identification unit 143 acquires information related to a specific area (interchange: IC / junction: JCT / lane increase / decrease point) existing around the own vehicle M based on the map information. As a result, the area specifying unit 143 can obtain information related to the specific area that assists the smooth progress of the own vehicle M even when the traveling direction image cannot be acquired through the outside world sensor 10 while hiding behind the vehicle in front including the vehicle in front. Can be obtained.

The area specifying unit 143 identifies the target by image processing based on the traveling direction image acquired via the outside world sensor 10 instead of acquiring the information related to the specific area based on the map information, or the outside world. Information related to the specific area may be acquired by recognizing the target based on the contour of the traveling direction image by the internal processing of the recognition unit 142.
Further, as will be described later, a configuration may be adopted in which the VICS information obtained by the communication device 25 is used to improve the accuracy of the information related to the specific area acquired by the area specifying unit 143.

<Action plan generation unit 144>
The action plan generation unit 144 sets the start point of the automatic driving and / or the destination of the automatic driving. The starting point of the automatic driving may be the current position of the own vehicle M, or may be a point where an operation for instructing the automatic driving is performed. The action plan generation unit 144 generates an action plan in the section between the starting point and the destination of the automatic driving. Not limited to this, the action plan generation unit 144 may generate an action plan for any section.

An action plan consists of, for example, a plurality of events that are executed sequentially. The plurality of events include, for example, a deceleration event for decelerating the own vehicle M, an acceleration event for accelerating the own vehicle M, a lane keeping event for driving the own vehicle M so as not to deviate from the traveling lane, and a lane for changing the traveling lane. Change event, overtaking event to let own vehicle M overtake the preceding vehicle, branch event to change to the desired lane at the branch point or drive own vehicle M so as not to deviate from the current driving lane, join the main line A merging event that accelerates or decelerates the own vehicle M in the merging lane to change the traveling lane, shifts from the manual driving mode to the automatic driving mode (automatic driving support state) at the start point of the automatic driving, or ends the automatic driving. It includes a handover event that shifts from the automatic operation mode to the manual operation mode at the planned point.

The action plan generation unit 144 sets a lane change event, a branch event, or a merging event at a position where the target lane determined by the target lane determination unit 110 is switched. The information indicating the action plan generated by the action plan generation unit 144 is stored in the storage unit 180 as the action plan information 183.

The action plan generation unit 144 includes a mode change unit 145 and a notification control unit 146.
<Mode change unit 145>
The mode change unit 145 is, for example, among the operation modes including a plurality of stages of automatic operation mode and manual operation mode set in advance based on the recognition result on the target existing in the traveling direction of the own vehicle M by the outside world recognition unit 142. Therefore, a driving mode suitable for the recognition result is selected, and the driving operation of the own vehicle M is performed using the selected driving mode.

<Notification control unit 146>
When the operation mode of the own vehicle M is changed by the mode change unit 145, the notification control unit 146 notifies that the operation mode of the own vehicle M has changed. The notification control unit 146 notifies that the operation mode of the own vehicle M has changed by outputting the voice information stored in advance in the storage unit 180 to the speaker 63, for example.
As long as it is possible to notify the driver of the transition of the driving mode of the own vehicle M, the notification may be performed not only by voice but also by display, light emission, vibration, or a combination thereof. ..

<Orbit generator 147>
The track generation unit 147 generates a track to be traveled by the own vehicle M based on the action plan generated by the action plan generation unit 144.

<Switching control unit 150>
As shown in FIG. 2, the switching control unit 150 switches between the automatic operation mode and the manual operation mode based on the signal input from the automatic operation changeover switch 71 (see FIG. 3) and the like. Further, the switching control unit 150 switches the automatic operation mode at that time to a lower operation mode based on the operation of instructing acceleration, deceleration, or steering of the components of the operation operation system in the HMI 35. For example, when the operation amount indicated by the signal input from the component of the operation operation system in the HMI 35 continues to exceed the threshold value for the reference time or longer, the switching control unit 150 lowers the automatic operation mode at that time. Switch to mode (override).
Further, the switching control unit 150 returns to the original automatic operation mode when no operation on the components of the operation operation system in the HMI 35 is detected for a predetermined time after switching to the lower operation mode by overriding. Switching control may be performed.

<Traveling control unit 160>
The travel control unit 160 includes a travel driving force output device 200, a steering device 210, and a steering device 210 so that the own vehicle M passes the track to be traveled by the own vehicle M generated by the track generation unit 147 on time. By controlling the brake device 220, the traveling control of the own vehicle M is performed.

<HMI control unit 170>
When the driving support control unit 120 notifies the setting information related to the automatic driving mode of the own vehicle M, the HMI control unit 170 refers to the mode-specific operation availability information 184 (see FIG. 11 below) and sets the automatic driving mode. The HMI 35 is controlled according to the setting contents.
As shown in FIG. 2, the HMI control unit 170 is permitted to be used based on the driving mode information of the own vehicle M acquired from the driving support control unit 120 and by referring to the mode-specific operation availability information 184. Devices (a part or all of the navigation device 20 and the HMI 35) and devices that are not permitted to be used are discriminated from each other. Further, the HMI control unit 170 controls whether or not the driver's operation regarding the HMI 35 of the driving operation system or the navigation device 20 can be accepted based on the determination result.

For example, when the operation mode executed by the vehicle control device 100 is the manual operation mode, the HMI control unit 170 uses the HMI 35 of the operation system (for example, the accelerator pedal 41, the brake pedal 47, the shift lever 51, the steering wheel 55, etc.). Accepts driver operations related to (see Fig. 3).

The HMI control unit 170 includes a display control unit 171.
<Display control unit 171>
The display control unit 171 controls the display of the internal display device 61 and the external display device 83. Specifically, for example, when the driving mode executed by the vehicle control device 100 is an automatic driving mode with a high degree of automation, the display control unit 171 alerts / warns the traffic participants existing around the own vehicle M. -Controlling the display of information such as driving assistance on the internal display device 61 and / or the external display device 83 is performed.

Further, the display control unit 171 displays the digital content including the content related to the chat communication and the key content extracted based on the conversation content related to the chat communication on the multi-information panel (display unit) 87 of the internal display device 61. Take control. This will be described in detail later.

<Memory unit 180>
Information such as high-precision map information 181, target lane information 182, action plan information 183, and mode-specific operation availability information 184 is stored in the storage unit 180. The storage unit 180 is realized by a ROM (Read Only Memory), a RAM (Random Access Memory), an HDD (Hard Disk Drive), a flash memory, or the like. The program executed by the processor may be stored in the storage unit 180 in advance, or may be downloaded from an external device via an in-vehicle Internet facility or the like. Further, the program may be installed in the storage unit 180 by mounting a portable storage medium in which the program is stored in a drive device (not shown).

The high-precision map information 181 is high-precision map information as compared with the map information normally provided in the navigation device 20. The high-precision map information 181 includes, for example, information on the center of the lane, information on the boundary of the lane, and the like. The boundary of the lane includes the type, color, length, road width, road shoulder width, main line width, lane width, boundary position, boundary type (guardrail, planting, curb), zebra zone, etc. of the lane mark. Boundaries are included in the high-precision map.

Further, the high-precision map information 181 may include road information, traffic regulation information, address information (address / zip code), facility information, telephone number information, and the like. Road information includes information indicating the type of road such as highways, toll roads, national roads, and prefectural roads, the number of lanes of the road, the width of each lane, the slope of the road, and the position of the road (longitudinal, latitude, height). Includes 3D coordinates), lane curve curvature, lane confluence and branch point positions, road signs, and other information. Traffic regulation information includes information that lanes are blocked due to construction work, traffic accidents, traffic jams, and the like.

[Traveling driving force output device 200, steering device 210, and brake device 220]
As shown in FIG. 2, the vehicle control device 100 controls the driving of the traveling driving force output device 200, the steering device 210, and the braking device 220 in accordance with the traveling control command by the traveling control unit 160.
<Traveling driving force output device 200>
The traveling driving force output device 200 outputs a driving force (torque) for the own vehicle M to travel to the driving wheels. The traveling driving force output device 200 is, for example, an engine ECU (Electronic Control Unit: any of) that controls an internal combustion engine engine, a transmission, and an internal combustion engine engine when the own vehicle M is an automobile powered by an internal combustion engine engine. Not shown).
Further, the traveling driving force output device 200 includes a traveling motor and a motor ECU (both not shown) for controlling the traveling motor and the traveling motor when the own vehicle M is an electric vehicle powered by an electric motor.
Further, the traveling driving force output device 200 includes an internal combustion engine engine, a transmission, an engine ECU, a traveling motor, and a motor ECU (all not shown) when the own vehicle M is a hybrid vehicle.

When the traveling driving force output device 200 includes only the internal combustion engine, the engine ECU adjusts the throttle opening, the shift stage, and the like of the internal combustion engine engine according to the information input from the traveling control unit 160, which will be described later.
When the traveling driving force output device 200 includes only the traveling motor, the motor ECU adjusts the duty ratio of the PWM signal given to the traveling motor according to the information input from the traveling control unit 160.
When the traveling driving force output device 200 includes an internal combustion engine engine and a traveling motor, the engine ECU and the motor ECU cooperate with each other to control the traveling driving force according to the information input from the traveling control unit 160.

<Steering device 210>
The steering device 210 includes, for example, a steering ECU and an electric motor (both not shown). The electric motor, for example, applies a force to the rack and pinion mechanism to change the direction of the steering wheel. The steering ECU drives the electric motor according to the information input from the vehicle control device 100, or the information of the steering steering angle or steering torque input, and changes the direction of the steering wheels.

<Brake device 220>
The brake device 220 is, for example, an electric servobrake device (not shown) including a brake caliper, a cylinder for transmitting hydraulic pressure to the brake caliper, an electric motor for generating flood pressure in the cylinder, and a braking control unit. The braking control unit of the electric servo brake device controls the electric motor according to the information input from the traveling control unit 160 so that the brake torque corresponding to the braking operation is output to each wheel. The electric servo brake device may include a mechanism for transmitting the hydraulic pressure generated by the operation of the brake pedal 47 to the cylinder via the master cylinder as a backup.

The brake device 220 is not limited to the electric servo brake device described above, and may be an electronically controlled hydraulic brake device. The electronically controlled hydraulic brake device controls the actuator according to the information input from the traveling control unit 160 to transmit the oil pressure of the master cylinder to the cylinder. Further, the braking device 220 may include a regenerative brake by a traveling motor that can be included in the traveling driving force output device 200.

[Block configuration of information providing device 300]
Next, the block configuration of the information providing device 300 according to the embodiment of the present invention provided in the vehicle control device 100 described above will be described with reference to FIG.
FIG. 5 is a block configuration diagram conceptually representing the key content display function of the information providing device 300 according to the embodiment of the present invention.

As shown in FIG. 5, the information providing device 300 according to the embodiment of the present invention includes a communication unit 311, an extraction unit 313, a registration unit 315, a display control unit 171 and the multi-information panel 87 (internal display device 61). ) Is provided.

<Communication unit 311>
As shown in FIG. 5, the communication unit 311 has a function of performing chat communication. Chat means real-time communication using a data communication line on a computer network including the Internet. The conversation content related to the chat communication is sent to the extraction unit 313.
The communication unit 311 is a functional unit included in the communication device 25 connected to the vehicle control device 100 shown in FIG.

<Extractor 313>
The extraction unit 313 has a function of extracting key contents from the conversation contents related to the chat communication by the communication unit 311. The key content is a concept including, for example, a keyword and a key image, which is the essence of the conversation content related to chat communication.
Further, the extraction unit 313 adopts a configuration in which, for example, an appropriate key content is extracted from the conversation content related to the chat communication based on the information on the occupant's preference registered in the registration unit 315 described below. be able to. When a plurality of key contents are extracted by this extraction, the extraction unit 313 determines the occupant's preference for each of the extracted plurality of key contents based on the information regarding the occupant's preference registered in the registration unit 315. Based on this, a configuration may be adopted in which the recommendation level is ranked and the ranking information related to the recommendation level is generated. The ranking information related to the recommendation level generated by the extraction unit 313 is sent to the display control unit 171.
The extraction unit 313 is a functional unit included in the recognition unit 140 of the vehicle control device 100 shown in FIG.

<Registration Department 315>
As shown in FIG. 5, the registration unit 315 has a function of registering information regarding the preferences of the occupants of the own vehicle M. In the registration unit 315, for example, information such as the address, name, age, occupation, gender, hobbies, luxury items, and disclosure allowance range of personal information of the occupants is registered for each occupant.
The registration unit 315 is a functional unit included in the recognition unit 140 of the vehicle control device 100 shown in FIG.

<Display control unit 171>
The display control unit 171 (see FIGS. 2 and 5) basically controls the display of the multi-information panel (display unit; hereinafter, may be abbreviated as “MIP”) 87.
The MIP 87 has a wide display area 331 in the vehicle width direction, for example, as shown in FIGS. 7A and 7B. The display area 331 includes a digital content display area 333 and a chat display area 335 that displays content related to chat communication.

In the digital content display area 333 provided in the MIP 87, for example, appropriate key content extracted from the conversation content related to chat communication by referring to the information on the occupant's preference registered in the registration unit 315 is displayed. Will be done.
In the chat display area 335 provided in the MIP 87, for example, an image of a conversation partner related to chat communication is displayed.

In addition, a mascot icon called a personal assistant 337 is displayed in the display area 331 related to the MIP (display unit) 87. The personal assistant 337 has emotions and emotions with anthropomorphic facial expressions in order to maintain smooth communication with the occupants when dialogues including various inquiries and answers are performed between the vehicle control device 100 and the occupants. Expression is given.

In particular, as shown in FIGS. 7A and 7B, for example, the display control unit 171 displays digital content including key content extracted based on the conversation content related to chat communication with respect to the digital content display area 333 in the chat display area 335. The contents related to the chat communication are displayed in parallel in the display area 331 provided in the MIP 87.

It should be noted that the display control unit 171 has a plurality of display control units 171 based on the ranking information related to the recommendation level generated by the extraction unit 313 when the extraction unit 313 extracts a plurality of key contents from the conversation content related to the chat communication. A configuration may be adopted in which the display form (display format; size / color / arrangement of design images representing each of a plurality of key contents, etc.) of each key content is changed.

[Operation of information providing device 300]
Next, the operation of the information providing device 300 according to the embodiment of the present invention will be described with reference to FIGS. 6, 7A to 7D as appropriate.
FIG. 6 is a flowchart for explaining the operation of the information providing device 300. 7A to 7D are diagrams conceptually showing a state in which conversation partners related to digital contents and chat communication are displayed in parallel on the multi-information panel 87.
As a premise, it is assumed that the autonomous driving vehicle (own vehicle) M equipped with the information providing device 300 is traveling in a preset level of automatic driving mode.

In step S11 shown in FIG. 6, the communication unit 311 of the information providing device 300 starts chat communication with a third party (for example, a friend). At this time, as shown in FIG. 7A, in the chat display area 335 of the display area 331 related to the MIP 87, an image of the conversation partner related to the chat communication (an image of the upper body of a friend, but a moving image may be used; the same applies hereinafter. ) Is displayed.
In addition, when displaying the image of the conversation partner related to the chat communication, it is assumed that another person other than the conversation partner is reflected. In such a case, from the viewpoint of privacy protection, a mask process may be applied to hide the same face part of another person's face part reflected with the same conversation partner.

In step S12, the extraction unit 313 of the information providing device 300 extracts the key content including the keyword from the conversation content related to the chat communication by the communication unit 311. In addition, this extraction may be performed by referring to the information regarding the preference of the occupant of the own vehicle M registered in the registration unit 315.
At this time, in the digital content display area 333 of the display area 331 related to the MIP 87, as shown in FIG. 7A, an icon image (for example, a service such as shopping relaxation sweets) representing the key content extracted by the extraction unit 313 is used. A circular design image) with a content heading is displayed.
When displaying the icon image, a configuration may be adopted in which the size is changed according to the degree of recommendation for the occupant (the higher the degree of recommendation for the occupant, the larger the display).

In step S13, the information providing device 300 displays a list of icon images of the key contents extracted by the extraction unit 313 during face-to-face chat communication with a third party (friend).
At this time, as shown in FIG. 7B, the image of the conversation partner related to the chat communication is reduced and displayed in the chat display area 335 of the display area 331 related to the MIP 87 (compared to the example of FIG. 7A).
Further, as shown in FIG. 7B, the icon image of the key content extracted by the extraction unit 313 is enlarged and displayed in the digital content display area 333 of the display area 331 related to the MIP 87 (compared to the example of FIG. 7A). ing.

In step S14, from among the icon images of the key contents listed in the digital content display area 333, the icon image related to the required service (for example, a circular design image with a heading of the service content of the sweets). Is selected and operated by the occupant. Then, the information providing device 300 advances the processing flow to the next step S15.

In step S15, the communication unit 311 of the information providing device 300 starts chat communication with a service member belonging to a specific store based on the selection operation of the occupant in step S13.
At this time, as shown in FIG. 7C, an image of a conversation partner related to chat communication (an image of the upper body of a service worker of a specific store) is displayed in the chat display area 335 of the display area 331 related to the MIP 87.
Further, as shown in FIG. 7C, in the digital content display area 333 of the display area 331 related to the MIP 87, information about a specific store and information related to the service menu is displayed. (For example, in FIG. 7C, icon images of hot coffee, iced coffee, and mango juice are displayed as a service menu of selectable drinks.

In step S16, it is assumed that the occupant selects and operates an icon image related to the required service (for example, an icon image related to seat reservation confirmation) from the service menu provided by the specific store. Then, the information providing device 300 advances the processing flow to the next step S17.
In addition, in the service menu provided by a specific store, a service for settling the consideration for the service whose reservation has been confirmed may be prepared.

In step S17, the information providing device 300 executes a process ((seat reservation confirmation) related to the selected required service based on the occupant selection operation in step S16.
At this time, as shown in FIG. 7D, an image of a conversation partner related to chat communication (an image of the upper body of a service worker of a specific store) is displayed in the chat display area 335 of the display area 331 related to the MIP 87.
Further, as shown in FIG. 7D, the digital content display area 333 of the display area 331 related to the MIP 87 relates to the indoor layout of the table related to a specific store in order to facilitate the seat reservation confirmation service. The information is displayed in a manner that can be appropriately selected by the occupant.

[Block configuration of information providing device 303 according to a modified example]
Next, the block configuration of the information providing device 303 according to the modified example of the present invention will be described with reference to FIG.
FIG. 9 is a block configuration diagram conceptually representing the key content display function of the information providing device 303 according to the modified example of the present invention.
The information providing device 300 according to the embodiment of the present invention shown in FIG. 5 and the information providing device 303 according to the modified example of the present invention shown in FIG. 9 have many common components. Therefore, by paying attention to the difference between the two, the description will be replaced with the description of the information providing device 303 according to the modification of the present invention. Further, it is assumed that a plurality of occupants (three occupants in the example of FIG. 9) are on board the own vehicle M.

As shown in FIG. 9, the information providing device 303 according to the modified example of the present invention is different from the information providing device 300 according to the embodiment of the present invention in that it includes an emotion estimation unit 317.

<Emotion estimation unit 317>
The emotion estimation unit 317 has a function of converting the emotions of the occupants on the own vehicle M into emotion score values and estimating them. To convert the occupant's emotions into emotion score values and estimate them, for example, a heart rate sensor that detects the occupant's heart rate, a blood pressure monitor that detects the occupant's blood pressure, and a line-of-sight sensor that detects the occupant's line-of-sight movement are used in the vehicle. It is attached to the occupants on board the M and monitors the heart rate, blood pressure, and line-of-sight movement of each occupant.
As a result of this monitoring, for example, the heart rate became higher than that in normal times when it exceeded the heart rate threshold, the blood pressure became higher than that in normal times when it exceeded the blood pressure threshold, and the line of sight moved frequently. In some cases, the occupant's emotions are considered to be high (due to anxiety, tension, etc.), and an appropriate emotion score value is given.
The emotion score value given to each occupant by the emotion estimation unit 317 is sent to the extraction unit 313.

<Extractor 313>
When a plurality of occupants are present in the own vehicle (moving body) M and the emotion estimation unit 317 estimates that the emotion score value is equal to or higher than the predetermined value, the extraction unit 313 determines from the estimated time point. Keywords appearing in the content of conversations exchanged between a plurality of occupants in the retroactive time zone are extracted as key contents.
The "when the emotion score value is estimated to be equal to or higher than the predetermined value" means that the emotion score value of at least one of the plurality of occupants is equal to or higher than the first predetermined value, and the emotion score for each of the plurality of occupants. It is a concept that includes cases where the total value is equal to or greater than the second predetermined value (however, the second predetermined value> the first predetermined value).
Further, when extracting the key content, the extraction unit 313 includes a keyword that does not match the preference of at least one of the plurality of occupants based on the information regarding the preference of the occupant of the own vehicle M registered in the registration unit 315. A configuration that excludes key content from extraction candidates can be adopted.

[Operation of the information providing device 303 according to the modified example]
Next, the concealment processing operation of the information providing device 303 according to the modified example will be described with reference to FIG.
FIG. 10 is a flowchart for explaining the concealment processing operation of the information providing device 303 according to the modified example.
As a premise, it is assumed that the autonomous driving vehicle (own vehicle) M equipped with the information providing device 303 according to the modified example is traveling in a preset level of automatic driving mode.

When the concealment process shown in FIG. 10 starts, in step S21, the information providing device 303 according to the modified example starts recording the conversation content between a plurality of occupants boarding the own vehicle M.

In step S22, the information providing device 303 according to the modified example determines (estimates) whether or not the emotion score value of at least one of the plurality of occupants is equal to or higher than the first predetermined value.
As a result of the determination (estimation) in step S22, when it is determined that the emotion score value of at least one of the plurality of occupants is less than the first predetermined value, the information providing device 303 according to the modified example processes the process. Jump the flow to "normal display control processing".
On the other hand, as a result of the determination (estimation) in step S22, the emotion score value of at least one of the plurality of occupants is equal to or higher than the first predetermined value (the emotion of at least one of the plurality of occupants is considerably high). When the determination (estimation) is made, the information providing device 303 according to the modified example advances the processing flow to the next step S23.

In step S23, the information providing device 303 according to the modified example acquires information on the preferences of each of a plurality of occupants of the own vehicle M, which are registered in the registration unit 315.
At this time, the information providing device 303 according to the modified example provides information on the preference of the specific one occupant in the case where the emotion score value of one specific occupant among the plurality of occupants is equal to or higher than the first predetermined value. Should be obtained. Further, in the case where the total of the emotion score values for each of the plurality of occupants is equal to or greater than the second predetermined value, the information providing device 303 according to the modified example may acquire information on the preferences of each of the plurality of occupants. ..

In step S24, the extraction unit 313 provided in the information providing device 303 according to the modified example has an emotion score value of at least one of the plurality of occupants of the first predetermined value or more in step S22 (at least one of the plurality of occupants). Keywords appearing in the conversation content exchanged between a plurality of occupants in a retroactive time zone retroactively for a predetermined time from the time when the judgment (estimation) that the emotion is considerably high) are extracted as key contents.
However, the extraction unit 313 provided in the information providing device 303 according to the modified example excludes the key content including the keyword that does not match the taste of at least one of the plurality of occupants from the extraction candidates.

After that, the information providing device 303 according to the modified example executes a normal information display control process.

[Action and effect of information providing devices 300 and 303 according to the present invention]
Next, the effects of the information providing devices 300 and 303 according to the present invention will be described.
The information providing device 300 based on the viewpoint (1) includes a display unit (MIP87) provided in the moving body (own vehicle M) and provided with an information display area 331, and a display control unit 171 that controls the display of the MIP87. It is an information providing device that provides the information displayed on the MIP 87 to the occupants.
The information providing device 300 based on the viewpoint (1) further includes a communication unit 311 that performs chat communication and an extraction unit 313 that extracts key content from the conversation content related to chat communication. The MIP 87 has a digital content display area 333 and a chat display area 335 for displaying content related to chat communication.
The display control unit 171 has decided to adopt a configuration that changes the display mode related to the digital content based on the key content extracted by the extraction unit 313.

In the information providing device 300 based on the viewpoint of (1), while the occupant of the moving body is in chat communication, the display control unit 171 is based on the key content extracted by the extraction unit 313 from the conversation content related to the chat communication. , Change the display mode related to digital contents.
Here, the display mode related to digital contents is a concept that comprehensively includes what and how to display as digital contents.
In addition, changing the display mode related to digital content means changing the display content itself (corresponding to "what") related to digital content, and changing the display format related to digital content ("how"). It is a concept that comprehensively includes changing (equivalent).
Specifically, for example, it is assumed that a plurality of entertainment facilities (amusement park, theme park, aquarium; see FIG. 8) are talked about as conversation contents related to chat communication. In such a case, as shown in FIG. 8, displaying the entertainment facility as a candidate for a destination (waypoint) in a list (change in display content) corresponds to changing the display mode related to the digital content.
In addition, destination candidates (multiple entertainment facilities: amusement parks, theme parks, aquariums) based on the ranking information related to the recommendation level associated with each of the multiple entertainment facilities based on the tastes and tastes of the occupants. Changing the display format (size / color / arrangement of design images representing each entertainment facility, etc.) (see FIG. 8) also corresponds to changing the display mode related to the digital content.
Since the display mode related to the above-mentioned digital contents is based on the key contents extracted from the conversation contents related to the chat communication, it can be said that the information has high added value for the occupants of the moving body.

According to the information providing device 300 based on the viewpoint of (1), while the occupant of the moving body is in chat communication, the display control unit 171 sets the key content extracted by the extraction unit 313 from the conversation content related to the chat communication. Based on this, since the display mode related to the digital content is changed, it is possible to provide information having high added value to the occupant of the moving body even in the case where the occupant of the moving body is in chat communication.

The information providing device 300 based on the viewpoint of (2) is an information providing device 300 based on the viewpoint of (1), further including a registration unit 315 for registering information on the preferences of the occupants of the own vehicle M, and an extraction unit 313. May adopt a configuration in which the key content is extracted from the conversation content related to the chat communication based on the information regarding the preference of the occupant of the own vehicle M registered in the registration unit 315.

According to the information providing device 300 based on the viewpoint of (2), the extraction unit 313 is a key from the conversation content related to the chat communication based on the information on the preference of the occupant of the own vehicle M registered in the registration unit 315. In order to extract the content, it is possible to enhance the information providing service that suits the taste of the occupant of the own vehicle M as compared with the information providing device 300 based on the viewpoint of (1).

The information providing device 303 based on the viewpoint of (3) is an information providing device based on the viewpoint of (1) or (2), and further includes an emotion estimation unit 317 that converts the emotions of the occupants into emotion score values and estimates them. , When the extraction unit 313 has a plurality of occupants in the own vehicle (moving body) M and the emotion estimation unit 317 estimates that the emotion score value is equal to or higher than a predetermined value, the extraction unit 313 starts from the estimated time point. A configuration may be adopted in which keywords appearing in the content of conversations exchanged between a plurality of occupants in a time zone retroactive to a predetermined time are extracted as key content.

In the information providing device 303 based on the viewpoint of (3), the emotion estimation unit 317 converts the emotion of the occupant into an emotion score value and estimates it. When the extraction unit 313 has a plurality of occupants in the own vehicle M and the emotion estimation unit 317 estimates that the emotion score value is equal to or higher than the predetermined value, the extraction unit 313 retroactively goes back a predetermined time from the estimated time. Keywords that appear in the content of conversations exchanged between multiple occupants during the time period are extracted as key content.
Here, examples of cases where the emotion score value is estimated by the emotion estimation unit 317 to be equal to or higher than a predetermined value include, for example, a case where the emotion score value of at least one of a plurality of occupants is equal to or higher than the first predetermined value, and a plurality of cases. It is assumed that the total emotional score value for each occupant is equal to or greater than the second predetermined value (however, the second predetermined value> the first predetermined value). In such cases, the emotions of the occupants are raised due to the topics that they want to avoid (key content) and the topics that may leak personal information (key content) in conversations between multiple occupants. It is considered to be high (due to anxiety, tension, etc.).
In addition, it was decided to extract the keywords that appeared in the conversation content exchanged between multiple occupants as key content in the retroactive time zone that goes back a predetermined time from the time when the emotion score value was estimated to be equal to or higher than the predetermined value. , The purpose is to acquire key content including keywords related to topics that the occupants avoid in a timely and accurate manner.

According to the information providing device 303 based on the viewpoint of (3), it is estimated that the extraction unit 313 has a plurality of occupants in the own vehicle M and the emotion score value is equal to or higher than a predetermined value by the emotion estimation unit 317. In this case, in order to extract the keywords appearing in the conversation content exchanged between the plurality of occupants in the retroactive time zone retroactively by a predetermined time from the estimated time point as the key content, the viewpoints of (1) or (2) are taken into consideration. Compared with the information providing device 300 based on the information providing device 300, it is possible to acquire key contents including keywords related to topics that the occupants avoid in a timely and accurate manner.
Further, by excluding the key contents including the keywords related to the topics to be avoided by the occupants acquired in this way from the extraction candidates or the extraction targets, it is possible to realize detailed information provision in consideration of the individual circumstances of each of a plurality of occupants.

Further, the information providing device 303 based on the viewpoint of (4) is an information providing device based on the viewpoint of (2) or (3), and is a registration for registering information on the preference of the occupant of the own vehicle (moving body) M. Further including a unit 315, the extraction unit 313 matches the preference of at least one of a plurality of occupants based on the information regarding the preference of the occupant of the own vehicle M registered in the registration unit 315 when extracting the key content. A configuration may be adopted in which key contents including keywords that are not included are excluded from the extraction candidates.

According to the information providing device 303 based on the viewpoint of (4), when extracting the key content, the extraction unit 313 has a plurality of information on the preference of the occupant of the own vehicle M registered in the registration unit 315. In order to exclude key contents including keywords that do not match the tastes of at least one of the occupants from the extraction candidates, the individual circumstances for each of a plurality of occupants are compared with the information providing device 303 based on the viewpoint of (2) or (3). It is possible to embody detailed information provision in consideration.

The information providing device 300 based on the viewpoint (5) is an information providing device 300 based on any one of the viewpoints (1) to (4), and is a specific place where the key content extracted by the extraction unit 313 is located. In the case of the above, the display control unit 171 displays the display mode of the digital content display area 333 as information on the specific place and includes at least one of the congestion information and the parking lot information related to the surrounding roads. You may adopt the configuration which changes to.

According to the information providing device 300 based on the viewpoint of (5), when the key content extracted by the extraction unit 313 is related to a specific place, the display control unit 171 displays the display mode of the digital content display area 333. , Information based on any one of (1) to (4) in order to change the display mode to include at least one of congestion information and parking lot information related to the surrounding roads, which is information about the specific place. Compared with the providing device 300, it is possible to enhance the guidance service for surely guiding the own vehicle M to the specific place.

The information providing device 300 based on the viewpoint (6) is an information providing device 300 based on any one of the viewpoints (1) to (5), and is a specific place where the key content extracted by the extraction unit 313 is located. When the information is related to the above and there are a plurality of the specific places, the display control unit 171 may adopt a configuration in which the plurality of the specific places are listed as candidate destinations in the digital content display area 333. No.

In the information providing device 300 based on the viewpoint of (6), when the key content extracted by the extraction unit 313 is related to a specific place and there are a plurality of the specific places, the display control unit 171 is digital. A plurality of the specific locations are listed as candidate destinations in the content display area 333. The specific place is not particularly limited, and examples thereof include entertainment facilities (for example, an amusement park, a theme park, an aquarium, etc.). In this example, the entertainment facility (amusement park, theme park, aquarium; see FIG. 8) is listed as a candidate destination.
The destination is a concept including a transit point which is a temporary destination.

According to the information providing device 300 based on the viewpoint of (6), when the key content extracted by the extraction unit 313 relates to a specific place and there are a plurality of the specific places, the display control unit 171 , In order to display a list of a plurality of the specific locations as destination candidates in the digital content display area 333, the specific locations are compared with the information providing device 300 based on any one of the viewpoints (1) to (5). In the case where there are a plurality of the occupants, the occupant can appropriately select one of the plurality of specific locations.
As a result, it is possible to provide convenience for the occupants when selecting one of the plurality of specific places as the destination.

The information providing device 300 based on the viewpoint of (7) is an information providing device 300 based on the viewpoint of (6), further including a registration unit 315 for registering information on the preferences of the occupants of the moving body, and the extraction unit. The 313 extracts a plurality of key contents from the conversation contents related to the chat communication based on the information regarding the preference of the occupant of the moving body registered in the registration unit 315, and a plurality of key contents are extracted as the plurality of key contents by the extraction. Based on the information on the occupant's preference of the own vehicle M registered in the registration unit 315 when the specific place is extracted, each of the extracted plurality of the specific place is based on the occupant's preference. When generating ranking information related to the recommendation level in which the recommendation level is ranked and displaying a list of a plurality of the specific locations as destination candidates in the digital content display area 333, the display control unit 171 uses the extraction unit 313 to display the ranking information. A configuration that changes the display form of a plurality of the specific locations may be adopted based on the generated ranking information related to the recommendation level.

In the information providing device 300 based on the viewpoint of (7), the extraction unit 313 has a plurality of keys from the conversation contents related to the chat communication based on the information regarding the preference of the occupant of the own vehicle M registered in the registration unit 315. Extract the content. When a plurality of the specific locations are extracted as a plurality of key contents by this extraction, the extraction unit 313 uses the information on the occupant's preferences registered in the registration unit 315 to extract the plurality of the extracted specific locations. For each place, the ranking information related to the recommendation level is generated by ranking the recommendation level based on the preference of the occupant.
When displaying a list of a plurality of the specific locations as candidate destinations in the digital content display area 333, the display control unit 171 may use the display control unit 171 based on the ranking information related to the recommendation level generated by the extraction unit 313. Change the display form of a specific place. The plurality of specific places is not particularly limited, and examples thereof include a plurality of entertainment facilities (for example, an amusement park, a theme park, an aquarium, etc.). In this example, when displaying a list of a plurality of the entertainment facilities (amusement park, theme park, aquarium) as destination candidates, the display control unit 171 is recommended by the extraction unit 313 as shown in FIG. Based on the ranking information related to the degree, the display form of the plurality of entertainment facilities (for example, the size / color / arrangement of the design image representing each of the plurality of entertainment facilities) is changed.

According to the information providing device 300 based on the viewpoint of (7), when the display control unit 171 displays a list of a plurality of the specific places (for example, an entertainment facility; an amusement park, a theme park, an aquarium) as destination candidates. , In order to change the display form of the plurality of specific places (the entertainment facility) based on the ranking information related to the recommendation level generated by the extraction unit 313, the information providing device 300 based on the viewpoint of (6) In comparison, when there are a plurality of specific places, the occupant can easily and accurately select one of the plurality of specific places that suits his / her taste.
As a result, similarly to the information providing device 300 based on the viewpoint of (6), it is possible to provide convenience for the occupants when selecting any one of a plurality of specific places as the destination.

Further, the information providing device 300 based on the viewpoint of (8) is an information providing device 300 based on any one of the viewpoints (1) to (7), and there is a key content extracted by the extraction unit 313. When it is related to a specific store, the display control unit 171 displays the display mode of the digital content display area 333 as information about the specific store and includes information related to the service menu (see FIG. 7C). You may adopt the configuration which changes to.

According to the information providing device 300 based on the viewpoint of (8), when the key content extracted by the extraction unit 313 is related to a specific store, the display control unit 171 displays the display mode of the digital content display area 333. , In order to change the display mode to include the information related to the service menu, which is the information about the specific store, as compared with the information providing device 300 based on any one of the viewpoints (1) to (7). Before visiting a specific store, it is possible to grasp the service content provided by that store. As a result, when visiting a specific store, the service provided by the store can be fully enjoyed.

Further, the information providing device 300 based on the viewpoint of (9) is an information providing device 300 based on the viewpoint of (8), and is information about the specific store in the digital content display area 333, and the service menu thereof. When the information related to the above is displayed and an order for a certain service is placed by the selection operation of the occupant of the moving body, the configuration in which the order for the selected service is confirmed may be adopted.

According to the information providing device 300 based on the viewpoint of (9), when the information related to the specific store and the information related to the service menu is displayed in the digital content display area 333, the own vehicle M When an order for a certain service is placed by the selection operation of the occupant, the order for the selected service is confirmed. Therefore, as compared with the information providing device 300 based on the viewpoint of (8), before visiting a specific store. , You can confirm the order of the required service from the service menu provided by the store. As a result, when visiting a specific store, the required services provided by the store can be immediately enjoyed.

The information providing device 300 based on the viewpoint of (10) is an information providing device 300 based on the viewpoint of (8) or (9), and when the conversation partner related to the chat communication is a service worker of the specific store. The communication unit 311 may adopt a configuration in which the estimated time of arrival of the own vehicle M to the specific store is notified by the chat communication.

According to the information providing device 300 based on the viewpoint of (10), when the conversation partner involved in the chat communication is a service worker of the specific store, the communication unit 311 uses the chat communication to send the vehicle to the specific store. In order to notify the estimated time of arrival of M, compared to the information providing device 300 based on the viewpoint of (8) or (9), a sense of security is given to the service staff waiting for the visit of the occupant of the own vehicle M at a specific store. Can be given.

[Other Embodiments]
The plurality of embodiments described above show examples of embodying the present invention. Therefore, these should not limit the technical scope of the invention. This is because the present invention can be carried out in various forms without departing from its gist or its main features.

For example, in the description of the information providing device 300 according to the embodiment of the present invention, the vehicle M has been described as an example of the moving body according to the present invention, but the present invention is not limited to this example.
As the moving body according to the present invention, in addition to the vehicle M, for example, a motorcycle, an aircraft, a ship, or the like is assumed.

Further, in the description of the information providing device 300 according to the embodiment of the present invention, while the occupant of the own vehicle M is in chat communication, the control unit (display control unit 171) extracts from the conversation contents related to the chat communication 313. Although the description has been given with an example of changing the display mode related to the digital content based on the key content extracted by the above, the present invention is not limited to this example.
Instead of or in addition to the above configuration, while the occupant of the own vehicle M is in chat communication, the control unit (display control unit 171) uses the key content extracted by the extraction unit 313 from the conversation content related to the chat communication. A configuration that changes the sound effect related to the digital content may be adopted based on the above.

Finally, the present invention supplies a program that realizes one or more functions according to the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device program the program. It can also be realized in the form of reading and executing. Further, it may be realized by a hardware circuit (for example, ASIC) that realizes one or more functions. Information including a program that realizes each function can be stored in a recording device such as a memory or a hard disk, or a recording medium such as a memory card or an optical disk.

87 Multi-information panel (MIP; display)
171 Display control unit 300 Information providing device 311 Communication unit 313 Extraction unit 315 Registration unit 317 Emotion estimation unit 331 Display area 333 Digital content display area 335 Chat display area M Own vehicle (autonomous driving vehicle, moving object)

Claims (10)

An information providing device including a display unit provided on a moving body and having an information display area and a display control unit that controls the display of the display unit, and providing information displayed on the display unit to an occupant. ,
With the communication department that performs chat communication,
Further provided with an extraction unit that extracts key content from the conversation content related to the chat communication.
The display unit has a digital content display area and a chat display area for displaying the content related to the chat communication.
The display control unit is an information providing device characterized by changing a display mode related to digital contents based on the key contents extracted by the extraction unit. The information providing device according to claim 1.
It also has a registration unit that registers information about the preferences of the occupants of the mobile body.
The extraction unit is an information providing device characterized by extracting key contents from conversation contents related to the chat communication based on information on the tastes of the occupants of the mobile body registered in the registration unit. The information providing device according to claim 1 or 2.
It also has an emotion estimation unit that converts the emotions of the occupants into emotion score values and estimates them.
When a plurality of occupants are present in the moving body and the emotion score value is estimated by the emotion estimation unit to be equal to or higher than a predetermined value, the extraction unit goes back a predetermined time from the estimated time point. An information providing device characterized in that keywords appearing in the contents of conversations exchanged between a plurality of occupants in the retroactive time zone are extracted as key contents. The information providing device according to claim 2 or 3.
It also has a registration unit that registers information about the preferences of the occupants of the mobile body.
When extracting the key content, the extraction unit includes a keyword that does not match the preference of at least one of a plurality of occupants based on the information regarding the preference of the occupant of the moving object registered in the registration unit. An information providing device characterized in that is excluded from extraction candidates. The information providing device according to any one of claims 1 to 4.
When the key content extracted by the extraction unit is related to a specific place, the display control unit displays the display mode of the digital content display area as information about the specific place on the surrounding road. An information providing device characterized in that the display mode is changed to include at least one of the traffic jam information and the parking lot information. The information providing device according to any one of claims 1 to 5.
When the key content extracted by the extraction unit relates to a specific place and there are a plurality of the specific places, the display control unit places the plurality of the specific places in the digital content display area. An information providing device characterized by displaying a list as a candidate for a destination. The information providing device according to claim 6.
Further provided with a registration unit for registering information on the preferences of the occupants of the mobile body.
The extraction unit extracts a plurality of key contents from the conversation content related to the chat communication based on the information regarding the preference of the occupant of the moving body registered in the registration unit, and uses the extraction as a plurality of key contents. When a plurality of the specific places are extracted, the occupant's preference is given to each of the extracted specific places based on the information regarding the occupant's preference of the moving body registered in the registration unit. Generate ranking information related to the recommendation level, which ranks the recommendation level based on
When displaying a list of a plurality of the specific places as destination candidates in the digital content display area, the display control unit may use the display control unit to display the plurality of the specific locations based on the ranking information related to the recommendation level generated by the extraction unit. An information providing device characterized by changing the display form of a specific place. The information providing device according to any one of claims 1 to 7.
When the key content extracted by the extraction unit is related to a specific store, the display control unit displays the display mode of the digital content display area in the service menu of the information regarding the specific store. An information providing device characterized by changing to a display mode including such information. The information providing device according to claim 8.
When information about the specific store and information related to the service menu is displayed in the digital content display area, when an order for a certain service is made by a selection operation of a occupant of the moving object, the service is concerned. An information providing device characterized in that an order for a selected service is confirmed. The information providing device according to claim 8 or 9.
When the conversation partner involved in the chat communication is a service worker of the specific store, the communication unit notifies the estimated time of arrival of the mobile body to the specific store by the chat communication. Providing equipment.

Images