WO2014054171A1

WO2014054171A1 - In-vehicle information processing device

Info

Publication number: WO2014054171A1
Application number: PCT/JP2012/075990
Authority: WO
Inventors: 家田　邦代; 達也三次; 直志宮原
Original assignee: 三菱電機株式会社
Priority date: 2012-10-05
Filing date: 2012-10-05
Publication date: 2014-04-10
Also published as: JP5847320B2; JPWO2014054171A1

Abstract

This in-vehicle information processing device is equipped with: an information acquisition unit (1) for obtaining information indicating conditions of a vehicle and conditions around the vehicle; a content database (5) for storing image information in the form of pictorial expressions describing the content of specific conditions of predetermined items concerning the vehicle and the surroundings of the vehicle; an information conversion unit (2) that extracts information related to a predetermined item from the information indicating the conditions of the vehicle and conditions around the vehicle and converts the extracted information into information that indicates the content of the condition of the predetermined item; an entertainment content generation unit (3) that estimates the content of a specific condition of the predetermined item from the information that indicates the content of the condition of the predetermined item and obtains image information that corresponds to the content of the estimated specific condition from the content database (5); and a display control unit (7) for displaying the obtained image information on an in-vehicle display (8).

Description

In-vehicle information processing equipment

The present invention relates to an in-vehicle information processing apparatus that is mounted on a vehicle and presents information indicating the traveling state of the host vehicle and surrounding vehicles and the environment surrounding the host vehicle.

2. Description of the Related Art Conventionally, a technique has been used in which a camera, a sensor, or the like is mounted on a vehicle to collect data on vehicles that perform dangerous driving around the host vehicle and improve the safety of traveling of the host vehicle.
For example, in Patent Document 1, when the surrounding vehicle is photographed with a camera provided in the own vehicle and the surrounding vehicle performs a dangerous driving, an image of the surrounding vehicle and its accompanying information (position, date, vehicle registration number, etc.) are displayed. There is described a dangerous driving restraint device that creates a database with the accompanying information as a key using data transmitted to the server and transmitted on the server side. By searching a database created using a vehicle registration number or the like as a key, related stored images and accompanying information are provided. As a result, an image in which a number of dangerous acts are performed and the accompanying information are provided for a vehicle that is repeatedly running dangerously.

JP 2002-342883 A

However, in the technique disclosed in Patent Document 1 described above, a vehicle that repeatedly performs a dangerous action is identified and recognized by the driver of the host vehicle, and is related to whether or not a dangerous action is being performed. The subject that the information which shows the state of the own vehicle and the surroundings of a vehicle cannot be shown without it occurred. In addition, the technique disclosed in Patent Document 1 searches a database and provides images and accompanying information, and the driver intuitively determines the host vehicle and the state around the host vehicle from the presented information. There was a problem that it was difficult to do.

The present invention has been made to solve the above-described problems, and is not limited to notifying the presence of a surrounding vehicle that performs dangerous driving, but can intuitively recognize the state of the host vehicle and the surroundings of the host vehicle. The purpose is to present.

The in-vehicle information processing apparatus according to the present invention images an information acquisition unit that acquires information indicating a vehicle situation and a situation around the vehicle, and an expression that describes a specific situation content of a predetermined item in the vehicle and around the vehicle Information relating to a predetermined item is extracted from a database for storing image information and information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and the extracted information is information indicating the status content of the predetermined item An information conversion unit that converts the information into the database, and information indicating the situation content of the predetermined item converted by the information conversion unit, the specific situation content of the predetermined item is estimated, and image information corresponding to the estimated specific situation content is stored in the database An entertainment content generation unit acquired from the display, and a display control unit for displaying the image information acquired by the entertainment content generation unit on the display unit. That.

According to the present invention, it is possible to present highly convenient information that is not limited to notification of the presence of a surrounding vehicle that performs dangerous driving. In addition, information capable of intuitively recognizing the host vehicle and the state around the host vehicle can be presented, and the driver of the host vehicle can quickly reflect the information in the driving operation.

1 is a block diagram illustrating a configuration of an in-vehicle information processing apparatus according to Embodiment 1. FIG. It is a figure which shows an example of the table of the information conversion part of the vehicle-mounted information processing apparatus by Embodiment 1. FIG. It is a figure which shows an example of the expression database of the vehicle-mounted information processing apparatus by Embodiment 1. It is a figure which shows an example of the content database of the vehicle-mounted information processing apparatus by Embodiment 1. FIG. 3 is a flowchart showing the operation of the in-vehicle information processing apparatus according to the first embodiment. FIG. 3 is an explanatory diagram schematically showing processing contents of the in-vehicle information processing apparatus according to Embodiment 1; It is a block diagram which shows the other structure of the vehicle-mounted information processing apparatus by Embodiment 1.

Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram showing the configuration of an in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
The in-vehicle information processing apparatus 100 includes an information acquisition unit 1, an information conversion unit 2, an entertainment content generation unit 3, an expression database 4, a content database 5, an entertainment content storage unit 6, a display control unit 7, and an in-vehicle display (display unit) 8. It is configured.

The information acquisition unit 1 includes an in-vehicle camera 1a, a sensor 1b, a microphone 1c, a navigation device 1d, the Internet 1e, a mobile terminal 1f, and the like, and acquires data of the own vehicle and data around the own vehicle. The data around the host vehicle is data indicating, for example, surrounding vehicles that run around the host vehicle, people walking around the host vehicle, roads on which the host vehicle runs, current weather, and the like. The configuration of the information acquisition unit 1 can be changed as appropriate according to the usage situation. By forming the information acquisition unit 1 with a large number of information acquisition means, more information can be acquired, and entertainment content suitable for the current traveling state of the host vehicle and the surrounding state of the host vehicle is generated. Can do.

The information conversion unit 2 uses the data of the host vehicle and the data of surrounding vehicles acquired by the information acquiring unit 1 to provide information that the driver of the host vehicle can grasp visually and audibly during normal travel, that is, the information about the host vehicle and the surrounding vehicles. Information such as traveling conditions, conditions of people inside and outside the vehicle, information on the environment outside the vehicle (hereinafter referred to as vehicle-related information), and the like are extracted. The extracted vehicle related information is converted into predetermined information set in a table held in advance by the information conversion unit 2.

Based on the state of the host vehicle and the state of the surrounding vehicle estimated from the conversion data of the information converting unit 2, the entertainment content generating unit 3 is a driver of the host vehicle, a driver of the surrounding vehicle, a passenger of the host vehicle, and the outside of the vehicle. An expression that describes the emotion, psychology, or movement of a person is acquired from the expression database 4. Similarly, based on the vehicle environment state estimated from the vehicle environment conversion data of the information conversion unit 2, an expression describing the emotion and psychology estimated to be received by the driver is acquired from the expression database 4. Furthermore, entertainment content (image information) that visually shows a concept associated with the acquired adjective expression is acquired from the content database 5.

The expression database 4 stores expressions describing emotions, psychology or movements of the driver of the own vehicle and the surrounding vehicles, passengers of the own vehicle and people outside the vehicle, and describes emotions or psychology received by the person from the outside environment. Accumulate expressions. The content database 5 accumulates illustrations (image information) that visually indicate concepts that are associated with expressions that describe human emotions, psychology, or movement. In addition, the content database 5 stores illustrations (image information) that visually indicate alerts associated with expressions that describe emotions or psychology received by people from outside the vehicle. The entertainment content storage unit 6 stores the entertainment content acquired by the entertainment content generation unit 3 in association with the corresponding vehicle-related information, conversion data, and description of the description.

The display control unit 7 performs control to display the entertainment content generated by the entertainment content generation unit 3 on the in-vehicle display 8. For example, when a navigation screen is displayed on the in-vehicle display 8, display control is performed to arrange entertainment content at a corresponding position on the navigation screen. Further, in accordance with a read instruction input via an operation input unit (not shown) or the like, the corresponding entertainment content is read from the entertainment content storage unit 6 and displayed on the in-vehicle display 8. The in-vehicle display 8 is composed of, for example, an LCD (Liquid Crystal Display), and superimposes the entertainment content on a predetermined position of the navigation screen based on the display control of the display control unit 7.

Next, each configuration will be described in more detail.
As described above, the information acquisition unit 1 includes, for example, the in-vehicle camera 1a, the sensor 1b, the microphone 1c, the navigation device 1d, the Internet 1e, the mobile terminal 1f, and the like.
The in-vehicle camera 1a captures the host vehicle and the surroundings of the host vehicle, and the in-vehicle camera installed inside the host vehicle captures the situation of the driver and passengers and is installed outside the host vehicle. The in-vehicle camera captures the relationship between the host vehicle and the surrounding vehicle, the driving situation of the surrounding vehicle, the environment outside the vehicle, and the like. A plurality of in-vehicle cameras 1a can be arranged such as being installed in the front and rear of the vehicle, and inside and outside the vehicle.

The sensor 1b is composed of various sensors that detect the running conditions of the host vehicle and surrounding vehicles. For example, a distance sensor for monitoring the surrounding state of the host vehicle, a speed sensor for detecting the traveling state of the host vehicle, an acceleration sensor, a steering angle sensor for detecting the driving operation of the driver, an accelerator opening sensor, A brake sensor, a gear change lever sensor, a human sensor for detecting a passenger's state of the own vehicle, and the like are provided. A plurality of sensors 1b can be arranged according to information to be acquired.

The microphone 1c is arranged inside and outside the host vehicle, and collects sounds inside the host vehicle and sounds generated by surrounding vehicles. A plurality of microphones 1c can be arranged according to information to be acquired. The navigation device 1d acquires information indicating the environment outside the vehicle, such as the travel distance and time of the host vehicle, the type of road on which the vehicle is traveling, and the congestion status of the road. The Internet 1e acquires the vehicle type information of the surrounding vehicles from the captured images of the surrounding vehicles captured by the in-vehicle camera 1a and the mobile terminal 1f. The mobile terminal 1f may estimate the personality of the driver and passengers based on the call history of the driver and passengers.

Next, the information conversion unit 2 will be described.
The information conversion unit 2 first extracts vehicle related information from the data acquired by the information acquisition unit 1. The extracted vehicle-related information is converted into conversion data indicating the movement of the host vehicle, the movement of surrounding vehicles, the road situation, and the like set in a table held in advance by the information conversion unit 2. There are various data conversion methods. For example, the value of the vehicle-related information is compared with a preset threshold value, and conversion data corresponding to the comparison result is selected from the table. Moreover, the in-vehicle camera 1a of the vehicle-related information and the navigation information of the navigation device 1d are analyzed, and conversion data corresponding to the analysis result is selected from the table.

FIG. 2 is a diagram showing an example of a table held and referred to by the information conversion unit 2 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
The table is composed of “conversion object” and “conversion data”. The conversion target (predetermined item) is, for example, “movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, “movement of people in the passenger compartment”, “empty situation”, “ It consists of items such as “road situation”, “traffic signal situation”, and “traffic sign situation”.

The conversion data includes the lateral movement of the vehicle, the relationship with the vehicle in the front-rear direction, the characteristic behavior of the driver, the characteristic behavior and characteristic classification of the person outside the vehicle, the characteristic behavior of the person inside the vehicle, It is composed of data indicating the characteristics of the weather, the characteristics of the road on the road, the characteristics regarding the visibility of traffic signals and traffic signs, and the like. In the example of FIG. 2, the determination method of the vehicle related information is described together, but the determination method may not be stored in the table.

An example in which the information conversion unit 2 converts the movement of the host vehicle into converted data using the table shown in FIG. 2 is compared with the threshold value P obtained by the sensor 1b. Is less than the threshold value P, the conversion data “Do not wobble from side to side” is selected. On the other hand, if the degree of fluctuation A is equal to or greater than the threshold value P, the conversion data of “fluctuate left and right” is selected. Furthermore, when the state where the degree of fluctuation A is equal to or greater than the threshold value P continues for a predetermined time or longer, the conversion data “meandering operation” is selected.

Further, the inter-vehicle distance B acquired by the sensor 1b is compared with the threshold value Q, and if the inter-vehicle distance B is less than the threshold value Q, conversion data “the inter-vehicle distance is short” is selected. On the other hand, when the inter-vehicle distance B is equal to or greater than the threshold value Q, the conversion data “the inter-vehicle distance is long” is selected. In addition, as a result of analyzing the captured video in the own vehicle, if it is determined that the driver is not facing the front, the conversion data of “side looking driving” is selected.

Next, the entertainment content generation unit 3, the expression database 4, and the content database 5 will be described.
The entertainment content generation unit 3 performs a plurality of conversions converted by the information conversion unit 2 as “movement of own vehicle”, “movement of surrounding vehicles”, “movement of people around the own vehicle”, and “movement of people in the passenger compartment”. Based on the data, the driving state of the driver of the own vehicle, the driving state of the driver of the surrounding vehicle, the state of the person around the own vehicle, and the state of the person in the passenger compartment are estimated based on the data. Based on each estimated state, an expression describing the driver's or person's emotion, psychology or movement is acquired from the database 4.
To explain with specific examples, the driver of the host vehicle is converted based on the converted data of “Driving while talking”, “Long distance between vehicles” and “Wakimi driving” converted as “Vehicle movement”. It is estimated that the driving state is “My paced driving”. An expression “niconico” that describes the driver's psychology is acquired from the database 4 based on the estimated “my pace driving”.

In addition, the entertainment content generation unit 3 is based on a plurality of conversion data converted by the information conversion unit 2 as “sky situation”, “road situation”, “traffic signal situation”, and “traffic sign situation”. The impression received by the driver of the host vehicle for collation with the expression database 4 is estimated, and an expression describing the driver's emotion or psychology is acquired from the database 4 based on each estimated impression.
To explain with a specific example, it is estimated that the driver receives the impression that “it is difficult to drive” from the converted data of “night” and “rain” converted as “sky situation”. Based on the estimated “difficult to drive”, an expression “Harahara” that describes the psychology of the driver is acquired from the database 4.

Thereafter, the entertainment content generation unit 3 acquires from the content database 5 as an entertainment content an illustration visually showing a concept associated with the description of the description acquired from the database 4.

FIG. 3 is a diagram showing an example of the expression database 4 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.
The expression database 4 includes “content generation target” and “adjective expression”. The content generation target is the same items as the conversion target shown in FIG. 2 "movement of own vehicle", "movement of surrounding vehicles", "movement of people around the own vehicle", "movement of people in the vehicle interior", " It is composed of “empty situation”, “road situation”, “traffic signal situation”, “traffic sign situation”, and the like.
Explain expressions for "movement of own vehicle", "movement of surrounding vehicles", "movement of people around the own vehicle", and "movement of people in the passenger compartment" are expressions of human emotions (emotions, emotions, smiles, etc.) Consists of human psychological expressions (dirty, scary, dangerous, beautiful, etc.) and dynamic expressions (Secaseca, etc.). On the other hand, description expressions for “sky situation”, “road situation”, “traffic signal situation”, and “traffic sign situation” are emotional expressions (refreshing, squeaky, etc.) and psychological expressions that people receive from the corresponding information. Consists of character strings that indicate (difficult to see, difficult to understand).

FIG. 4 is a diagram showing an example of the content database 5 of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention.

As shown in FIG. 4, a round face illustration is used to show the movement of the host vehicle, and a square is used to show the movement of surrounding vehicles, the movement of people around the own vehicle, and the movement of people in the passenger compartment. Visibility can be improved by using illustration notation that distinguishes the movement of the host vehicle from the rest, such as using a face illustration. The distinction of the illustration notation is not limited to the shape, but may be based on a color or blinking display.

Next, taking the “road situation” as an example, the description is “irritated”, “pounding”, “decorative”, “dirty”, “scary”, “dangerous”, “dark”, “difficult to see” In this case, an illustration clearly stating "Road attention!" Is associated, and if the description is "irritated", "pounding", "dark", or "difficult to see", an illustration clearly stating "noticeful visibility!" Are associated. On the other hand, when the expression is “Nico Nico”, “Beautiful”, “Bright”, or “Easy to see”, no alert is required and no illustration is set.

Next, the operation of the in-vehicle information processing apparatus 100 will be described.
FIG. 5 is a flowchart showing the operation of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention. In the following description, the in-vehicle information processing apparatus 100 displays on the in-vehicle display 8 whether to generate entertainment content in advance, whether to re-acquire data, whether to accumulate entertainment content, or not. It is assumed that whether or not to set is set (hereinafter referred to as setting conditions).

First, the in-vehicle information processing apparatus 100 refers to the setting condition and determines whether to generate entertainment content (step ST1). If entertainment content is not generated (step ST1; NO), the process ends. On the other hand, when generating entertainment content (step ST1; YES), the information acquisition unit 1 acquires host vehicle data and host vehicle peripheral data (step ST2). The information conversion unit 2 determines the movement of the own vehicle, the movement of the surrounding vehicle, the movement of the person around the vehicle, the movement of the person in the vehicle interior, the situation of the sky, from the own vehicle data and the surrounding data of the own vehicle acquired in step ST2. Vehicle-related information that can be grasped by the driver of the host vehicle, such as road conditions, traffic signal conditions, and traffic sign conditions, is extracted (step ST3). Further, conversion data corresponding to the vehicle-related information extracted in step ST3 is acquired with reference to a table held in advance (step ST4).

The entertainment content generation unit 3 estimates the driving state of the driver of the host vehicle or the surrounding vehicle and the state of the passenger or the person outside the vehicle for collation with the expression database 4 based on the converted data converted in step ST4. At the same time, the impression received by the driver from the environment outside the vehicle is estimated (step ST5). Furthermore, the entertainment content generation unit 3 determines whether or not a description expression corresponding to the estimated driving state, the state of the person, and the impression received by the driver is stored in the expression database 4 (step ST6). When the corresponding adjective expression is not accumulated (step ST6; NO), it is determined whether or not the own vehicle data and the own vehicle surrounding data are acquired again with reference to the set condition (step ST7). When the own vehicle data and the own vehicle surrounding data are acquired again (step ST7; YES), the process returns to step ST1, and the above-described process is repeated. On the other hand, when the own vehicle data and the own vehicle surrounding data are not acquired (step ST7; NO), the process is terminated.

On the other hand, if the corresponding adjective expression is accumulated (step ST6; YES), the entertainment content generation unit 3 selects the relevant adjective expression (step ST8), and further refers to the content database 5 to the selected adjective expression. Entertainment content that is a corresponding illustration is acquired (step ST9). The entertainment content generation unit 3 determines whether to store corresponding vehicle-related information, conversion data, description of description, and the like in the entertainment content storage unit 6 in addition to the acquired entertainment content (step ST10). When not storing (step ST10; NO), it progresses to the process of step ST12. On the other hand, when accumulating (step ST10; YES), the data is accumulated in the entertainment content accumulating unit 6 (step ST11).

Further, the entertainment content generation unit 3 determines whether or not to display the entertainment content acquired in step ST9 on the in-vehicle display 8 with reference to the setting condition (step ST12). When not displaying on the vehicle-mounted display 8 (step ST12; NO), it progresses to the process of step ST14. When displaying on the vehicle-mounted display 8 (step ST12; YES), an entertainment content is displayed on the vehicle-mounted display 8 via the display control part 7 (step ST13).

Thereafter, the entertainment content generation unit 3 refers to the setting condition and determines whether or not to continue acquiring the own vehicle data and the surrounding data of the own vehicle (step ST14). When not continuing (step ST14; NO), a process is complete | finished. On the other hand, when continuing (step ST14; YES), it returns to the process of step ST2 and repeats the process mentioned above.

In the flowchart of FIG. 5 described above, the case where the setting conditions are set in advance is shown as an example, but the screen for requesting the user's selection input in steps ST1, ST7, ST10, and ST12 without setting the setting conditions in advance. You may comprise so that the audio | voice announcement which displays on the vehicle-mounted display 8 or a user's selection input may be output from a speaker (not shown).

Next, a specific example until entertainment content is generated from the acquired host vehicle data and host vehicle peripheral data will be described with reference to FIG.
FIG. 6 is an explanatory diagram schematically showing the processing contents of the in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention. 6A shows a configuration example of the information acquisition unit, FIG. 6B shows a conversion processing example of the information conversion unit, FIG. 6C shows a generation example of the entertainment content generation unit, and FIG. d) shows a configuration example of the expression database, FIG. 6 (e) shows a configuration example of the content database, and FIG. 6 (f) shows a display example of the in-vehicle display.

As shown in FIG. 6A, the information acquisition unit 1 includes an in-vehicle camera 1a, a sensor 1b, a microphone 1c, a navigation device 1d, and a mobile terminal 1f. Each structure of the information acquisition part 1 acquires own vehicle data and own vehicle surrounding data as step ST2.

As shown in FIG. 6B, vehicle-related information is extracted as step ST3 from the data acquired in step ST2. Vehicle-related information is classified and extracted as “movement of own vehicle”, “movement of surrounding vehicles”, “sky situation”, and “road situation”, for example, photographing the driver's facial expression about “movement of own vehicle” The captured image, the vehicle wobble information, the in-vehicle state and the vehicle speed measurement result are extracted.

Next, as step ST4, conversion data is selected from the table based on the comparison between the vehicle related information and the threshold value or the analysis result of the vehicle related information. For example, from the analysis result of the shot image that captured the driver's facial expression, select conversion data that is `` eyes are patchy '' and compare the vehicle speed measurement result with the threshold value to say `` slower than the speed limit '' Select the conversion data.

As shown in FIG. 6 (c), based on the conversion data selected in step ST4, in step ST5, the driving of the host vehicle is determined based on the driving state, the sky condition, and the road condition of the driver of the host vehicle and the surrounding vehicles. The impression that the person will receive. For example, from the five conversion data indicating the movement of the host vehicle shown in FIG. 6B, the driving state of the driver of the host vehicle is estimated as “because of a call, the surrounding situation is not grasped”. Similarly, from the two conversion data indicating the empty situation shown in FIG. 6B, the impression received by the driver of the host vehicle from the outside environment is estimated as “needs attention”.

Subsequently, as step ST6 and step ST8, referring to the expression database 4 shown in FIG. 6D, expressions expressing the driving state and impression estimated in step ST5 are acquired. For example, for the driver of the own vehicle, an adjective expression “Nico Nico” is acquired with respect to the driving state estimated as “because of the call, the surrounding situation is not grasped”. In addition, for the impression that “the driver needs attention” received by the driver of the host vehicle from the outside environment, an adjective expression “Harahara” is acquired.

As shown in FIG. 6 (f), the display control unit 7 displays the entertainment content acquired in step ST9 on the in-vehicle display 8 as step ST13. When the navigation screen is displayed on the in-vehicle display 8 as shown in FIG. 6 (f), entertainment contents of the host vehicle and the surrounding vehicles are displayed at corresponding positions on the running road. Furthermore, entertainment content indicating the environment outside the vehicle is displayed in an empty area of the navigation screen.

In addition, when the entertainment content which alerts the driver | operator of the own vehicle is produced | generated, you may comprise so that an audio | voice announcement may be output via the speaker 10 with which the vehicle-mounted information processing apparatus 100 is provided (FIG. 6 (c) and FIG. 6 (f)). In the example of FIG. 6 (f), since there is an irritated surrounding vehicle behind the host vehicle and it is necessary to pay attention to the road surface, a voice announcement “rear warning! Road attention!” Is output.

FIG. 7 shows a configuration of the in-vehicle information processing apparatus 100 having the voice announcement function. FIG. 7 is a block diagram showing another configuration of in-vehicle information processing apparatus 100 according to Embodiment 1 of the present invention. An audio output control unit 9 and a speaker 10 are additionally provided in the in-vehicle information processing apparatus 100 shown in FIG.
The audio output control unit 9 performs control to output the entertainment content generated by the entertainment content generation unit 3 from the speaker 10. The speaker 10 outputs an audio announcement according to the entertainment content based on the audio output control of the audio output control unit 9. By outputting a voice announcement according to the entertainment content, the driver of the host vehicle can more easily recognize the situation of the host vehicle and the surrounding situation of the host vehicle.

The display example of the in-vehicle display 8 shown in FIG. 6F is an example, and various displays can be performed depending on the driving state and the driving scene. For example, if a vehicle traveling in front of the host vehicle is meandering and acceleration / deceleration of the speed is severe, it is estimated that the driver of the vehicle is frustrated and the vehicle traveling in front of the host vehicle is angry. An illustration showing In addition, when a traffic signal is allowed to turn right and a straight vehicle enters the intersection, it is estimated that the driver of the host vehicle is in danger, and the subject vehicle is indicated by an illustration indicating “in danger”.

In the above-mentioned example, the illustration showing the face of the person and the illustration showing the alert are displayed as entertainment content. However, the illustration shows the own vehicle, surrounding vehicles, passengers of the own vehicle, people around the own vehicle, and the environment outside the vehicle. Any illustration may be used as long as the situation is appropriately expressed and the description can be easily associated with the description. For example, for the description of “danger”, which is a human emotional expression, and for the expression of “danger”, which is the expression of the psychological situation of a person, which generates illustrations of “demon” and “mountain eruption” as entertainment content. The illustrations of “sports car” and “horse” are generated as entertainment content for the expression of “cool” that is human psychological expression. To do. In this way, various illustrations such as natural objects and artificial objects can be used as entertainment content.

Although not illustrated in FIG. 6 (f), the driver can easily recognize the passenger's state and psychological state by displaying the entertainment content of the passenger of the own vehicle on the in-vehicle display 8. For example, it is possible to easily recognize the situation in which the child in the back seat is sleeping or going to sleep from the entertainment content, and the driver avoids sudden braking, accelerates slowly, etc. It is possible to operate according to.

In addition, when displaying entertainment content on the in-vehicle display 8, when outputting warning information to the driver or passenger of the host vehicle, the display color is changed to a warning color such as red or yellow, or You may comprise so that a warning sound may be output from the speaker 10 via the audio | voice output control part 9. FIG.

In addition, the display control unit 7 reads out the entertainment content stored in the entertainment content storage unit 6 and the corresponding vehicle-related information, conversion data, and description of the description, and displays them on the in-vehicle display 8 again, thereby driving operation simulation, etc. It can be used for.

In the above-described example, the entertainment content is output to one in-vehicle display 8. However, the entertainment content may be output to a plurality of in-vehicle displays 8. Thereby, the passenger can have a simulated experience of driving and can give advice to the driver. Note that only entertainment content may be displayed on the display visually recognized by the passenger.
Further, in addition to the in-vehicle display 8, it may be configured to display simultaneously on a display arranged at a remote location connected by a network. This makes it possible for a family member at home to grasp the running state of the vehicle.

Moreover, in Embodiment 1 mentioned above, although the information acquisition part 1 showed the structure provided with several information acquisition means, such as the vehicle-mounted camera 1a, the sensor 1b, and the microphone 1c, even if comprised with any one information acquisition means. Alternatively, any information acquisition means may be selected and configured.

As described above, according to the first embodiment, vehicle related information is extracted from the acquired host vehicle data and host vehicle peripheral data, and the extracted vehicle related information is compared with a threshold value or the vehicle related information is analyzed. An information conversion unit 2 that selects conversion data based on the result, and a person's emotion, psychology or movement for collation with the expression database 4 based on the conversion data, or an emotion or psychology that the person receives from the conversion data An entertainment content generating unit 3 that acquires an expression describing the estimated emotion, psychology, or movement from the database 4, and an entertainment content that visually indicates the acquired description expression from the content database 5, and the entertainment content on the vehicle display And a display control unit 7 that performs control to display on Since the configurations and is not limited to the notification of presence around the vehicle to perform dangerous driving, the running state of the vehicle, passenger state, it is possible to always provide status information with high usability such as around the host vehicle.

In addition, according to the first embodiment, since the content expression 5 is stored so as to be associated with entertainment contents visually shown using illustrations, information that improves recognition performance is provided. Presentation can be realized. In addition, the travel state of the host vehicle, the passenger's state, the state around the host vehicle, and the like can be intuitively recognized from the entertainment content, and the driver can promptly reflect it in the driving operation.

Further, according to the first embodiment, since the description database is configured to include the content database 5 that is stored in association with entertainment contents visually shown using natural or artificial objects, the driver can It is possible to intuitively recognize the traveling state of the vehicle, the passenger's state, the state around the host vehicle, and the like.

In the present invention, any component of the embodiment can be modified or any component of the embodiment can be omitted within the scope of the invention.

As described above, since the in-vehicle information device according to the present invention enables presentation of entertainment content that visually indicates the host vehicle state and the surroundings of the host vehicle, the vehicle safety that requires intuitive recognition performance is required. It is suitable for a notification system.

1 information acquisition unit, 1a in-vehicle camera, 1b sensor, 1c microphone, 1d navigation device, 1e internet, 1f mobile terminal, 2 information conversion unit, 3 entertainment content generation unit, 4 expression database, 5 content database, 6 entertainment content storage unit 7, display control unit, 8 on-vehicle display, 9 audio output control unit, 10 speakers, 100 on-vehicle information processing device.

Claims

In an in-vehicle information processing apparatus mounted on a vehicle and presenting information to a passenger of the vehicle,
An information acquisition unit for acquiring information indicating a situation of the vehicle and a situation around the vehicle;
A database for storing image information obtained by imaging an expression describing a specific situation content of a predetermined item in the vehicle and around the vehicle;
Information conversion for extracting information related to the predetermined item from information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converting the extracted information into information indicating the status content of the predetermined item And
Entertainment for estimating the specific situation content of the predetermined item from the information indicating the situation content of the predetermined item converted by the information conversion unit, and acquiring image information corresponding to the estimated specific situation content from the database A content generation unit;
An in-vehicle information processing apparatus comprising: a display control unit that displays image information acquired by the entertainment content generation unit on a display unit.
The database accumulates image information that images the driver's emotion, psychology, or movement of the vehicle that describes the specific driving state of the vehicle,
The information conversion unit extracts information related to the traveling state of the host vehicle from information indicating the state of the vehicle and the situation around the vehicle acquired by the information acquiring unit, and converts the information into the information indicating the traveling state of the host vehicle,
The entertainment content generation unit estimates a specific driving state of the host vehicle from information indicating the driving state of the host vehicle converted by the information conversion unit, and image information corresponding to the estimated specific driving state of the host vehicle. The in-vehicle information processing apparatus according to claim 1, wherein the information is acquired from the database.
The database accumulates image information that images the driver's emotion, psychology, or movement of the surrounding vehicle that describes a specific driving state of the surrounding vehicle that runs around the host vehicle,
The information conversion unit extracts information related to the driving situation of the surrounding vehicle from the information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converts the information into the information indicating the driving state of the surrounding vehicle,
The entertainment content generation unit estimates a specific driving state of the surrounding vehicle from information indicating the driving state of the surrounding vehicle converted by the information conversion unit, and image information corresponding to the estimated specific driving state of the surrounding vehicle The in-vehicle information processing apparatus according to claim 1, wherein the information is acquired from the database.
The database accumulates image information that images the emotion, psychology, or movement of a person outside the vehicle that describes a specific operation state of the person outside the vehicle located around the vehicle,
The information conversion unit extracts information related to the situation of the person outside the vehicle from the information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converts the information into the information indicating the operation state of the person outside the vehicle. ,
The entertainment content generation unit estimates a specific operation state of the person outside the vehicle from the information indicating the operation state of the person outside the vehicle converted by the information conversion unit, and corresponds to the estimated specific operation state of the person outside the vehicle. The in-vehicle information processing apparatus according to claim 1, wherein image information is acquired from the database.
The database accumulates image information that images passengers' emotions, psychology or movements that describe the specific operating state of the passengers of the vehicle,
The information conversion unit extracts information related to the passenger's situation from the information indicating the state of the vehicle acquired by the information acquisition unit, and converts the information into information indicating the passenger's operating state,
The entertainment content generation unit estimates a specific operation state of the passenger from the information indicating the operation state of the passenger converted by the conversion unit, and obtains image information corresponding to the estimated specific operation state of the passenger. The in-vehicle information processing apparatus according to claim 1, wherein the information is acquired from a database.
The database accumulates image information that images the emotion or psychology of the driver of the own vehicle that describes the impression that the driver of the own vehicle receives from a specific state of the road,
The information conversion unit extracts information related to the situation of the road on which the host vehicle is traveling from information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, and converts the information into information indicating the situation of the road And
The entertainment content generation unit estimates the specific state of the road from the information indicating the road state converted by the information conversion unit, and corresponds to the impression received by the driver of the host vehicle from the estimated specific state of the road The in-vehicle information processing apparatus according to claim 1, wherein image information is acquired from the database.
The database accumulates image information that images the emotion or psychology of the driver of the own vehicle that describes the impression that the driver of the own vehicle receives from a specific state of weather,
The information conversion unit extracts information related to the weather situation from the information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition part, and converts the information into information indicating the weather condition,
The entertainment content generation unit estimates a specific weather state from the information indicating the weather state converted by the information conversion unit, and corresponds to an impression received by the driver of the host vehicle from the estimated specific weather state. The in-vehicle information processing apparatus according to claim 1, wherein image information is acquired from the database.
The database accumulates image information that images the emotion or psychology of the driver of the host vehicle that describes the impression received by the driver of the host vehicle from a specific visual state of the traffic lights and signs,
The information conversion unit extracts information related to the visibility of traffic lights and signs installed on the road on which the host vehicle is traveling from information indicating the situation of the vehicle and the situation around the vehicle acquired by the information acquisition unit, Convert it into information that shows the visibility of traffic lights and signs,
The entertainment content generation unit estimates a specific visual state of the traffic signal and the sign from information indicating the visual state of the traffic signal and the sign converted by the information conversion unit, and the host vehicle from the estimated specific visual state of the traffic signal and the sign The in-vehicle information processing apparatus according to claim 1, wherein image information corresponding to an impression received by the driver is acquired from the database.
The vehicle-mounted vehicle according to claim 1, wherein the database stores image information obtained by replacing an expression describing a specific situation content of a predetermined item in the vehicle and the vicinity of the vehicle with an artificial object or a natural object. Information processing device.
An entertainment content storage unit for storing image information acquired by the entertainment content generation unit;
The in-vehicle information processing apparatus according to claim 1, wherein the display control unit reads image information stored in the entertainment content storage unit and displays the image information on the display unit.