JP2020047132A - Information processor, information processing method, information processing program, and storage medium - Google Patents

Abstract

To provide an information processor capable of effectively assisting driver's auditory recognition for an external situation of a moving body; an information processing method; an information processing program; and a storage medium.SOLUTION: An information obtaining processor 120 includes: a sound obtaining unit 112 for obtaining outer sounds of a moving body 1; a position obtaining unit 113 for obtaining a position of the moving body 1; a driving information obtaining unit 121 for obtaining driving information regarding both behavior of the moving body 1 and behaviour of a driver of the moving body; an information obtaining determination unit 122 for determining, based on the outer sounds and the driving information, whether a sound which the driver easily fails to hear is included in the outer sounds; and an information output unit 124 for outputting, to a server 2, individual correspondence information in which the position of the moving body 1 obtained by the position obtaining unit 113 is associated with information related to the sound which the driver easily fails to hear, when the information obtaining determination unit 122 determines that the sound which the driver easily fails to hear is included in the outer sounds.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an information processing apparatus for performing information processing on a moving object, an information processing method, an information processing program, and a storage medium storing the information processing program.

  2. Description of the Related Art Conventionally, as an example of information processing on a moving body, information processing for determining whether or not there is a target that is difficult for a driver to visually recognize is present outside the moving body (for example, see Patent Document 1). . In the information processing described in Patent Literature 1, it is determined whether or not there is an object that is difficult to visually recognize based on an image or the like outside the moving object. According to such information processing, by notifying the driver of various types according to the determination result, the driver can be appropriately alerted.

JP 2014-30212 A

  Here, when the driver recognizes the external situation of the moving body, the driver often frequently recognizes the external situation aurally. However, auditory perception is currently left to the driver's individual auditory ability and concentration, and information processing that effectively assists the driver's auditory perception of the situation outside the moving object is not considered. It has not been done yet.

  Therefore, an object of the present invention is to provide an information processing apparatus, an information processing method, an information processing program, and a storage medium that can effectively assist a driver's auditory recognition of a situation outside a moving object. Etc. are mentioned as an example.

  In order to solve the above-described problems and achieve the object, an information processing apparatus of the present invention includes a sound acquisition unit that acquires a sound outside a moving body, a position acquisition unit that acquires a position of the moving body, A driving information acquisition unit that acquires driving information relating to at least one of the behavior of the body and the behavior of the driver of the moving body, and the driver misses the external sound based on the external sound and the driving information. A determination unit that determines whether or not a sound that is easy to hear is included; and a position that is acquired by the position acquisition unit when the determination unit determines that the external sound includes a sound that is easily missed by a driver. An information output unit that outputs, to a predetermined information collection server, correspondence information that associates the position of the moving body or an area including the position with the information on sounds that the driver easily misses. It is characterized by.

  Further, in order to solve the above-described problems and achieve the object, the information processing method of the present invention, a sound acquisition step of acquiring a sound outside the moving body, a position acquisition step of acquiring the position of the moving body, A driving information acquisition step of acquiring driving information relating to at least one of the behavior of the moving body and the behavior of the driver of the moving body, and a driver responding to the external sound based on the external sound and the driving information. A determining step of determining whether a sound that is easy to overlook is included, and the position obtaining unit when it is determined in the determining step that the external sound includes a sound that the driver easily overlooks. An information output step of outputting, to a predetermined information collection server, correspondence information in which the acquired position of the moving body or a region including the position, and information on sounds that the driver easily misses are associated with each other. Specially To.

  In order to solve the above-described problems and achieve the object, an information processing program according to the present invention causes a computer to execute the above-described information processing method according to the present invention.

  In order to solve the above-mentioned problems and achieve the object, a storage medium of the present invention stores the above-described information processing program of the present invention.

FIG. 3 is a schematic diagram illustrating a moving object and a server according to the first embodiment. FIG. 2 is a schematic block diagram illustrating a device configuration in each of a moving object and a server illustrated in FIG. 1. FIG. 3 is a schematic diagram illustrating a data structure of data stored in a storage unit illustrated in FIG. 2. FIG. 4 is a diagram showing the data structure shown in FIG. 3 in a table format. FIG. 3 is a schematic diagram illustrating an information table used for determination by an alert determination unit illustrated in FIG. 2. FIG. 3 is a schematic diagram illustrating an information table used by an information acquisition determination unit illustrated in FIG. 2 to determine driving information. FIG. 3 is a schematic diagram illustrating a statistical process on individual correspondence information performed by a data creation unit illustrated in FIG. 2. 3 is a flowchart illustrating a flow of processing of an information processing method executed by the alert processing device illustrated in FIG. 2. 3 is a flowchart illustrating a flow of processing of an information processing method executed by the information acquisition processing device illustrated in FIG. 2. 3 is a flowchart illustrating a flow of processing of a data creation method executed by the data creation device illustrated in FIG. 2. FIG. 11 is a schematic block diagram illustrating a device configuration in each of a moving object and a server according to a second embodiment. 12 is a flowchart illustrating a flow of processing of an information processing method performed by the information acquisition processing device illustrated in FIG. 12 is a flowchart illustrating a flow of processing of a data creation method executed by the data creation device illustrated in FIG. 11.

  Hereinafter, embodiments of the present invention will be described. An information processing device according to an embodiment of the present invention includes a sound acquisition unit, a position acquisition unit, a driving information acquisition unit, a determination unit, and an information output unit. The sound acquisition unit acquires a sound outside the moving object. The position acquisition unit acquires the position of the moving object. The driving information acquisition unit acquires driving information relating to at least one of a behavior of the moving body and a behavior of a driver of the moving body. The determining unit determines, based on the external sound and the driving information, whether or not the external sound includes a sound that the driver easily misses. The information output unit outputs the following correspondence information to a predetermined information collection server. The correspondence information is the position of the moving body obtained by the position obtaining unit or the area including the position, and the driver, when the determination unit determines that the external sound includes a sound that the driver easily misses. Is information that associates information about sounds that are easy to miss.

  According to the information processing apparatus of the present embodiment, the correspondence information in which the position or the area of the moving object when the driver easily hears the sound, and the information on the sound that is easily missed are associated with the information collection server. Is output to This makes it possible to provide the above-mentioned correspondence information to operations such as creating data for prompting the driver to appropriately pay attention to sounds that are easily overlooked by the information collection server. As described above, according to the information processing apparatus of the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  Here, the information processing apparatus of the present embodiment includes a recognition unit that recognizes a source of a sound that is easily missed by a driver based on external sound and driving information. Then, information about sounds that the driver easily misses is a source recognized by the recognition unit.

  According to the present embodiment, since the source of the sound is adopted as the information on the sound that the driver easily misses, the source of the sound that is easy to overhear can be notified to the driver, and the driver can be alerted to the details. Thus, the driver's auditory perception can be more effectively assisted.

  Further, in the present embodiment, in the following cases, the determination unit includes a cautionary sound predetermined as a sound that the driver should pay attention to as an external sound as a sound that the driver easily misses. It is determined that there is. That is, the determination unit makes the determination as described above when the cautionary sound is extracted from the external sound acquired by the sound acquisition unit and the driving information on the dangerous driving is acquired by the driving information acquisition unit.

  According to the present embodiment, by associating the predetermined cautionary sound with the dangerous driving, it is possible to determine with high accuracy a sound that is easily missed by the driver.

  Further, in the present embodiment, the dangerous driving may be a sudden braking as a behavior of the moving body, and the dangerous driving indicates that the driver does not pay attention to the caution sound. It may be behavior.

  According to the present embodiment, the driver needs to be aware of the cautionary sound immediately before hearing, or the cautionary sound completely missed, etc., with high accuracy, and is easily missed by the driver included in the external sound. It can be determined as a sound.

  The information processing method according to the embodiment of the present invention includes a sound acquisition step, a position acquisition step, a driving information acquisition step, a determination step, and an information output step. The sound acquisition step is a step of acquiring sound outside the moving body. The position obtaining step is a step of obtaining the position of the moving object. The driving information acquisition step is a step of acquiring driving information relating to at least one of the behavior of the moving body and the behavior of the driver of the moving body. The determination step is a step of determining, based on the external sound and the driving information, whether or not the external sound includes a sound that the driver easily misses. The information output step is a step of outputting the following correspondence information to a predetermined information collection server. The correspondence information is the position of the moving body obtained by the position obtaining unit or the area including the position, and the driver, when the determination unit determines that the external sound includes a sound that the driver easily misses. Is information that associates information about sounds that are easy to miss.

  According to the information processing method of the present embodiment, the correspondence information in which the position or the area of the moving object when the driver easily hears a sound, and the information on the sound that is easily missed are associated with the information collection server. Is output to This makes it possible to provide the above-mentioned correspondence information to operations such as creating data for prompting the driver to appropriately pay attention to sounds that are easily overlooked by the information collection server. As described above, according to the information processing method of the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  An information processing program according to an embodiment of the present invention causes a computer to execute the above-described information processing method.

  According to the information processing program according to the present embodiment, by causing the computer to execute the above-described information processing method, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  Further, a storage medium according to the embodiment of the present invention stores the above-described information processing program.

  According to the storage medium of the present embodiment, the above-described information processing method can be executed by a computer using the stored information processing program. As a result, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object.

  Hereinafter, an embodiment for solving the problem of effectively assisting the driver's auditory recognition of the situation outside the moving object will be specifically described with reference to the drawings. First, a first embodiment will be described.

  FIG. 1 is a schematic diagram showing a moving body and a server in the first embodiment, and FIG. 2 is a schematic block diagram showing a device configuration in each of the moving body and the server shown in FIG.

  In the present embodiment, as shown in FIG. 1, a plurality of moving objects 1, each of which is a passenger car, are wirelessly connected to one server 2. The server 2 is provided with a storage unit 220 that stores data indicating a position or an area where a sound that the driver easily misses frequently occurs. The server 2 is provided with a data creation device 210 that creates data to be stored in the storage unit 220.

  On the other hand, each mobile unit 1 is provided with an alert processing device 110 and an information acquisition processing device 120. The alert processing device 110 is a device that acquires data stored in the storage unit 220 of the server 2 via wireless communication, and alerts the driver about sounds that are easily overlooked based on the data. . Further, the information acquisition processing device 120 is a device that acquires information for creating data to be stored in the storage unit 220 of the server 2.

  In the present embodiment, the components of the alert processing device 110 and the information acquisition processing device 120, except for a part thereof, are configured in a navigation device mounted on the moving body 1.

  Before describing each component of the alert processing device 110 of the mobile unit 1, the information acquisition processing device 120, and the data creation device 210 of the server 2, first, a data structure of data stored in the storage unit 220 will be described. .

  FIG. 3 is a schematic diagram illustrating a data structure of data stored in the storage unit illustrated in FIG. 2, and FIG. 4 is a diagram illustrating the data structure illustrated in FIG. 3 in a table format. .

  The data structure 221 shown in FIGS. 3 and 4 is a data structure including the following statistical correspondence information 221b. The statistical correspondence information 221b indicates that the location or the area on the road network 221a and the statistically large number of drivers of the mobile body 1 are likely to overlook when the unspecified number of the mobile bodies 1 travel in the position or the area. The information on the sound is associated with the information. The position on the road network 221a refers to a node 221c that forms the road network 221a and a point 221e on a road link 221d that forms the road network 221a. The region on the road network 221a is a road link 221d that forms the road network 221a. In addition, the information on the sound that the driver easily misses is the source of the sound.

  3 and 4, five pieces of statistical correspondence information 221b are illustrated. In the first statistical correspondence information 221b-1, "child" and "bicycle" are associated with the road link L1 as sound sources that are easy to miss. In the second statistical correspondence information 221b-2, "bicycle" is associated with the road link L2. In the third statistical correspondence information 221b-3, "bicycle" is associated with the point P1 on the road link L3. In the fourth statistical correspondence information 221b-4, "child" is associated with the node N1. In the fifth statistical correspondence information 221b-5, "skateboard" is associated with the node N2.

  These statistical correspondence information 221b means the following cases. For example, schools, parks and alleys where skateboard and bicycle users and children tend to be located, and roads and large shopping malls where there is a lot of traffic that tends to buried the noise from noise are nearby. It means the case that it is. In such a position or area, a large number of drivers are likely to miss the sound of a skateboard, the sound of a bicycle, or the voice of a child.

  In the present embodiment, data having the data structure 221 described above is stored in the storage unit 220 provided in the server 2. The storage unit 220 is a hard disk device as a storage device provided in the server 2. The storage of the above data is not limited to the hard disk device, but may be another writable / readable storage device or a known portable storage medium. When data is stored in a portable storage medium, the storage unit 220 is a reader / writer device capable of installing and removing the portable storage medium.

  The alert processing device 110 of each mobile unit 1 alerts the driver based on the data stored in the storage unit 220.

  Further, in the present embodiment, the statistical creation information 221b is generated in the data creation device 210 of the server 2, that is, data having a data structure 221 including the statistical association information 221b is created.

  Then, the information acquisition processing device 120 of each mobile unit 1 acquires various types of information that is a source of generation of the statistical correspondence information 221b in the data creation device 210 of the server 2.

  As shown in FIG. 2, the alert processing device 110 of the mobile unit 1 includes a data acquisition unit 111, a sound acquisition unit 112, a position acquisition unit 113, an alert determination unit 114, a correspondence processing unit 115, and a first The communication unit 116 is provided. The correspondence processing unit 115 includes a reproduction unit 115a and a notification unit 115b.

  The data acquisition unit 111 reads the data structure 221 of the data structure 221 shown in FIGS. 3 and 4 from the storage unit 220 of the server 2, in which information about sounds that the driver of the mobile unit easily hears is associated with a position or an area. The data is acquired via the first communication unit 116.

  The sound acquisition unit 112 has microphones installed at various parts of the moving body 1 and acquires sounds outside the moving body 1 through these microphones.

  The position acquisition unit 113 acquires the position of the mobile unit 1 using a positioning system such as GNSS (Global Navigation Satellite System).

  The alert determination unit 114 first determines whether or not the position of the moving object 1 acquired by the position acquisition unit 113 exists in the position or area in the statistical correspondence information 221b of the data acquired by the data acquisition unit 111. judge. Further, the alert determination unit 114 includes, in the statistical correspondence information 221b, a sound that is easily missed by the driver and is associated with the position or the area in the external sound acquired by the sound acquisition unit 112. Is determined.

  Here, the alert determination unit 114 stores an information table described below, and uses the information table to determine a sound that is easily missed by the driver.

  FIG. 5 is a schematic diagram illustrating an information table used by the alert determination unit illustrated in FIG. 2 for determination.

  The information table 114a shown in FIG. 5 is a table in which the names of the cautionary sounds predetermined as the sounds to which the driver should pay attention and the conditions for extracting the cautionary sounds are associated with each other. . In the example of FIG. 5, “children's voice”, “bicycle sound”, and “skateboarding sound” are given as names of the cautionary sounds. The conditions for extracting each cautionary sound are defined by a frequency range and a sound level range specific to each cautionary sound.

  Note that the cautionary sound is not limited to the above-mentioned "children's voice", "bicycle sound", and "skateboarding sound", but may be set as appropriate. In addition, the extraction conditions are not limited to the frequency range and the sound level range, and do not ask the specific conditions as long as the conditions for extracting the cautionary sound can be satisfied.

  The alert determination unit 114 illustrated in FIG. 2 performs a frequency analysis on an external sound acquired by the sound acquisition unit 112 when determining a sound that the driver easily misses. Then, on the basis of the analysis result, the cautionary sound that satisfies the extraction condition defined in the information table 114a is extracted. Then, it is determined whether or not any cautionary sound is extracted from the external sound, and whether or not the extracted cautionary sound matches the sound in the above-described statistical correspondence information 221b that is easily missed by the driver. I do. When both match, the alert determination unit 114 determines that the external sound includes a sound that the driver can easily miss.

  The reproduction unit 115a of the correspondence processing unit 115 has a speaker installed inside the moving object 1, and reproduces the external sound acquired by the sound acquisition unit 112 through the speaker. At this time, the reproduction unit 115a reproduces the external sound in a reproduction mode according to the determination result of the alert determination unit 114. In the present embodiment, it is determined that the position of the moving object 1 exists in the position or the area in the statistical correspondence information 221b, and that the external sound includes a sound that is easily missed in the statistical correspondence information 221b. When the determination is made by the unit 114, the playback unit 115a performs the following playback. That is, in such a case, the reproduction unit 115a reproduces an external sound in a reproduction mode in which the easily audible sound extracted as the cautionary sound in the alert determination unit 114 is emphasized with respect to other sounds.

  The reproduction mode in which the easily overlooked sound is emphasized with respect to the other sounds, which is performed by the reproduction unit 115a, is not specified here. For example, the reproduction mode is to increase the volume of the easily overlooked sound and to reproduce the easily overlooked sound. One example is a mode in which a sound is echoed and reproduced.

  The notification unit 115b of the correspondence processing unit 115 determines that the position of the moving object 1 exists in the position or the area in the statistical correspondence information 221b, and that the sound that is easily overlooked is included in the external sound. Is determined, the presence of a sound that is easy to miss is notified to the driver. The notification method by the notification unit 115b is not specified here, but may be, for example, a method of notifying by a voice message, displaying a message or a message image on a display screen, turning on an LED indicator, or the like.

  The first communication unit 116 performs wireless communication with the server 2. The wireless communication by the first communication unit 116 is performed by attaching an identifier such as a vehicle body number for identifying the mobile unit 1 on which the first communication unit 116 is mounted to various types of information to be communicated.

  Next, the information acquisition processing device 120 shown in FIG. 2 will be described. In the present embodiment, the information acquisition processing device 120 uses the sound acquisition unit 112, the position acquisition unit 113, and the first communication unit 116 included in the alert processing device 110 as components of the information acquisition processing device 120. . The information acquisition processing device 120 includes a driving information acquisition unit 121, an information acquisition determination unit 122, a recognition unit 123, and an information output unit 124, in addition to the sound acquisition unit 112, the position acquisition unit 113, and the first communication unit 116. ing.

  The driving information acquisition unit 121 acquires driving information relating to both the behavior of the moving body 1 and the behavior of the driver. For the behavior of the moving body 1, operation information of various devices related to driving such as a steering wheel and a brake is acquired, and for the behavior of the driver, information on a driver's line of sight is acquired with an eye tracker mounted on the moving body 1. doing.

  Note that the acquisition of the driving information is not limited to the above-described acquisition method, and any specific method may be used as long as the information on the behavior of the moving object 1 and the behavior of the driver is acquired. Further, unlike the present embodiment, the driving information regarding only one of the behavior of the moving body 1 and the behavior of the driver may be acquired.

  The information acquisition determination unit 122 determines whether the external sound includes a sound that the driver easily misses, based on the external sound acquired by the sound acquisition unit 112 and the driving information acquired by the driving information acquisition unit 121. Determine whether or not. First, the information acquisition determination unit 122 attempts to extract the above-mentioned cautionary sound from the external sound acquired by the sound acquisition unit 112. The information acquisition determination unit 122 stores an information table similar to the information table 114a (FIG. 5) stored in the alert determination unit 114 of the alert processing device 110. Try to extract. Then, when any cautionary sound is extracted, the information acquisition determination unit 122 determines whether the driving information acquisition unit 121 has acquired driving information on dangerous driving. Another information table described below is used to determine the driving information on the dangerous driving.

  FIG. 6 is a schematic diagram illustrating an information table used by the information acquisition determination unit illustrated in FIG. 2 to determine driving information.

  The information table 122a illustrated in FIG. 6 is a table in which operation names as information related to various dangerous driving and extraction conditions of each dangerous driving are associated with each other. In the example of FIG. 4, the driving names related to the dangerous driving include “sudden braking”, “looking aside”, and “device operation”. The extraction condition of “sudden braking” includes, for example, that brake operation information regarding sudden braking is obtained by the brake device. Examples of the extraction condition of “looking aside” include that the detection direction of the driver's line of sight with the eye tracker is directed to a direction unrelated to the movement of the moving body 1. Examples of the extraction condition of “device operation” include that device operation information on a device mounted on the moving body 1 such as a navigation device or an audio device has been obtained.

  In addition, the dangerous driving is not limited to the above-mentioned “sudden braking”, “side-by-side watching”, and “device operation”, and may be appropriately set. In addition, the extraction conditions are not limited to the above-described conditions, and do not ask the specific conditions as long as the conditions for extracting the dangerous driving can be satisfied.

  When the cautionary sound is acquired from the external sound acquired by the sound acquiring unit 112, the information acquisition determining unit 122 illustrated in FIG. 2 causes the driving information acquiring unit 121 to extract the cautionary sound in the information table 122a of FIG. It is determined whether or not driving information on dangerous driving that meets the conditions has been obtained. Then, the information acquisition determination unit 122 is apt to overlook the cautionary sound in the external sound when any cautionary sound is extracted from the external sound and driving information related to dangerous driving is obtained. It is determined that the sound is included.

  The recognizing unit 123 recognizes a source of a sound that is easily missed by the driver based on external sound and driving information. Specifically, the recognizing unit 123 outputs a signal requiring caution that the information acquisition determining unit 122 determines based on the external sound and the driving information to be included in the external sound as a sound that is easily overlooked, such as “child”. A source such as a car or a "bicycle" is recognized as a source of sound that is easy to miss.

  The information output unit 124 generates the following individual correspondence information when the information acquisition determination unit 122 determines that the external sound includes a sound that the driver easily misses. When the information acquisition determination unit 122 determines that the external sound includes a sound that is easily missed by the driver, the individual correspondence information indicates the position of the mobile object 1 acquired by the position acquisition unit 113 when the driver acquires the sound. Is information that associates information about sounds that are easy to miss. Here, in the present embodiment, the source of the sound recognized by the recognizing unit 123 is adopted as the information about the sound that is easily missed.

  In the individual correspondence information, the information associated with the information about the sound that is easily missed is not limited to the position of the moving object 1 but may be an area including the position. In this case, as the area including the position of the moving object 1, a road link 221d to which the position of the moving object 1 obtained by GNSS belongs in the road network 221a illustrated in FIG. Further, the information regarding sounds that are easily overlooked in the individual correspondence information is not limited to the above-described sources, and may be recorded data or the like representing the sounds.

  After generating the individual correspondence information in this way, the information output unit 124 outputs the individual correspondence information to the server 2 as the information collection server via the first communication unit 116.

  In the server 2, the individual correspondence information sent from each of the plurality of mobile units 1 is received by the data creation device 210. The data creation device 210 includes an information collection unit 211, a data creation unit 212, a providing unit 213, and a second communication unit 214.

  The information collecting unit 211 collects, from the plurality of mobile units 1, the above-described individual correspondence information in which information on a sound that is easily missed by the driver of each mobile unit 1 is associated with a position where the sound is generated.

  The data creation unit 212 performs a statistical process on the individual correspondence information collected by the information collection unit 211, and the information about the sounds that the driver easily misses is statistically associated with the position or the area, as shown in FIGS. The data of the data structure 221 shown in FIG. 4 is created.

  FIG. 7 is a schematic diagram showing a statistical process on the individual correspondence information performed by the data creation unit shown in FIG.

  In FIG. 7, the first to eleventh individual correspondence information 211a-1, 211a-2,... 211a-11 are collected, and the first processing shown in FIG. 3 and FIG. An example is shown in which statistical correspondence information 221b-1 and third statistical correspondence information 221b-3 are generated.

  The first individual correspondence information 211a-1 is information in which “child” is associated as a sound source that is easily overlooked at the position G1 on the road link L4, and the second individual correspondence information 211a-2 is This is information in which “bicycle” is associated with the position G2 on the road link L4. The two positions G1 and G2 on the road link L4 are dispersed apart from each other by a predetermined degree or more.

  The third individual correspondence information 211a-3 is information in which “child” is associated with the position G3 on the road link L1, and the fourth individual correspondence information 211a-4 is information corresponding to the position G4 on the road link L1. This is information associated with “child”. The fifth individual correspondence information 211a-5 is information in which “bicycle” is associated with the position G5 on the road link L1, and the sixth individual correspondence information 211a-6 is information corresponding to the position G6 on the road link L1. This is information associated with “bicycle”. The seventh individual correspondence information 211a-7 is information in which “bicycle” is associated with the position G7 on the road link L1, and the eighth individual correspondence information 211a-8 is information corresponding to the position G8 on the road link L1. This is information associated with “child”. The six positions G3 to G8 on the road link L1 are separated from each other by a predetermined degree or more.

  The ninth individual correspondence information 211a-9 is information in which “bicycle” is associated with the position G9 on the road link L3, and the ninth individual correspondence information 211a-10 is information corresponding to the position G10 on the road link L3. This is information associated with “bicycle”. The eleventh individual correspondence information 211a-11 is also information in which “bicycle” is associated with the position G11 on the road link L3. The three positions G9 to G11 on the road link L3 are concentrated in a predetermined range near the point P3 on the road link L3.

  In the present embodiment, in the statistical processing for the individual correspondence information 211a, first, the individual correspondence information 211a is obtained for each of a predetermined range near the node 221c, a road link 221d, and a predetermined range near the point 221e on the road link 221d. The number is counted. Then, a statistical correspondence information 221b is generated by associating a part where three or more individual correspondence information 211a exist with a source of a sound that is easily missed in each individual correspondence information 211a.

  In the example of FIG. 7, "child" and "bicycle" are associated with the road link L1 in which the six individual correspondence information 211a exists, and the first statistical correspondence information also shown in FIGS. 221b-1 is generated. Also, the third statistical correspondence information 221b-3 is generated by associating "bicycle" with the point P3 on the road link L3 where the three individual correspondence information 211a are concentrated in the vicinity.

  Note that the statistical processing is not limited to the processing for obtaining a part where the individual correspondence information 211a equal to or more than the threshold number exists as described above, and may be a processing for obtaining a part where a sound that is easily missed by the driver occurs statistically frequently. It does not ask for specific processing contents. Further, even in the case of adopting a process of finding a part where the individual correspondence information 211a equal to or more than the threshold number is present, the threshold is not limited to three as described above, and the threshold can be set arbitrarily.

  The data creation unit 212 illustrated in FIG. 2 performs the above-described statistical processing and generates the statistical correspondence information 221b every time the number of individual correspondence information 211a collected by the information collection unit 211 reaches a predetermined number. . The data creation unit 212 causes the storage unit 220 to sequentially store the generated statistical correspondence information 221b. By accumulating the statistical correspondence information 221b in the storage unit 220 in this manner, the data creation unit 212 creates data of the data structure 221 shown in FIGS.

  Further, the providing unit 213 illustrated in FIG. 2 reads out the data created by the data creating unit 212 from the storage unit 220 in response to the request of the data acquisition unit 111 in the alert processing device 110 of the mobile unit 1 and requests the data. It is provided to the original mobile unit 1 via the second communication unit 214.

  In the present embodiment, the providing unit 213 that provides data to the requesting mobile unit 1 in response to the request from the data acquisition unit 111 has been illustrated. Instead, the providing unit may provide the data to the mobile unit at regular intervals. In this case, the mobile unit stores the provided data in the storage unit of the mobile unit, reads out the data appropriately, and uses the data.

  Further, in the present embodiment, the form in which the mobile unit 1 to which the data is provided is the source of the above-described individual correspondence information 211a is illustrated, but the data supply destination is not limited to such a mobile unit. . The destination of the data may have any function as long as it has a function of wirelessly receiving the data from the server 2 and uses the data for some information processing.

  The second communication unit 214 illustrated in FIG. 2 performs wireless communication with each mobile unit 1. Further, when transmitting information to each mobile unit 1, the second communication unit 214 attaches an identifier for identifying the destination mobile unit 1 to the information and transmits the information.

  Next, an information processing method executed by each of the alert processing device 110, the information acquisition processing device 120, and the data creation device 210 illustrated in FIG. 2 will be described. First, an information processing method executed by the alert processing device 110 will be described.

  FIG. 8 is a flowchart illustrating a flow of processing of an information processing method executed by the alert processing device illustrated in FIG. 2.

  The processing of the information processing method represented by the flowchart of FIG. 8 is a warning process for urging the driver of the moving body 1 to pay attention to a sound that is likely to be overlooked, and starts when the navigation device of the moving body 1 is powered on. . When the process starts, a data acquisition step by the data acquisition unit 111 is executed (step S111). In the data acquisition step (step S111), first, the data acquisition unit 111 requests the server 2 via the first communication unit 116 to transmit data in the storage unit 220. In response to the request, the providing unit 213 of the server 2 reads the data from the storage unit 220 and sends the data to the requesting mobile unit 1 via the second communication unit 214. Then, the data acquisition unit 111 acquires the transmitted data via the first communication unit 116.

  Next, a sound obtaining step by the sound obtaining unit 112 is performed (step S112), and a position obtaining step by the position obtaining unit 113 is further performed (step S113).

  Subsequently, the alert determination unit 114 extracts a cautionary sound specified in the information table 114a illustrated in FIG. 6 from the external sound acquired in the sound acquiring step (step S112) (step S112). S114). If a cautionary sound has not been extracted (No determination in step S114), the process returns, and the sound acquisition step (step S112) and the position acquisition step (step S113) are repeated.

  On the other hand, when the caution sound is extracted (Yes determination in step S114), the alert determination unit 114 obtains the position obtained in the position obtaining step (step S113) in the data obtaining step (step S111). It is determined whether the data exists in the position or area in the statistical correspondence information 221b (step S115). As described above, the position or the area in the statistical correspondence information 221b is the position or the area where the sound that the driver easily misses frequently occurs statistically. Therefore, in step S115, it is determined whether or not the position acquired in the position acquisition step (step S113), that is, the position of the moving body 1 exists in such a position or area.

  When the position of the moving object 1 is present at a position or an area where sounds that are easy to overhear statistically frequently occur (Yes determination in step S115), the alert determination unit 114 performs the following determination. That is, the alert determination unit 114 determines whether the cautionary sound extracted in step S114 matches the sound that the driver easily misses in the statistical correspondence information 221b (step S116).

  When the cautionary sound extracted from the external sound coincides with the sound that is easily overlooked (Yes determination in step S116), the alerting determination unit 114 determines that the external sound includes the sound that is easily overlooked. In this case, the reproduction unit 115a of the correspondence processing unit 115 reproduces an external sound in a reproduction mode in which a sound that is easily overlooked is emphasized with respect to other sounds (step S117). Further, the notification unit 115b of the correspondence processing unit 115 notifies the driver of the presence of a sound that is easily overlooked (step S118).

  On the other hand, when the position of the moving object 1 does not exist at a position or an area where the sounds that are easy to overtake statistically frequently occur (No determination in step S115), the reproducing unit 115a reproduces the external sound as it is (step S119). Also, in the case where the cautionary sound extracted from the external sound does not match the easily overlooked sound (No in Step S116), the reproducing unit 115a reproduces the external sound as it is in Step S119.

  When the notification in step S118 and the reproduction in step S119 are completed, the process returns to step S112, and the subsequent processes are repeated.

  The alerting process represented by the flowchart of FIG. 8 is continuously executed until the power of the navigation device is turned off.

  An information processing program for causing a computer to execute the information processing method of the alerting process represented by the flowchart of FIG. 8 is stored in a storage medium of a navigation device or a storage medium of a vehicle-mounted computer device separate from the navigation device. I have. The storage medium for storing the information processing program is not limited to the storage medium of these devices, but may be a known portable storage medium or a storage medium installed in a server connected to these devices via a network. There may be.

  Next, an information processing method executed in the information acquisition processing device 120 will be described.

  FIG. 9 is a flowchart illustrating a process flow of an information processing method executed by the information acquisition processing device illustrated in FIG.

  The process of the information processing method represented by the flowchart of FIG. 9 is an information acquisition process of acquiring information for creating data to be stored in the storage unit 220 of the server 2. This information acquisition process is started together with the above-described alerting process when the navigation device of the mobile unit 1 is powered on, and is executed in parallel with the alerting process.

  When the process starts, a sound acquisition step by the sound acquisition unit 112 is executed (step S121), and a position acquisition step by the position acquisition unit 113 is executed (step S122). In the present embodiment, the sound acquisition step (step S112) and the position acquisition step (step S113) in the alerting processing shown in FIG. 8 are different from the sound acquisition step (step S121) and the position acquisition step (step S121) in the information acquisition processing. S122).

  In the flowchart of FIG. 9, subsequently, a driving information acquisition unit 121 that acquires driving information on both the behavior of the moving body 1 and the behavior of the driver is executed by the driving information acquisition unit 121 (step S123). In the driving information acquisition step (step S123), operation information of various devices in the moving body 1 is acquired with respect to the behavior of the moving body 1, and information regarding the driver's gaze is acquired with the eye tracker regarding the behavior of the driver.

  Next, the information acquisition determination unit 122 determines whether the external sound acquired in the sound acquisition step (step S121) includes a cautionary sound (step S124). The determination here is performed by extracting a cautionary sound from an external sound based on an information table similar to the information table 114a in FIG. 5 used in step S115 of the flowchart in FIG.

  When the cautionary sound is included in the external sound (Yes in step S124), the information acquisition determination unit 122 determines whether the driving information regarding dangerous driving has been acquired by the driving information acquisition unit 121 ( Step S125). In this determination, the information table 122a shown in FIG. 6 is referred to, and it is determined whether or not the information on dangerous driving specified in the information table 122a has been obtained by the driving information obtaining unit 121. The determination is made by the unit 122.

  If the information on the dangerous driving has been acquired (Yes in Step S125), the following information output process is executed (Step 126). In the information output step (step 126), first, the recognizing unit 123 recognizes the source of the cautionary sound extracted in the process of step 124 as the source of the sound that the driver easily misses. Then, the information output unit 124 generates the above-described individual correspondence information 211a by associating the generation source with the position of the moving object 1 acquired in the position acquisition step (Step S122). The information output unit 124 outputs the individual correspondence information 211a to the server 2 via the first communication unit 116.

  When this information output step (Step S126) ends, the process returns to Step S121, and the subsequent processes are repeated. In addition, when the cautionary sound is not included in the external sound (No in Step S124) or when the information regarding the dangerous driving is not acquired (No in Step S125), the process returns to Step S121. Subsequent processing is repeated.

  The information acquisition process shown in the flowchart of FIG. 9 is also executed together with the alerting process shown in the flowchart of FIG. 8 until the power of the navigation device is turned off.

  An information processing program for causing a computer to execute the information processing method of the information acquisition process represented by the flowchart of FIG. 9 is also stored in a storage medium of the navigation device or a storage medium of a vehicle-mounted computer device separate from the navigation device. I have. The storage medium for storing the information processing program is not limited to the storage medium of these devices, but may be a known portable storage medium or a storage medium installed in a server connected to these devices via a network. There may be.

  Next, an information processing method executed in the data creation device 210 of the server 2 will be described.

  FIG. 10 is a flowchart illustrating a flow of processing of a data creation method executed by the data creation device illustrated in FIG.

  The process of the data creation method represented by the flowchart of FIG. 10 is a data creation process of collecting the individual correspondence information 211a from the plurality of mobile units 1 and creating data to be stored in the storage unit 220. Then start.

  When the process starts, an information collecting step by the information collecting unit 211 is executed (Step S211). In the information collecting step (step S211), the individual collecting information 211a from the plurality of mobile units 1 is collected by the information collecting unit 211, and when the number of collection reaches a predetermined number, the process proceeds to the next processing.

  In the next process, a data creation process is performed by the data creation unit 212 (step S212). In the data creation step (step S212), the statistical processing described with reference to FIG. 7 is performed on the collected individual correspondence information 211a, and information on sounds that are statistically easily missed by the driver is stored in the position or area. The associated statistical correspondence information 221b is generated. Further, in the data creation step (step S212), the generated statistical correspondence information 221b is sequentially stored in the storage unit 220. By accumulating the statistical correspondence information 221b in the storage unit 220 in this manner, in the data creation step (step S212), data of the data structure 221 shown in FIGS. 3 and 4 is created.

  When the data creation step (Step S212) ends, the process returns to Step S211 and the subsequent processing is repeated.

  In the present embodiment, the data creation process represented by the flowchart in FIG. 10 is continuously executed until the power of the server is turned off.

  In the present embodiment, a data creation program for causing a computer to execute the data creation method represented by the flowchart of FIG. 10 includes a storage medium that forms a part of the storage unit 220 provided in the server 2, Are stored in a separate storage medium. Further, the storage medium for storing the data creation program is not limited to the storage medium installed in the server 2, but may be installed in a known portable storage medium or another server connected to the server 2 via a network. Storage medium may be used.

  Various information processing apparatuses, various information processing methods, various information processing programs, various storage media, the data structure 221 in FIGS. 3 and 4, the storage medium storing the data structure 221 and the storage in the first embodiment described above. According to the device, the following effects can be obtained.

  First, the effects of the alert processing device 110 shown in FIG. 2, the information processing method executed in the alert process shown in FIG. 8, the information processing program, and various storage media will be described.

  According to the alert processing device 110 and the information processing method of the present embodiment, whether sound that is easily overlooked in the statistical correspondence information 221b of the data acquired from the storage unit 220 is included in the sound outside the moving body 1 It is determined whether or not. Thereby, based on the result of the determination, it is possible to perform an operation such as prompting the driver to pay attention to a sound that is easy to miss. As described above, according to the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving body 1.

  Here, the alert processing device 110 of the present embodiment includes a reproducing unit 115a that reproduces an external sound inside the moving object 1 in a reproduction mode according to the determination result of the alert determining unit 114. . According to this, by reproducing the external sound in the reproduction mode according to the determination result of the alert determination section 114, it is possible to prompt the driver to pay attention to a sound that is easily missed in a manner that is easy for the driver to hear.

  Further, in the present embodiment, when the alert determination unit 114 determines that a sound that is easily overlooked is included in the external sound, the playback unit 115a emphasizes the sound with respect to other sounds. To play the external sound. According to this, the driver can be alerted by a reproduction mode with a small processing load that emphasizes sounds that are easily overlooked.

  When the alert determination unit 114 determines that the sound corresponding to the information in the data acquired from the storage unit 220 is included, the alert processing device 110 of the present embodiment determines that the sound is present. A notification unit 115b for notifying the driver is provided. According to this, the driver can be directly alerted to sounds that are easily overlooked.

  Further, according to the information processing program of the present embodiment, the above-mentioned alerting process is executed by the computer, so that the driver's auditory recognition of the situation outside the moving object 1 can be effectively assisted. it can.

  Further, according to the storage medium of the present embodiment, the above-described alerting process can be executed by a computer using the stored information processing program. As a result, it is possible to effectively assist the driver in audibly recognizing the situation outside the moving body 1.

  Next, effects of the information acquisition processing device 120 illustrated in FIG. 2, the information processing method executed in the information acquisition process illustrated in FIG. 9, an information processing program, and various storage media will be described.

  According to the information acquisition processing device 120 and the information processing method of the present embodiment, the individual correspondence information in which the position of the moving object 1 when the driver easily hears the sound is associated with the source of the easily heard sound. 211a is output to the server 2. As a result, the above-described individual correspondence information 211a can be provided to operations such as creating data for prompting the driver to pay attention to sounds that are easily overlooked by the server 2. As described above, according to the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving body 1.

  Here, the information acquisition processing device 120 of the present embodiment includes a recognition unit 123 that recognizes a source of a sound that is easily missed by a driver based on external sound and driving information. Then, as the information about the sound that the driver easily misses, the above-mentioned individual correspondence information 211a is generated using the source recognized by the recognition unit 123. According to this, since the source of the sound is adopted as the information on the sound that the driver is likely to overlook, the driver can be notified of the source of the sound that is easy to overhear to the driver so as to call attention to the driver. Thus, the driver's auditory perception can be more effectively assisted.

  Further, in the present embodiment, the information acquisition determination unit 122 outputs a cautionary sound that is predetermined as a sound that the driver should pay attention to in a case such as the following, in which an external sound is likely to be overlooked by the driver. Is determined to be included. That is, when the cautionary sound is extracted from the external sound obtained by the sound obtaining unit 112 and the driving information on the dangerous driving is obtained by the driving information obtaining unit 121, the information obtaining determination unit 122 Is determined. According to this, by associating the predetermined cautionary sound with the dangerous driving, it is possible to determine with high accuracy a sound that is easily missed by the driver.

  Further, in the present embodiment, as the above-mentioned dangerous driving, “sudden braking” as a behavior of the moving body 1 and “looking aside” or “device Operation "is adopted. According to this, a cautionary sound that the driver noticed immediately before he noticed, or a cautionary sound that he completely missed, was recorded with high accuracy as a sound that is easily missed by the driver included in the external sound. Can be determined.

  Further, according to the information processing program of the present embodiment, the information acquisition processing described above is executed by a computer, thereby effectively assisting the driver's auditory recognition of the situation outside the moving body 1. it can.

  Further, according to the storage medium of the present embodiment, the above-described information acquisition processing can be executed by a computer using the stored information processing program. As a result, it is possible to effectively assist the driver in audibly recognizing the situation outside the moving body 1.

  Next, effects of the data creation device 210 shown in FIG. 2, the data creation method executed in the data creation process shown in FIG. 10, the data creation program, and various storage media will be described.

  According to the data creation device 210 and the data creation method of the present embodiment, a sound source that is statistically easily heard by a driver, that is, a sound source easily heard by an unspecified number of drivers is associated with a position or a region. The generated statistical correspondence information 221b is generated. Then, by storing the statistical correspondence information 221b in the storage unit 220, data of the data structure 221 shown in FIGS. 3 and 4 is created. Thereby, based on the data, it is possible to perform an operation such as appropriately calling a driver's attention when the moving body 1 is present at a position or an area associated with a sound that is easily missed. As described above, according to the present embodiment, it is possible to create data for effectively assisting the driver's auditory recognition of the situation outside the moving object 1.

  Here, in the present embodiment, the data created by the data creation device 210 is data relating to a position or area corresponding to the road network 221a in which the driver of the sound that the driver easily misses is generated. According to this, based on the created data, a position or area corresponding to the road network 221a in which the mobile unit 1 moves can be obtained as a position or area that calls attention to a sound that is easily missed. That is, it is possible to create data that can be more effectively assisted and that matches the movement of the moving body 1.

  Further, the data creation device 210 according to the present embodiment includes a providing unit 213 that provides the data created by the data creation unit 212 to a predetermined mobile unit 1. According to this, since the created data is provided to the mobile 1, the driver of the mobile 1 can be more effectively assisted.

  Further, according to the data creation program of the present embodiment, the above-described data creation processing is executed by a computer, thereby effectively assisting the driver's auditory recognition of the situation outside the moving object 1. it can.

  Further, according to the storage medium of the present embodiment, the above-described data creation processing can be executed by a computer using the stored data creation program. As a result, it is possible to effectively assist the driver in audibly recognizing the situation outside the moving body 1.

  Next, the data structure 221 shown in FIGS. 3 and 4, the storage medium storing the data of the data structure 221 and the effect of the storage device will be described.

  According to the data structure 221 of the present embodiment, the data of the data structure 221 is subjected to comparison between the above-described statistical correspondence information 221b and the position of the specific moving object 1 and the external sound. Operations can be performed. That is, it is possible to perform an operation such as prompting the driver to pay attention to a position or an area corresponding to the sound source which is easily overlooked in the statistical correspondence information 221b when the specific mobile unit 1 travels. As described above, according to the data structure 221 of the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving object 1.

  Here, in this embodiment, the position or area in the statistical correspondence information 221b corresponds to the road network 221a. According to this, a position or an area corresponding to the road network 221a in which the mobile unit 1 moves can be obtained as a position or an area that calls attention to a sound that is easily missed, based on the configured data. That is, more effective assistance matching the movement of the moving body 1 can be performed.

  Further, in the present embodiment, the position or the area in the statistical correspondence information 221b is a road link 221d or a node 221c that forms a road in the road network 221a. According to this, a detailed position or area in the road network 221a can be obtained as a position or area that calls attention to a sound that is easy to miss based on the configured data. That is, detailed assistance matching the movement of the moving body 1 can be performed.

  Further, according to the storage medium and the storage device of the present embodiment, the data stored in each can be used for the operation in the alert processing device 110 in the specific moving body 1 described above. As a result, it is possible to effectively assist the driver in audibly recognizing the situation outside the moving body 1.

  This concludes the description of the first embodiment, and then describes the second embodiment.

  The second embodiment is different from the above-described first embodiment in that the individual correspondence information 211a is generated not by the information acquisition processing device of the moving body but by the data creation device of the server. Hereinafter, the second embodiment will be described while focusing on differences from the first embodiment. On the other hand, the alerting device of the moving object, the alerting process executed by the alerting device, and the data structure of the alerting data are the same as those in the first embodiment, and thus the description thereof is omitted.

  FIG. 11 is a schematic block diagram illustrating a device configuration in each of a moving object and a server according to the second embodiment. In FIG. 11, components equivalent to those in the first embodiment shown in FIG. 2 are denoted by the same reference numerals as those in FIG. 2, and hereinafter, the equivalent components will be described. Is omitted.

  In the second embodiment, an information acquisition processing device 320 provided in the mobile unit 3 together with the alert processing device 110 corresponds to the information acquisition determination unit 122 provided in the information acquisition processing device 120 in the first embodiment. No elements. Then, in the present embodiment, the information output unit 324 of the information acquisition processing device 320 outputs the external sound information regarding the sound outside the moving body 3, the driving information regarding both the behavior of the moving body 3 and the behavior of the driver, and the moving body 3. 3 is output to the server 4. This output is repeated at regular intervals.

  In the present embodiment, the driving information output by the information output unit 324 is also information on at least one of the behavior of the moving body 3 and the behavior of the driver. May be information on only one of them.

  In the data creation device 410 of the server 4, the information collecting unit 411 collects external sound information, driving information, and position information sent from each mobile unit 3.

  In this embodiment, the data creation device 410 of the server 4 is provided with an information generation unit 412 that generates the individual correspondence information 211a shown in FIG. In the first embodiment, the information generation unit 412 includes an information acquisition determination unit 412a and a recognition unit 412b equivalent to the information acquisition determination unit 122 and the recognition unit 123 included in the information acquisition processing device 120 of the mobile unit 1. . Further, the information generation unit 412 includes a generation unit 412c that generates the individual correspondence information 211a based on the determination result of the information acquisition determination unit 412a and the recognition content of the recognition unit 412b.

  The information acquisition determining unit 412a according to the present embodiment first determines whether the external sound represented by the external sound information collected by the information collecting unit 411 includes a cautionary sound. For this determination, an information table equivalent to the information table 114a of the cautionary sound shown in FIG. 5 is used.

  If the external sound includes a cautionary sound, the information acquisition determination unit 412a determines in the information collection unit 411 about the dangerous driving specified in the information table equivalent to the information table 122a illustrated in FIG. It is determined whether the driving information has been collected.

  When the cautionary sound is included in the external sound and the driving information related to the dangerous driving is collected, the information acquisition determining unit 412a may easily miss the cautionary sound in the external sound for the driver. It is determined that the sound is included. Then, the recognition unit 412b recognizes the generation source of the cautionary sound as a generation source of a sound that the driver easily misses.

  The generating unit 412c employs the source recognized by the recognizing unit 412b as the information about the sound that the driver easily misses, and the position information collected by the information collecting unit 411 together with the external sound information is included in the source. The individual correspondence information 211a is generated by associating the represented positions.

  In this embodiment, in this way, each time the external sound information, the position information, and the driving information are sent from each of the plurality of moving bodies 3 at regular intervals, the information generation unit 412 individually handles each of the moving bodies 3. Information 211a is repeatedly generated.

  Then, every time the number of generations of the individual correspondence information 211a in the information generation unit 412 reaches a predetermined number, the data creation unit 212 equivalent to the first embodiment performs the above-described statistical processing to generate the statistical correspondence information 221b. I do. By accumulating the statistical correspondence information 221b in the storage unit 220, data of the data structure 221 shown in FIGS. 3 and 4 is created.

  Next, an information processing method executed in the information acquisition processing device 320 will be described.

  FIG. 12 is a flowchart illustrating a flow of processing of an information processing method executed by the information acquisition processing device illustrated in FIG.

  The process of the information processing method represented by the flowchart of FIG. 11 is an information acquisition process of acquiring information for creating data to be stored in the storage unit 220 of the server 4. This information acquisition process starts when the navigation device of the mobile unit 3 is powered on.

  When the process starts, a sound acquisition step by the sound acquisition unit 112 is executed (step S311), a position acquisition step by the position acquisition unit 113 is executed (step S312), and a driving information acquisition step by the operation information acquisition unit 121 is executed. Is performed (step S313). These steps in this embodiment are equivalent to the sound acquisition step (step S121), the position acquisition step (step S122), and the driving information acquisition step (step S123) of the first embodiment shown in FIG. It is.

  Then, in the present embodiment, following these steps, an information output step by the information output unit 324 is executed (Step S314). In the information output step (step S314), the external sound information relating to the external sound acquired in the sound acquisition step (step S311) and the position information relating to the position acquired in the position acquisition step (step S312) are output to the server 2. You. Further, in the information output step (Step S314), the driving information acquired in the driving information acquisition step (Step S313) is also output to the server 2 together with the external sound information and the position information.

  After the information output process (step S314) ends, the process returns to step S311 and the subsequent processes are repeated.

  The information acquisition process represented by the flowchart of FIG. 12 is continuously executed until the power of the navigation device is turned off.

  An information processing program for causing a computer to execute the information processing method of the information acquisition process represented by the flowchart of FIG. 12 is stored in a storage medium of the navigation device or a storage medium of a vehicle-mounted computer device separate from the navigation device. I have. The storage medium for storing the information processing program is not limited to the storage medium of these devices, but may be a known portable storage medium or a storage medium installed in a server connected to these devices via a network. There may be.

  Next, a data creation method executed in the data creation device 410 of the server 4 will be described.

  FIG. 13 is a flowchart illustrating a flow of processing of a data creation method executed by the data creation apparatus illustrated in FIG.

  The process of the data creation method represented by the flowchart of FIG. 13 is a data creation process of collecting external sound information, position information, and driving information from a plurality of moving objects 3 and creating data to be stored in the storage unit 220. 4 starts when the power is turned on.

  When the process starts, an information collecting step by the information collecting unit 411 is executed (Step S411). In the information collecting step (step S411), the information collecting unit 411 collects external sound information, position information, and driving information from each mobile unit 1.

  Next, the information acquisition determining unit 412a determines whether the external sound represented by the external sound information collected in the information collecting step (Step S411) includes a cautionary sound (Step S412). For this determination, an information table similar to the information table 114a of the cautionary sound shown in FIG. 5 is used.

  When the cautionary sound is included in the external sound (Yes in Step S412), the information acquisition determining unit 412a determines whether or not driving information on dangerous driving has been acquired in the information collecting step (Step S411). (Step S413). In this determination, an information table similar to the dangerous driving information table 122a shown in FIG. 6 is referred to.

  If the driving information on the dangerous driving has been acquired (Yes in Step S413), the following information generation process is executed (Step 414). In the information generation step (step 414), the recognition unit 412b recognizes the source of the cautionary sound extracted in the process of step 412 as the source of the sound that is easily missed by the driver. Then, the generation unit 412c generates the individual correspondence information 211a by associating the generation source with the position of the moving object 1 represented by the position information collected in the information collection step (step S411).

  In the next process, a data creation process is performed by the data creation unit 212 (step S415). In the data creation step (step S415), the statistical processing described with reference to FIG. 7 is performed on the generated individual correspondence information 211a, and information on sounds that are statistically easy for the driver to miss is stored in the position or area. The associated statistical correspondence information 221b is generated. Further, in the data creation step (step S415), the generated statistical correspondence information 221b is sequentially stored in the storage unit 220. Thus, in the data creation step (step S415), data of the data structure 221 shown in FIGS. 3 and 4 is created.

  When the data creation step (Step S415) ends, the process returns to Step S411, and the subsequent processing is repeated.

  In the present embodiment, the data creation process represented by the flowchart in FIG. 13 is continuously executed until the power of the server 4 is turned off.

  In the present embodiment, a data creation program for causing a computer to execute the data creation processing represented by the flowchart of FIG. 13 is executed by a storage medium that forms a part of the storage unit 220 provided in the server 4, Are stored in a separate storage medium. The storage medium for storing the data creation program is not limited to the storage medium installed in the server 4, but may be installed in a known portable storage medium or another server connected to the server 4 via a network. Storage medium may be used.

  The information acquisition processing device 320 shown in FIG. 11, the information processing method of the information acquisition process shown in FIG. 12, and the information processing program, which are different from the first embodiment in the second embodiment described above. And effects of various storage media will be described.

  According to the information acquisition processing device 320 and the information processing method of the information acquisition processing of the present example, the external sound information relating to the sound outside the moving body 3, the driving information relating to both the behavior of the moving body 3 and the behavior of the driver, and the movement Position information on the position of the body is output to the server 4. As a result, the above-described various information can be provided to operations such as creating data in the server 4 for prompting the driver to pay attention to sounds that are easily overlooked. As described above, according to the present embodiment, it is possible to effectively assist the driver's auditory recognition of the situation outside the moving body 3.

  Further, according to the information processing program of the present embodiment, by causing the computer to execute the information processing method of the information acquisition processing described above, the driver's auditory recognition of the situation outside the moving body 3 can be effectively performed. Can be assisted.

  Further, according to the storage medium of the present embodiment, the above-described information processing method can be executed by a computer using the stored information processing program. As a result, it is possible to effectively assist the driver in audibly recognizing the situation outside the moving body 3.

  Next, a data creation device 410 shown in FIG. 11 having a difference from the first embodiment in the second embodiment, a data creation method of a data creation process shown in FIG. 13, a data creation program, and The effects of various storage media will be described.

  According to the data creation device 410 and the data creation method of the present embodiment, the individual correspondence information 211a in which the position or area where the sound is generated is associated with the information about the sound that is easily missed for the driver of each mobile unit 3 is generated. Is done. By the statistical processing on the individual correspondence information 211a, the statistical correspondence information in which the sound that the driver can easily overhear statistically, that is, the information about the sound that the unspecified number of drivers easily overhear is associated with the position or the area. 221b is created. Thereby, based on the data, it is possible to perform an operation such as appropriately calling the driver's attention when the moving body 3 is present at the position or the area associated with the sound that is easily missed. As described above, according to the present embodiment, it is possible to create data for effectively assisting the driver's auditory recognition of the situation outside the moving object 3.

  Further, according to the data creation program of the present embodiment, the above-described data creation processing is executed by a computer to effectively assist the driver's auditory recognition of the situation outside the moving body 3. Data can be created.

  Further, according to the storage medium of the present embodiment, the above-described data creation processing can be executed by a computer using the stored data creation program. This makes it possible to create data for effectively assisting the driver in audibly recognizing the situation outside the moving body 3.

  It should be noted that the present invention is not limited to the embodiments described above, but includes other configurations and the like that can achieve the object of the present invention, and the following modifications and the like are also included in the present invention.

  For example, in the above-described first and second embodiments, the moving bodies 1 and 3 as passenger cars are illustrated. However, the moving object is not limited to a passenger car, but may be a motorcycle, a large vehicle such as a truck or a bus, and does not matter the specific type of the moving object.

  In the above-described first and second embodiments, the alert processing device 110 and the information acquisition processing device 120 each include, as an example of the information processing device of the moving object, the components configured in the navigation device mounted on the moving object. , 320 are illustrated. However, the mobile information processing device is not limited to these, and may be a device in which a control unit is constructed in a computer provided separately from the navigation device.

1,3 moving body 2,4 server 110 alert processing device 111 data acquisition unit 112 sound acquisition unit 113 position acquisition unit 114 attention alert determination unit 114a, 122a information table 115 corresponding processing unit 115a playback unit 115b notification unit 116 first communication Units 120, 320 Information acquisition processing device 121 Operating information acquisition unit 122 Information acquisition determination unit 123 Recognition unit 124, 324 Information output unit 210, 410 Data creation device 211, 411 Information collection unit 211a Individual correspondence information 211a-1 First individual Correspondence information 211a-2 Second individual correspondence information 211a-3 Third individual correspondence information 211a-4 Fourth individual correspondence information 211a-5 Fifth individual correspondence information 211a-6 Sixth individual correspondence information 211a-7 Seventh individual correspondence information 211a-8 Eighth individual correspondence information 211 -9 Ninth individual correspondence information 211a-10 Tenth individual correspondence information 211a-11 Eleventh individual correspondence information 212 Data creation unit 213 Provision unit 214 Second communication unit 220 Storage unit 221 Data structure 221a Road network 221b Statistical Correspondence information 221b-1 First statistical correspondence information 221b-2 Second statistical correspondence information 221b-3 Third statistical correspondence information 221b-4 Fourth statistical correspondence information 221b-5 Fifth statistical Corresponding information 221c Node 221d Road link 221e Point 412 Information generation unit 412a Information acquisition determination unit 412b Recognition unit 412c Generation unit

Claims (8)

A sound acquisition unit for acquiring sound outside the moving object;
A position acquisition unit that acquires the position of the moving body,
A driving information acquisition unit that acquires driving information on at least one of the behavior of the moving body and the behavior of a driver of the moving body,
Based on the external sound and the driving information, a determining unit that determines whether or not the external sound includes a sound that is easily missed by a driver,
The position of the moving body or the area including the position obtained by the position obtaining unit when it is determined that the external sound includes a sound that is easily missed by the driver by the determining unit, and the driving An information output unit that outputs, to a predetermined information collection server, correspondence information in which information on sounds that are easily missed by a person is associated with the information,
An information processing apparatus comprising: Based on the external sound and the driving information, a recognition unit that recognizes a source of sound that the driver is likely to overlook,
The information processing apparatus according to claim 1, wherein the information about the sound that the driver easily misses is the source recognized by the recognition unit.   The determination unit is configured to extract, from the external sound acquired by the sound acquisition unit, a predetermined cautionary sound as a sound to which the driver should pay attention, and perform a dangerous driving by the driving information acquisition unit. 3. The information according to claim 1, wherein when the driving information related to the information is acquired, it is determined that the cautionary sound is included in the external sound as a sound that is easily missed by a driver. 4. Processing equipment.   The information processing apparatus according to claim 3, wherein the dangerous driving is a sudden braking as a behavior of the moving body.   The information processing apparatus according to claim 3, wherein the dangerous driving is a behavior of the driver indicating that the driver is not paying attention to the caution sound. A sound acquisition step of acquiring a sound outside the moving body,
A position acquisition step of acquiring the position of the moving body,
A driving information acquisition step of acquiring driving information on at least one of the behavior of the moving body and the behavior of the driver of the moving body,
Based on the external sound and the driving information, a determining step of determining whether or not the external sound includes a sound that is easily missed by a driver,
The position of the moving body or the area including the position obtained by the position obtaining unit when it is determined in the determining step that the external sound includes a sound that the driver easily misses, and the driving An information output step of outputting, to a predetermined information collection server, correspondence information in which information relating to a sound that is easily missed by a person,
An information processing method comprising:   An information processing program for causing a computer to execute the information processing method according to claim 6.   A storage medium storing the information processing program according to claim 7.

Images