JP7041700B2 - Information processing equipment, information processing methods and information processing programs - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method and an information processing program.

A technique for warning when a vehicle approaches a mobile speed-violation automatic control device (hereinafter referred to as a control device) is disclosed.

Japanese Patent No. 6100466

However, the above-mentioned conventional technique merely issues an alarm based on the position information when the speed detection wave emitted from the control device is detected while the vehicle is running. In the above-mentioned conventional technique, a radar detector that is not owned by the user is generally required in order to detect the speed detection wave. In addition, with the above-mentioned conventional technology, it is not possible to find a warning target (flooded / frozen road surface, collapsed / collapsed part, fallen object, accident site, etc.) other than the control device.

The present application has been made in view of the above, and an object thereof is to discover and share information on various warning targets in the progress of a moving body.

The information processing device according to the present application is an information processing device mounted on a moving body, and includes a photographing unit that captures a warning target on the progress of the moving body discovered by image analysis by AI while the moving body is in progress. A creation unit that creates data related to the moving object progress warning target according to an operation performed by the user after confirming the image of the moving body progress warning target, and the moving body progress warning target. The photographing unit includes a transmitting unit that transmits data related to the outside, and a receiving unit that receives the result of machine learning using the data related to the warning target on the progress of the moving object from the outside, and the photographing unit receives the data from the outside. The result of machine learning is reflected in the AI, and the creation unit responds to the operation performed by the user after confirming the image of the warning target on the movement of the moving body. Among them, it is characterized by excluding the warning targets that are considered to be appropriate and identifying the warning targets that are considered to be appropriate.

According to one aspect of the embodiment, it is possible to discover and share information on various warning targets in the progress of the mobile body.

FIG. 1 is an explanatory diagram showing an outline of an information processing method according to an embodiment. FIG. 2 is a diagram showing a configuration example of an information processing system according to an embodiment. FIG. 3 is a diagram showing a configuration example of the terminal device according to the embodiment. FIG. 4 is a diagram showing a configuration example of the information processing apparatus according to the embodiment. FIG. 5 is a diagram showing an example of a user database. FIG. 6 is a diagram showing an example of a caution target database. FIG. 7A is a flowchart showing a processing procedure for finding a warning target by the terminal device. FIG. 7B is a flowchart showing a processing procedure related to an alarm by the terminal device. FIG. 8 is a flowchart showing a processing procedure by the information processing apparatus. FIG. 9 is a diagram showing an example of a hardware configuration.

Hereinafter, the information processing apparatus, the information processing method, and the embodiment for implementing the information processing program (hereinafter referred to as “the embodiment”) according to the present application will be described in detail with reference to the drawings. It should be noted that this embodiment does not limit the information processing apparatus, information processing method, and information processing program according to the present application. Further, in the following embodiments, the same parts are designated by the same reference numerals, and duplicate description is omitted.

[1. Overview of information processing method]
First, with reference to FIG. 1, an outline of an information processing method performed by the information processing apparatus according to the embodiment will be described. FIG. 1 is an explanatory diagram showing an outline of an information processing method according to an embodiment. In addition, in FIG. 1, a warning target on vehicle driving is discovered from an image captured while driving by a drive recorder or the like, the user confirms the found warning target, and then information on the warning target is transmitted between users. The case of sharing information will be described as an example.

As shown in FIG. 1, the information processing system 1 includes a terminal device 10 and an information processing device 100. The terminal device 10 and the information processing device 100 are connected to each other via a network N (see FIG. 2) so as to be able to communicate with each other by wire or wirelessly.

The terminal device 10 is an information processing device such as a smartphone used by the user U, activates a navigation application (hereinafter referred to as an application), and performs a program function, data, etc. via an API (Application Programming Interface). Is called from the information processing apparatus 100 and used.

Here, a car navigation application will be described as an example as a navigation application. The navigation application may be a map application. For example, a map app may have a navigation function.

The information processing device 100 is an information processing device that provides API services and the like for various applications and the like and various data to the terminal device 10 of each user U. For example, the information processing device 100 provides a car navigation application operating on the terminal device 10 of the user U with functions such as map display, store / facility search, route search, and POI (Point Of Interest) search.

The user U gets into the vehicle C together with the terminal device 10, activates the car navigation application on the terminal device 10, and drives the vehicle C. The user U may be a passenger of the vehicle C. For example, the user U may be sitting in the passenger seat or the like when another person takes over or takes over the driving of the vehicle C.

In this embodiment, the car navigation application is equipped with a drive recorder function. The terminal device 10 activates this car navigation application, and uses the drive recorder function to photograph the road surface, the road shoulder, and the like in front of the vehicle C (in the direction of travel) while the vehicle C is traveling. The drive recorder function may be a simple one.

For example, the terminal device 10 of the user U uses the drive recorder function of the car navigation application to take a picture by using the camera function of the terminal device 10 itself. Alternatively, the terminal device 10 is mounted on the vehicle C via a short-range wireless communication such as Bluetooth (registered trademark) or a wireless LAN (Local Area Network) or a wired communication by a cable or the like by the drive recorder function of the car navigation application. In cooperation with the actual drive recorder, data such as a captured image may be acquired.

Here, instead of the terminal device 10 currently used by the user U, an old terminal device 10 that is not currently used (for example, before the model change) may be used as a drive recorder by a drive recorder application or the like. In this case, the terminal device 10 currently in use is an old terminal device 10 via a short-range wireless communication such as Bluetooth (registered trademark) or a wireless LAN, or a wired communication by a cable or the like by the drive recorder function of the car navigation application. In cooperation with the old terminal device 10, data such as a captured image is acquired from the old terminal device 10.

In the example shown in FIG. 1, the user U1 and the user U2 are shown as the user U. Further, as the terminal device 10, the terminal device 10A used by the user U1 and the terminal device 10B used by the user U2 are shown. Further, as the vehicle C, a vehicle C1 driven by the user U1 and a vehicle C2 driven by the user U2 are shown.

In the following description, when it is not necessary to distinguish between the user U1 and the user U2, the user U is collectively referred to as the user U. Similarly, when it is not necessary to particularly distinguish between the terminal device 10A and the terminal device 10B, the terminal device 10 is collectively referred to as the terminal device 10. Further, when it is not necessary to distinguish between the vehicle C1 and the vehicle C2, the vehicle C is collectively referred to as the vehicle C.

For example, as shown in FIG. 1, the user U1 gets into the vehicle C1 together with the terminal device 10A, installs (fixes) the terminal device 10A in the vehicle of the vehicle C1, and activates the car navigation application on the terminal device 10A (. Step S1).

The terminal device 10A is installed so as to be able to photograph the front of the vehicle C1. The terminal device 10A may be installed in the vehicle C1 in advance.

At this time, the user U1 operates the terminal device 10A, inputs a destination into the car navigation application, and searches for a route to the destination by the navigation function.

The user U1 operates the terminal device 10A to start guiding to the destination by the navigation function of the car navigation application, and then drives the vehicle C1 to drive the vehicle C1 (step S2).

On the map of the car navigation application, the position of a fixed speed violation automatic control device (hereinafter referred to as a control device) whose existence is already known at the present time is clearly indicated on the route on which the vehicle C1 is scheduled to travel.

The terminal device 10A uses the drive recorder function of the car navigation application to photograph the road surface, the road shoulder, and the like in front of the vehicle C1 included in the photographing range R1 while the vehicle C1 is traveling (step S3).

The navigation function of the car navigation application and the drive recorder function may be linked to each other. For example, shooting by the drive recorder function may be started at the same time as the guidance by the navigation function is started, and shooting by the drive recorder function may be finished at the same time as the guidance is finished. Further, the shooting position and shooting date / time of the image in the drive recorder function may be associated with the position on the map in the navigation function.

Further, the terminal device 10A exists on the road or shoulder in front of the vehicle C1 included in the shooting range R1 by image analysis by AI (Artificial Intelligence) or the like in the drive recorder function of the car navigation application. You may find a warning target that is not yet displayed on the map and meets certain conditions. The predetermined conditions may be arbitrarily set. Then, the terminal device 10A may issue an alarm when it finds a warning target.

Further, the terminal device 10A may shoot a warning target found by image analysis by AI or the like by the drive recorder function of the car navigation application, and save the image together with the shooting position and the shooting date and time. The image to be watched may be a moving image or a still image. Alternatively, in the image being captured by the drive recorder function, a mark (mark) may be added by AI or the like when the warning target is discovered so that the user U1 can later determine the warning target.

The user U1 operates the terminal device 10A while the vehicle is stopped or after the operation of the vehicle C1 is completed (that is, in a situation where the user U1 is not driving) to check the image taken while the vehicle C1 is traveling. (Step S4).

When the user U1 is a passenger of the vehicle C and is sitting in the passenger seat or the like (when he / she is not always driving), he / she may check the image taken while the vehicle C1 is traveling at any time. For example, when the user U1 discovers (visually recognizes) the control device, the image taken while the vehicle C1 is traveling may be confirmed.

At this time, the image confirmed by the user U1 may be an image of all the routes traveled by the vehicle C from the start of driving to that time, or an image of a caution target found by image analysis by the above AI or the like. It may be.

In the present embodiment, in order to confirm the image taken while the vehicle C1 is running by the user U1, the presence and control of the control device and the control are not performed at the position when the vehicle detects the speed detection wave emitted from the control device. You can visually confirm the installation location of the device.

The user U1 operates the terminal device 10A to be wary of the vehicle running, which is included in the image taken while the vehicle C1 is running (control device, flooded / frozen road surface, collapsed / collapsed part, falling object, accident). Specify the site, inspection, etc. (step S5).

For example, the user U1 marks (or marks) an object or location that is considered to be a warning target when the vehicle is running by designating (or specifying a range) with a finger or a cursor in the image displayed on the terminal device 10A. ) May be added.

Further, the user U1 operates the terminal device 10A to confirm whether the warning target found by the above image analysis by AI or the like is appropriate as the warning target for vehicle driving, and the warning target that is considered to be invalid. May be excluded to identify what seems to be a valid alert.

In addition, as a warning target when driving a vehicle, not only dangerous objects and dangerous situations, but also places with a good view (view spots) where visibility suddenly opens and landmarks and beautiful scenery can be seen well, signboards of conspicuous advertisements, etc. You may specify the place where is appearing. In a broad sense, it can be said to be a warning target when driving a vehicle in that the driver is fascinated (there is a possibility of inattentive driving).

At this time, the user U1 operates the terminal device 10A to set the position of the warning target on the vehicle running as a POI on the map of the car navigation application, and gives the name of the warning target, a comment about the warning target, and the like. Enter to create POI data. Then, the image data taken by the drive recorder function and the created POI data are combined to create data related to the warning target on the vehicle running.

The terminal device 10A of the user U1 transmits data regarding a warning target on vehicle travel to the information processing device 100 (step S6).

The information processing device 100 collects and accumulates data related to a warning target on vehicle travel from the terminal device 10 of each user U (step S7).

That is, the information processing device 100 receives data on the warning target on vehicle travel not only from the terminal device 10A of the user U1 but also from the terminal device 10 of each user U who has traveled the vehicle C in the same manner as the user U1. collect.

The information processing device 100 may be able to input / change comments and the like regarding the warning target included in the data regarding the warning target on the vehicle running from the terminal device 10 of each user U after the fact.

The information processing apparatus 100 performs machine learning on the accumulated data regarding the warning target on the vehicle running (step S8).

The greater the number of stored data (eg, the number of captured images, etc.), the better the accuracy of machine learning. Therefore, it is preferable to perform machine learning not with the terminal device 10 of each user U but with the information processing device 100 capable of collecting a large number of data from a large number of people.

At this time, as a result of machine learning, the information processing apparatus 100 creates a learning model about the relationship between the captured image and the warning target on the vehicle running. Further, the information processing apparatus 100 extracts highly accurate data (for example, highly reliable data) from the collected data regarding the warning target on the vehicle running based on the learning model.

Here, when the information processing device 100 performs a route search to the destination input to the car navigation application of the terminal device 10 of each user U, the purpose is based on highly accurate data regarding the warning target on the vehicle running. You may decide the route to the ground.

Actually, the data on the warning target on the vehicle running listed by a large number of users U may be used as highly accurate data on the warning target on the vehicle running. Further, all of the accumulated data regarding the warning target in vehicle running may be used as highly accurate data regarding the warning target in vehicle running.

The information processing device 100 provides the terminal device 10A of the user U1 with highly accurate data regarding a warning target on vehicle travel (step S9).

The terminal device 10A of the user U1 reflects highly accurate data regarding the warning target on the vehicle running on the map of the car navigation application (step S10).

At this time, the information processing apparatus 100 may provide the created learning model together with the highly accurate data to the terminal apparatus 10A of the user U1. Then, the terminal device 10A of the user U1 reflects this learning model in the drive recorder function of the car navigation application, the above AI, and the like, and based on this learning model, the image analysis by the above AI and the like is performed. good. As a result, the performance of image analysis by the above AI or the like is cumulatively improved.

Further, the user U2, which is different from the user U1, gets into the vehicle C2 together with the terminal device 10B, installs (fixes) the terminal device 10B in the vehicle of the vehicle C2, and activates the car navigation application on the terminal device 10B (). Step S11).

At this time, the user U2 operates the terminal device 10B, inputs the destination into the car navigation application, and searches for a route to the destination by the navigation function.

As a result of the route search, the information processing apparatus 100 provides the terminal apparatus 10B of the user U2 with highly accurate data regarding the warning target in the vehicle traveling together with the route to the destination (step S12).

The timing of providing the information processing device 100 to the terminal device 10B of the user U2 regarding the warning target on the vehicle running may be when the car navigation application is started, or is applicable on the map of the car navigation application. It may be the timing when the warning target on the vehicle running is displayed.
The terminal device 10B of the user U2 reflects highly accurate data regarding the warning target on the vehicle running on the map of the car navigation application (step S13).

For example, the terminal device 10B of the user U2 is a warning target on the vehicle running in a format that the user U2 can visually recognize on the map of the car navigation application based on highly accurate data on the warning target on the vehicle running. Display information indicating existence.

The user U2 drives the vehicle C2 and drives the vehicle C2 after the terminal device 10B starts guiding to the destination by the navigation function of the car navigation application (step S14).

The terminal device 10B uses the drive recorder function of the car navigation application to photograph the road surface, the road shoulder, and the like in front of the vehicle C2 included in the photographing range R2 while the vehicle C2 is traveling (step S15).

That is, the terminal device 10B of the user U2 also performs the same operation as the terminal device 10A of the user U1 by the drive recorder function of the car navigation application.

The terminal device 10B of the user U2 confirms the place where the warning target in the vehicle running exists based on the highly accurate data regarding the warning target in the vehicle running (step S15).

At this time, the terminal device 10B of the user U2 compares the current position of the vehicle C2 with the position of the warning target on the map of the car navigation application based on highly accurate data regarding the warning target on the vehicle running, and the vehicle. It is confirmed whether or not the current position of C2 is in front of the position to be watched by a predetermined distance (step S16).

The terminal device 10B of the user U2 issues an alarm in front of a place where a warning target for vehicle traveling exists (step S17).

At this time, the terminal device 10B of the user U2 displays the alarm screen WA shown in FIG. 1 in the car navigation application and issues an alarm.

For example, if the warning target for vehicle driving is a fixed / mobile control device, or a flooded / frozen road surface where hydroplaning phenomenon or slippage is likely to occur, the warning target should be watched. To prevent the vehicle C from passing through the area at high speed, the warning screen WA1 indicating the area to be watched is displayed, and a message such as "It is a speed caution area" is output by voice to warn. The content of the message is arbitrary. The specific content of the warning target may be output by voice to warn.

In addition, when the object of caution when driving the vehicle is "a collapsed / collapsed place, a falling object, an accident site, an inspection, etc.", an alarm screen WA2 indicating a specific place is displayed, and "a point to watch out for soon". A message such as "is" is output as a voice to warn. Here, for example, when the specific location of the mobile control device can be specified, the alarm screen WA2 indicating the specific location is displayed, and a specific location such as "There will be a mobile control device soon". Message may be output by voice to warn.

Further, when the vehicle C2 is compatible with Advanced Driver Assistance Systems (ADAS), automatic driving, etc., the terminal device 10B of the user U2 is close to Bluetooth (registered trademark), wireless LAN, or the like. The vehicle C2 may be decelerated or avoided (lane change, stop, etc.) in cooperation with the vehicle C2 via distance wireless communication or wired communication using a cable or the like. ..

Even when using an advanced driver assistance system or automatic driving, vehicle C suddenly slows down or behaves unnaturally without warning to the user U who is on board without notifying the existence of the warning target. If you go, the user U may be surprised and worried about something, so there is a demand to issue an alarm.

Here, when the terminal device 10B of the user U2 does not show the warning target on the vehicle running that caused the warning in the image taken by the drive recorder function of the car navigation application when the warning is issued. Is determined that the warning target on the vehicle running has disappeared, and requests the information processing apparatus 100 to delete the data related to the warning target on the vehicle running (step S18).

At this time, when the information processing apparatus 100 receives a request from a plurality of users (more than a predetermined number of people) to delete the data related to the warning target on the vehicle running, the information processing apparatus 100 obtains the data related to the warning target on the vehicle running. delete.

Further, the information processing apparatus 100 sets an expiration date for the data related to the warning target on the vehicle running, and automatically deletes the data related to the warning target on the vehicle running when the expiration date has expired. For example, the information processing apparatus 100 automatically deletes the data on the warning target on the vehicle running when a predetermined period has elapsed from the time when the data on the warning target on the vehicle running is registered.

Further, when the terminal device 10B of the user U2 shows the warning target on the vehicle running that caused the warning in the image taken by the drive recorder function of the car navigation application when the warning is issued. (Step S19) transmits the latest data regarding the warning target on the vehicle travel to the information processing device 100, and updates the data regarding the warning target on the vehicle travel (step S19). As a result, the expiration date of the data regarding the warning target for vehicle driving is updated / extended.

[2. Information processing system configuration example]
Next, the configuration of the information processing system 1 including the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the information processing system 1 according to the embodiment. As shown in FIG. 2, the information processing system 1 according to the embodiment includes a terminal device 10 and an information processing device 100. These various devices are connected so as to be communicable by wire or wirelessly via the network N. The network N is, for example, a LAN (Local Area Network) or a WAN (Wide Area Network) such as the Internet.

Further, the number of each device included in the information processing system 1 shown in FIG. 2 is not limited to that shown in the figure. For example, in FIG. 2, for simplification of the illustration, only one terminal device 10 is shown, but this is merely an example and is not limited, and may be two or more.

The terminal device 10 is an information processing device used by the user U. For example, the terminal device 10 is a smart device such as a smartphone or tablet terminal, a feature phone, a PC (Personal Computer), a PDA (Personal Digital Assistant), a car navigation system, a wearable device such as a smart watch or a head-mounted display (Wearable Device). , Smart glasses, etc.

Further, the terminal device 10 includes a wireless communication network such as LTE (Long Term Evolution), 4G (4th Generation), 5G (5th Generation: 5th generation mobile communication system), Bluetooth (registered trademark), and wireless LAN (Local). It can be connected to the network N via short-range wireless communication such as Area Network) and communicate with the information processing apparatus 100.

The information processing device 100 is, for example, a PC, a server, a mainframe, a workstation, or the like. The information processing device 100 may be realized by cloud computing.

[3. Configuration example of terminal device]
Next, the configuration of the terminal device 10 will be described with reference to FIG. FIG. 3 is a diagram showing a configuration example of the terminal device 10. As shown in FIG. 3, the terminal device 10 includes a communication unit 11, a display unit 12, an input unit 13, a positioning unit 14, a voice output unit 15, a sensor unit 20, and a control unit 30 (controller). , A storage unit 40 is provided.

(Communication unit 11)
The communication unit 11 is connected to the network N (see FIG. 2) by wire or wirelessly, and transmits / receives information to / from the information processing apparatus 100 via the network N. For example, the communication unit 11 is realized by a NIC (Network Interface Card), an antenna, or the like.

(Display unit 12)
The display unit 12 is a display device that displays various information such as position information. For example, the display unit 12 is a liquid crystal display (LCD) or an organic EL display (Organic Electro-Luminescent Display). Further, the display unit 12 is a touch panel type display, but the display unit 12 is not limited thereto.

(Input unit 13)
The input unit 13 is an input device that receives various operations from the user U. The input unit 13 has, for example, a button for inputting characters, numbers, and the like. When the display unit 12 is a touch panel type display, a part of the display unit 12 functions as an input unit 13. The input unit 13 may be a microphone or the like that receives voice input from the user U. The microphone may be wireless.

(Positioning unit 14)
The positioning unit 14 receives a signal (radio wave) transmitted from a GPS (Global Positioning System) satellite, and based on the received signal, position information (for example, latitude) indicating the current position of the terminal device 10 which is its own device. And longitude). That is, the positioning unit 14 positions the terminal device 10. GPS is only an example of GNSS (Global Navigation Satellite System).

(Audio output unit 15)
The voice output unit 15 is a voice output device that outputs various voice information such as a beep sound and a message. For example, the audio output unit 15 is realized by a speaker, an audio terminal (headphone terminal), or the like. The speaker may be wireless.

In addition, the positioning unit 14 can position the position by various methods other than GPS. For example, the positioning unit 14 may position the position by using various communication functions of the terminal device 10 as an auxiliary positioning means for position correction or the like as described below.

(Wi-Fi positioning)
For example, the positioning unit 14 positions the position of the terminal device 10 by using the Wi-Fi (registered trademark) communication function of the terminal device 10 or the communication network provided by each communication company. Specifically, the positioning unit 14 determines the position of the terminal device 10 by performing Wi-Fi communication or the like and measuring the distance to a nearby base station or access point.

(Beacon positioning)
Further, the positioning unit 14 may position the position by using the Bluetooth (registered trademark) function of the terminal device 10. For example, the positioning unit 14 positions the terminal device 10 by connecting to a beacon transmitter connected by the Bluetooth function.

(Geomagnetic positioning)
Further, the positioning unit 14 positions the position of the terminal device 10 based on the geomagnetic pattern of the structure measured in advance and the geomagnetic sensor included in the terminal device 10.

(RFID positioning)
Further, for example, when the terminal device 10 has an RFID (Radio Frequency Identification) tag function equivalent to a contactless IC card used in a station ticket gate, a store, or the like, or has a function of reading an RFID tag. In this case, the used position is recorded together with the information that the payment or the like has been made by the terminal device 10. The positioning unit 14 may position the position of the terminal device 10 by acquiring such information. Further, the position may be determined by an optical sensor included in the terminal device 10, an infrared sensor, or the like.

The positioning unit 14 may position the position of the terminal device 10 by using one or a combination of the above-mentioned positioning means, if necessary.

(Sensor unit 20)
The sensor unit 20 includes various sensors mounted on the terminal device 10. In the example shown in FIG. 3, the sensor unit 20 includes an acceleration sensor 21, a gyro sensor 22, a pressure sensor 23, a temperature sensor 24, a sound sensor 25, an optical sensor 26, a step count sensor 27, and an image sensor ( It is equipped with a camera) 28.

It should be noted that the above-mentioned sensors 21 to 28 are merely examples and are not limited thereto. That is, the sensor unit 20 may be configured to include a part of the sensors 21 to 28, or may include other sensors such as a humidity sensor in addition to or in place of the sensors 21 to 28. ..

The acceleration sensor 21 is, for example, a 3-axis acceleration sensor, and detects the moving direction, speed, acceleration, and other physical movements of the terminal device 10. The gyro sensor 22 detects the physical movement of the terminal device 10 such as the inclination in the triaxial direction based on the angular velocity of the terminal device 10 and the like. The barometric pressure sensor 23 detects, for example, the barometric pressure around the terminal device 10.

Since the terminal device 10 includes the above-mentioned acceleration sensor 21, gyro sensor 22, pressure sensor 23, etc., technologies such as pedestrian autonomous navigation (PDR) using each of these sensors 21 to 23, etc. It becomes possible to determine the position of the terminal device 10 by using. This makes it possible to acquire indoor position information, which is difficult to acquire with a positioning system such as GPS.

The air temperature sensor 24 detects, for example, the air temperature around the terminal device 10. The sound sensor 25 detects, for example, the sound around the terminal device 10. The optical sensor 26 detects the illuminance around the terminal device 10. The step sensor 27 detects the number of steps of the user U. The image sensor 28 captures an image of the surroundings of the terminal device 10.

The barometric pressure sensor 23, the temperature sensor 24, the sound sensor 25, the optical sensor 26, and the image sensor 28, respectively, detect the barometric pressure, the temperature, the sound, and the illuminance, and capture an image of the surroundings, so that the terminal device 10 It is possible to detect the surrounding situation of the. This makes it possible to improve the accuracy of the position information of the terminal device 10 from the surrounding conditions of the terminal device 10.

(Control unit 30)
The control unit 30 includes, for example, a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM, an input / output port, and various circuits. Further, the control unit 30 may be configured by hardware such as an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 30 includes a transmission unit 31, a reception unit 32, a processing unit 33, and an alarm unit 34.

(Transmitting unit 31)
The transmission unit 31 is, for example, various information input by the user U using the input unit 13, various information detected by the sensors 21 to 28 mounted on the terminal device 10, and a terminal positioned by the positioning unit 14. The position information of the device 10, the information generated by the processing unit 33 described later, and the like can be transmitted to the information processing device 100 via the communication unit 11.

(Receiver 32)
The receiving unit 32 can receive various information related to the Web service provided from the information processing device 100 and a request for location information from the information processing device 100 via the communication unit 11.

(Processing unit 33)
The processing unit 33 controls the entire terminal device 10 including the display unit 12 and the like. For example, the processing unit 33 can output and display various information related to the Web service received by the receiving unit 32 to the display unit 12.

Further, the processing unit 33 displays the alarm screen WA shown in FIG. 1 on the display unit 12. At this time, the processing unit 33 may display the name and explanation of the warning target on the vehicle running, a message indicating the specific content of the warning, and the like on the display unit 12 together with the warning screen WA.

(Alarm unit 34)
The alarm unit 34 issues an alarm via the voice output unit 15. For example, when the alarm screen WA shown in FIG. 1 is displayed on the display unit 12, the alarm unit 34 outputs a beep sound, a message, or the like from the voice output unit 15 and issues an alarm to the user U.

(Memory unit 40)
The storage unit 40 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or an optical disk. To. Various programs, various data, and the like are stored in the storage unit 40.

[4. Configuration example of information processing device]
Next, the configuration of the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 4 is a diagram showing a configuration example of the information processing apparatus 100 according to the embodiment. As shown in FIG. 4, the information processing apparatus 100 includes a communication unit 110, a storage unit 120, and a control unit 130.

(Communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. Further, the communication unit 110 is connected to the network N (see FIG. 2) by wire or wirelessly.

(Memory unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or an optical disk. To. As shown in FIG. 4, the storage unit 120 has a user database 121, a map database 122, and a caution target database 123.

(User database 121)
The user database 121 stores various information about the user U. For example, the user database 121 stores various information such as the attributes of the user U. FIG. 5 is a diagram showing an example of the user database 121. In the example shown in FIG. 5, the user database 121 has items such as "user ID (Identifier)", "age", "gender", "home", "work location", "vehicle", and "driving history". Has.

The "user ID" indicates identification information for identifying the user U. The "user ID" may be identification information for identifying the terminal device 10 of each user U, or identification information for identifying the car navigation application installed in each terminal device 10. You may.

Further, "age" indicates the age of the user U identified by the user ID. The "age" may be a specific age of the user U identified by the user ID, for example, 35 years old. Further, "gender" indicates the gender of the user U identified by the user ID.

Further, "home" indicates the location information of the home of the user U identified by the user ID. In the example shown in FIG. 5, "home" is illustrated with an abstract reference numeral such as "LC11", but may be latitude / longitude information or the like. Further, for example, "home" may be a region name or an address.

Further, the "work location" indicates the location information of the work location (school in the case of a student) of the user U identified by the user ID. In the example shown in FIG. 5, the “work location” is illustrated with an abstract code such as “LC12”, but may be latitude / longitude information or the like. Further, for example, the "work location" may be a region name or an address.

Further, the "vehicle" indicates various information regarding the vehicle C on which the user U identified by the user ID is boarded. For example, "vehicle" indicates the name, vehicle type, model, model year, mileage, etc. of vehicle C. Further, the "driving history" indicates the driving history of the user U identified by the user ID. It is expected that the target and degree of caution will differ depending on the driving history.

For example, in the example shown in FIG. 5, the age of the user U identified by the user ID "U1" is "20's", and the gender is "male". Further, the user U identified by the user ID "U1" indicates that the home is "LC11". Further, the user U identified by the user ID "U1" indicates that the work location is "LC12". Further, the user U identified by the user ID "U1" indicates that he / she gets on the vehicle C represented by "vehicle # 1". Further, it is shown that the user U identified by the user ID "U1" has a driving history indicated by "driving history # 1".

Here, in the example shown in FIG. 5, although illustrated using abstract values such as "U1", "LC11", "LC12", "vehicle # 1" and "driving history # 1", "U1", Information such as specific character strings and numerical values shall be stored in "LC11", "LC12", "vehicle # 1" and "driving history # 1". Hereinafter, abstract values may be illustrated also in figures relating to other information.

The user database 121 is not limited to the above, and various information may be stored depending on the purpose. For example, the user database 121 has attributes such as demographic (demographic attribute), psychographic (psychological attribute), geographic (geographical attribute), and behavioral (behavioral attribute) of user U. May remember information about. In addition, the user database 121 includes name, family structure, occupation, position, income, qualification, living style (detached house, apartment, etc.), commuting time, commuting route, commuter pass section (station, route, etc.). , Frequently used stations (other than the nearest station to your home / work location), activity history (frequently used location information), hobbies, interests, lifestyle, etc. may be stored. In addition, the user database 121 may store information regarding whether or not park-and-ride, car-sharing, rental cars, etc. are used around the station.

(Map database 122)
The map database 122 stores various information related to map contents (map information). In addition, the map database 122 stores various information related to the map service by the map API. Since the map database 122 can be realized with an existing map database, the illustration is omitted.

The map database 122 is not limited to the above, and various information may be stored depending on the purpose. For example, when the map content 122 is divided into areas or predetermined blocks, the map database 122 may store the "map ID" as the identification information for identifying each of the divided map contents. In this case, the "map ID" is given to each map content.

(Caution target database 123)
The alert target database 123 stores various information regarding the alert target on vehicle traveling found by the terminal device 10 of the user U. FIG. 6 is a diagram showing an example of the alert target database 123. In the example shown in FIG. 6, the alert target database 123 has the "user ID", "departure point", "destination", "movement date and time", "alert target", "shooting date and time", "type", and " It has items such as "position" and "comment".

The "user ID" indicates identification information for identifying the user U. The "user ID" may be identification information for identifying the terminal device 10 of each user U, or identification information for identifying the car navigation application installed in each terminal device 10. You may.

Further, the "departure place" indicates the departure place in the route search input by the user U. For example, the "departure place" indicates the current position of the user U, the place where the user U searches for a route, and the place where the user U starts driving the vehicle C (location of the vehicle C, etc.). The "departure place" may be the "home" or "work place" of the user U.

Further, the "destination" indicates a destination in the route search entered by the user U. For example, the "destination" indicates a destination aimed at by the user U and a place where the user U can stop or park (parking lot, etc.). The "destination" may be the "home" or "work location" of the user U.

Further, the "movement date and time" indicates the date and time when the user U has moved from the "departure place" to the "destination". For example, "travel date and time" indicates the departure date and time of the departure place and the arrival date and time of the destination.

Further, the "warning target" indicates a warning target for vehicle running, which is photographed by the drive recorder function of the car navigation application of the terminal device 10 of the user U and is specified by the user U. For example, "warning target" indicates a file ID of an image of a warning target while the vehicle is running. Further, the "shooting date and time" indicates the date and time when the warning target on the vehicle running was photographed.

Further, the "type" indicates the type of the warning target when the vehicle is running. For example, "type" indicates specific contents such as a control device, a flooded / frozen road surface, a depressed / collapsed part, a falling object, an accident site, and an inspection.

Further, the "position" indicates the position of the warning target on the vehicle running on the map of the car navigation application. For example, the "position" may be latitude / longitude information or the like.

Further, the "comment" indicates a comment entered by the user U regarding the warning target when the vehicle is running. The "comment" may be an explanation of the object of caution when the vehicle is running.

For example, in the example shown in FIG. 6, the user U identified by the user ID "U1" travels from the departure point "departure point # 1" to the destination "destination # 1", and the travel date and time "travel date and time # 1". Indicates that the vehicle C has been driven. Further, it indicates that the warning target "warning target # 1" on the vehicle running specified by the user U identified by the user ID "U1" was shot at the shooting date and time "shooting date and time # 1". In addition, the warning target "warning target # 1" in vehicle driving is a type "control device", exists at the position "position # 1" on the map of the car navigation application, and is accompanied by a comment "comment # 1". Indicates that you are.

Here, in the alert target database 123, a character string or numerical value for identifying the user U or the alert target for vehicle running, a character string or numerical value for identifying the departure point or the destination, and a movement are actually stored in the alert target database 123. Information such as specific numerical values indicating the date and time and the shooting date and time is registered.

The alert target database 123 is not limited to the above, and various information may be stored depending on the purpose. For example, the alert target database 123 may store information indicating a period (expiration date) during which the alert target for vehicle traveling is displayed on the map of the car navigation application. Further, the alert target database 123 may store information indicating the content of the message issued as an alarm.

(Control unit 130)
Returning to FIG. 4, the explanation will be continued. The control unit 130 is a controller, and is an information processing device 100 using, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like. It is realized by executing various programs (corresponding to an example of an information processing program) stored in the internal storage device using a storage area such as a RAM as a work area. In the example shown in FIG. 4, the control unit 130 has a reception unit 131, an acquisition unit 132, a learning unit 133, and a provision unit 134.

(Reception Department 131)
The reception unit 131 receives the registration of various information about each user U from the terminal device 10 of each user U via the communication unit 110, and stores it in the user database 121.

(Acquisition unit 132)
The acquisition unit 132 acquires data related to the warning target during vehicle travel from the terminal device 10 of each user U via the communication unit 110, and stores the data in the warning target database 123.

At this time, the terminal device 10 of each user U discovers a warning target on vehicle traveling from an image captured during traveling by the drive recorder function of the car navigation application. Each user U operates the terminal device 10 to set the position of the warning target on the vehicle running as a POI on the map of the car navigation application, and inputs the name of the warning target, a comment about the warning target, and the like. And create POI data. Then, the image data taken by the drive recorder function and the created POI data are combined to create data related to the warning target on the vehicle running.

(Learning Department 133)
The learning unit 133 performs machine learning on the data related to the warning target on the vehicle running stored in the warning target database 123, and generates a learning model as a result of the machine learning.

Machine learning is, for example, deep learning (deep learning) using a deep neural network (DNN). Data mining and other machine learning algorithms may also be used.

(Providing section 134)
The providing unit 134 extracts highly accurate data from the data related to the warning target on vehicle running based on the learning model, and relates the warning target on vehicle running to the terminal device 10 of each user U. Providing highly accurate data.

At this time, the providing unit 134 provides the terminal device 10 of each user U with highly accurate data regarding the warning target in vehicle running and data regarding an alarm issued by the terminal device 10 at the place where the warning target exists. May be provided. The data related to the alarm is, for example, data related to the timing of issuing the alarm (before XX m, etc.) and the content of the message issued as the alarm. The timing at which the warning is issued may be changed according to the traveling speed (vehicle speed) and the congestion situation (traffic jam, etc.).

[5. Processing procedure]
Next, the processing procedure by the terminal device 10 and the information processing device 100 according to the embodiment will be described with reference to FIGS. 7A, 7B, and 8. 7A, 7B and 8 are flowcharts showing the processing procedure according to the embodiment.

[5-1. Processing procedure for finding a warning target by the terminal device]
First, a processing procedure by the terminal device 10 according to the embodiment will be described with reference to FIG. 7A. FIG. 7A is a flowchart showing a processing procedure for finding a warning target by the terminal device 10. The processing procedure shown below is repeatedly executed by the control unit 30 of the terminal device 10.

Here, the terminal device 10 is installed so as to be able to photograph the front of the vehicle C. For example, the user U gets into the vehicle C together with the terminal device 10 and installs (fixes) the terminal device 10 in the vehicle of the vehicle C. The terminal device 10 may be installed in the vehicle C in advance.

The control unit 30 of the terminal device 10 activates a car navigation application equipped with a drive recorder function in response to an operation of the user U on the terminal device 10 (step S101).

The control unit 30 searches for a route to the destination in response to the input of the destination of the user U to the car navigation application (step S102).

The control unit 30 starts traveling to the destination by the navigation function of the car navigation application and starts shooting by the drive recorder function together with the start of traveling of the vehicle C (start of driving of the user U) (step S103).

The control unit 30 uses the drive recorder function of the car navigation application to photograph the road surface, the road shoulder, and the like in front of the vehicle C while the vehicle C1 is traveling (step S104).

The control unit 30 is a warning target that exists on the road or shoulder in front of the vehicle C by image recognition by AI or the like and is not yet displayed on the map of the car navigation application, and is a warning target that meets a predetermined condition. When the target is found, an alarm is issued to the user U, and the position and image of the warning target are stored so that the user U can be reconfirmed later (step S105).

The control unit 30 confirms the image taken while the vehicle C is running when the user U is not driving the vehicle C, and responds to the operation performed by checking the image taken while the vehicle C is running. The included warning targets (control device, flooded / frozen road surface, collapse / collapse location, falling object, accident site, inspection, etc.) are specified (step S106).

The control unit 30 sets the name of the warning target input by the user U, a comment about the warning target, and the like, creates POI data indicating the position of the warning target on the vehicle running on the map of the car navigation application, and creates POI data. The image data taken by the drive recorder function and the created POI data are combined to create data regarding a warning target in vehicle driving (step S107).

The control unit 30 transmits data regarding a warning target on vehicle travel to the information processing device 100 via the communication unit 11 (step S108).

[5-2. Processing procedure for alarms by terminal devices]
First, a processing procedure by the terminal device 10 according to the embodiment will be described with reference to FIG. 7B. FIG. 7B is a flowchart showing a processing procedure related to the alarm by the terminal device 10. The processing procedure shown below is repeatedly executed by the control unit 30 of the terminal device 10.

Here, the terminal device 10 is installed so as to be able to photograph the front of the vehicle C. For example, the user U gets into the vehicle C together with the terminal device 10 and installs (fixes) the terminal device 10 in the vehicle of the vehicle C. The terminal device 10 may be installed in the vehicle C in advance.

The control unit 30 of the terminal device 10 activates a car navigation application equipped with a drive recorder function in response to an operation of the user U on the terminal device 10 (step S201).

The control unit 30 searches for a route to the destination in response to the input of the destination of the user U to the car navigation application (step S202).

The control unit 30 receives data from the information processing device 100 via the communication unit 11 regarding the warning target on the vehicle traveling on the route to the destination (step S203).

At this time, the control unit 30 displays information indicating the existence of the warning target on the vehicle running on the map of the car navigation application in a format that can be visually recognized by the user U, based on the data on the warning target on the vehicle running. You may. For example, it may be displayed as POI.

The control unit 30 starts traveling to the destination by the navigation function of the car navigation application and starts shooting by the drive recorder function together with the start of traveling of the vehicle C (start of driving of the user U) (step S204).

The control unit 30 uses the drive recorder function of the car navigation application to photograph the road surface, the road shoulder, and the like in front of the vehicle C while the vehicle C1 is traveling (step S205).

The control unit 30 issues an alarm in front of the place where the warning target in the vehicle running exists based on the data regarding the warning target in the vehicle running (step S206).

For example, the control unit 30 issues an alarm when the current position of the vehicle C is within a predetermined range from the position of the warning target based on the data regarding the warning target on the vehicle running.

The control unit 30 determines whether or not the warning target for vehicle running exists at the location according to the data regarding the warning target for vehicle running (step S207).

For example, the control unit 30 determines whether or not the warning target for vehicle running is included in the image taken at the location according to the data regarding the warning target for vehicle running.

When the warning target for vehicle running does not exist at the location according to the data regarding the warning target for vehicle running (step S207; No), the control unit 30 is the information processing device via the communication unit 11. The 100 is requested to delete the data regarding the warning target in the vehicle running (step S208).

When the warning target for vehicle running exists at the location according to the data regarding the warning target for vehicle running (step S207; Yes), the control unit 30 is the information processing device via the communication unit 11. The latest data regarding the warning target in vehicle running is transmitted to 100, and the data regarding the warning target in vehicle running is updated (step S209).

It should be noted that, for example, a new comment regarding the current state of the warning target in vehicle running may be added to the latest data regarding the warning target in vehicle running.

Here, by transmitting the latest data on the warning target on vehicle running and updating the data on the warning target on vehicle running, the expiration date of the data on the warning target on vehicle running is updated / extended. That is, the timing at which the information processing apparatus 100 deletes the data related to the warning target on the vehicle travel is extended first. In this way, as long as the existence of the warning target on the vehicle running is continuously confirmed, the data on the warning target on the vehicle running will also continue.

[5-3. Processing procedure by information processing device]
Next, the processing procedure by the information processing apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 8 is a flowchart showing a processing procedure by the information processing apparatus 100. The processing procedure shown below is repeatedly executed by the control unit 130 of the information processing apparatus 100.

The control unit 130 of the information processing device 100 collects data regarding a warning target on vehicle travel from the terminal device 10 of each user U via the communication unit 110 (step S301).

The control unit 130 stores the data related to the warning target on the vehicle running in the warning target database 123, overwrites the already stored data with the latest data (step S302).

At this time, the information processing device 100 may be able to input / change the comment or the like regarding the warning target included in the data regarding the warning target on the vehicle running from the terminal device 10 of each user U after the fact. ..

Further, when the control unit 130 receives a request from a plurality of users (more than a predetermined number of people) to delete the data related to the warning target on the vehicle running, the control unit 130 deletes the data related to the warning target on the vehicle running. ..

The control unit 130 performs machine learning on the stored data regarding the warning target on the vehicle running (step S303).

The control unit 130 extracts highly accurate data from the collected data regarding the warning target on the vehicle running based on the learning model created as a result of machine learning (step S304).

The control unit 130 provides the terminal device 10 of the user U via the communication unit 110 with highly accurate data regarding the warning target during vehicle travel (step S305).

[6. Modification example]
The terminal device 10 and the information processing device 100 described above may be implemented in various different forms other than the above-described embodiment. Therefore, a modified example of the embodiment will be described below.

In the above embodiment, the user U may specify the warning target for vehicle running and then rank the specified warning target for vehicle running. For example, the user U may evaluate the specified vehicle driving caution target on a five-point scale (ranked into levels 1 to 5).

Further, in the above embodiment, the information processing apparatus 100 may allow each user U to vote for the warning target on the vehicle running displayed on the map of the car navigation application. For example, the information processing apparatus 100 may rank or score warning targets for vehicle traveling according to the number of votes. Further, the information processing device 100 can be used as a coupon or a coupon that can be used in an electronic shopping district (online mall) or the like for the terminal device 10 of the user U who has created data on a warning target on the vehicle running according to the number of votes. Points and the like may be provided. In addition, the number of votes for the object of caution when traveling the vehicle may be applied to insurance.

Further, in the above embodiment, the terminal device 10 of the user U is located in a roadside zone of a highway, etc., in addition to a warning target for vehicle traveling by image recognition by AI or the like while the car navigation application is operating. You may try to find an emergency phone, telephone booth, parking meter, etc.

Further, in the above embodiment, the terminal device 10 of the user U is a vehicle in which dangerous driving such as reverse driving / tilting driving / meandering driving is performed by image recognition by AI or the like while the car navigation application is operating. When is found, those vehicles are judged to be warning targets for vehicle driving, and the image data of those vehicles is combined with the discovered position and time to create data related to the warning target for vehicle driving. Then, the data regarding the warning target on the vehicle running may be transmitted to the information processing apparatus 100.

Further, in the above embodiment, the terminal device 10 of the user U is in the event that the vehicle C of the user U is in an accident, or is inspected or cracked down while the car navigation application is in operation. By combining the image data taken by the drive recorder function and the position information indicating the current position at that time, data on the warning target on the vehicle running is created, and the information processing device 100 is used on the vehicle running. You may send data about the alert target of.

Further, in the above embodiment, the terminal device 10 of the user U observes the state and behavior of the user U by image recognition by an in-camera or the like while the car navigation application is operating, and becomes a warning target when traveling the vehicle. If it is determined that the driver is looking aside or sleeping, an alarm or warning may be issued.

Further, in the above embodiment, the terminal device 10 of the user U uses a voice recognition by a microphone, an image recognition by an in-camera, or the like while the car navigation application is operating, to indicate a voice (scream or scream) indicating an emergency situation of the user U. When a screaming voice, a voice calling for help, etc.) or a panicked behavior is detected, the inside and outside of the vehicle may be photographed and the images may be transmitted to the information processing apparatus 100 or registered in advance. It may be transmitted to the terminal device of another user (family, friend, etc.). Further, when the information processing device 100 receives the images from the terminal device 10 of the user U, the information processing device 100 may transfer the images to the terminal device of another user registered in advance.

Further, in the above embodiment, the road surface, the road shoulder, etc. in front of the vehicle C (in the direction of travel) are photographed, but in reality, the road surface, the road shoulder, etc. on the side or the rear side of the vehicle C may also be photographed. good. For example, there is a possibility that a falling object or a collapse may occur after the vehicle C has passed, and such a falling object or a collapse can be found by photographing the side or the rear. In particular, when there is no following vehicle of vehicle C on a road with low traffic volume, it is useful for vehicle C to photograph the side or the rear.

Further, in the above embodiment, the image is taken on an outdoor road (public road, private road, etc.), but in reality, the image may be taken in an underground road or tunnel. You may also shoot indoors. For example, the photograph may be taken in an indoor facility where vehicles can enter, an indoor parking lot / a multi-story parking lot / an underground parking lot, or the like. At this time, if it is difficult to acquire position information with a positioning system such as GPS, the vehicle C or terminal device may be used using technologies such as autonomous navigation (DR: Dead Reckoning) and pedestrian autonomous navigation (PDR). Position 10 positions.

Further, in the above embodiment, the terminal device 10 cooperates with an in-vehicle camera or the like mounted for controlling the vehicle by the drive recorder function of the car navigation application, and acquires and acquires an image captured by the in-vehicle camera or the like. You may find a warning target on the vehicle running from the image. For example, the terminal device 10 of the user U is used in an in-vehicle camera for synthesizing an image of the surroundings of a vehicle to create a bird's-eye view image (overhead view image), an advanced driver assistance system (ADAS), or automatic driving. In cooperation with an in-vehicle camera, LiDAR (Light Detection and Ranging), a millimeter-wave radar, or the like, the output results thereof may be acquired, and the warning target on vehicle driving may be discovered from the output results.

Further, in the above embodiment, not only the vehicle C but also a walking object, a bicycle, or a moving body other than the vehicle may be targeted. In the case of walking or biking, it can be said that the user U himself is a mobile body. Moving objects other than vehicles include, for example, drones, robots, personal mobility, ships moving in rivers, personal watercraft, various gliders, small aircraft, and the like.

[7. effect〕
As described above, the terminal device 10 according to the present application is an information processing device mounted on a mobile body (vehicle or the like), and includes a photographing unit, a creating unit, and a transmitting unit. The photographing unit photographs a warning target on the progress of the moving body while the moving body is in progress. The creating unit creates data on the warning target on the movement of the moving object according to the operation performed after the user confirms the image of the warning target on the progress of the moving body. The transmission unit transmits data regarding the warning target for the progress of the moving object to the outside. As a result, it is possible to discover and share information on various warning targets in the progress of the moving body.

Further, the terminal device 10 according to the present application further includes a receiving unit, a confirmation unit, and an alarm unit. The receiving unit receives from the outside data related to the warning target on the progress of the moving object other than the data transmitted by itself. The confirmation unit confirms the place where the warning target for the progress of the moving object exists based on the data regarding the warning target for the progress of the moving body. The alarm unit issues an alarm in front of the place where the warning target for the progress of the moving object exists. As a result, it is possible to issue an alarm for various warning targets in the progress of the moving body.

Further, the terminal device 10 according to the present application further includes a requesting unit. The requesting part deletes the data related to the mobile progress warning target to the outside when the mobile progress warning target does not exist at the location according to the data related to the mobile progress warning target. To request. As a result, it is possible to delete the data related to various warning targets on the progress of the mobile body that do not already exist and reflect the actual situation.

Further, the terminal device 10 according to the present application further includes an update unit. The update unit updates the data on the mobile progress alert target to the outside when the mobile progress alert target exists in the same place as the data on the mobile progress alert target. Update to the data of. As a result, it is possible to update / extend the expiration date of the data regarding the alert target for the progress of the moving object, which is automatically deleted.

Further, the terminal device 10 according to the present application further includes a shooting alarm unit. During the progress of the moving object, the shooting alarm unit issues an alarm when the image of the moving object progress warning target taken by the shooting unit contains a warning target that meets certain conditions. Emit. As a result, it is possible to issue an alarm for the alert target while discovering the alert target for which data has not been created yet.

Further, the terminal device 10 according to the present application further includes a determination unit. The judgment unit determines that another moving object having dangerous behavior is a warning target for the progress of the moving object. As a result, it is possible to set a warning target for a vehicle that falls under dangerous driving and issue an alarm.

Further, the terminal device 10 according to the present application further includes a voting unit. The voting unit is a part for voting for data on the object of caution regarding the progress of the moving object to the outside. As a result, it is possible to vote for the alert target, and it is possible to rank and score the alert target.

Further, the terminal device 10 according to the present application further includes a user photographing unit and a warning unit. The user photography unit photographs the user inside the moving body. The warning unit warns according to the behavior of the user who is the target of caution in the progress of the moving object. As a result, it is possible to warn against inattentive driving, dozing driving, etc., which may be warning targets for the progress of the moving body.

Further, the terminal device 10 according to the present application further includes a reporting unit. When the reporting unit determines that the state of the user is abnormal, the reporting unit reports the photographed image of the inside of the moving object to the outside. As a result, it is possible to notify other users (family members, friends, etc.) registered in advance of the state of the user who has fallen into an emergency.

The target of caution regarding the progress of mobile objects is a mobile speed-violation automatic control device. This makes it possible to issue an alarm to the mobile control device.

Further, as described above, the information processing apparatus 100 according to the present application includes an acquisition unit, a storage unit, and a provision unit. The acquisition unit acquires data on the moving object progress warning target taken by each user's terminal device while the moving body is in progress, and the image is confirmed by each user. .. The storage unit stores data regarding the alert target for the progress of the moving object. The providing unit provides the terminal device of each user with the data regarding the warning target in the progress of the mobile body. As a result, it is possible to discover and share information on various warning targets in the progress of the moving body.

Further, the information processing apparatus 100 according to the present application further includes a learning unit. The learning unit performs machine learning on data related to the alert target on the progress of the moving object. As a result, the accuracy of the data regarding the alert target in the progress of the moving object can be cumulatively improved.

Based on the learning model created as a result of machine learning, the providing unit provides the terminal device of each user with data regarding the alert target in the progress of the moving object. As a result, it is possible to provide highly accurate data regarding the warning target in the running of the vehicle.

Further, the information processing apparatus 100 according to the present application further includes a deletion unit. When the expiration date of the data related to the mobile progress alert target has expired, the deletion unit deletes the data related to the mobile progress alert target. As a result, it is possible to automatically delete the data related to the warning target on the progress of the moving object after a certain period of time has passed since the registration.

[8. Hardware configuration]
Further, the terminal device 10 and the information processing device 100 according to the above-described embodiment are realized by, for example, a computer 1000 having a configuration as shown in FIG. FIG. 9 is a diagram showing an example of a hardware configuration. The computer 1000 is connected to the output device 1010 and the input device 1020, and the arithmetic unit 1030, the primary storage device 1040, the secondary storage device 1050, the output I / F (Interface) 1060, the input I / F 1070, and the network I / F 1080 are bused. It has a form connected by 1090.

The arithmetic unit 1030 operates based on a program stored in the primary storage device 1040 or the secondary storage device 1050, a program read from the input device 1020, or the like, and executes various processes. The arithmetic unit 1030 is realized by, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or the like.

The primary storage device 1040 is a memory device such as a RAM (Random Access Memory) that temporarily stores data used by the arithmetic unit 1030 for various calculations. Further, the secondary storage device 1050 is a storage device in which data used by the calculation device 1030 for various calculations and various databases are registered, and is a ROM (Read Only Memory), an HDD (Hard Disk Drive), and an SSD (Solid). State Drive), flash memory, etc. The secondary storage device 1050 may be an internal storage or an external storage. Further, the secondary storage device 1050 may be a removable storage medium such as a USB memory or an SD (Secure Digital) memory card. Further, the secondary storage device 1050 may be a cloud storage (online storage), NAS (Network Attached Storage), a file server, or the like.

The output I / F 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various information such as a display, a projector, and a printer. For example, USB (Universal Serial Bus) or DVI. (Digital Visual Interface), HDMI (Registered Trademark) (High Definition Multimedia Interface), etc. Further, the input I / F 1070 is an interface for receiving information from various input devices 1020 such as a mouse, a keyboard, a keypad, a button, a scanner, and the like, and is realized by, for example, USB.

Further, the output I / F 1060 and the input I / F 1070 may be wirelessly connected to the output device 1010 and the input device 1020, respectively. That is, the output device 1010 and the input device 1020 may be wireless devices.

Further, the output device 1010 and the input device 1020 may be integrated like a touch panel. In this case, the output I / F 1060 and the input I / F 1070 may also be integrated as input / output I / F.

The input device 1020 is, for example, an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), or a tape. It may be a device that reads information from a medium, a magnetic recording medium, a semiconductor memory, or the like.

The network I / F 1080 receives data from another device via the network N and sends it to the arithmetic unit 1030, and also transmits the data generated by the arithmetic unit 1030 to the other device via the network N.

The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output I / F 1060 and the input I / F 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040, and executes the loaded program.

For example, when the computer 1000 functions as the terminal device 10, the arithmetic unit 1030 of the computer 1000 realizes the function of the control unit 30 by executing the program loaded on the primary storage device 1040. Further, the arithmetic unit 1030 of the computer 1000 may load a program acquired from another device via the network I / F 1080 onto the primary storage device 1040 and execute the loaded program. Further, the arithmetic unit 1030 of the computer 1000 may cooperate with other devices via the network I / F 1080 to call the functions and data of the program from other programs of the other devices and use them.

[9. others〕
Although the embodiments of the present application have been described above, the present invention is not limited to the contents of these embodiments. Further, the above-mentioned components include those that can be easily assumed by those skilled in the art, those that are substantially the same, that is, those in a so-called equal range. Furthermore, the components described above can be combined as appropriate. Further, various omissions, replacements or changes of the components can be made without departing from the gist of the above-described embodiment.

Further, among the processes described in the above-described embodiment, all or a part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed can be performed. All or part of it can be done automatically by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

For example, the above-mentioned information processing apparatus 100 may be realized by a plurality of server computers, or may be realized by calling an external platform or the like by API (Application Programming Interface), network computing, or the like depending on the function. Can be changed flexibly.

Further, the above-described embodiments and modifications can be appropriately combined as long as the processing contents do not conflict with each other.

Further, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the reception unit can be read as a reception means or a reception circuit.

1 Information processing system 10 Terminal equipment 12 Display unit 15 Voice output unit 30 Control unit 31 Transmission unit 32 Reception unit 33 Processing unit 34 Alarm unit 100 Information processing equipment 110 Communication unit 120 Storage unit 121 User database 122 Map database 123 Warning target database 130 Control unit 131 Reception unit 132 Acquisition unit 133 Learning unit 134 Providing unit

Claims (14)

It is an information processing device mounted on a moving body.
An imaging unit that captures a warning target on the progress of a moving object discovered by image analysis by AI while the moving object is in progress.
A creation unit that creates data related to the warning target on the movement of the moving body in response to an operation performed by the user after confirming the image of the warning target on the progress of the moving body.
A transmission unit that transmits data related to the warning target on the progress of the moving object to the outside ,
A receiver that receives the result of machine learning using data related to the warning target on the progress of the moving object from the outside, and a receiver.
Equipped with
The photographing unit reflects the result of the machine learning received from the outside on the AI.
In response to the operation performed by the user after confirming the image of the warning target on the progress of the moving body, the creating unit excludes the warning target on the progress of the moving body, which is considered to be inappropriate. An information processing device characterized in that it identifies a warning target that seems to be appropriate. A receiver that receives data related to the mobile progress alert target other than the data transmitted by itself from the outside,
Based on the data related to the warning target on the progress of the moving object, the confirmation unit for confirming the location of the warning target on the progress of the moving body, and the confirmation unit.
The information processing apparatus according to claim 1, further comprising an alarm unit that issues an alarm in front of a place where a warning target for the progress of a moving object exists. When the moving object progressing warning target does not exist at the location according to the data regarding the moving body progress warning target, the transmitting unit notifies the outside of the moving body progress warning target. The information processing apparatus according to claim 2, wherein the information processing apparatus is requested to delete data relating to the data. When the moving object progressing warning target exists at the location according to the data regarding the moving body progress warning target, the transmitting unit notifies the outside of the moving body progress warning target. The information processing apparatus according to claim 2 or 3, wherein the data relating to the data is updated to the latest data. A shooting alarm that issues an alarm when a warning target that meets a predetermined condition is included in the image of the warning target on the movement of the moving body taken by the photographing unit while the moving body is in progress. The information processing apparatus according to any one of claims 1 to 4, further comprising a unit. The information according to any one of claims 1 to 5, further comprising a determination unit for determining another moving object having a dangerous behavior as a warning target in the progress of the moving object. Processing equipment. The information processing apparatus according to any one of claims 1 to 6, further comprising a voting unit for voting on data relating to the alert target in the progress of the moving object to the outside. A user shooting unit that shoots the user inside the moving body, and
Claim 1 is further provided with a warning unit for observing the behavior of the user by the user photographing unit and warning the behavior when it is determined that the behavior is a warning target in the progress of the moving object. The information processing apparatus according to any one of 7 to 7. The eighth aspect of claim 8, further comprising a reporting unit for reporting an image of the inside of the moving body to the outside when it is determined that the state of the user is abnormal. Information processing device. The information processing device according to any one of claims 1 to 9, wherein the warning target for the progress of the moving body is a mobile speed violation automatic control device. It is a warning target for moving body progress that was discovered and photographed by image analysis by AI while the moving body is in progress on each user's terminal device, and the warning target for moving body progress that each user confirmed the image. The acquisition unit that acquires data about
A storage unit that stores data related to the warning target in the progress of the moving object,
A learning unit that performs machine learning using data related to the warning target on the progress of the moving object, and
In order to reflect it in the AI, it is provided with a providing unit that provides the terminal device of each user with the result of machine learning using the data regarding the warning target on the progress of the moving object.
The acquisition unit considers that each user confirms the image of the warning target on the progress of the moving body and excludes the warning target that is considered to be inappropriate from the warning targets on the progress of the moving body. An information processing device characterized by acquiring data that identifies a warning target. The information processing according to claim 11 , further comprising a deletion unit for deleting the data related to the mobile progress alert target when the expiration date of the data relating to the mobile progress alert target has arrived. Device. It is an information processing method executed by an information processing device.
A shooting process in which a camera mounted on the moving body captures a warning target on the progress of the moving body discovered by image analysis by AI while the moving body is in progress.
The creation process of creating data related to the warning target on the movement of the moving body according to the operation performed by the user after confirming the image of the warning target on the progress of the moving body.
The transmission process of transmitting data related to the warning target on the progress of the moving object to the outside, and
A receiving process for receiving the result of machine learning using the data related to the warning target on the progress of the moving object from the outside, and the receiving process.
Including
In the photographing process, the result of the machine learning received from the outside is reflected in the AI.
In the creation step, among the warning targets for moving body progress, the warning target that is considered to be inappropriate is selected according to the operation performed by the user after confirming the image of the warning target for moving body progress. An information processing method characterized by excluding and identifying a warning target that seems appropriate. A shooting procedure for taking a picture of a moving object progressing alert target discovered by image analysis by AI while the moving body is in progress by a camera mounted on the moving body, and a shooting procedure.
The creation procedure for creating data related to the warning target on the movement of the moving object according to the operation performed by the user after confirming the image of the warning target on the progress of the moving body.
The transmission procedure for transmitting data related to the warning target on the progress of the moving object to the outside, and the transmission procedure.
A reception procedure for receiving the result of machine learning using the data related to the warning target on the progress of the moving object from the outside, and the reception procedure.
Let the computer run
In the shooting procedure, the result of the machine learning received from the outside is reflected in the AI.
In the creation procedure, among the warning targets for moving body progress, the warning target that is considered to be inappropriate is selected according to the operation performed by the user after confirming the image of the warning target for moving body progress. An information processing program characterized by excluding and identifying objects of caution that appear to be valid.

Images