WO2023047888A1 - Hazard information notification system, terminal device, and hazard information notification method - Google Patents

Hazard information notification system, terminal device, and hazard information notification method Download PDF

Info

Publication number
WO2023047888A1
WO2023047888A1 PCT/JP2022/032328 JP2022032328W WO2023047888A1 WO 2023047888 A1 WO2023047888 A1 WO 2023047888A1 JP 2022032328 W JP2022032328 W JP 2022032328W WO 2023047888 A1 WO2023047888 A1 WO 2023047888A1
Authority
WO
WIPO (PCT)
Prior art keywords
danger information
danger
information
notification
unit
Prior art date
Application number
PCT/JP2022/032328
Other languages
French (fr)
Japanese (ja)
Inventor
寛鳳 新田
Original Assignee
株式会社Ｊｖｃケンウッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2021156798A external-priority patent/JP2023047713A/en
Priority claimed from JP2021157150A external-priority patent/JP2023047946A/en
Application filed by 株式会社Ｊｖｃケンウッド filed Critical 株式会社Ｊｖｃケンウッド
Publication of WO2023047888A1 publication Critical patent/WO2023047888A1/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R21/00—Arrangements or fittings on vehicles for protecting or preventing injuries to occupants or pedestrians in case of accidents or other traffic risks
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/08—Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using communication transmission lines
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B27/00—Alarm systems in which the alarm condition is signalled from a central station to a plurality of substations
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/09—Arrangements for giving variable traffic instructions
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/123—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams
    • G08G1/127—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams to a central station ; Indicators in a central station
    • G08G1/13—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams to a central station ; Indicators in a central station the indicator being in the form of a map
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/16—Anti-collision systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
    • H04M11/04—Telephonic communication systems specially adapted for combination with other electrical systems with alarm systems, e.g. fire, police or burglar alarm systems

Definitions

  • the present invention relates to a danger information notification system, a terminal device, and a danger information notification method.
  • Patent Document 1 A technology is known in which, when a notification from a vehicle is received, an accident notification is sent to other vehicles within a predetermined range from the accident location (see Patent Document 1, for example).
  • Patent Document 2 There is a known technology that, when a predetermined event occurs in one of a plurality of vehicles, notifies the occurrence of the event to a vehicle located in a transmission area based on vehicle characteristic data and the location of occurrence (for example, patent Reference 2).
  • the amount of information may become excessive if video data is communicated as is. Even if the amount of information is suppressed, it is desirable to share information of a plurality of vehicles and appropriately notify danger and the like.
  • the present disclosure has been made in view of the above, and aims to reduce the amount of information, share information on multiple vehicles, and appropriately notify danger and the like.
  • the danger information notification system includes a video data acquisition unit that acquires video data obtained by photographing the surroundings of a moving object; a terminal device having a danger information detection unit that detects a type; and a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device; and the danger information received from the terminal device.
  • a specifying unit for specifying a notification area for notifying the danger information according to the type of the danger information
  • a notification control unit for controlling the notification of the danger information to a target moving object located in the notification area, based on and a server device having
  • a terminal device includes a video data acquisition unit that acquires video data captured around a moving object, a danger information detection unit that detects danger information and its type from the video data, and a danger information detection unit that: a danger information communication control unit that transmits the detected danger information to a server device and receives the danger information notified from the server device when the device is located within the notification area specified by the server device. .
  • a danger information notification method includes a video data acquisition step of acquiring video data of a surrounding of a mobile object, and a danger information detection step of detecting danger information and its type from the video data, which are executed by a terminal device. a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server; The method includes a specifying step of specifying a notification area for notifying the danger information according to a type, and a notification control step of controlling to notify the danger information to a target moving body located in the notification area.
  • FIG. 1 is a schematic diagram showing a configuration example of a danger information notification system according to an embodiment.
  • FIG. 2 is a block diagram illustrating a configuration example of a terminal device according to the embodiment;
  • FIG. 3 is a block diagram illustrating a configuration example of a server device according to the embodiment;
  • FIG. 4 is a diagram illustrating an example of risk type information.
  • FIG. 5 is a diagram illustrating another example of risk type information.
  • FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system according to the embodiment.
  • FIG. 1 is a schematic diagram showing a configuration example of a danger information notification system 1 according to an embodiment.
  • the danger information notification system 1 has a terminal device 10 mounted on a plurality of moving bodies and a server device 40 .
  • the danger information notification system 1 notifies the target mobile object within the notification area of the danger information from the server device 40 based on the danger information transmitted from the plurality of terminal devices 10 to the server device 40 .
  • Danger information is information about dangers that occur around roads. Danger information is information about dangers that may affect moving bodies traveling on roads. Danger information is information about dangers that a moving object should be aware of when traveling on a road. Danger information is information about dangers that require the mobile body to slow down, take a detour, stop, or pass more carefully than other places, for example.
  • a mobile object is a mobile object that moves on roads.
  • Mobile objects include, for example, vehicles and pedestrians.
  • a vehicle will be described as an example of a mobile object.
  • FIG. 2 is a block diagram showing a configuration example of the terminal device 10 according to the embodiment.
  • the terminal device 10 detects danger information around the vehicle from video data captured while the vehicle is running, and transmits the danger information to the server device 40 .
  • the terminal device 10 receives danger information from the server device 40, the terminal device 10 notifies the passenger of the danger information.
  • the terminal device 10 is a so-called drive recorder.
  • the terminal device 10 may be a portable device that can be used in a vehicle, in addition to one that is mounted on the vehicle.
  • the terminal device 10 includes a camera 11, a recording unit 12, a display unit 13, a GPS (Global Positioning System) receiving unit 14, which is an example of a GNSS (Global Navigation Satellite System), a recognition dictionary storage unit 16, and communication. 17 and a control unit 20 .
  • GPS Global Positioning System
  • GNSS Global Navigation Satellite System
  • the camera 11 is a camera that captures the surroundings of the vehicle. Camera 11 captures at least the front or rear of the vehicle. In this embodiment, the cameras 11 are two cameras arranged in the interior of the vehicle for photographing the front and rear, each of which is an ultra-wide-angle camera capable of photographing about 178° in the horizontal direction and about 60° in the vertical direction. Although it is assumed that the camera is capable of photographing almost the entire periphery of the vehicle, it is not limited to this. It may be composed of a plurality of camera groups that capture images in each direction. Moreover, a stereo camera suitable for distance measurement of an object, which will be described later, may be used. The camera 11 constantly captures images from the time the engine is started until it stops, that is, while the vehicle is operating.
  • the camera 11 constantly captures images while the accessory power source of the vehicle is ON.
  • the camera 11 outputs captured image data to the image data acquisition unit 21 of the control unit 20 .
  • the video data is, for example, moving images composed of images of 30 frames per second.
  • the camera 11 is not limited to one mounted on a vehicle, and may be a fixed-point camera or a security camera installed near a road.
  • the recording unit 12 is used for temporary storage of data in the terminal device 10 .
  • the recording unit 12 is, for example, a RAM (Random Access Memory), a semiconductor memory device such as a flash memory, or a recording unit such as a memory card. Alternatively, it may be an external recording unit wirelessly connected via a communication device (not shown).
  • the recording section 12 records the loop recording data based on the control signal output from the recording control section 24 of the control section 20 .
  • the display unit 13 is, for example, a display device unique to the terminal device 10 or a display device shared with other systems including a navigation system.
  • the display unit 13 is a display including, for example, a liquid crystal display (LCD) or an organic EL (electro-luminescence) display.
  • the display unit 13 displays images based on the video signal output from the display control unit 25 of the control unit 20 .
  • the display unit 13 displays images captured by the camera 11 or images recorded in the recording unit 12 .
  • the display unit 13 displays information for notifying the driver of the vehicle that the surrounding vehicle is driving dangerously.
  • the GPS receiving unit 14 receives radio waves from GPS satellites (not shown). The GPS receiver 14 outputs the received radio wave signal to the position information acquisition unit 26 of the controller 20 .
  • the recognition dictionary storage unit 16 stores danger information and recognition dictionaries for types of danger information.
  • the recognition dictionary storage unit 16 may be a storage device such as an external server that acquires the recognition dictionary via the communication unit 17 .
  • the types of danger information include, for example, collision accident, hit-and-run accident, backtracking driving, wrong-way driving on the highway, fire, landslide disaster, landslide/engineering road blockage, ground collapse, tsunami caused by earthquake, road surface freezing/snow/flooding, and large-scale disaster. Including large-scale blackouts.
  • the communication unit 17 is a communication unit.
  • the communication unit 17 may communicate by any method such as the Internet or a mobile phone line.
  • the communication unit 17 communicates data with the server device 40 .
  • the control unit 20 is, for example, an arithmetic processing device (control device) configured by a CPU (Central Processing Unit).
  • the control unit 20 loads a stored program into memory and executes instructions included in the program.
  • the control unit 20 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 20 and the like.
  • the control unit 20 includes a video data acquisition unit 21, a buffer memory 22, a video data processing unit 23, a recording control unit 24, a display control unit 25, and a position information acquisition unit 26, which are connected to the bus 20X. It has a danger information detection unit 30 and a danger information communication control unit 32 .
  • the video data acquisition unit 21 acquires video data of the surroundings of the vehicle.
  • the video data acquisition unit 21 acquires video data of the surroundings captured while the vehicle is running. More specifically, the image data acquisition unit 21 acquires image data output by the camera 11 and outputs the image data to the buffer memory 22 .
  • the buffer memory 22 is an internal memory provided in the control unit 20, and is a memory that temporarily records video data for a certain period of time acquired by the video data acquisition unit 21 while updating.
  • the video data processing unit 23 converts the video data temporarily stored in the buffer memory 22 into H.264, for example. 264 or MPEG-4 (Moving Picture Experts Group) or any other codec, and converted into any file format such as MP4 format together with audio data.
  • the video data processing unit 23 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 22 .
  • the video data processing unit 23 generates 60 seconds of video data temporarily stored in the buffer memory 22 as one file in recording order.
  • the video data processing section 23 outputs the generated video data to the recording control section 24 .
  • the video data processing unit 23 outputs the generated video data to the display control unit 25 .
  • the period of video data generated as a file is set to 60 seconds as an example, but is not limited to this.
  • the recording control unit 24 controls the recording unit 12 to record the video data filed by the video data processing unit 23 .
  • the recording control unit 24 converts the video data filed by the video data processing unit 23 to the recording unit 12 as overwritable video data during a period in which the loop recording process is executed, such as when the accessory power source of the vehicle is ON. to record. More specifically, the recording control unit 24 continues recording the video data generated by the video data processing unit 23 in the recording unit 12 during the loop recording process. The oldest video data is overwritten with new video data and recorded.
  • the recording control unit 24 may cause the recording unit 12 to record the video data captured when the danger information is detected by the danger information detection unit 30 by prohibiting overwriting.
  • the display control unit 25 controls display of video data on the display unit 13 .
  • the display control unit 25 outputs a video signal that causes the display unit 13 to output video data. More specifically, the display control unit 25 causes the display unit 13 to display the image captured by the camera 11 .
  • the display control unit 25 causes the display unit 13 to display the danger information.
  • the display control unit 25 may display by changing the display mode according to the degree of danger of the danger information received from the server device 40 . For example, when the risk is "high", the display control unit 25 displays it in a conspicuous display mode so that the passenger can easily check it, compared to when the risk is "small".
  • the location information acquisition unit 26 calculates the current location information of the vehicle based on the radio waves received by the GPS reception unit 14 by a known method.
  • the position information calculated by the position information acquisition unit 26 may be stored together with the video data.
  • the danger information detection unit 30 detects danger information and its type from the video data acquired by the video data acquisition unit 21 . More specifically, the danger information detection unit 30 detects danger information and its type from video data captured by the camera 11 using, for example, the recognition dictionary stored in the recognition dictionary storage unit 16 . The danger information detection unit 30 uses the recognition dictionary from the captured image data to detect, for example, collision accidents, hit-and-run accidents, slamming driving, wrong-way driving on highways, fires, landslide disasters, sediment/civil engineering road blockades, ground collapses, etc. Detects tsunamis caused by earthquakes, frozen road surfaces, snow cover, flooding, and large-scale stops.
  • the danger information detection unit 30 may detect various items according to the type of danger information in the detected danger information. For example, when the type of danger information is "collision accident", the danger information detection unit 30 detects "scale of accident” as an item of danger information. The scale of the accident is detected by subjecting video data to image processing for the content of, for example, a self-inflicted accident, an accident involving property, a multiple accident, or an accident involving persons. The scale of the accident is detected, for example, by performing image processing on the video data to determine whether an emergency vehicle is dispatched or whether the lane is restricted. For example, when the type of danger information is "collision accident", the danger information detection unit 30 may further detect "presence or absence of injured person" as an item of danger information. The presence or absence of an injured person is detected by performing image processing on video data.
  • the danger information detection unit 30 detects "scale of accident, vehicle number, vehicle color, vehicle type” as items of danger information. For example, when the type of danger information is "hit-and-run accident", the danger information detection unit 30 may further detect "presence or absence of injured person” as an item of danger information.
  • the vehicle number, vehicle color, and vehicle type are detected by performing image processing on the video data.
  • the danger information detection unit 30 detects "vehicle number, vehicle color, vehicle type” as items of danger information. For example, when the type of danger information is "relentless driving", the danger information detection unit 30 may further detect "presence or absence of passenger trouble” as an item of danger information.
  • Passenger trouble is, for example, a state in which a passenger of one vehicle is getting off and approaching the other vehicle. The presence or absence of passenger trouble is detected by performing image processing on the video data.
  • the danger information detection unit 30 detects "vehicle number, vehicle color, vehicle type” as items of danger information. For example, when the type of danger information is "reverse driving on an expressway", the danger information detection unit 30 further detects "name of expressway, name of toll gate, name of entrance/exit where reverse driving occurred” as items of danger information. good too. Expressway names, tollgate names, and entrance/exit names are detected from video data, vehicle position information, and map information.
  • the danger information detection unit 30 detects "scale of disaster”, “area where disaster occurred”, and "presence or absence of injured persons” as items of danger information.
  • the scale of the disaster is detected, for example, by performing image processing on video data to determine the size of the area where flames or smoke are recognized, the number of buildings, and the presence or absence of spread of fire.
  • the area where the disaster occurred is detected by performing image processing on the image data in the area where flames or smoke are recognized. Then, on the basis of map information (not shown), a disaster area where a fire is detected is specified.
  • the presence or absence of an injured person is detected by performing image processing on video data.
  • the danger information detection unit 30 detects "the scale of the disaster and whether the local point is a designated area at the time of the disaster?"
  • the scale of the disaster is detected, for example, by performing image processing on the video data for the size of the area where the landslide disaster is recognized.
  • Whether or not the local point is a designated area for disaster is detected by, for example, whether or not the local point is registered as a designated area for landslide disaster in map information stored in a map information storage unit (not shown).
  • the danger information detection unit 30 detects "scale of disaster” as an item of danger information when the type of danger information is "sediment/civil engineering road blockage".
  • the scale of the disaster is detected, for example, by performing image processing on the video data to determine the size of the area recognized as the range where the road is blocked by earth and sand/civil engineering.
  • the danger information detection unit 30 detects "scale of disaster” as an item of danger information.
  • the scale of the disaster is detected, for example, by performing image processing on video data for the area recognized as the range where the ground collapsed.
  • the danger information detection unit 30 detects "the scale of the disaster and whether the local point is a designated area at the time of the disaster?"
  • the scale of the disaster is recognized from, for example, seismic intensity or tsunami information obtained from an external device. Whether or not the local point is a designated area in the event of a disaster is detected by, for example, whether or not the local point is registered as a designated area for tsunami caused by an earthquake in map information stored in a map information storage unit (not shown).
  • the danger information detection unit 30 detects "the scale of the disaster and whether the local point is a designated area at the time of the disaster?" do.
  • the scale of the disaster is recognized from, for example, road surface freezing/snow cover/flooding information obtained from an external device.
  • Whether or not a local point is a designated area in the event of a disaster is determined, for example, by whether or not the local point is registered as a designated area for road surface freezing, snow, or flooding in map information stored in a map information storage unit (not shown). To detect.
  • the danger information detection unit 30 detects "scale of disaster” as an item of danger information.
  • the scale of the disaster is recognized, for example, from power outage area map information obtained from an external device.
  • the danger information detection unit 30 may further detect the degree of danger for the detected danger information. More specifically, the danger information detection unit 30 may detect the degree of danger from various items such as "scale of accident” and "presence or absence of injured persons” of the detected danger information. For example, if the "accident scale" is greater than or equal to a predetermined range, the degree of risk is set to "high". For example, when “there is an injured person”, the degree of danger is set to "high”. For example, if the type of danger information is "reversing the highway”, the degree of danger is “high”. For example, if the type of danger information is "reckoning driving" and "passenger has trouble”, the degree of danger is set to "high".
  • the danger information communication control unit 32 communicates danger information detected by the danger information detection unit 30 with the server device 40 .
  • the danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server device 40 .
  • the danger information to be sent includes information indicating the degree of danger, the location of occurrence of the danger information, and the date and time of occurrence.
  • the danger information communication control unit 32 receives danger information around the vehicle from the server device 40 .
  • the danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server device 40, and is notified by the server device 30 when the location is within the notification area specified by the server device 30. Receive danger information.
  • the danger information communication control unit 32 receives danger information notified from the server device 40 and determines that the danger information is the same as the danger information detected by the danger information detection unit 30 in the vehicle. When it is determined, it may be controlled to transmit the danger information detected by the vehicle to the server device 40 again. As a result, the latest danger information is always transmitted from the terminal device 10 to the server device 40 .
  • the fact that the contents of the danger information are the same means that the danger information notified from the server device 40 and the danger information detected by the danger information detection unit 30 in the vehicle satisfy the following conditions. It means that the two pieces of danger information have the same type of danger information, the difference in occurrence position is within a predetermined distance, and the difference in date and time of occurrence is within a predetermined time.
  • FIG. 3 is a block diagram showing a configuration example of the server device 40 according to the embodiment.
  • the server device 40 has a communication section 41 , a risk type information storage section 42 and a control section 50 .
  • the communication unit 41 is a communication unit.
  • the communication unit 41 may communicate by any method such as the Internet or a mobile phone line.
  • the communication unit 41 communicates data with the terminal devices 10 mounted on a plurality of vehicles.
  • the risk type information storage unit 42 stores risk type information.
  • the risk class information storage unit 42 may be a storage device such as an external server that acquires risk class information via the communication unit 41 .
  • Danger type information is information related to notification of danger information for each type of danger information.
  • the danger type information is information including, for example, a danger information notification area, an item of danger information to be notified, and a notification time interval for each type of danger information.
  • the danger information notification area is an area in which danger information is notified.
  • the item of danger information to be notified is an item to be notified.
  • the notification time interval is the time interval for notification.
  • FIG. 4 is a diagram explaining an example of risk type information.
  • the type of danger information “collision accident” has a notification area of "1 km radius from the scene", an item of danger information to be notified of "accident scale”, and a notification time interval of "every 5 minutes”. It is said that The type of danger information “hit-and-run accident” has a notification area of "target vehicle traveling direction 5km", danger information items to be notified of "accident scale, vehicle number, vehicle color, vehicle type”, and notification time interval of "1 minute”. It is said to be "every”.
  • the type of hazard information, ⁇ Driving,'' has a notification area of ⁇ Target vehicle traveling direction 5km'', items of hazard information to be notified of ⁇ vehicle number, vehicle color, and vehicle type'', and a time interval of notification of ⁇ every minute''.
  • the type of danger information "Reversing the highway” has a notification area of "reversing vehicle travel direction 10km", items of danger information to be notified are "vehicle number, vehicle color, vehicle type”, and time intervals to be notified are "every 30 seconds”. ”.
  • the type of danger information "fire” has a notification area of "1 km radius from the site", an item of danger information to be notified is “scale of disaster, area of disaster occurrence”, and a time interval of notification is “every 10 minutes”.
  • the type of danger information “Landslide disaster” has a notification area of "5 km radius from the site”, an item of danger information to be notified is “scale of disaster, is the local point in the designated area at the time of disaster?", and a time interval for notification. is “every 30 seconds”.
  • the type of danger information "Earth and sand/road blockage” has a notification area of "1 km radius from the site", an item of danger information to be notified of "scale of disaster", and a notification time interval of "every 10 minutes”. .
  • the danger information type “ground collapse” has a notification area of "1 km radius from the site”, an item of danger information to be notified of "scale of disaster”, and a time interval of notification of "every 5 minutes”.
  • the type of danger information “Tsunami caused by earthquake” has a notification area of "5 km radius from the site”, danger information items to be notified of "scale of disaster, is the local point in the designated area at the time of disaster?", time to notify. The interval is set to "every 30 seconds”.
  • the type of danger information "frozen road surface/snowfall/flooding” has a notification area of "1 km radius from the site", an item of danger information to be notified is "the scale of the disaster, is the local point in the designated area at the time of the disaster?" The time interval for notification is “every 10 minutes”.
  • the type of danger information “Large power outage” has a notification area of "1 km radius from the site", an item of danger information to be notified of "scale of disaster", and a notification time interval of "every 10 minutes”.
  • the risk type information may further include information indicating whether an emergency call is necessary for each type of risk information.
  • the danger type information may include information indicating whether or not an emergency call is necessary for each type and degree of danger information.
  • the degree of risk indicates the magnitude of the impact on the surroundings for each type of risk.
  • the degree of danger indicates the magnitude of the impact on vehicles traveling on the road.
  • the degree of risk is indicated by, for example, "high” and "low”.
  • the "high” degree of danger is, for example, a level that interferes with driving on the road.
  • a “high” degree of risk is, for example, a level that requires reporting to an emergency agency.
  • the "low” degree of risk is, for example, a level that requires caution when driving on roads.
  • a “low” risk is, for example, a level that does not require reporting to an emergency agency.
  • Emergency organizations are organizations to which to report in an emergency.
  • the emergency agency includes, for example, a police agency or an agency that requests an ambulance.
  • FIG. 5 is a diagram explaining another example of risk type information.
  • information including the notification area of danger information, the items of danger information to be notified, the notification time interval, and the necessity of an emergency call is defined for each degree of danger of each type of danger information.
  • the type of hazard information is ⁇ furious driving'' and the degree of hazard is ⁇ high''
  • the notification area is ⁇ target vehicle traveling direction 5km''
  • the items of hazard information to be notified are ⁇ vehicle number, vehicle color, vehicle type''
  • the notification time interval is ⁇ Every minute
  • the type of hazard information is ⁇ furious driving'' and the degree of danger is ⁇ small'', the notification area is ⁇ 3km in the direction of the target vehicle'', the items of hazard information to be notified are ⁇ vehicle number, vehicle color, and vehicle type'', and the notification time interval is ⁇ Every minute", emergency call "do not call”.
  • the control unit 50 is, for example, an arithmetic processing device configured with a CPU or the like.
  • the control unit 50 loads the stored program into memory and executes the instructions contained in the program.
  • the control unit 50 includes an internal memory (not shown), which is used for temporary storage of data in the server device 40 and the like.
  • the control unit 50 has a danger information reception control unit 51 , an identification unit 52 , a notification determination unit 53 , a notification control unit 54 and a notification control unit 55 .
  • the report determination unit 53 and the report control unit 55 are not essential components.
  • the danger information reception control unit 51 controls to receive danger information from the terminal devices 10 mounted on a plurality of vehicles via the communication unit 41 .
  • the identifying unit 52 Based on the danger information received from the terminal device 10, the identifying unit 52 identifies a notification area for notifying danger information according to the type of danger information.
  • the identifying unit 52 identifies a notification area for notifying the received danger information from the danger classification information stored in the danger classification information storage unit 42 . For example, when the type of danger information is "reverse driving on an expressway", the identifying unit 52 identifies the notification area as "reversing vehicle traveling direction 10 km".
  • the specifying unit 52 may specify the notification area to be notified according to the degree of danger of the received danger information. For example, the specifying unit 52 may specify an expanded notification area when the risk is "high” compared to when the risk is "low".
  • the specifying unit 52 may further specify items of danger information to be notified and time intervals for notification.
  • the identification unit 52 may identify the items of danger information to be notified and the time intervals for notification regarding the received danger information from the danger classification information stored in the danger classification information storage unit 42 .
  • the specifying unit 52 specifies the notification area again when it is determined that the received multiple pieces of risk information have the same content.
  • the specifying unit 52 may specify the notification area again based on the latest danger information.
  • the identifying unit 52 may re-identify the notification area based on the average value of occurrence positions included in a plurality of pieces of risk information.
  • the average value of the occurrence positions is, for example, the average value of the map coordinate values of each occurrence position.
  • the specifying unit 52 may widen the notification area and specify again as the number of danger information received increases.
  • the contents of multiple pieces of danger information are the same when the received multiple pieces of danger information meet the following conditions. It means that a plurality of pieces of danger information have the same type of danger information, the difference in occurrence positions is within a predetermined distance, and the difference in date and time of occurrence is within a predetermined time.
  • the report determination unit 53 determines whether or not to report to an emergency agency according to the degree of risk in the danger information received from the terminal device 10. In this embodiment, the report determination unit 53 determines whether or not to notify the emergency agency based on the risk type information stored in the risk type information storage unit 42 . If the degree of danger is "high", the report determination unit 53 determines whether or not to report to an emergency agency. If the same content of danger information has already been reported to the emergency agency, the report determination unit 53 does not make the report redundantly.
  • the notification determination unit 53 may determine that an emergency agency should be notified.
  • the notification control unit 54 controls to notify the target vehicle located within the notification area of the danger information. More specifically, the notification control unit 54 controls to notify the terminal device 10 of the target vehicle located within the notification area of the danger information based on the identification result of the identification unit 52 .
  • the notification control unit 54 performs control to change the items of danger information or the time intervals for notifying danger information according to the type of danger information received. More specifically, the notification control unit 54 performs control to change the item of danger information or the time interval for notifying the danger information based on the identification result of the identification unit 52 so as to notify the danger information.
  • the report control unit 55 controls to report to emergency agencies according to the degree of danger of the danger information received from the terminal device 10. More specifically, when the report determination unit 53 determines to "report", the report control unit 55 controls to report to the emergency agency.
  • the report control unit 55 controls the communication unit 41 to transmit report information indicating a report accompanied by a request for dispatch to an emergency agency.
  • the report information includes information identifying the vehicle, current position information of the vehicle, and information indicating a dispatch request.
  • FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system 1 according to the embodiment.
  • the terminal device 10 mounted on each vehicle is activated while the vehicle is activated. While the terminal device 10 is running, the camera 11 constantly takes pictures.
  • vehicle position information is acquired by the control unit 20 of the terminal device 10 installed in the vehicle (step S11). More specifically, the control unit 20 causes the position information acquiring unit 26 to calculate the current position information of the vehicle based on the radio waves received by the GPS receiving unit 14 by a known method. The control unit 20 proceeds to step S12.
  • the control unit 20 acquires video data (step S12). More specifically, the image data acquisition unit 21 of the control unit 20 acquires image data of the surroundings of the vehicle captured by the camera 11 . The control unit 20 proceeds to step S13.
  • the control unit 20 detects danger information (step S13). More specifically, the control unit 20 uses the recognition dictionary stored in the recognition dictionary storage unit 16 to detect danger information and its type from the video data captured by the camera 11 by the danger information detection unit 30 . The control unit 20 detects various items according to the type of danger information from the danger information detected by the danger information detection unit 30 . The control unit 20 detects the degree of danger for the detected danger information by the danger information detection unit 30 . The control unit 20 proceeds to step S14.
  • the control unit 20 transmits danger information (step S14). More specifically, the control unit 20 causes the danger information communication control unit 32 to transmit the danger information detected by the danger information detection unit 30 to the server device 40 .
  • the danger information transmitted in step S14 includes information indicating the degree of danger, the location of occurrence of the danger information, and the date and time of occurrence.
  • the danger information is received by the control unit 50 of the server device 40 (step S21). More specifically, the control unit 50 uses the danger information reception control unit 51 to receive danger information from the terminal device 10 mounted on the vehicle. The controller 50 proceeds to step S22.
  • the control unit 50 identifies a notification area for notifying danger information (step S22). More specifically, the control unit 50 causes the specifying unit 52 to specify the notification area for notifying the received danger information from the danger type information stored in the danger type information storage unit 42 . The control unit 50 may further use the specifying unit 52 to specify items of danger information to be notified and time intervals to be notified. The control unit 50 may use the identifying unit 52 to identify items of danger information to be notified and time intervals for notification regarding the received danger information from the danger type information stored in the danger type information storage unit 42 . .
  • the control unit 50 uses the specifying unit 52 to specify, for example, when the type of danger information is “reversing the highway”, the notification area is “10 km in the direction in which the vehicle travels in the opposite direction”. For example, when the type of danger information is "reverse driving on an expressway", the control unit 50 causes the specifying unit 52 to specify "vehicle number, vehicle color, vehicle type” as the items of danger information to be notified, and set the time interval to "30 seconds.” specified as "every”. The controller 50 proceeds to step S23.
  • the control unit 50 notifies danger information (step S23). More specifically, the control unit 50 controls the notification control unit 54 to notify the terminal device 10 of the target vehicle located within the notification area of the danger information based on the identification result of the identification unit 52 . For example, when the type of danger information is "reversing highway", the control unit 50 notifies the terminal device 10 of the target vehicle located "10 km in the traveling direction of the reverse vehicle" of the danger information by the notification control unit 54. control to The controller 50 proceeds to step S24.
  • the control unit 50 determines whether a report is necessary (step S24). More specifically, based on the danger type information stored in the danger type information storage unit 42 , the control unit 50 determines whether or not to report to the emergency agency by the notification determination unit 53 . The controller 50 proceeds to step S25.
  • the control unit 50 notifies the emergency agency (step S25). More specifically, when it is determined to "report" in step S24, the control unit 50 causes the report control unit 55 to control the communication unit 41 to transmit report information indicating a report accompanied by a request to the emergency organization. do.
  • the other terminal device 10 mounted on the target vehicle within the notification area receives the danger information (step S31). More specifically, the control unit 20 receives the danger information around the vehicle from the server device 40 by the danger information communication control unit 32 . For example, when the type of danger information is “reverse driving on an expressway”, the terminal device 10 of the target vehicle located “10 km in the traveling direction of the reverse transport vehicle” receives danger information around the vehicle by the danger information communication control unit 32. is received from the server device 40 . The controller 20 proceeds to step S32.
  • the control unit 20 notifies danger information (step S32). More specifically, the control unit 20 causes the display control unit 25 to display the danger information received from the server device 40 by the danger information communication control unit 32 on the display unit 13 .
  • the control unit 20 causes the display control unit 25 to display the types of danger information and items of danger information received from the server device 40 on the display unit 13 at time intervals.
  • the type of danger information is "reverse driving on an expressway”
  • the control unit 20 causes the display control unit 25 to display "Vehicle number ⁇ ⁇ ⁇ , blue "A (A is the vehicle model name)" is driving in the reverse direction". is displayed on the display unit 13 at time intervals of "every 30 seconds".
  • this embodiment can appropriately notify the target vehicle within the notification area of the danger information via the server device 40 without requiring an operation by the passenger of the vehicle.
  • this embodiment for example, even in a state in which danger information cannot be transmitted from the vehicle of the party concerned, other vehicles passing by can transmit the danger information to the server device 40, and the target vehicle can be appropriately notified of the danger information.
  • the amount of information can be suppressed compared to the case of communicating video data, and danger information of a plurality of vehicles can be shared to appropriately notify danger and the like.
  • the danger information can be transmitted to the server device 40 from another vehicle passing by, and the emergency agency can be notified if necessary.
  • the notification area is specified again. According to this embodiment, it is possible to appropriately specify the notification area.
  • the server device 40 can report to emergency organizations according to the degree of danger of the danger information received. This embodiment can appropriately notify the necessary emergency agencies.
  • the server device 40 when danger information notified from the server device 40 is received and it is determined that the content of the danger information is the same as the danger information detected by the danger information detection unit 30 in the vehicle, the server device 40 can transmit danger information detected by the vehicle. According to this embodiment, the latest danger information can always be transmitted from the terminal device 10 to the server device 40 . According to this embodiment, the server device 40 can receive danger information from more terminal devices 10 .
  • the danger information notification system according to the present invention may be implemented in various forms other than the above-described embodiments.
  • Each component of the illustrated danger information notification system is functionally conceptual and does not necessarily have to be physically configured as illustrated.
  • the specific form of each device is not limited to the illustrated one, and all or part of it may be functionally or physically distributed or integrated in arbitrary units according to the processing load and usage conditions of each device.
  • the configuration of the danger information notification system is implemented, for example, as software by programs loaded into memory.
  • functional blocks realized by cooperation of these hardware or software have been described. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.
  • the video data captured by the camera 11 may include audio data.
  • the voice data may be subjected to voice recognition processing to detect an impact sound of an accident or the like, a human cry, or the like.
  • the terminal device 10 may further include a speaker and an audio output control section.
  • the audio output control section causes the speaker to output audio for notifying the danger information.
  • the voice output control unit may change the volume of the notification according to the degree of danger of the danger information received from the server device 40 . For example, the audio output control unit outputs a louder volume when the risk is "high” than when the risk is "low".
  • the vehicle that has been involved in the accident is sent to other vehicles in the vicinity.
  • a request may be made to send the image data of the accident together with the risk information of the accident to the server device 40 .
  • Server device 40 may transmit video data received from other vehicles to the vehicle involved in the accident. By receiving video data shot by other vehicles, the vehicle involved in the accident can check the circumstances of the accident that are difficult to check due to blind spots from the own vehicle.
  • the present disclosure can be used, for example, in a danger information notification system including terminal devices mounted on multiple moving bodies.
  • This disclosure includes matters that contribute to the realization of the SDGs "Building a foundation for industry and technological innovation" and contributes to value creation through IoT solutions.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

A terminal device 10 comprises: a video data acquisition unit 21 that acquires video data captured of an area around a moving body; a hazard information detection unit 30 that detects, from the video data, hazard information and the type thereof; and a hazard information communication control unit 32 that transmits the hazard information detected by the hazard information detection unit 30 to a server device 40, and receives, from the server device 40, hazard information for which notification is to be provided, when positioning within a notification area specified by the server device 40.

Description

危険情報通知システム、端末装置および危険情報通知方法Danger information notification system, terminal device and danger information notification method
　本発明は、危険情報通知システム、端末装置および危険情報通知方法に関する。 The present invention relates to a danger information notification system, a terminal device, and a danger information notification method.
　車両からの通知を受信した場合、事故発生位置から所定範囲内に存在する他車両へ事故発生通知を行う技術が知られている（例えば、特許文献１参照）。複数の車両のいずれかに所定の事象が発生した際に、車両の特徴データと発生地点とに基づき、送信領域に所在する車両へ事象の発生を報知する技術が知られている（例えば、特許文献２参照）。 A technology is known in which, when a notification from a vehicle is received, an accident notification is sent to other vehicles within a predetermined range from the accident location (see Patent Document 1, for example). There is a known technology that, when a predetermined event occurs in one of a plurality of vehicles, notifies the occurrence of the event to a vehicle located in a transmission area based on vehicle characteristic data and the location of occurrence (for example, patent Reference 2).
特開２０１７－１１７００５号公報Japanese Patent Application Laid-Open No. 2017-117005 特許第６５４６０２８号公報Japanese Patent No. 6546028
　例えば、クラウドサービスなどを利用して、複数の車両の情報を共有して危険などを通知する場合、映像データをそのまま通信すると情報量が過大になるおそれがある。情報量を抑制しても、複数の車両の情報を共有して危険などを適切に通知することが望まれる。 For example, when using cloud services to share information on multiple vehicles and notify them of dangers, the amount of information may become excessive if video data is communicated as is. Even if the amount of information is suppressed, it is desirable to share information of a plurality of vehicles and appropriately notify danger and the like.
　本開示は、上記に鑑みてなされたものであって、情報量を抑制して、複数の車両の情報を共有して危険などを適切に通知することを目的とする。 The present disclosure has been made in view of the above, and aims to reduce the amount of information, share information on multiple vehicles, and appropriately notify danger and the like.
　上述した課題を解決し、目的を達成するために、本開示に係る危険情報通知システムは、移動体の周辺を撮影した映像データを取得する映像データ取得部と、前記映像データから危険情報とその種別を検出する危険情報検出部と、前記危険情報検出部によって検出された前記危険情報をサーバ装置へ送信する危険情報通信制御部と、を有する端末装置と、前記端末装置から受信した前記危険情報に基づいて、前記危険情報の種別によって前記危険情報を通知する通知エリアを特定する特定部と、前記通知エリア内に位置する対象移動体へ前記危険情報を通知するよう制御する通知制御部と、を有するサーバ装置と、を備える。 In order to solve the above-described problems and achieve the object, the danger information notification system according to the present disclosure includes a video data acquisition unit that acquires video data obtained by photographing the surroundings of a moving object; a terminal device having a danger information detection unit that detects a type; and a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device; and the danger information received from the terminal device. a specifying unit for specifying a notification area for notifying the danger information according to the type of the danger information, a notification control unit for controlling the notification of the danger information to a target moving object located in the notification area, based on and a server device having
　本開示に係る端末装置は、移動体の周辺を撮影した映像データを取得する映像データ取得部と、前記映像データから危険情報とその種別を検出する危険情報検出部と、前記危険情報検出部によって検出された前記危険情報をサーバ装置へ送信し、前記サーバ装置によって特定される通知エリア内に位置する場合に、前記サーバ装置から通知される危険情報を受信する危険情報通信制御部と、を備える。 A terminal device according to the present disclosure includes a video data acquisition unit that acquires video data captured around a moving object, a danger information detection unit that detects danger information and its type from the video data, and a danger information detection unit that: a danger information communication control unit that transmits the detected danger information to a server device and receives the danger information notified from the server device when the device is located within the notification area specified by the server device. .
　本開示に係る危険情報通知方法は、端末装置が実行する、移動体の周辺を撮影した映像データを取得する映像データ取得ステップと、前記映像データから危険情報とその種別を検出する危険情報検出ステップと、前記危険情報検出ステップによって検出された前記危険情報をサーバ装置へ送信する危険情報通信制御ステップと、サーバ装置が実行する、前記端末装置から受信した前記危険情報に基づいて、前記危険情報の種別によって前記危険情報を通知する通知エリアを特定する特定ステップと、前記通知エリア内に位置する対象移動体へ前記危険情報を通知するよう制御する通知制御ステップと、を含む。 A danger information notification method according to the present disclosure includes a video data acquisition step of acquiring video data of a surrounding of a mobile object, and a danger information detection step of detecting danger information and its type from the video data, which are executed by a terminal device. a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server; The method includes a specifying step of specifying a notification area for notifying the danger information according to a type, and a notification control step of controlling to notify the danger information to a target moving body located in the notification area.
　本開示によれば、情報量を抑制して、複数の車両の情報を共有して危険などを適切に通知することができるという効果を奏する。 According to the present disclosure, it is possible to reduce the amount of information, share information on a plurality of vehicles, and appropriately notify danger and the like.
図１は、実施形態に係る危険情報通知システムの構成例を示す概略図である。FIG. 1 is a schematic diagram showing a configuration example of a danger information notification system according to an embodiment. 図２は、実施形態に係る端末装置の構成例を示すブロック図である。FIG. 2 is a block diagram illustrating a configuration example of a terminal device according to the embodiment; 図３は、実施形態に係るサーバ装置の構成例を示すブロック図である。FIG. 3 is a block diagram illustrating a configuration example of a server device according to the embodiment; 図４は、危険種別情報の一例を説明する図である。FIG. 4 is a diagram illustrating an example of risk type information. 図５は、危険種別情報の他の例を説明する図である。FIG. 5 is a diagram illustrating another example of risk type information. 図６は、実施形態に係る危険情報通知システムにおける処理の流れを示すシーケンス図である。FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system according to the embodiment.
　以下に添付図面を参照して、本開示に係る危険情報通知システム、端末装置および危険情報通知方法の実施形態を詳細に説明する。なお、以下の実施形態により本発明が限定されるものではない。 Embodiments of a danger information notification system, a terminal device, and a danger information notification method according to the present disclosure will be described below in detail with reference to the accompanying drawings. In addition, the present invention is not limited by the following embodiments.
［実施形態］
＜危険情報通知システム＞
　図１は、実施形態に係る危険情報通知システム１の構成例を示す概略図である。危険情報通知システム１は、複数の移動体に搭載された端末装置１０と、サーバ装置４０とを有する。危険情報通知システム１は、複数の端末装置１０からサーバ装置４０へ送信された危険情報に基づいて、サーバ装置４０から通知エリア内の対象移動体に危険情報を通知する。 [Embodiment]
<Danger information notification system>
FIG. 1 is a schematic diagram showing a configuration example of a danger information notification system 1 according to an embodiment. The danger information notification system 1 has a terminal device 10 mounted on a plurality of moving bodies and a server device 40 . The danger information notification system 1 notifies the target mobile object within the notification area of the danger information from the server device 40 based on the danger information transmitted from the plurality of terminal devices 10 to the server device 40 .
　危険情報とは、道路の周辺で発生する危険に関する情報である。危険情報とは、道路を通行中の移動体に影響を及ぼす可能性がある危険に関する情報である。危険情報とは、道路の通行時に、移動体が注意すべき危険に関する情報である。危険情報とは、移動体が、例えば、減速したり、迂回したり、停止したり、他の場所よりも注意深く通行したりする必要がある危険に関する情報である。 　Danger information is information about dangers that occur around roads. Danger information is information about dangers that may affect moving bodies traveling on roads. Danger information is information about dangers that a moving object should be aware of when traveling on a road. Danger information is information about dangers that require the mobile body to slow down, take a detour, stop, or pass more carefully than other places, for example.
　移動体は、道路を移動する移動体である。移動体は、例えば、車両および歩行者を含む。以下の説明では、移動体の一例として、車両について説明する。 A mobile object is a mobile object that moves on roads. Mobile objects include, for example, vehicles and pedestrians. In the following description, a vehicle will be described as an example of a mobile object.
＜端末装置＞
　図２は、実施形態に係る端末装置１０の構成例を示すブロック図である。端末装置１０は、車両の走行時に撮影した映像データから車両の周辺の危険情報を検出して、危険情報をサーバ装置４０へ送信する。端末装置１０は、サーバ装置４０から危険情報を受信した場合、危険情報を搭乗者に通知する。本実施形態では、端末装置１０は、いわゆるドライブレコーダである。端末装置１０は、車両に載置されているものに加えて、可搬型で車両において利用可能な装置であってもよい。端末装置１０は、カメラ１１と、記録部１２と、表示部１３と、ＧＮＳＳ（Ｇｌｏｂａｌ　Ｎａｖｉｇａｔｉｏｎ　Ｓａｔｅｌｌｉｔｅ　Ｓｙｓｔｅｍ）の一例である、ＧＰＳ（Ｇｌｏｂａｌ　Ｐｏｓｉｔｉｏｎｉｎｇ　Ｓｙｓｔｅｍ）受信部１４と、認識辞書記憶部１６と、通信部１７と、制御部２０とを有する。 <Terminal device>
FIG. 2 is a block diagram showing a configuration example of the terminal device 10 according to the embodiment. The terminal device 10 detects danger information around the vehicle from video data captured while the vehicle is running, and transmits the danger information to the server device 40 . When the terminal device 10 receives danger information from the server device 40, the terminal device 10 notifies the passenger of the danger information. In this embodiment, the terminal device 10 is a so-called drive recorder. The terminal device 10 may be a portable device that can be used in a vehicle, in addition to one that is mounted on the vehicle. The terminal device 10 includes a camera 11, a recording unit 12, a display unit 13, a GPS (Global Positioning System) receiving unit 14, which is an example of a GNSS (Global Navigation Satellite System), a recognition dictionary storage unit 16, and communication. 17 and a control unit 20 .
　カメラ１１は、車両の周辺を撮影するカメラである。カメラ１１は、少なくとも車両の前方または後方を撮影する。本実施形態では、カメラ１１は、車両の車室内に配置された前方および後方を撮影する２つのカメラであり、それぞれが水平方向に１７８°程度、上下方向に６０°程度を撮影可能な超広角カメラとすることで車両周辺をほぼ全周囲にわたり撮影可能なものとして説明するが、これに限定されず、例えば、３６０°の全方位を撮影可能な魚眼系レンズを有したカメラ、または、各方向をそれぞれ撮影する複数のカメラ群で構成してもよい。また、後述する対象物の距離測定に適したステレオカメラで構成してもよい。カメラ１１は、エンジンが始動してから停止するまでの間、つまり車両が動作している間は、映像を常時撮影する。本実施形態では、カメラ１１は、車両のアクセサリ電源がＯＮである間、映像を常時撮影する。カメラ１１は、撮影した映像データを制御部２０の映像データ取得部２１へ出力する。映像データは、例えば毎秒３０フレームの画像から構成される動画像である。カメラ１１は、車両に搭載されたものに限定されず、道路の近傍に設置された定点カメラまたは防犯カメラなどであってもよい。 The camera 11 is a camera that captures the surroundings of the vehicle. Camera 11 captures at least the front or rear of the vehicle. In this embodiment, the cameras 11 are two cameras arranged in the interior of the vehicle for photographing the front and rear, each of which is an ultra-wide-angle camera capable of photographing about 178° in the horizontal direction and about 60° in the vertical direction. Although it is assumed that the camera is capable of photographing almost the entire periphery of the vehicle, it is not limited to this. It may be composed of a plurality of camera groups that capture images in each direction. Moreover, a stereo camera suitable for distance measurement of an object, which will be described later, may be used. The camera 11 constantly captures images from the time the engine is started until it stops, that is, while the vehicle is operating. In this embodiment, the camera 11 constantly captures images while the accessory power source of the vehicle is ON. The camera 11 outputs captured image data to the image data acquisition unit 21 of the control unit 20 . The video data is, for example, moving images composed of images of 30 frames per second. The camera 11 is not limited to one mounted on a vehicle, and may be a fixed-point camera or a security camera installed near a road.
　記録部１２は、端末装置１０におけるデータの一時記憶などに用いられる。記録部１２は、例えば、ＲＡＭ（Ｒａｎｄｏｍ　Ａｃｃｅｓｓ　Ｍｅｍｏｒｙ）、フラッシュメモリなどの半導体メモリ素子、または、メモリカードなどの記録部である。または、図示しない通信装置を介して無線接続される外部記録部であってもよい。記録部１２は、制御部２０の記録制御部２４から出力された制御信号に基づいて、ループ記録データを記録する。 The recording unit 12 is used for temporary storage of data in the terminal device 10 . The recording unit 12 is, for example, a RAM (Random Access Memory), a semiconductor memory device such as a flash memory, or a recording unit such as a memory card. Alternatively, it may be an external recording unit wirelessly connected via a communication device (not shown). The recording section 12 records the loop recording data based on the control signal output from the recording control section 24 of the control section 20 .
　表示部１３は、一例としては、端末装置１０に固有の表示装置、または、ナビゲーションシステムを含む他のシステムと共用した表示装置などである。表示部１３は、例えば、液晶ディスプレイ（ＬＣＤ：Ｌｉｑｕｉｄ　Ｃｒｙｓｔａｌ　Ｄｉｓｐｌａｙ）または有機ＥＬ（Ｅｌｅｃｔｒｏ－Ｌｕｍｉｎｅｓｃｅｎｃｅ）ディスプレイなどを含むディスプレイである。表示部１３は、制御部２０の表示制御部２５から出力された映像信号に基づいて、映像を表示する。表示部１３は、カメラ１１が撮影している映像、または、記録部１２に記録された映像を表示する。表示部１３は、周辺車両が危険運転をしていることを、車両の運転者に報知する情報を表示する。 The display unit 13 is, for example, a display device unique to the terminal device 10 or a display device shared with other systems including a navigation system. The display unit 13 is a display including, for example, a liquid crystal display (LCD) or an organic EL (electro-luminescence) display. The display unit 13 displays images based on the video signal output from the display control unit 25 of the control unit 20 . The display unit 13 displays images captured by the camera 11 or images recorded in the recording unit 12 . The display unit 13 displays information for notifying the driver of the vehicle that the surrounding vehicle is driving dangerously.
　ＧＰＳ受信部１４は、図示しないＧＰＳ衛星から電波を受信する。ＧＰＳ受信部１４は、受信した電波の信号を制御部２０の位置情報取得部２６へ出力する。 The GPS receiving unit 14 receives radio waves from GPS satellites (not shown). The GPS receiver 14 outputs the received radio wave signal to the position information acquisition unit 26 of the controller 20 .
　認識辞書記憶部１６は、危険情報および危険情報の種別の認識辞書を記憶する。認識辞書記憶部１６は、通信部１７を介して認識辞書を取得する外部サーバ等の記憶装置であってもよい。 The recognition dictionary storage unit 16 stores danger information and recognition dictionaries for types of danger information. The recognition dictionary storage unit 16 may be a storage device such as an external server that acquires the recognition dictionary via the communication unit 17 .
　危険情報の種別は、例えば、衝突事故、ひき逃げ事故、煽り運転、高速道路逆走、火災、土砂災害、土砂・土木道路封鎖、地盤崩落、地震による津波、路面凍結・積雪・冠水、および、大規模停電を含む。 The types of danger information include, for example, collision accident, hit-and-run accident, backtracking driving, wrong-way driving on the highway, fire, landslide disaster, landslide/engineering road blockage, ground collapse, tsunami caused by earthquake, road surface freezing/snow/flooding, and large-scale disaster. Including large-scale blackouts.
　通信部１７は、通信ユニットである。通信部１７は、インターネットまたは携帯電話回線などいずれの方法で通信を行ってもよい。通信部１７は、サーバ装置４０とデータを通信する。 The communication unit 17 is a communication unit. The communication unit 17 may communicate by any method such as the Internet or a mobile phone line. The communication unit 17 communicates data with the server device 40 .
　制御部２０は、例えば、ＣＰＵ（Ｃｅｎｔｒａｌ　Ｐｒｏｃｅｓｓｉｎｇ　Ｕｎｉｔ）などで構成された演算処理装置（制御装置）である。制御部２０は、記憶されているプログラムをメモリにロードして、プログラムに含まれる命令を実行する。制御部２０には図示しない内部メモリが含まれ、内部メモリは制御部２０におけるデータの一時記憶などに用いられる。制御部２０は、バス２０Ｘに接続された、映像データ取得部２１と、バッファメモリ２２と、映像データ処理部２３と、記録制御部２４と、表示制御部２５と、位置情報取得部２６と、危険情報検出部３０と、危険情報通信制御部３２とを有する。 The control unit 20 is, for example, an arithmetic processing device (control device) configured by a CPU (Central Processing Unit). The control unit 20 loads a stored program into memory and executes instructions included in the program. The control unit 20 includes an internal memory (not shown), which is used for temporary storage of data in the control unit 20 and the like. The control unit 20 includes a video data acquisition unit 21, a buffer memory 22, a video data processing unit 23, a recording control unit 24, a display control unit 25, and a position information acquisition unit 26, which are connected to the bus 20X. It has a danger information detection unit 30 and a danger information communication control unit 32 .
　映像データ取得部２１は、車両の周辺を撮影した映像データを取得する。映像データ取得部２１は、車両の走行時に、通りがかりに周辺を撮影した映像データを取得する。より詳しくは、映像データ取得部２１は、カメラ１１が出力した映像データを取得して、バッファメモリ２２に出力する。 The video data acquisition unit 21 acquires video data of the surroundings of the vehicle. The video data acquisition unit 21 acquires video data of the surroundings captured while the vehicle is running. More specifically, the image data acquisition unit 21 acquires image data output by the camera 11 and outputs the image data to the buffer memory 22 .
　バッファメモリ２２は、制御部２０が備える内部メモリであり、映像データ取得部２１が取得した一定時間分の映像データを、更新しながら一時的に記録するメモリである。 The buffer memory 22 is an internal memory provided in the control unit 20, and is a memory that temporarily records video data for a certain period of time acquired by the video data acquisition unit 21 while updating.
　映像データ処理部２３は、バッファメモリ２２が一時的に記憶している映像データを、例えばＨ．２６４やＭＰＥＧ－４（Ｍｏｖｉｎｇ　Ｐｉｃｔｕｒｅ　Ｅｘｐｅｒｔｓ　Ｇｒｏｕｐ）などの任意の方式のコーデックで符号化して、音声データとともに、例えばＭＰ４形式などの任意のファイル形式に変換する。映像データ処理部２３は、バッファメモリ２２が一時的に記憶している映像データから、一定時間分のファイルとした映像データを生成する。具体例として、映像データ処理部２３は、バッファメモリ２２が一時的に記憶している映像データを、記録順に６０秒間の映像データを１ファイルとして生成する。映像データ処理部２３は、生成した映像データを記録制御部２４へ出力する。また、映像データ処理部２３は、生成した映像データを表示制御部２５へ出力する。ファイルとして生成される映像データの期間は、一例として６０秒としたが、これには限定されない。 The video data processing unit 23 converts the video data temporarily stored in the buffer memory 22 into H.264, for example. 264 or MPEG-4 (Moving Picture Experts Group) or any other codec, and converted into any file format such as MP4 format together with audio data. The video data processing unit 23 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 22 . As a specific example, the video data processing unit 23 generates 60 seconds of video data temporarily stored in the buffer memory 22 as one file in recording order. The video data processing section 23 outputs the generated video data to the recording control section 24 . Also, the video data processing unit 23 outputs the generated video data to the display control unit 25 . The period of video data generated as a file is set to 60 seconds as an example, but is not limited to this.
　記録制御部２４は、映像データ処理部２３でファイル化された映像データを、記録部１２に記録させる制御を行う。記録制御部２４は、車両のアクセサリ電源がＯＮであるときなど、ループ記録処理を実行する期間は、映像データ処理部２３でファイル化された映像データを、上書き可能な映像データとして、記録部１２に記録する。より詳しくは、記録制御部２４は、ループ記録処理を実行する期間は、映像データ処理部２３が生成した映像データを記録部１２に記録し続け、記録部１２の容量が一杯になった場合、最も古い映像データに新しい映像データを上書きして記録する。 The recording control unit 24 controls the recording unit 12 to record the video data filed by the video data processing unit 23 . The recording control unit 24 converts the video data filed by the video data processing unit 23 to the recording unit 12 as overwritable video data during a period in which the loop recording process is executed, such as when the accessory power source of the vehicle is ON. to record. More specifically, the recording control unit 24 continues recording the video data generated by the video data processing unit 23 in the recording unit 12 during the loop recording process. The oldest video data is overwritten with new video data and recorded.
　記録制御部２４は、危険情報検出部３０によって、危険情報が検出されたときに撮影された映像データを上書き禁止にして記録部１２に記録させてもよい。 The recording control unit 24 may cause the recording unit 12 to record the video data captured when the danger information is detected by the danger information detection unit 30 by prohibiting overwriting.
　表示制御部２５は、表示部１３における映像データの表示を制御する。表示制御部２５は、映像データを表示部１３に出力させる映像信号を出力する。より詳しくは、表示制御部２５は、カメラ１１が撮影している映像を表示部１３に表示させる。 The display control unit 25 controls display of video data on the display unit 13 . The display control unit 25 outputs a video signal that causes the display unit 13 to output video data. More specifically, the display control unit 25 causes the display unit 13 to display the image captured by the camera 11 .
　表示制御部２５は、危険情報通信制御部３２によってサーバ装置４０から危険情報を受信した場合、危険情報を表示部１３に表示させる。 When the danger information communication control unit 32 receives danger information from the server device 40, the display control unit 25 causes the display unit 13 to display the danger information.
　表示制御部２５は、サーバ装置４０から受信した危険情報の危険度に応じて、表示態様を変えて表示してもよい。表示制御部２５は、例えば、危険度が「大」である場合は「小」である場合に比べて、搭乗者が確認しやすいように目立つ表示態様で表示する。 The display control unit 25 may display by changing the display mode according to the degree of danger of the danger information received from the server device 40 . For example, when the risk is "high", the display control unit 25 displays it in a conspicuous display mode so that the passenger can easily check it, compared to when the risk is "small".
　位置情報取得部２６は、ＧＰＳ受信部１４が受信した電波に基づいて、車両の現在の位置情報を公知の方法によって算出する。位置情報取得部２６が算出した位置情報は、映像データとともに保存されてもよい。 The location information acquisition unit 26 calculates the current location information of the vehicle based on the radio waves received by the GPS reception unit 14 by a known method. The position information calculated by the position information acquisition unit 26 may be stored together with the video data.
　危険情報検出部３０は、映像データ取得部２１が取得した映像データから危険情報とその種別を検出する。より詳しくは、危険情報検出部３０は、カメラ１１が撮影した映像データから、例えば、認識辞書記憶部１６に記憶された認識辞書を使用して、危険情報とその種別を検出する。危険情報検出部３０は、撮影した映像データから、認識辞書を使用して、例えば、衝突事故、ひき逃げ事故、煽り運転、高速道路逆走、火災、土砂災害、土砂・土木道路封鎖、地盤崩落、地震による津波、路面凍結・積雪・冠水、および、大規模停を検出する。映像データから危険情報とその種別を検出する方法は、認識辞書を使用する方法に限定されず、公知の方法を使用可能である。危険情報検出部３０は、自車両が当事者として巻き込まれた事故および災害などの危険情報に限らず、通りがかりに遭遇した事故および災害などの危険情報とその種別を検出する。 The danger information detection unit 30 detects danger information and its type from the video data acquired by the video data acquisition unit 21 . More specifically, the danger information detection unit 30 detects danger information and its type from video data captured by the camera 11 using, for example, the recognition dictionary stored in the recognition dictionary storage unit 16 . The danger information detection unit 30 uses the recognition dictionary from the captured image data to detect, for example, collision accidents, hit-and-run accidents, slamming driving, wrong-way driving on highways, fires, landslide disasters, sediment/civil engineering road blockades, ground collapses, etc. Detects tsunamis caused by earthquakes, frozen road surfaces, snow cover, flooding, and large-scale stops. The method of detecting danger information and its type from video data is not limited to the method using a recognition dictionary, and known methods can be used. The danger information detection unit 30 detects not only danger information such as accidents and disasters in which the own vehicle is involved, but also danger information such as accidents and disasters encountered while passing by and its type.
　危険情報検出部３０は、検出した危険情報について、危険情報の種別に応じた各種項目を検出してもよい。危険情報検出部３０は、例えば、危険情報の種別「衝突事故」である場合、危険情報の項目として「事故の規模」を検出する。事故の規模は、例えば、自損事故、対物事故、多重事故、または、対人事故などの内容を映像データに画像処理を行って検出する。事故の規模は、例えば、緊急車両が出動しているか、車線が規制されているかなどを映像データに画像処理を行って検出する。危険情報検出部３０は、例えば、危険情報の種別「衝突事故」である場合、危険情報の項目としてさらに「怪我人の有無」を検出してもよい。怪我人の有無は、映像データに画像処理を行って検出する。 The danger information detection unit 30 may detect various items according to the type of danger information in the detected danger information. For example, when the type of danger information is "collision accident", the danger information detection unit 30 detects "scale of accident" as an item of danger information. The scale of the accident is detected by subjecting video data to image processing for the content of, for example, a self-inflicted accident, an accident involving property, a multiple accident, or an accident involving persons. The scale of the accident is detected, for example, by performing image processing on the video data to determine whether an emergency vehicle is dispatched or whether the lane is restricted. For example, when the type of danger information is "collision accident", the danger information detection unit 30 may further detect "presence or absence of injured person" as an item of danger information. The presence or absence of an injured person is detected by performing image processing on video data.
　危険情報検出部３０は、例えば、危険情報の種別「ひき逃げ事故」である場合、危険情報の項目として「事故の規模、車両ナンバー、車両カラー、車種」を検出する。危険情報検出部３０は、例えば、危険情報の種別「ひき逃げ事故」である場合、危険情報の項目としてさらに「怪我人の有無」を検出してもよい。車両ナンバー、車両カラー、車種は、映像データに画像処理を行って検出する。 For example, if the type of danger information is "hit-and-run accident", the danger information detection unit 30 detects "scale of accident, vehicle number, vehicle color, vehicle type" as items of danger information. For example, when the type of danger information is "hit-and-run accident", the danger information detection unit 30 may further detect "presence or absence of injured person" as an item of danger information. The vehicle number, vehicle color, and vehicle type are detected by performing image processing on the video data.
　危険情報検出部３０は、例えば、危険情報の種別「煽り運転」である場合、危険情報の項目として「車両ナンバー、車両カラー、車種」を検出する。危険情報検出部３０は、例えば、危険情報の種別「煽り運転」である場合、危険情報の項目としてさらに「搭乗者トラブルの有無」を検出してもよい。搭乗者トラブルとは、例えば、一方の車両の搭乗者が降車して他方の車両に近づいている状態である。搭乗者トラブルの有無は、映像データに画像処理を行って検出する。 For example, if the type of danger information is "reckoning driving", the danger information detection unit 30 detects "vehicle number, vehicle color, vehicle type" as items of danger information. For example, when the type of danger information is "relentless driving", the danger information detection unit 30 may further detect "presence or absence of passenger trouble" as an item of danger information. Passenger trouble is, for example, a state in which a passenger of one vehicle is getting off and approaching the other vehicle. The presence or absence of passenger trouble is detected by performing image processing on the video data.
　危険情報検出部３０は、例えば、危険情報の種別「高速道路逆走」である場合、危険情報の項目として「車両ナンバー、車両カラー、車種」を検出する。危険情報検出部３０は、例えば、危険情報の種別「高速道路逆走」である場合、危険情報の項目としてさらに「逆走の発生した高速道路名、料金所名、出入口名」を検出してもよい。高速道路名、料金所名、出入口名は、映像データまたは車両の位置情報および地図情報から検出する。 For example, if the type of danger information is "reversing the highway", the danger information detection unit 30 detects "vehicle number, vehicle color, vehicle type" as items of danger information. For example, when the type of danger information is "reverse driving on an expressway", the danger information detection unit 30 further detects "name of expressway, name of toll gate, name of entrance/exit where reverse driving occurred" as items of danger information. good too. Expressway names, tollgate names, and entrance/exit names are detected from video data, vehicle position information, and map information.
　危険情報検出部３０は、例えば、危険情報の種別「火災」である場合、危険情報の項目として「災害の規模」、「災害発生の区域」、「怪我人の有無」を検出する。災害の規模は、例えば、炎または煙が認識された面積の広さ、建物の数、延焼の有無を映像データに画像処理を行って検出する。災害発生の区域は、炎または煙が認識された範囲を映像データに画像処理を行って検出する。そして、図示しない地図情報に基づいて、火災が検出された災害発生の区域を特定する。怪我人の有無は、映像データに画像処理を行って検出する。 For example, if the type of danger information is "fire", the danger information detection unit 30 detects "scale of disaster", "area where disaster occurred", and "presence or absence of injured persons" as items of danger information. The scale of the disaster is detected, for example, by performing image processing on video data to determine the size of the area where flames or smoke are recognized, the number of buildings, and the presence or absence of spread of fire. The area where the disaster occurred is detected by performing image processing on the image data in the area where flames or smoke are recognized. Then, on the basis of map information (not shown), a disaster area where a fire is detected is specified. The presence or absence of an injured person is detected by performing image processing on video data.
　危険情報検出部３０は、例えば、危険情報の種別「土砂災害」である場合、危険情報の項目として「災害の規模、現地点が災害時の指定区域であるか？」を検出する。災害の規模は、例えば、土砂災害が認識された面積の広さを映像データに画像処理を行って検出する。現地点が災害時の指定区域であるか否かは、例えば、図示しない地図情報記憶部に記憶された地図情報に、現地点が土砂災害の指定区域として登録されているかどうかで検出する。 For example, if the type of danger information is "landslide disaster", the danger information detection unit 30 detects "the scale of the disaster and whether the local point is a designated area at the time of the disaster?" The scale of the disaster is detected, for example, by performing image processing on the video data for the size of the area where the landslide disaster is recognized. Whether or not the local point is a designated area for disaster is detected by, for example, whether or not the local point is registered as a designated area for landslide disaster in map information stored in a map information storage unit (not shown).
　危険情報検出部３０は、例えば、危険情報の種別「土砂・土木道路封鎖」である場合、危険情報の項目として「災害の規模」を検出する。災害の規模は、例えば、土砂・土木によって道路封鎖された範囲として認識された面積の広さを映像データに画像処理を行って検出する。 For example, the danger information detection unit 30 detects "scale of disaster" as an item of danger information when the type of danger information is "sediment/civil engineering road blockage". The scale of the disaster is detected, for example, by performing image processing on the video data to determine the size of the area recognized as the range where the road is blocked by earth and sand/civil engineering.
　危険情報検出部３０は、例えば、危険情報の種別「地盤崩落」である場合、危険情報の項目として「災害の規模」を検出する。災害の規模は、例えば、地盤が崩落した範囲として認識された面積の広さを映像データに画像処理を行って検出する。 For example, when the type of danger information is "ground collapse", the danger information detection unit 30 detects "scale of disaster" as an item of danger information. The scale of the disaster is detected, for example, by performing image processing on video data for the area recognized as the range where the ground collapsed.
　危険情報検出部３０は、例えば、危険情報の種別「地震による津波」である場合、危険情報の項目として「災害の規模、現地点が災害時の指定区域であるか？」を検出する。災害の規模は、例えば、外部の装置から取得した地震の震度または津波情報から認識する。現地点が災害時の指定区域であるか否かは、例えば、図示しない地図情報記憶部に記憶された地図情報に、現地点が地震による津波の指定区域として登録されているかどうかで検出する。 For example, if the type of danger information is "tsunami caused by an earthquake", the danger information detection unit 30 detects "the scale of the disaster and whether the local point is a designated area at the time of the disaster?" The scale of the disaster is recognized from, for example, seismic intensity or tsunami information obtained from an external device. Whether or not the local point is a designated area in the event of a disaster is detected by, for example, whether or not the local point is registered as a designated area for tsunami caused by an earthquake in map information stored in a map information storage unit (not shown).
　危険情報検出部３０は、例えば、危険情報の種別「路面凍結・積雪・冠水」である場合、危険情報の項目として「災害の規模、現地点が災害時の指定区域であるか？」を検出する。災害の規模は、例えば、外部の装置から取得した路面凍結・積雪・冠水の情報から認識する。現地点が災害時の指定区域であるか否かは、例えば、図示しない地図情報記憶部に記憶された地図情報に、現地点が路面凍結・積雪・冠水の指定区域として登録されているかどうかで検出する。 For example, when the type of danger information is "road surface freezing/snowfall/flooding", the danger information detection unit 30 detects "the scale of the disaster and whether the local point is a designated area at the time of the disaster?" do. The scale of the disaster is recognized from, for example, road surface freezing/snow cover/flooding information obtained from an external device. Whether or not a local point is a designated area in the event of a disaster is determined, for example, by whether or not the local point is registered as a designated area for road surface freezing, snow, or flooding in map information stored in a map information storage unit (not shown). To detect.
　危険情報検出部３０は、例えば、危険情報の種別「大規模停電」である場合、危険情報の項目として「災害の規模」を検出する。災害の規模は、例えば、外部の装置から取得した停電のエリアマップの情報から認識する。 For example, if the type of danger information is "large-scale blackout", the danger information detection unit 30 detects "scale of disaster" as an item of danger information. The scale of the disaster is recognized, for example, from power outage area map information obtained from an external device.
　危険情報検出部３０は、検出した危険情報について、さらに危険度を検出してもよい。より詳しくは、危険情報検出部３０は、検出した危険情報の「事故の規模」、「怪我人の有無」などの各種項目から危険度を検出してもよい。例えば、「事故の規模」が所定範囲以上である場合、危険度「大」とする。例えば、「怪我人がいる」場合、危険度「大」とする。例えば、危険情報の種別が「高速道路逆走」である場合、危険度「大」とする。例えば、危険情報の種別が「煽り運転」で「搭乗者トラブルあり」である場合、危険度「大」とする。 The danger information detection unit 30 may further detect the degree of danger for the detected danger information. More specifically, the danger information detection unit 30 may detect the degree of danger from various items such as "scale of accident" and "presence or absence of injured persons" of the detected danger information. For example, if the "accident scale" is greater than or equal to a predetermined range, the degree of risk is set to "high". For example, when "there is an injured person", the degree of danger is set to "high". For example, if the type of danger information is "reversing the highway", the degree of danger is "high". For example, if the type of danger information is "reckoning driving" and "passenger has trouble", the degree of danger is set to "high".
　危険情報通信制御部３２は、危険情報検出部３０によって検出された危険情報をサーバ装置４０と通信する。危険情報通信制御部３２は、危険情報検出部３０によって検出された危険情報をサーバ装置４０へ送信する。送信する危険情報には、危険度、危険情報の発生位置および発生日時を示す情報を含む。 The danger information communication control unit 32 communicates danger information detected by the danger information detection unit 30 with the server device 40 . The danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server device 40 . The danger information to be sent includes information indicating the degree of danger, the location of occurrence of the danger information, and the date and time of occurrence.
　危険情報通信制御部３２は、車両の周辺の危険情報をサーバ装置４０から受信する。危険情報通信制御部３２は、危険情報検出部３０によって検出された危険情報をサーバ装置４０へ送信し、サーバ装置３０によって特定される通知エリア内に位置する場合に、サーバ装置３０から通知される危険情報を受信する。本実施形態では、危険情報通信制御部３２は、サーバ装置４０から通知された危険情報を受信した場合であって、車両において危険情報検出部３０によって検出された危険情報の内容と同一であると判断した場合、再度、サーバ装置４０へ車両で検出した危険情報を送信するよう制御してもよい。これにより、端末装置１０からサーバ装置４０へ、常に最新の危険情報が送信される。 The danger information communication control unit 32 receives danger information around the vehicle from the server device 40 . The danger information communication control unit 32 transmits the danger information detected by the danger information detection unit 30 to the server device 40, and is notified by the server device 30 when the location is within the notification area specified by the server device 30. Receive danger information. In this embodiment, the danger information communication control unit 32 receives danger information notified from the server device 40 and determines that the danger information is the same as the danger information detected by the danger information detection unit 30 in the vehicle. When it is determined, it may be controlled to transmit the danger information detected by the vehicle to the server device 40 again. As a result, the latest danger information is always transmitted from the terminal device 10 to the server device 40 .
　危険情報の内容と同一であるとは、サーバ装置４０から通知された危険情報と車両において危険情報検出部３０によって検出された危険情報とが次の条件を満たすことである。２つの危険情報が、危険情報の種別が同一であり、発生位置の差異が所定距離内であり、発生日時の差異が所定時間内であることを満たすことをいう。 The fact that the contents of the danger information are the same means that the danger information notified from the server device 40 and the danger information detected by the danger information detection unit 30 in the vehicle satisfy the following conditions. It means that the two pieces of danger information have the same type of danger information, the difference in occurrence position is within a predetermined distance, and the difference in date and time of occurrence is within a predetermined time.
＜サーバ装置＞
　図３は、実施形態に係るサーバ装置４０の構成例を示すブロック図である。サーバ装置４０は、通信部４１と、危険種別情報記憶部４２と、制御部５０とを有する。 <Server device>
FIG. 3 is a block diagram showing a configuration example of the server device 40 according to the embodiment. The server device 40 has a communication section 41 , a risk type information storage section 42 and a control section 50 .
　通信部４１は、通信ユニットである。通信部４１は、インターネットまたは携帯電話回線などいずれの方法で通信を行ってもよい。通信部４１は、複数の車両に搭載された、端末装置１０とデータを通信する。 The communication unit 41 is a communication unit. The communication unit 41 may communicate by any method such as the Internet or a mobile phone line. The communication unit 41 communicates data with the terminal devices 10 mounted on a plurality of vehicles.
　危険種別情報記憶部４２は、危険種別情報を記憶する。危険種別情報記憶部４２は、通信部４１を介して危険種別情報を取得する外部サーバ等の記憶装置であってもよい。 The risk type information storage unit 42 stores risk type information. The risk class information storage unit 42 may be a storage device such as an external server that acquires risk class information via the communication unit 41 .
　危険種別情報は、危険情報の種別ごとの、危険情報の通知に関する情報である。本実施形態では、危険種別情報は、危険情報の種別ごとに、例えば、危険情報の通知エリア、通知する危険情報の項目、および、通知する時間間隔を含む情報である。危険情報の通知エリアは、危険情報を通知するエリアである。通知する危険情報の項目は、通知する項目である。通知する時間間隔は、通知を行う時間間隔である。 　Danger type information is information related to notification of danger information for each type of danger information. In this embodiment, the danger type information is information including, for example, a danger information notification area, an item of danger information to be notified, and a notification time interval for each type of danger information. The danger information notification area is an area in which danger information is notified. The item of danger information to be notified is an item to be notified. The notification time interval is the time interval for notification.
　図４は、危険種別情報の一例を説明する図である。図４に示す例では、危険情報の種別「衝突事故」は、通知エリアが「現場から半径１ｋｍ」、通知する危険情報の項目が「事故の規模」、通知する時間間隔が「５分毎」とされている。危険情報の種別「ひき逃げ事故」は、通知エリアが「対象車進行方向５ｋｍ」、通知する危険情報の項目が「事故の規模、車両ナンバー、車両カラー、車種」、通知する時間間隔が「１分毎」とされている。危険情報の種別「煽り運転」は、通知エリアが「対象車進行方向５ｋｍ」、通知する危険情報の項目が「車両ナンバー、車両カラー、車種」、通知する時間間隔が「１分毎」とされている。危険情報の種別「高速道路逆走」は、通知エリアが「逆送車進行方向１０ｋｍ」、通知する危険情報の項目が「車両ナンバー、車両カラー、車種」、通知する時間間隔が「３０秒毎」とされている。危険情報の種別「火災」は、通知エリアが「現場から半径１ｋｍ」、通知する危険情報の項目が「災害の規模、災害発生の区域」、通知する時間間隔が「１０分毎」とされている。危険情報の種別「土砂災害」は、通知エリアが「現場から半径５ｋｍ」、通知する危険情報の項目が「災害の規模、現地点が災害時の指定区域であるか？」、通知する時間間隔が「３０秒毎」とされている。危険情報の種別「土砂・土木道路封鎖」は、通知エリアが「現場から半径１ｋｍ」、通知する危険情報の項目が「災害の規模」、通知する時間間隔が「１０分毎」とされている。危険情報の種別「地盤崩落」は、通知エリアが「現場から半径１ｋｍ」、通知する危険情報の項目が「災害の規模」、通知する時間間隔が「５分毎」とされている。危険情報の種別「地震による津波」は、通知エリアが「現場から半径５ｋｍ」、通知する危険情報の項目が「災害の規模、現地点が災害時の指定区域であるか？」、通知する時間間隔が「３０秒毎」とされている。危険情報の種別「路面凍結・積雪・冠水」は、通知エリアが「現場から半径１ｋｍ」、通知する危険情報の項目が「災害の規模、現地点が災害時の指定区域であるか？」、通知する時間間隔が「１０分毎」とされている。危険情報の種別「大規模停電」は、通知エリアが「現場から半径１ｋｍ」、通知する危険情報の項目が「災害の規模」、通知する時間間隔が「１０分毎」とされている。 FIG. 4 is a diagram explaining an example of risk type information. In the example shown in FIG. 4, the type of danger information "collision accident" has a notification area of "1 km radius from the scene", an item of danger information to be notified of "accident scale", and a notification time interval of "every 5 minutes". It is said that The type of danger information "hit-and-run accident" has a notification area of "target vehicle traveling direction 5km", danger information items to be notified of "accident scale, vehicle number, vehicle color, vehicle type", and notification time interval of "1 minute". It is said to be "every". The type of hazard information, ``Driving,'' has a notification area of ``Target vehicle traveling direction 5km'', items of hazard information to be notified of ``vehicle number, vehicle color, and vehicle type'', and a time interval of notification of ``every minute''. ing. The type of danger information "Reversing the highway" has a notification area of "reversing vehicle travel direction 10km", items of danger information to be notified are "vehicle number, vehicle color, vehicle type", and time intervals to be notified are "every 30 seconds". ”. The type of danger information "fire" has a notification area of "1 km radius from the site", an item of danger information to be notified is "scale of disaster, area of disaster occurrence", and a time interval of notification is "every 10 minutes". there is The type of danger information "Landslide disaster" has a notification area of "5 km radius from the site", an item of danger information to be notified is "scale of disaster, is the local point in the designated area at the time of disaster?", and a time interval for notification. is "every 30 seconds". The type of danger information "Earth and sand/road blockage" has a notification area of "1 km radius from the site", an item of danger information to be notified of "scale of disaster", and a notification time interval of "every 10 minutes". . The danger information type "ground collapse" has a notification area of "1 km radius from the site", an item of danger information to be notified of "scale of disaster", and a time interval of notification of "every 5 minutes". The type of danger information "Tsunami caused by earthquake" has a notification area of "5 km radius from the site", danger information items to be notified of "scale of disaster, is the local point in the designated area at the time of disaster?", time to notify. The interval is set to "every 30 seconds". The type of danger information "frozen road surface/snowfall/flooding" has a notification area of "1 km radius from the site", an item of danger information to be notified is "the scale of the disaster, is the local point in the designated area at the time of the disaster?" The time interval for notification is "every 10 minutes". The type of danger information "Large power outage" has a notification area of "1 km radius from the site", an item of danger information to be notified of "scale of disaster", and a notification time interval of "every 10 minutes".
　危険種別情報は、危険情報の種別ごとに、さらに緊急通報の要否を示す情報を含んでもよい。本実施形態では、危険種別情報は、危険情報の種別および危険度ごとに、緊急通報の要否を示す情報を含んでもよい。 The risk type information may further include information indicating whether an emergency call is necessary for each type of risk information. In this embodiment, the danger type information may include information indicating whether or not an emergency call is necessary for each type and degree of danger information.
　危険度は、危険種別ごとに周囲に与える影響の大きさを示す。本実施形態では、危険度は、道路を走行中の車両に与える影響の大きさを示す。危険度は、例えば「大」、「小」で示される。危険度「大」は、例えば、道路の走行に支障が出るレベルである。危険度「大」は、例えば、緊急機関への通報が必要なレベルである。危険度「小」は、例えば、道路の走行に注意が必要なレベルである。危険度「小」は、例えば、緊急機関への通報が必要ではないレベルである。 The degree of risk indicates the magnitude of the impact on the surroundings for each type of risk. In this embodiment, the degree of danger indicates the magnitude of the impact on vehicles traveling on the road. The degree of risk is indicated by, for example, "high" and "low". The "high" degree of danger is, for example, a level that interferes with driving on the road. A "high" degree of risk is, for example, a level that requires reporting to an emergency agency. The "low" degree of risk is, for example, a level that requires caution when driving on roads. A "low" risk is, for example, a level that does not require reporting to an emergency agency.
　緊急機関とは、緊急時に通報する通報先の機関である。緊急機関とは、例えば、警察機関または救急要請を行う機関などを含む。 　Emergency organizations are organizations to which to report in an emergency. The emergency agency includes, for example, a police agency or an agency that requests an ambulance.
　図５は、危険種別情報の他の例を説明する図である。図５に示す例では、危険情報の種別の危険度ごとに、危険情報の通知エリア、通知する危険情報の項目、通知する時間間隔、および、緊急通報の要否を含む情報が規定されている。危険情報の種別「煽り運転」、危険度「大」は、通知エリアが「対象車進行方向５ｋｍ」、通知する危険情報の項目が「車両ナンバー、車両カラー、車種」、通知する時間間隔が「１分毎」、緊急通報「通報する」とされている。危険情報の種別「煽り運転」、危険度「小」は、通知エリアが「対象車進行方向３ｋｍ」、通知する危険情報の項目が「車両ナンバー、車両カラー、車種」、通知する時間間隔が「１分毎」、緊急通報「通報しない」とされている。 FIG. 5 is a diagram explaining another example of risk type information. In the example shown in FIG. 5, information including the notification area of danger information, the items of danger information to be notified, the notification time interval, and the necessity of an emergency call is defined for each degree of danger of each type of danger information. . The type of hazard information is ``furious driving'' and the degree of hazard is ``high'', the notification area is ``target vehicle traveling direction 5km'', the items of hazard information to be notified are ``vehicle number, vehicle color, vehicle type'', and the notification time interval is `` Every minute", emergency call "notify". The type of hazard information is ``furious driving'' and the degree of danger is ``small'', the notification area is ``3km in the direction of the target vehicle'', the items of hazard information to be notified are ``vehicle number, vehicle color, and vehicle type'', and the notification time interval is `` Every minute", emergency call "do not call".
　制御部５０は、例えば、ＣＰＵなどで構成された演算処理装置である。制御部５０は、記憶されているプログラムをメモリにロードして、プログラムに含まれる命令を実行する。制御部５０には図示しない内部メモリが含まれ、内部メモリはサーバ装置４０におけるデータの一時記憶などに用いられる。制御部５０は、危険情報受信制御部５１と、特定部５２と、通報判定部５３と、通知制御部５４と、通報制御部５５とを有する。通報判定部５３および通報制御部５５は、必須の構成ではない。 The control unit 50 is, for example, an arithmetic processing device configured with a CPU or the like. The control unit 50 loads the stored program into memory and executes the instructions contained in the program. The control unit 50 includes an internal memory (not shown), which is used for temporary storage of data in the server device 40 and the like. The control unit 50 has a danger information reception control unit 51 , an identification unit 52 , a notification determination unit 53 , a notification control unit 54 and a notification control unit 55 . The report determination unit 53 and the report control unit 55 are not essential components.
　危険情報受信制御部５１は、通信部４１を介して、複数の車両に搭載された端末装置１０から危険情報を受信するよう制御する。 The danger information reception control unit 51 controls to receive danger information from the terminal devices 10 mounted on a plurality of vehicles via the communication unit 41 .
　特定部５２は、端末装置１０から受信した危険情報に基づいて、危険情報の種別によって危険情報を通知する通知エリアを特定する。特定部５２は、危険種別情報記憶部４２に記憶された危険種別情報から、受信した危険情報を通知する通知エリアを特定する。特定部５２は、例えば、危険情報の種別が「高速道路逆走」である場合、通知エリアを「逆送車進行方向１０ｋｍ」と特定する。 Based on the danger information received from the terminal device 10, the identifying unit 52 identifies a notification area for notifying danger information according to the type of danger information. The identifying unit 52 identifies a notification area for notifying the received danger information from the danger classification information stored in the danger classification information storage unit 42 . For example, when the type of danger information is "reverse driving on an expressway", the identifying unit 52 identifies the notification area as "reversing vehicle traveling direction 10 km".
　特定部５２は、受信した危険情報の危険度に応じて、通知する通知エリアを特定してもよい。例えば、特定部５２は、危険度が「大」である場合は「小」である場合に比べて、拡大した通知エリアを特定してもよい。 The specifying unit 52 may specify the notification area to be notified according to the degree of danger of the received danger information. For example, the specifying unit 52 may specify an expanded notification area when the risk is "high" compared to when the risk is "low".
　本実施形態では、特定部５２は、さらに、通知する危険情報の項目、および、通知する時間間隔を特定してもよい。特定部５２は、危険種別情報記憶部４２に記憶された危険種別情報から、受信した危険情報について、通知する危険情報の項目、および、通知する時間間隔を特定してもよい。 In this embodiment, the specifying unit 52 may further specify items of danger information to be notified and time intervals for notification. The identification unit 52 may identify the items of danger information to be notified and the time intervals for notification regarding the received danger information from the danger classification information stored in the danger classification information storage unit 42 .
　本実施形態では、特定部５２は、受信した複数の危険情報の内容が同一であると判定された場合、通知エリアを再度特定する。例えば、特定部５２は、最新の危険情報に基づいて、通知エリアを再度特定してもよい。例えば、特定部５２は、複数の危険情報に含まれる発生位置の平均値に基づいて、通知エリアを再度特定してもよい。発生位置の平均値は、例えば、各発生位置の地図座標の値の平均値である。例えば、特定部５２は、受信した危険情報の数が多くなるほど、通知エリアを広げて再度特定してもよい。 In the present embodiment, the specifying unit 52 specifies the notification area again when it is determined that the received multiple pieces of risk information have the same content. For example, the specifying unit 52 may specify the notification area again based on the latest danger information. For example, the identifying unit 52 may re-identify the notification area based on the average value of occurrence positions included in a plurality of pieces of risk information. The average value of the occurrence positions is, for example, the average value of the map coordinate values of each occurrence position. For example, the specifying unit 52 may widen the notification area and specify again as the number of danger information received increases.
　複数の危険情報の内容が同一であるとは、受信した複数の危険情報が次の条件を満たすことである。複数の危険情報が、危険情報の種別が同一であり、発生位置の差異が所定距離内であり、発生日時の差異が所定時間内であることを満たすことをいう。 　The contents of multiple pieces of danger information are the same when the received multiple pieces of danger information meet the following conditions. It means that a plurality of pieces of danger information have the same type of danger information, the difference in occurrence positions is within a predetermined distance, and the difference in date and time of occurrence is within a predetermined time.
　通報判定部５３は、端末装置１０から受信した危険情報の危険度に応じて緊急機関へ通報するか否かを判定する。本実施形態では、通報判定部５３は、危険種別情報記憶部４２に記憶された危険種別情報に基づいて、緊急機関へ通報するか否かを判定する。通報判定部５３は、危険度が「大」である場合、緊急機関へ通報するか否かを判定する。通報判定部５３は、同一の内容の危険情報について、すでに緊急機関へ通報している場合、通報を重複して行わない。 The report determination unit 53 determines whether or not to report to an emergency agency according to the degree of risk in the danger information received from the terminal device 10. In this embodiment, the report determination unit 53 determines whether or not to notify the emergency agency based on the risk type information stored in the risk type information storage unit 42 . If the degree of danger is "high", the report determination unit 53 determines whether or not to report to an emergency agency. If the same content of danger information has already been reported to the emergency agency, the report determination unit 53 does not make the report redundantly.
　通報判定部５３は、端末装置１０から受信した危険情報について「怪我人あり」で、「緊急車両の出動なし」であることを示す情報を含む場合、緊急機関へ通報すると判定してもよい。 If the danger information received from the terminal device 10 includes information indicating that "there is an injured person" and "no emergency vehicle is dispatched", the notification determination unit 53 may determine that an emergency agency should be notified.
　通知制御部５４は、通知エリア内に位置する対象車両へ危険情報を通知するよう制御する。より詳しくは、通知制御部５４は、特定部５２の特定結果に基づいて、通知エリア内に位置する対象車両の端末装置１０へ危険情報を通知するよう制御する。 The notification control unit 54 controls to notify the target vehicle located within the notification area of the danger information. More specifically, the notification control unit 54 controls to notify the terminal device 10 of the target vehicle located within the notification area of the danger information based on the identification result of the identification unit 52 .
　本実施形態では、通知制御部５４は、受信した危険情報の種別に応じて、危険情報の項目、または、危険情報を通知する時間間隔を変えて通知するよう制御する。より詳しくは、通知制御部５４は、特定部５２の特定結果に基づいて、危険情報の項目、または、危険情報を通知する時間間隔を変えて通知するよう制御する。 In this embodiment, the notification control unit 54 performs control to change the items of danger information or the time intervals for notifying danger information according to the type of danger information received. More specifically, the notification control unit 54 performs control to change the item of danger information or the time interval for notifying the danger information based on the identification result of the identification unit 52 so as to notify the danger information.
　通報制御部５５は、端末装置１０から受信した危険情報の危険度に応じて緊急機関へ通報するよう制御する。より詳しくは、通報制御部５５は、通報判定部５３が「通報する」と判定した場合、緊急機関へ通報するよう制御する。通報制御部５５は、通信部４１を制御して、緊急機関に対する出動要請を伴う通報を示す通報情報を送信する。通報情報には、車両を識別する情報と、車両の現在位置情報と、出動要請を示す情報とを含む。 The report control unit 55 controls to report to emergency agencies according to the degree of danger of the danger information received from the terminal device 10. More specifically, when the report determination unit 53 determines to "report", the report control unit 55 controls to report to the emergency agency. The report control unit 55 controls the communication unit 41 to transmit report information indicating a report accompanied by a request for dispatch to an emergency agency. The report information includes information identifying the vehicle, current position information of the vehicle, and information indicating a dispatch request.
＜危険情報通知システムにおける処理＞
　次に、図６を参照して、危険情報通知システム１における情報処理について説明する。図６は、実施形態に係る危険情報通知システム１における処理の流れを示すシーケンス図である。各車両に搭載された端末装置１０は、車両が起動している間、起動している。端末装置１０が起動している間、カメラ１１によって常時撮影が行われる。 <Processing in the danger information notification system>
Next, information processing in the danger information notification system 1 will be described with reference to FIG. FIG. 6 is a sequence diagram showing the flow of processing in the danger information notification system 1 according to the embodiment. The terminal device 10 mounted on each vehicle is activated while the vehicle is activated. While the terminal device 10 is running, the camera 11 constantly takes pictures.
　まず、車両に配置された端末装置１０の制御部２０によって、車両位置情報が取得される（ステップＳ１１）。より詳しくは、制御部２０は、位置情報取得部２６によって、ＧＰＳ受信部１４が受信した電波に基づいて、車両の現在の位置情報を公知の方法によって算出される。制御部２０は、ステップＳ１２へ進む。 First, vehicle position information is acquired by the control unit 20 of the terminal device 10 installed in the vehicle (step S11). More specifically, the control unit 20 causes the position information acquiring unit 26 to calculate the current position information of the vehicle based on the radio waves received by the GPS receiving unit 14 by a known method. The control unit 20 proceeds to step S12.
　制御部２０は、映像データを取得する（ステップＳ１２）。より詳しくは、制御部２０は、映像データ取得部２１によって、カメラ１１で車両の周辺を撮影した映像データが取得される。制御部２０は、ステップＳ１３へ進む。 The control unit 20 acquires video data (step S12). More specifically, the image data acquisition unit 21 of the control unit 20 acquires image data of the surroundings of the vehicle captured by the camera 11 . The control unit 20 proceeds to step S13.
　制御部２０は、危険情報を検出する（ステップＳ１３）。より詳しくは、制御部２０は、危険情報検出部３０によって、カメラ１１が撮影した映像データから、認識辞書記憶部１６に記憶された認識辞書を使用して、危険情報とその種別を検出する。制御部２０は、危険情報検出部３０によって、検出した危険情報について、危険情報の種別に応じた各種項目を検出する。制御部２０は、危険情報検出部３０によって、検出した危険情報について、危険度を検出する。制御部２０は、ステップＳ１４へ進む。 The control unit 20 detects danger information (step S13). More specifically, the control unit 20 uses the recognition dictionary stored in the recognition dictionary storage unit 16 to detect danger information and its type from the video data captured by the camera 11 by the danger information detection unit 30 . The control unit 20 detects various items according to the type of danger information from the danger information detected by the danger information detection unit 30 . The control unit 20 detects the degree of danger for the detected danger information by the danger information detection unit 30 . The control unit 20 proceeds to step S14.
　制御部２０は、危険情報を送信する（ステップＳ１４）。より詳しくは、制御部２０は、危険情報通信制御部３２によって、危険情報検出部３０で検出された危険情報を、サーバ装置４０へ送信する。ステップＳ１４によって送信される危険情報には、危険度、危険情報の発生位置および発生日時を示す情報を含む。 The control unit 20 transmits danger information (step S14). More specifically, the control unit 20 causes the danger information communication control unit 32 to transmit the danger information detected by the danger information detection unit 30 to the server device 40 . The danger information transmitted in step S14 includes information indicating the degree of danger, the location of occurrence of the danger information, and the date and time of occurrence.
　サーバ装置４０の制御部５０によって、危険情報が受信される（ステップＳ２１）。より詳しくは、制御部５０は、危険情報受信制御部５１によって、車両に搭載された端末装置１０から危険情報を受信する。制御部５０は、ステップＳ２２へ進む。 The danger information is received by the control unit 50 of the server device 40 (step S21). More specifically, the control unit 50 uses the danger information reception control unit 51 to receive danger information from the terminal device 10 mounted on the vehicle. The controller 50 proceeds to step S22.
　制御部５０は、危険情報を通知する通知エリアを特定する（ステップＳ２２）。より詳しくは、制御部５０は、特定部５２によって、危険種別情報記憶部４２に記憶された危険種別情報から、受信した危険情報を通知する通知エリアを特定する。制御部５０は、特定部５２によって、さらに、通知する危険情報の項目、および、通知する時間間隔を特定してもよい。制御部５０は、特定部５２によって、危険種別情報記憶部４２に記憶された危険種別情報から、受信した危険情報について、通知する危険情報の項目、および、通知する時間間隔を特定してもよい。制御部５０は、特定部５２によって、例えば、危険情報の種別が「高速道路逆走」である場合、通知エリアを「逆送車進行方向１０ｋｍ」と特定する。制御部５０は、特定部５２によって、例えば、危険情報の種別が「高速道路逆走」である場合、通知する危険情報の項目として「車両ナンバー、車両カラー、車種」、時間間隔を「３０秒毎」と特定する。制御部５０は、ステップＳ２３へ進む。 The control unit 50 identifies a notification area for notifying danger information (step S22). More specifically, the control unit 50 causes the specifying unit 52 to specify the notification area for notifying the received danger information from the danger type information stored in the danger type information storage unit 42 . The control unit 50 may further use the specifying unit 52 to specify items of danger information to be notified and time intervals to be notified. The control unit 50 may use the identifying unit 52 to identify items of danger information to be notified and time intervals for notification regarding the received danger information from the danger type information stored in the danger type information storage unit 42 . . The control unit 50 uses the specifying unit 52 to specify, for example, when the type of danger information is “reversing the highway”, the notification area is “10 km in the direction in which the vehicle travels in the opposite direction”. For example, when the type of danger information is "reverse driving on an expressway", the control unit 50 causes the specifying unit 52 to specify "vehicle number, vehicle color, vehicle type" as the items of danger information to be notified, and set the time interval to "30 seconds." specified as "every". The controller 50 proceeds to step S23.
　制御部５０は、危険情報を通知する（ステップＳ２３）。より詳しくは、制御部５０は、通知制御部５４によって、特定部５２の特定結果に基づいて、通知エリア内に位置する対象車両の端末装置１０へ危険情報を通知するよう制御する。制御部５０は、通知制御部５４によって、例えば、危険情報の種別が「高速道路逆走」である場合、「逆送車進行方向１０ｋｍ」に位置する対象車両の端末装置１０へ危険情報を通知するよう制御する。制御部５０は、ステップＳ２４へ進む。 The control unit 50 notifies danger information (step S23). More specifically, the control unit 50 controls the notification control unit 54 to notify the terminal device 10 of the target vehicle located within the notification area of the danger information based on the identification result of the identification unit 52 . For example, when the type of danger information is "reversing highway", the control unit 50 notifies the terminal device 10 of the target vehicle located "10 km in the traveling direction of the reverse vehicle" of the danger information by the notification control unit 54. control to The controller 50 proceeds to step S24.
　制御部５０は、通報の要否を判定する（ステップＳ２４）。より詳しくは、制御部５０は、通報判定部５３によって、危険種別情報記憶部４２に記憶された危険種別情報に基づいて、緊急機関へ通報するか否かを判定する。制御部５０は、ステップＳ２５へ進む。 The control unit 50 determines whether a report is necessary (step S24). More specifically, based on the danger type information stored in the danger type information storage unit 42 , the control unit 50 determines whether or not to report to the emergency agency by the notification determination unit 53 . The controller 50 proceeds to step S25.
　制御部５０は、緊急機関へ通報する（ステップＳ２５）。より詳しくは、ステップＳ２４において「通報する」と判定された場合、制御部５０は、通報制御部５５によって、通信部４１を制御して、緊急機関に対する出動要請を伴う通報を示す通報情報を送信する。 The control unit 50 notifies the emergency agency (step S25). More specifically, when it is determined to "report" in step S24, the control unit 50 causes the report control unit 55 to control the communication unit 41 to transmit report information indicating a report accompanied by a request to the emergency organization. do.
　通知エリア内の対象車両である対象車両に搭載された、他の端末装置１０では、危険情報を受信する（ステップＳ３１）。より詳しくは、制御部２０は、危険情報通信制御部３２によって、車両の周辺の危険情報をサーバ装置４０から受信する。例えば、危険情報の種別が「高速道路逆走」である場合、「逆送車進行方向１０ｋｍ」に位置する対象車両の端末装置１０は、危険情報通信制御部３２によって、車両の周辺の危険情報をサーバ装置４０から受信する。制御部２０は、ステップＳ３２へ進む。 The other terminal device 10 mounted on the target vehicle within the notification area receives the danger information (step S31). More specifically, the control unit 20 receives the danger information around the vehicle from the server device 40 by the danger information communication control unit 32 . For example, when the type of danger information is “reverse driving on an expressway”, the terminal device 10 of the target vehicle located “10 km in the traveling direction of the reverse transport vehicle” receives danger information around the vehicle by the danger information communication control unit 32. is received from the server device 40 . The controller 20 proceeds to step S32.
　制御部２０は、危険情報を報知する（ステップＳ３２）。より詳しくは、制御部２０は、表示制御部２５によって、危険情報通信制御部３２によってサーバ装置４０から受信した危険情報を表示部１３に表示させる。制御部２０は、表示制御部２５によって、サーバ装置４０から受信した危険情報の種別および危険情報の項目を、時間間隔で表示部１３に表示させる。制御部２０は、表示制御部２５によって、危険情報の種別が「高速道路逆走」である場合、「車両ナンバー△□〇◇、青色の“Ａ（Ａは車種名）”が逆走中」といった情報を、時間間隔「３０秒毎」に表示部１３に表示させる。 The control unit 20 notifies danger information (step S32). More specifically, the control unit 20 causes the display control unit 25 to display the danger information received from the server device 40 by the danger information communication control unit 32 on the display unit 13 . The control unit 20 causes the display control unit 25 to display the types of danger information and items of danger information received from the server device 40 on the display unit 13 at time intervals. When the type of danger information is "reverse driving on an expressway", the control unit 20 causes the display control unit 25 to display "Vehicle number △ □ ◇, blue "A (A is the vehicle model name)" is driving in the reverse direction". is displayed on the display unit 13 at time intervals of "every 30 seconds".
＜効果＞
　上述したように、本実施形態は、車両の搭乗者による操作を必要とせずに、サーバ装置４０を介して、通知エリア内の対象車両に危険情報を適切に通知できる。本実施形態によれば、例えば、当事者の車両から危険情報を送信できない状態でも、通りがかりの他車両から危険情報をサーバ装置４０へ送信し、対象車両に危険情報を適切に通知できる。本実施形態によれば、映像データを通信する場合に比べて情報量を抑制して、複数の車両の危険情報を共有して危険などを適切に通知することができる。 <effect>
As described above, this embodiment can appropriately notify the target vehicle within the notification area of the danger information via the server device 40 without requiring an operation by the passenger of the vehicle. According to this embodiment, for example, even in a state in which danger information cannot be transmitted from the vehicle of the party concerned, other vehicles passing by can transmit the danger information to the server device 40, and the target vehicle can be appropriately notified of the danger information. According to this embodiment, the amount of information can be suppressed compared to the case of communicating video data, and danger information of a plurality of vehicles can be shared to appropriately notify danger and the like.
　本実施形態によれば、例えば、当事者の車両の搭乗者が緊急機関へ通報できない状態でも、通りがかりの他車両から危険情報をサーバ装置４０へ送信し、必要に応じて緊急機関へ通報できる。 According to this embodiment, for example, even if the passenger of the vehicle concerned cannot report to the emergency agency, the danger information can be transmitted to the server device 40 from another vehicle passing by, and the emergency agency can be notified if necessary.
　本実施形態では、危険情報の種別に応じて、危険情報の項目、または、危険情報を通知する時間間隔を変えて通知することができる。本実施形態は、危険情報を適切に通知することができる。 In this embodiment, depending on the type of danger information, it is possible to notify by changing the items of danger information or the time intervals for notifying danger information. This embodiment can appropriately notify danger information.
　本実施形態では、サーバ装置４０において受信された複数の危険情報の内容が同一であると判定された場合、通知エリアが再度特定される。本実施形態によれば、通知エリアを適切に特定することができる。 In this embodiment, when it is determined that the contents of a plurality of danger information received by the server device 40 are the same, the notification area is specified again. According to this embodiment, it is possible to appropriately specify the notification area.
　本実施形態では、サーバ装置４０において受信された危険情報の危険度に応じて緊急機関へ通報することができる。本実施形態は、必要な緊急機関への通報を適切に行うことができる。 In this embodiment, the server device 40 can report to emergency organizations according to the degree of danger of the danger information received. This embodiment can appropriately notify the necessary emergency agencies.
　本実施形態では、サーバ装置４０から通知された危険情報を受信した場合であって、車両において危険情報検出部３０によって検出された危険情報の内容と同一であると判断した場合、再度、サーバ装置４０へ車両で検出した危険情報を送信することができる。本実施形態によれば、端末装置１０からサーバ装置４０へ、常に最新の危険情報を送信することができる。本実施形態によれば、サーバ装置４０においては、より多くの端末装置１０から危険情報を受信することができる。 In this embodiment, when danger information notified from the server device 40 is received and it is determined that the content of the danger information is the same as the danger information detected by the danger information detection unit 30 in the vehicle, the server device 40 can transmit danger information detected by the vehicle. According to this embodiment, the latest danger information can always be transmitted from the terminal device 10 to the server device 40 . According to this embodiment, the server device 40 can receive danger information from more terminal devices 10 .
　本発明に係る危険情報通知システムは、上述した実施形態以外にも種々の異なる形態にて実施されてもよい。 The danger information notification system according to the present invention may be implemented in various forms other than the above-described embodiments.
　図示した危険情報通知システムの各構成要素は、機能概念的なものであり、必ずしも物理的に図示の如く構成されていなくてもよい。すなわち、各装置の具体的形態は、図示のものに限られず、各装置の処理負担や使用状況などに応じて、その全部または一部を任意の単位で機能的または物理的に分散または統合してもよい。 Each component of the illustrated danger information notification system is functionally conceptual and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to the illustrated one, and all or part of it may be functionally or physically distributed or integrated in arbitrary units according to the processing load and usage conditions of each device. may
　危険情報通知システムの構成は、例えば、ソフトウェアとして、メモリにロードされたプログラムなどによって実現される。上記実施形態では、これらのハードウェアまたはソフトウェアの連携によって実現される機能ブロックとして説明した。すなわち、これらの機能ブロックについては、ハードウェアのみ、ソフトウェアのみ、または、それらの組み合わせによって種々の形で実現できる。 The configuration of the danger information notification system is implemented, for example, as software by programs loaded into memory. In the above embodiments, functional blocks realized by cooperation of these hardware or software have been described. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.
　上記した構成要素には、当業者が容易に想定できるもの、実質的に同一のものを含む。さらに、上記した構成は適宜組み合わせが可能である。また、本発明の要旨を逸脱しない範囲において構成の種々の省略、置換または変更が可能である。 The above components include those that can be easily assumed by those skilled in the art and those that are substantially the same. Furthermore, the above configurations can be combined as appropriate. Also, various omissions, substitutions, or modifications of the configuration are possible without departing from the gist of the present invention.
　上記では、カメラ１１が撮影する映像データは、音声データを含んでもよい。音声データを音声認識処理を行って、事故などの衝撃音、人の叫び声などを検出してもよい。 In the above, the video data captured by the camera 11 may include audio data. The voice data may be subjected to voice recognition processing to detect an impact sound of an accident or the like, a human cry, or the like.
　上記では、端末装置１０は、さらにスピーカと音声出力制御部とを有してもよい。音声出力制御部は、危険情報通信制御部３２によってサーバ装置４０から危険情報を受信した場合、危険情報を通知する音声をスピーカで出力させる。音声出力制御部は、サーバ装置４０から受信した危険情報の危険度に応じて、音量を変えて通知してもよい。音声出力制御部は、例えば、危険度が「大」である場合は「小」である場合に比べて、音量を大きく出力する。 In the above description, the terminal device 10 may further include a speaker and an audio output control section. When danger information is received from the server device 40 by the danger information communication control section 32, the audio output control section causes the speaker to output audio for notifying the danger information. The voice output control unit may change the volume of the notification according to the degree of danger of the danger information received from the server device 40 . For example, the audio output control unit outputs a louder volume when the risk is "high" than when the risk is "low".
　複数の車両のうちの１台の車両が事故にあったことを端末装置１０が有するドライブレコーダのイベント検出機能によって検出した場合、事故にあった車両から、周辺の他の車両に対して、当該事故の危険情報とともに当該事故を撮影した映像データをサーバ装置４０へ送信するように依頼してもよい。サーバ装置４０は、他の車両から受信した映像データを、事故にあった車両へ送信してもよい。事故にあった車両では、他の車両が撮影した映像データを受信することにより、自車両から死角になるなどして確認しにくい事故の状況を確認することができる。 When it is detected by the event detection function of the drive recorder of the terminal device 10 that one of the plurality of vehicles has been involved in an accident, the vehicle that has been involved in the accident is sent to other vehicles in the vicinity. A request may be made to send the image data of the accident together with the risk information of the accident to the server device 40 . Server device 40 may transmit video data received from other vehicles to the vehicle involved in the accident. By receiving video data shot by other vehicles, the vehicle involved in the accident can check the circumstances of the accident that are difficult to check due to blind spots from the own vehicle.
　本開示は、例えば、複数の移動体にに搭載される端末装置を含む危険情報通知システムに使用することができる。 The present disclosure can be used, for example, in a danger information notification system including terminal devices mounted on multiple moving bodies.
　本開示は、SDGsの「産業と技術革新の基盤をつくろう」の実現に貢献し、IoTソリューションによる価値創出に寄与する事項を含む。 This disclosure includes matters that contribute to the realization of the SDGs "Building a foundation for industry and technological innovation" and contributes to value creation through IoT solutions.
　１　　　　危険情報通知システム
　１０　　　端末装置
　１１　　　カメラ（撮影部）
　１２　　　記録部
　１３　　　表示部
　１４　　　ＧＰＳ受信部
　１６　　　認識辞書記憶部
　１７　　　通信部
　２０　　　制御部
　２１　　　映像データ取得部
　２２　　　バッファメモリ
　２３　　　映像データ処理部
　２４　　　記録制御部
　２５　　　表示制御部
　２６　　　位置情報取得部
　３０　　　危険情報検出部
　３２　　　危険情報通信制御部
　４０　　　サーバ装置
　４１　　　通信部
　４２　　　危険種別情報記憶部
　５０　　　制御部
　５１　　　危険情報受信制御部
　５２　　　特定部
　５３　　　通報判定部
　５４　　　通知制御部
　５５　　　通報制御部 1 Danger Information Notification System 10 Terminal Device 11 Camera (Photographing Unit)
12 recording unit 13 display unit 14 GPS receiving unit 16 recognition dictionary storage unit 17 communication unit 20 control unit 21 image data acquisition unit 22 buffer memory 23 image data processing unit 24 recording control unit 25 display control unit 26 position information acquisition unit 30 danger information Detection unit 32 Danger information communication control unit 40 Server device 41 Communication unit 42 Danger type information storage unit 50 Control unit 51 Danger information reception control unit 52 Identification unit 53 Report determination unit 54 Notification control unit 55 Report control unit

Claims (7)

  1. 　移動体の周辺を撮影した映像データを取得する映像データ取得部と、
    　前記映像データから危険情報とその種別を検出する危険情報検出部と、
    　前記危険情報検出部によって検出された前記危険情報をサーバ装置へ送信する危険情報通信制御部と、
    　を有する端末装置と、
    　前記端末装置から受信した前記危険情報に基づいて、前記危険情報の種別によって前記危険情報を通知する通知エリアを特定する特定部と、
    　前記通知エリア内に位置する対象移動体へ前記危険情報を通知するよう制御する通知制御部と、
    　を有するサーバ装置と、
    　を備える危険情報通知システム。     a video data acquisition unit that acquires video data captured around a moving object;
    a danger information detection unit that detects danger information and its type from the video data;
    a danger information communication control unit that transmits the danger information detected by the danger information detection unit to a server device;
    a terminal device having
    a specifying unit that specifies a notification area for notifying the danger information according to the type of the danger information based on the danger information received from the terminal device;
    a notification control unit that controls to notify the danger information to the target moving object located within the notification area;
    a server device having
    hazard information notification system.
  2. 　前記通知制御部は、受信した前記危険情報の種別に応じて、前記危険情報の項目、または、前記危険情報を通知する時間間隔を変えて通知するよう制御する、
    　請求項１に記載の危険情報通知システム。     The notification control unit controls to notify by changing the items of the danger information or the time interval for notifying the danger information according to the type of the received danger information.
    The danger information notification system according to claim 1.
  3. 　前記特定部は、受信した複数の前記危険情報の内容が同一であると判定された場合、前記通知エリアを再度特定する、
    　請求項１または２に記載の危険情報通知システム。     The identifying unit re-identifies the notification area when it is determined that the contents of the plurality of received danger information are the same.
    The danger information notification system according to claim 1 or 2.
  4. 　前記サーバ装置は、
    　受信した前記危険情報の危険度に応じて緊急機関へ通報するよう制御する通報制御部、
    　を有する、請求項１から３のいずれか一項に記載の危険情報通知システム。     The server device
    A notification control unit that controls to notify an emergency agency according to the degree of danger of the received danger information;
    The danger information notification system according to any one of claims 1 to 3, comprising:
  5. 　移動体の周辺を撮影した映像データを取得する映像データ取得部と、
    　前記映像データから危険情報とその種別を検出する危険情報検出部と、
    　前記危険情報検出部によって検出された前記危険情報をサーバ装置へ送信し、前記サーバ装置によって特定される通知エリア内に位置する場合に、前記サーバ装置から通知される危険情報を受信する危険情報通信制御部と、
    　を備える端末装置。     a video data acquisition unit that acquires video data captured around a moving object;
    a danger information detection unit that detects danger information and its type from the video data;
    Danger information communication for transmitting the danger information detected by the danger information detection unit to a server device, and receiving the danger information notified from the server device when positioned within a notification area specified by the server device. a control unit;
    terminal device.
  6. 　前記危険情報通信制御部は、前記サーバ装置から通知された前記危険情報を受信した場合であって、前記移動体において前記危険情報検出部によって検出された前記危険情報の内容と同一であると判断した場合、再度、サーバ装置へ前記移動体で検出した前記危険情報を送信するよう制御する、
    　請求項５に記載の端末装置。     The danger information communication control unit receives the danger information notified from the server device and determines that the danger information is the same as the danger information detected by the danger information detection unit in the moving body. if the device is detected by the mobile object, control is performed again to transmit the danger information detected by the mobile object to the server device;
    The terminal device according to claim 5.
  7. 　端末装置が実行する、
    　移動体の周辺を撮影した映像データを取得する映像データ取得ステップと、
    　前記映像データから危険情報とその種別を検出する危険情報検出ステップと、
    　前記危険情報検出ステップによって検出された前記危険情報をサーバ装置へ送信する危険情報通信制御ステップと、
    　サーバ装置が実行する、
    　前記端末装置から受信した前記危険情報に基づいて、前記危険情報の種別によって前記危険情報を通知する通知エリアを特定する特定ステップと、
    　前記通知エリア内に位置する対象移動体へ前記危険情報を通知するよう制御する通知制御ステップと、
    　を含む危険情報通知方法。     the terminal device executes,
    a video data obtaining step of obtaining video data obtained by photographing the surroundings of a moving object;
    a danger information detection step of detecting danger information and its type from the video data;
    a danger information communication control step of transmitting the danger information detected by the danger information detection step to a server device;
    the server device executes,
    a specifying step of specifying a notification area for notifying the danger information according to the type of the danger information based on the danger information received from the terminal device;
    a notification control step of controlling notification of the danger information to a target moving object located within the notification area;
    Hazardous information notification methods, including;
PCT/JP2022/032328 2021-09-27 2022-08-29 Hazard information notification system, terminal device, and hazard information notification method WO2023047888A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2021156798A JP2023047713A (en) 2021-09-27 2021-09-27 Danger information notification system
JP2021157150A JP2023047946A (en) 2021-09-27 2021-09-27 Terminal device, danger information notification method, and program
JP2021-157150 2021-09-27
JP2021-156798 2021-09-27

Publications (1)

Publication Number Publication Date
WO2023047888A1 true WO2023047888A1 (en) 2023-03-30

Family

ID=85720517

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/032328 WO2023047888A1 (en) 2021-09-27 2022-08-29 Hazard information notification system, terminal device, and hazard information notification method

Country Status (1)

Country Link
WO (1) WO2023047888A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007193475A (en) * 2006-01-18 2007-08-02 Matsushita Electric Ind Co Ltd Road obstruction report system and radio communication terminal device
US20100250111A1 (en) * 2009-03-26 2010-09-30 B&C Electronic Engineering, Inc. Emergency and traffic alert system
KR20110133795A (en) * 2010-06-07 2011-12-14 김형섭 Car cdma module with enhanced safety
JP2012014324A (en) * 2010-06-30 2012-01-19 Fujitsu Ten Ltd Information distribution apparatus
KR101590510B1 (en) * 2014-10-17 2016-02-01 주식회사 유비벨록스모바일 Black box and method to send and receive emergency information via a network
JP2017033096A (en) * 2015-07-29 2017-02-09 富士通テン株式会社 Server, transmission system, transmission method, and program
JP2020126355A (en) * 2019-02-01 2020-08-20 トヨタ自動車株式会社 Information processing device, information processing system, information processing method, and program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007193475A (en) * 2006-01-18 2007-08-02 Matsushita Electric Ind Co Ltd Road obstruction report system and radio communication terminal device
US20100250111A1 (en) * 2009-03-26 2010-09-30 B&C Electronic Engineering, Inc. Emergency and traffic alert system
KR20110133795A (en) * 2010-06-07 2011-12-14 김형섭 Car cdma module with enhanced safety
JP2012014324A (en) * 2010-06-30 2012-01-19 Fujitsu Ten Ltd Information distribution apparatus
KR101590510B1 (en) * 2014-10-17 2016-02-01 주식회사 유비벨록스모바일 Black box and method to send and receive emergency information via a network
JP2017033096A (en) * 2015-07-29 2017-02-09 富士通テン株式会社 Server, transmission system, transmission method, and program
JP2020126355A (en) * 2019-02-01 2020-08-20 トヨタ自動車株式会社 Information processing device, information processing system, information processing method, and program

Similar Documents

Publication Publication Date Title
US9685084B2 (en) Traffic event monitoring
CN106816035B (en) Pedestrian-oriented warning method and device
US7348895B2 (en) Advanced automobile accident detection, data recordation and reporting system
US5515042A (en) Traffic enforcement device
Amin et al. GPS and Map matching based vehicle accident detection system
US20150118990A1 (en) Utilizing information about mobile communication devices with respect to an area of interest
US20060261979A1 (en) Event detection system
JP2011503696A (en) Traffic monitoring system
US20130242104A1 (en) Traffic monitoring system and method for monitoring roadway condition
MX2011006018A (en) Computer system and method for jurisdictionwide registering and monitoring of vehicle locations.
CN104882010A (en) Congestion vehicle information processing system and method, and vehicle auxiliary way-giving system and method
CN107578645A (en) A kind of highway early warning response system and its operation method
KR20190100602A (en) System for notifying navigation accident of front vehicele for protecting second traffic accident of highway, and method of thereof
KR102159111B1 (en) Apparatus and method for providing risk information using mobile id group information
KR20210032758A (en) System and method for providing traffic safty based on traffic flow information in a tunnel
WO2023047888A1 (en) Hazard information notification system, terminal device, and hazard information notification method
RU69661U1 (en) REMOTE ACCESS SYSTEM FOR DECISION-MAKING ON ANALYSIS AND EVALUATION OF ROAD ACCIDENT
US11107302B2 (en) Methods and systems for emergency event management
JP2023047713A (en) Danger information notification system
JP2023047946A (en) Terminal device, danger information notification method, and program
Masatu et al. Development and testing of road signs alert system using a smart mobile phone
KR101760819B1 (en) Reporting System of Fallen Objects at Highway
CN114387796A (en) System and method for detecting a wrong travel route of a vehicle
KR100710869B1 (en) Stolen Vehicle Location Tracking and Trapping System
RU2304813C1 (en) Method and device for inspecting transportation vehicles

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22872644

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE