JP6945226B2 - In-vehicle electronic devices, client terminals, and programs - Google Patents

Description

The present invention relates to in-vehicle electronic devices , client terminals , and programs .

Patent Documents 1 and 2 disclose inventions relating to drive recorders.
The drive recorder disclosed in Patent Document 1 is a wired or wireless mutual communication between a data collecting unit that collects vehicle driving status data, a storage unit that non-volatilely stores driving status data, and a mobile phone terminal. It has a communication unit that performs the above operations and a control unit that controls each of these functional units in an integrated manner. When the control unit determines that the predetermined trigger condition is satisfied, the control unit controls the communication unit and transmits the operation status data to the mobile phone terminal.

The drive recorder disclosed in Patent Document 2 transmits at least a moving image data generating means for generating moving image data from a video signal captured outside the vehicle and image data including the moving image data to an external device when an event occurrence is detected. It is equipped with an image data transmission means.

Japanese Patent No. 5561847 JP-A-2009-93255

A conventional in-vehicle electronic device such as a drive recorder transmits operation status data and moving image data to the outside when a predetermined trigger condition is satisfied, when an event occurs, and the like. Data at the time when the predetermined trigger condition is not satisfied or when the event does not occur is not transmitted to the outside. For example, in the case where data is constantly transmitted without being limited to the time when a predetermined trigger condition is satisfied, there is a concern that the amount of communication will increase.

The object of the invention of the present application is not limited to this, and there is an intention to acquire rights by divisional application, amendment, etc. for a configuration for the purpose of obtaining an effect produced from a portion of the configuration disclosed in the present specification, drawings, etc. .. For example, the present specification discloses a problem in which the part described as "can be" is replaced with "is a problem" in the present specification. The issues are described as independent, and we have the intention to independently acquire the rights to the structure for solving this issue by divisional application, amendment, etc. Even if the subject matter is silently grasped from the description in the specification, the applicant intends to make a part of the structure described in the specification amended or to be claimed in the divisional application. .. In addition, issues that combine these independent issues are also disclosed.

(1) Based on the moving image captured by the imaging means mounted on the vehicle, the first moving image data and the second moving image data having a smaller amount of data than the first moving image data are generated, and the above-mentioned An in-vehicle electronic device having a processing means for recording the first moving image data in the storage means and transmitting the second moving image data to a server on the network via the wireless communication means may be used.

Since the amount of data of the second moving image data to be transmitted is smaller than the amount of data of the first moving image data recorded in the storage means, the amount of data to be transmitted is reduced as compared with the case of transmitting the first moving image data. Can be done. When the second moving image data is constantly transmitted without being limited to a specific time point such as the occurrence of an event, a remarkable effect of suppressing an increase in the amount of transmitted data can be obtained. For example, it is preferable to mount an in-vehicle electronic device on a plurality of vehicles to be managed by a corporation and collect second video data from a plurality of managed vehicles on a server.

As the imaging means mounted on the vehicle, for example, a camera that captures the front of the vehicle and acquires a moving image may be used. The image pickup means may be used to image the omnidirectional direction of the vehicle, the inside of the vehicle, and the like. By making the second moving image data have a lower resolution and a lower frame rate than the first moving image data, the data amount of the second moving image data may be smaller than the data amount of the first moving image data. For example, the resolution of the first video data is equivalent to full high-definition (1920 x 1080 pixels), the frame rate is 30 fps, etc., the resolution of the second video data is equivalent to VGA (640 x 480 pixels), and the frame rate is 5 to 10 fps. And so on.

As a storage means, it is preferable to use a removable medium such as an SD card. By removing the removable media from the in-vehicle electronic device and attaching it to an external electronic device such as a personal computer or a tablet terminal, the first moving image data recorded on the removable media can be played back on the external electronic device. Removable media such as SD cards may have difficulty meeting the required specifications in terms of reliability. For example, a failure may occur in which the recorded moving image data cannot be read. By transmitting the second video data to the server, it is possible to read the second video data from the server even if a failure occurs in which the first video data that should have been recorded on the removable media cannot be read. Is.

As the storage means, a storage device built in the in-vehicle electronic device may be used instead of the removable media. When a built-in storage device is used as the storage means, the first moving image data may be transferred to an external device via a wireless LAN or the like.

As a wireless communication means for transmitting the second moving image data, it is preferable to use a communication module conforming to a mobile wireless communication standard such as LTE or 4G. This makes it possible to transmit the second moving image data to the server when the vehicle is located in the service target area of the mobile wireless communication. As the upstream communication speed, for example, 512 kbps may be secured.

It is preferable that the server has a function of accumulating the received second moving image data and a function of distributing the accumulated second moving image data via the network in response to a request from the client terminal.

(2) When the processing means executes the function of transmitting the second moving image data to the server, the second moving image data is sent to the server regardless of the presence or absence of an impact given to the vehicle from the outside. It is preferable to use an in-vehicle electronic device for transmission.

The second moving image data is transmitted to the server not only when the vehicle is impacted but also during normal driving, for example. The server can acquire more information than when the video data is transmitted only when an impact occurs. It is advisable to give the server a function to use a lot of information for various purposes such as live distribution, on-demand distribution, and machine learning.

For example, the processing means may be such that the second moving image data is constantly transmitted to the server while the accessory switch of the vehicle is on.

(3) The function of the processing means to transmit the second moving image data to the server may be an in-vehicle electronic device including a function of transmitting the second moving image data to the server in real time.

When the server is provided with a function for live-streaming the second video data, the user (vehicle manager) of the client terminal that receives the live-streamed second video data is installed in the managed vehicle. It becomes possible to check the moving image captured by the imaging means in almost real time.

It is preferable to generate moving image data by adding vehicle information in association with each frame of the moving image captured by the imaging means, and transcode the moving image data to generate the first moving image data and the second moving image data. If the frame rates of the original video data and the newly generated first video data and the second video data are not changed, the vehicle information added in association with each frame is newly generated. The frames of the first moving image data and the second moving image data may be associated with each frame as they are.

For example, if the frame rate of the second video data with a small amount of data is made lower than the frame rate of the original video data and the vehicle information is directly associated with each frame of the second video data, the vehicle in the second video data. Information will be lost. In order to prevent the vehicle information from being lost, it is preferable to perform a process of changing the correspondence between the vehicle information and the frame in the second moving image data generation process. For example, it is preferable to perform a process of associating the vehicle information associated with a plurality of frames of the original moving image data with one frame of the second moving image data.

(4) The processing means generates a third moving image data and a fourth moving image data having a smaller amount of data than the third moving image data, based on the moving image captured by the imaging means. The first moving image data is generated by adding the vehicle information of the vehicle in association with each frame of the third moving image data, and the vehicle information is added in association with each frame of the fourth moving image data. As a result, it is preferable to use an in-vehicle electronic device that generates the second moving image data.

Even when the frame rates of the first moving image data and the second moving image data are different, vehicle information can be added in association with each frame according to the frame rate. When the first video data or the second video data is played back on the video data playback device, the vehicle information at the time when the image of the currently displayed frame is acquired is stored in the first video data or the second video data. It is good to have a function to extract from video data. Since the vehicle information is added in association with each frame, the vehicle information associated with the frame can be easily extracted from the first moving image data or the second moving image data.

The vehicle information may be added to the frame header of the first moving image data or the second moving image data. The vehicle information may include, for example, GPS data, real-time clock time information, front-rear upper limit left-right acceleration information, terminal identification information (terminal ID), and the like. GPS data includes, for example, current time information, current position information (latitude and longitude), traveling speed information, traveling direction information, current altitude information, valid / invalid information, and the like. The time information of the real-time clock may be periodically calibrated based on the current time information included in the GPS data. The acceleration information may be acquired by an acceleration sensor mounted on the vehicle, an acceleration sensor built in an in-vehicle electronic device, or the like.

For example, the ID number of the SIM card may be used as the terminal identification information. In this case, the terminal identification information is unique to the in-vehicle electronic device. As the terminal identification information, instead of the ID number of the SIM card, the ID number or the like given to each of the plurality of in-vehicle electronic devices may be used. In addition, when there is a possibility that a plurality of drivers drive one vehicle and it is desired to manage video data for each driver, in addition to the terminal identification information, the driver who is currently driving can be identified. It is advisable to associate the moving image data with the driver by using the driver identification information. For example, it is preferable that the in-vehicle electronic device reads the driver ID information recorded on the ID card possessed by the driver before the vehicle travels. As the ID card, an IC driver's license, a contactless IC card such as FeliCa, a contact IC card such as an SD card, or the like may be used.

(5) The processing means may be an in-vehicle electronic device that detects the occurrence of an event based on a determination condition for determining that an event has occurred in the vehicle and sets the presence or absence of the event as a part of the vehicle information.

It is preferable that the server that has received the second video data including the vehicle information has a function of reading the vehicle information, determining whether or not an event has occurred in the vehicle, and executing a specific process according to the determination result. .. A server having a function of determining whether or not an event has occurred can perform a specific process on the second moving image data when the event occurs. For example, it is preferable that the in-vehicle electronic device does not perform the specific processing when an event occurs, and the server performs the specific processing instead of the in-vehicle electronic device. For example, when an event occurs, the server may have a function (event recording function) of recording moving images before and after the event occurrence in a storage area different from the storage area for constantly recording. If the server has an event recording function, it is advisable not to record the event on the in-vehicle electronic device.

As events that occur in the vehicle, it is advisable to adopt sudden steering operation, sudden braking operation, generation of impact, and the like. The occurrence of these events may be detected by an acceleration sensor mounted on the vehicle, an acceleration sensor built in the in-vehicle electronic device, or the like. As a determination condition, for example, it is preferable that the detection result of acceleration by the acceleration sensor exceeds a predetermined determination threshold value. As vehicle information indicating whether or not an event has occurred, an event flag indicating whether or not an event has occurred may be used. It is even better to set event flags for each event type such as sudden steering operation, sudden braking operation, and impact generation.

(6) When the processing means receives an update command for the determination condition from the server, the processing means may be an in-vehicle electronic device that updates the determination condition and detects the occurrence of an event based on the updated determination condition.

The vehicle manager can update the determination conditions via the server without directly operating the in-vehicle electronic device mounted on the vehicle. For example, when the number of detected events is too large, it is advisable to lower the detection sensitivity by increasing the acceleration determination threshold. On the contrary, when the event to be detected is overlooked, it is preferable to increase the detection sensitivity by lowering the acceleration determination threshold.

The processing means may update the determination condition immediately after receiving the determination condition update command. The vehicle manager can find the optimum judgment condition by fine-tuning the judgment condition while checking the detection result of the event based on the updated judgment condition.

(7) When the processing means receives a command from the server to stop transmitting a moving image, the processing means blanks the image portion of the second moving image data and uses the second moving image data to which the vehicle information is added as the server. It is preferable to use an in-vehicle electronic device having a function of transmitting to.

By blanking the image portion of the second moving image data, the amount of data can be reduced. For example, the image portion may be blanked by setting all the pixels to a single color such as black. Since the second moving image data is transmitted even if the transmission of the moving image is stopped, the transmission of the vehicle information to the server is continued. Although the transmission of vehicle information is continued, the amount of data to be transmitted is also small because the amount of data of the second moving image data is small. The second moving image data is, for example, H. It is preferable that the image is compressed using a moving image compression technique such as the 264 standard.

(8) The processing means determines whether or not to transmit the second moving image data based on the state of radio waves used by the wireless communication means, and if it is determined not to transmit, the processing means said. It is preferable to use an in-vehicle electronic device having a function of recording the second moving image data in the storage means instead of transmitting the second moving image data to the server.

When the radio wave condition is such that communication is not possible or a communication speed sufficient for transmitting the second moving image data cannot be secured, it may be determined that the second moving image data is not transmitted. The processing means may detect that the radio wave condition is not suitable for transmitting the second moving image data before performing the transmission processing. As a result, it is possible to eliminate unnecessary retries in the second moving image data transmission process.

By recording the second video data in the storage means, after the radio wave condition is restored, the second video data currently being acquired is transmitted to the server, and the second video data recorded in the storage means is transmitted. It is advisable to give the processing means a function of reading the moving image data and transmitting it to the server. By doing so, it is possible to prevent the second moving image data transmitted to the server from being lost. If sufficient transfer speed or processing power is not secured to transmit both the current second video data and the second video data recorded in the storage means, the vehicle After the operation is stopped (for example, after the accessory switch is turned off), the processing means may be provided with a function of transmitting the second moving image data recorded in the storage means to the server. In this way, the second moving image data can be transmitted to the server even when sufficient transfer speed or sufficient processing capacity is not secured.

(9) The processing means may be an in-vehicle electronic device having a function of outputting the content of the message by an image or sound from the output means when receiving a message from the server via the wireless communication means.

It is preferable that the client terminal has a function of transmitting a message from the client terminal to the in-vehicle electronic device via the server by operating the client terminal of the server by the vehicle administrator. In this way, the vehicle manager can send a message to the driver of the vehicle by operating the client terminal. The driver who notices the message can reflect the content of the message in the driving operation or the like. The content of the message may be, for example, a content that warns the driver to avoid overspeeding, heavy use of sudden steering wheel and sudden braking, and the like. In addition, it may be a general business contact that needs to be notified to the driver. The output of the message content from the output means may be performed after the vehicle has stopped by waiting for the output until the vehicle stops due to a signal waiting or the like so as not to interfere with the driving operation. For example, when the traveling speed becomes 0, it may be determined that the vehicle has stopped.

A message notifying the occurrence of an emergency such as a traffic accident may be transmitted from the in-vehicle electronic device to the administrator via the server. For example, it is preferable to provide an in-vehicle electronic device with a switch such as a button for notifying the occurrence of an emergency, and when the driver operates this switch, the processing means transmits a message notifying the occurrence of the emergency. The administrator can know through the server that an emergency has occurred in the vehicle.

The moving image data including the moving image captured by the imaging means mounted on each of the plurality of managed vehicles and the vehicle information added in association with each frame of the moving image is received from each vehicle, and the moving image data is described. It is preferable to use a server having a processing means having a function of storing the data in the storage means.

When a device that reads and processes the stored moving image data of a specific vehicle processes a specific frame, the device easily accesses the vehicle information of the vehicle associated with the frame to be processed at the present time. be able to. It is advisable to give the processing means of the server a function of reading and processing the accumulated moving image data. It is preferable to give the device that reads and processes the moving image data a function of extracting the vehicle information associated with the frame from the moving image data, for example, while performing the processing of a specific frame, for example, the process of displaying the image on the display means. ..

The vehicle information is extracted from the moving image data including the moving image captured by the imaging means mounted on each of the plurality of managed vehicles and the vehicle information added in association with each frame of the moving image. A server having a processing means having a function of storing the moving image data in the storage means may be used.

By extracting vehicle information from video data and storing it in a storage means separately from the video data, a device that accesses the stored vehicle information can easily obtain necessary vehicle information without reading the video data in chronological order, for example. Can be taken out. It is advisable to give the processing means of the server a function to access the accumulated vehicle information.

(10) The moving image data including the moving image captured by the imaging means mounted on each of the plurality of vehicles to be managed and the vehicle information added in association with each frame of the moving image is received from each vehicle. A server having a processing means having a function of accumulating the moving image data in the storage means and a function of extracting the vehicle information from the moving image data and storing the moving image data in the storage means separately from the moving image data may be used.

When the device that reads and processes the stored moving image data of a specific vehicle processes a specific frame, the vehicle information of the vehicle associated with the frame to be processed at the present time can be easily accessed. For example, necessary vehicle information can be easily retrieved from the storage means without reading the moving image data in chronological order.

It is preferable that the processing means of the server has a function of reading and processing the stored moving image data and a function of accessing the stored vehicle information.

The moving image data may be transmitted from an in-vehicle electronic device such as a drive recorder. The processing means of the server may be to store and manage moving image data, vehicle information, etc. sent from the vehicle by grouping them according to the terminal ID.

Vehicle information stored separately from the video data should be stored in a database so that it can be searched with various search keys. The search key may be, for example, vehicle identification information, driver identification information, date / time information, information indicating the presence or absence of an event, or the like. Vehicle managers can easily find the vehicle information they need by accessing this database.

(11) The processing means has a function of identifying a vehicle from a client terminal and receiving a request for live distribution, and then performing live distribution of the moving image data received from the specified vehicle to the client terminal requesting live distribution. , When there is a request for on-demand distribution by specifying a vehicle from a client terminal, a function of reading the moving image data of the specified vehicle from storage in the storage means and delivering it on-demand to the client terminal requesting on-demand distribution. It is preferable to use a server having.

By operating the client terminal and requesting live distribution, the vehicle manager can check the moving image captured by a specific vehicle live. Further, the vehicle manager can confirm the moving image captured in the past by the specific vehicle by requesting the on-demand distribution by designating the specific vehicle and the specific date and time.

When there is a request for live distribution regarding a vehicle for which transmission of moving images is currently stopped, it is preferable that the processing means of the server sends a command to the target vehicle to start transmission of moving images. It is preferable that the in-vehicle electronic device has a function of starting the transmission of the moving image when receiving a command to start the transmission of the moving image. When the transmission of the moving image is started from the in-vehicle electronic device mounted on the target vehicle for which the live distribution is requested, the processing means of the server may be such that the moving image is live-distributed to the client terminal. The vehicle manager can operate the client terminal to check the current moving image from the target vehicle.

(12) The vehicle information includes position data indicating the current position of the corresponding vehicle.
When the processing means identifies a vehicle from a client terminal and requests live distribution of the video data, the processing means performs live distribution of position data indicating the current position of at least one vehicle other than the vehicle to be live-distributed. It is preferable that the server has a function of transmitting to the requested client terminal.

It is preferable that the client terminal has a function of extracting the position data of a specific vehicle that is live-streamed from the video data of that vehicle. The vehicle manager can operate a client terminal having this function to know the current position of a specific vehicle. Further, the vehicle manager operates a client terminal having a function of receiving position data indicating the current position of the vehicle other than the vehicle targeted for live distribution, and obtains the current position of the vehicle other than the specific vehicle. You can know.

The position data of the vehicle other than the vehicle to be live-streamed may be transmitted to the client terminal only when requested by the client terminal. Further, the position data of a vehicle other than the vehicle targeted for live distribution may be constantly transmitted to the client terminal of the live distribution destination. It is preferable that the position data of the vehicle other than the vehicle targeted for live distribution is also transmitted to the client terminal while maintaining immediacy. The position data of the vehicle other than the vehicle to be live-streamed may be transmitted at a time interval longer than the frame interval of the moving image being live-streamed. For example, when the frame interval of the moving image is about 0.1 seconds, the transmission interval of the position data of the vehicle other than the vehicle targeted for live distribution may be about 1 to 5 seconds.

(13) The vehicle information includes an event flag indicating whether or not an event has occurred in the corresponding vehicle.
The processing means determines whether or not an event has occurred in the vehicle based on the event flag included in the moving image data received from the plurality of managed vehicles, and when it is determined that the event has occurred in the vehicle. Of the moving image data received from the vehicle determined to have generated the event, the moving image data for a certain period before and after the event occurrence is used as the event recording data, and the moving image data is stored regardless of the occurrence of the event. A server having a function of accumulating in the storage means may be used separately from the processing of accumulating in the means.

It is preferable that the processing means has a function of receiving the event recording data from the vehicle without interruption and managing it separately from the moving image data (constantly recorded data) stored in the storage means. The time width before and after the event occurrence time to be accumulated as the event recording data may be, for example, one minute before and after, and it is further preferable that the vehicle manager can arbitrarily set it. In addition, it is preferable that this time width can be set for each event type.

It is advisable to provide the processing means with a function of constantly deleting (erasing) the recorded data under the set conditions for each terminal (drive recorder) or each group. The conditions for deleting the constantly recorded data may be set by, for example, a client terminal operated by the user (for example, a PC application installed on a personal computer). For example, when a certain period of time elapses from the time of acquiring the moving image data, the processing means may always delete the recorded data. As the processing means, even if the constantly recorded data is deleted, the event recorded data may be retained. By erasing the constantly recorded data, the storage capacity of the storage means occupied by the constantly recorded data can be reduced. The vehicle manager or the like can confirm the contents of the event recording data having a high importance such as when an accident occurs even after the constantly recorded data is deleted. It is advisable to provide the processing means with a function of erasing the event recorded data under conditions different from the erasing of the constantly recorded data. It is preferable that the processing means of the server and the client terminal have a function that allows the vehicle administrator to operate the client terminal and set the deletion condition of the event recording data. For example, the processing means may request the user (vehicle administrator) to approve the erasure via the client terminal before erasing the event recording data. After the vehicle administrator operates the client terminal and approves the deletion, the processing means may delete the event video data. By doing so, it is possible to prevent the occurrence of a situation in which the event recording data is deleted without the vehicle manager noticing it.

The event flag check and the event recording data storage process should be performed in real time when the moving image data is received. In this way, the vehicle administrator can access the event recording data of the server immediately after the event occurs. The event flag may be checked and the event recording data may be accumulated in a batch process on a regular basis or by a command from the vehicle manager.

When checking the event flag and accumulating event recording data by batch processing, the event flag is checked before erasing the constantly recorded data, and if an event that is not accumulated as event recording data is found, before and after the event occurrence time. It is advisable to ask the vehicle manager whether or not to accumulate the event recording data of. By doing so, it is possible to avoid the occurrence of a situation in which important video data at the time of event occurrence is deleted.

When the processing means of the server detects the occurrence of an event, it is advisable to send an e-mail notifying the occurrence of the event to the registered e-mail address. As the destination e-mail address, for example, it is advisable to register an e-mail address that can be received by a terminal operated by the vehicle administrator. Instead of sending an e-mail, a push notification may be sent to a mobile terminal such as a tablet terminal operated by the vehicle administrator. By doing so, the vehicle manager can immediately notice that an event has occurred in the managed vehicle.

(14) The processing means may be a server having a function of accumulating the data communication amount for each vehicle to be managed and for each unit period, and transmitting the data communication amount for each vehicle to the client terminal in association with the vehicle.

The vehicle manager can operate a client terminal having a function of receiving and displaying the data communication amount transmitted from the server, and can grasp the data communication amount for each vehicle. The unit period for accumulating the amount of data communication may be a period that is the basis for calculating communication charges, for example, one month. The processing means may also transmit the total value of the data communication volume of all the managed vehicles to the client terminal. When the communication charge is determined based on the total value of the data communication amount, the vehicle manager can easily predict the communication charge from the total value of the data communication amount. The processing means may be such that the data communication amount for a period longer than the unit period, for example, one year is totaled for each vehicle, and the total value is transmitted to the client terminal.

The processing means has a function to send an e-mail notifying that the communication amount has exceeded the set upper limit to the registered e-mail address when the communication charge for each vehicle or the total communication amount exceeds the set upper limit. It is good to let it. The registered e-mail address may be an e-mail address that can be received by the vehicle administrator. Further, instead of sending an e-mail, a push notification may be sent to a tablet terminal or the like that can be operated by the administrator. By doing so, when the administrator notices that the communication amount exceeds the expected value, the transmission of the moving image data can be stopped and the communication charge can be prevented from exceeding the expected amount.

(15) The processing means may be a server having a function of transmitting the content of the message to the specified vehicle when receiving a request from the client terminal to specify the vehicle and transmit the message.

The vehicle manager can send a message to the vehicle via the server by operating the client terminal. Examples of the message include a message urging people to avoid dangerous driving, a mere business contact, and the like. When the server receives a message from the vehicle-mounted electronic device of the vehicle, it is preferable to send the message to the client terminal. As a result, messages can be exchanged between the client terminal (PC application) and the in-vehicle electronic device (for example, a drive recorder).

(16) When the processing means receives a command from the client terminal to stop the transmission of the moving image captured by a specific vehicle among the managed vehicles, the moving image is sent to the target vehicle for stopping the transmission of the moving image. It is preferable that the server has a function of transmitting a command to stop the transmission of.

The vehicle manager can stop the transmission of moving images from a specific vehicle via the server by operating the client terminal. For example, the vehicle manager may stop the transmission of the moving image from a specific vehicle when the communication charge exceeds the assumed upper limit value.

(17) The processing means performs machine learning based on the moving image data received from a plurality of managed vehicles, and uses the result of the machine learning to cause an accident with respect to the moving image data newly received from the managed vehicle. It is preferable to use a server that has a function of predicting the degree of risk of occurrence of.

By machine learning by associating the moving image contained in the moving image with the vehicle information, the processing means has higher utility value than machine learning based only on the vehicle information or machine learning based only on the moving image. Results can be derived. It is possible to take measures to prevent accidents by using the prediction results of the risk of accidents. For example, it is possible to extract places where driving should be noted based on information such as places where accidents are likely to occur, places where sudden braking or sudden steering operation is frequently performed, and the like.

Further, by analyzing the moving image included in the moving image data, it is possible to calculate the frequency of occurrence of a situation in which an accident did not occur but the risk of an accident was high for each vehicle or each driver. For example, the occurrence of a situation in which a pedestrian or a bicycle is abnormally approached but not in contact with a pedestrian, a pause violation, or the like cannot be detected from the measured value of the acceleration sensor. By analyzing the moving image of the moving image data, the occurrence of such a situation can be detected. Furthermore, by associating the moving image with the vehicle information, it is possible to calculate the degree of danger by associating the traveling speed when overtaking a pedestrian or a bicycle with the distance to the pedestrian or the bicycle when overtaking.

(18) Receive video data from the server including moving images captured by the imaging means mounted on each of the plurality of vehicles to be managed and vehicle information of the vehicles added in association with each frame of the moving images. , A process having a function of displaying a moving image included in the moving image data on a display means, taking out the vehicle information included in the moving image data, and displaying the vehicle information in association with the moving image to be displayed on the display means. It is preferable to use a client terminal having means.

Since the vehicle information is added in association with each frame of the moving image, the processing means of the client terminal can easily associate the frame image of the currently displayed moving image with the vehicle information. The vehicle information may include the current position information of the vehicle, acceleration information, traveling speed information, presence / absence of an event, and the like. In this way, the processing means is provided with a function of extracting the position information, acceleration information, running speed information, presence / absence of event occurrence, etc. at the time when the frame image of the moving image currently displayed on the display means is acquired from the moving image data. It is good. For example, the processing means may display the position information, the acceleration information, the traveling speed information, the presence / absence of an event, etc. on the display means in synchronization with the moving image being reproduced together with the moving image.

The client terminal may have a function of displaying a list of managed vehicles. When the vehicle manager selects one vehicle from the plurality of vehicles listed, the processing means may receive moving image data about the selected vehicle from the server and display a moving image.

When new (unconfirmed) event recording data exists for the listed vehicles, information (event indicator) for notifying the existence of unconfirmed event recording data is displayed on the display means for each vehicle. It is good. When the administrator confirms the event recording data, it is advisable to hide the event indicator. For example, the processing means may display the "confirmation" button together with the event indicator, and click or tap the "confirmation" button to complete the confirmation of the event recording data.

A "data" button is displayed for each vehicle on the screen displaying a list of vehicles, and when the "data" button is clicked or tapped, the moving image and vehicle information included in the video data about the vehicle are displayed on the display means. It is advisable to transition to the vehicle data screen. Furthermore, it is advisable to display a "map" button for each vehicle, and when the "map" button is clicked or tapped, the screen transitions to a map and a map display screen that displays the position of the selected vehicle on the map. .. When transitioning to the map display screen, it is preferable to display the map so that the current position of the vehicle displayed on the immediately preceding vehicle data screen is placed in the center of the map. By clicking or tapping the "managed vehicle list" button displayed on the vehicle data screen or the map display screen, it is preferable to return to the vehicle list screen that displays the list of managed vehicles.

(19) Further, it has a storage means for storing data, and has a storage means.
The function of the processing means to display the moving image included in the moving image data on the display means is realized by streaming the moving image included in the moving image data, and the processing means is used for the streaming reproduction. A client terminal having a function of storing moving image data in the storage means may be used.

Once streaming playback is performed, the streamed video data can be saved in the client terminal without being downloaded again. The video data saved in the client terminal can be played back without accessing the server. For example, even if the video data stored in the server is deleted after the storage period, if the video data is stored in the client terminal, it can be played back as needed. When performing streaming playback, the processing means may ask the vehicle manager whether or not to save the video data to be streamed to the client terminal.

“The moving image data used for streaming playback is stored in the storage means” means that the moving image data can be read from the storage means and stored in the storage means even after the streaming playback is finished. Means.

The streaming reproduction of the moving image included in the moving image data includes the reproduction of the moving image lively distributed from the server and the reproduction of the moving image distributed on demand. When the video data is live-streamed from the server, the client terminal can grasp the situation around the vehicle in real time. The processing means of the client terminal is a means for displaying information that can distinguish whether the moving image currently being played is live-streamed, on-demand-delivered, or stored in the client terminal. It is good to display it in. It is even better to have a function to download video data from the server to the client terminal without streaming playback.

(20) The processing means has a function of reading the moving image data stored in the storage means and displaying a moving image included in the moving image data on the display means, and a moving image displayed on the display means. However, it is preferable that the client terminal has a function of displaying on the display means information that can identify whether it is based on the moving image data received from the server or based on the moving image data read from the storage means. ..

The vehicle administrator who operates the client terminal uses the display means to determine whether the moving image currently being played is based on the video data stored in the server or the video data stored in the client terminal. It can be easily known from the displayed information. For example, if it is determined that there is a possibility of playing a moving image contained in the video data stored on the server even after it is deleted by the server, the video data is downloaded from the server to the client terminal. Can recognize the need

It is preferable to adopt a character string, a color, or the like as information that can identify whether the moving image being played is based on the moving image data received from the server or the moving image data stored in the client terminal. For example, when the video data is received from the server, the character string "server video" is displayed on the moving image display screen, and when the video data saved in the client terminal is read out. , It is advisable to display the character string "video of the terminal" in the display screen of the moving image. Alternatively, the two may be distinguished by different colors of the moving image reproduction indicator.

(21) Further, it has a reading means for reading the data of the attached removable media.
When the processing means receives a date and time registration command input by the operator during the period in which the moving image included in the moving image data is displayed on the display means, the processing means displays the moving image on the display means at the time of receiving the date and time registration command. The imaging date and time data of the frame of the moving image is extracted as the command date and time, and the frame at the time based on the command date and time is extracted from the moving image recorded on the removable media mounted on the reading means, and the display is described. It is preferable to use a client terminal having a function of displaying the data on the means.

As the removable media, it is preferable to use an in-vehicle electronic device such as a drive recorder mounted on the vehicle, which records moving image data obtained by imaging the surroundings of the vehicle. It is preferable to record the moving image data having a higher resolution and a higher frame rate than the moving image data transmitted from the vehicle to the server on the removable media. When a situation arises in which a moving image with a higher resolution is desired to be viewed while playing a moving image on the client terminal, the vehicle manager may input a date and time registration command to the client terminal. By removing the removable media from the in-vehicle electronic device of the vehicle and attaching it to the client terminal, the video included in the video data in the removable media can be easily cueed and played from the date and time specified by the date and time registration command. .. As a result, the situation around the vehicle can be confirmed with a moving image having a higher resolution than the moving image included in the moving image data received from the server.

When the date and time registration command is input, the processing means of the client terminal sends a message via the server prompting the in-vehicle electronic device of the vehicle to bring the removable media to the vehicle manager. It is good to do. The in-vehicle electronic device may output this message to the driver after the engine stop operation is performed. When the driver who notices this message brings the removable media to the manager of the vehicle, the manager can immediately play back the moving image contained in the video data in the removable media.

Even if the vehicle subject to the input date and time registration command returns to the depot, high-resolution, high-frame rate video data is transmitted from the in-vehicle electronic device to the server by short-range wireless communication such as WiFi. good. In this way, it is possible to save the trouble of removing the removable media from the in-vehicle electronic device and bringing it to the administrator.

(22) The processing means identifies at least one of a plurality of vehicles to be managed, and when a command for changing the operating conditions of the in-vehicle electronic device of the specified vehicle is input, the operating conditions to be changed are changed. When it is necessary to stop the acquisition of the moving image from the imaging means when changing, it is necessary to stop the acquisition of the moving image before transmitting the command for changing the operating conditions to the server. A client terminal having a function of notifying the operator is preferable.

The vehicle manager can change the operating conditions of the in-vehicle electronic device without going to the vehicle equipped with the in-vehicle electronic device. When it is necessary to stop the acquisition of moving images in order to change the operating conditions, the administrator who operates the client terminal notices that the acquisition of moving images is stopped in order to change the operating conditions. Can be done. For example, it is advisable to display the message "Recording is stopped for XX seconds due to a change in operating conditions. Can I change the operating conditions?" On the display means of the client terminal. The administrator can decide whether or not to change the operating conditions in consideration of the priority of changing the operating conditions and acquiring the moving image.

Operating conditions include, for example, the sensitivity of an in-vehicle electronic device to detect the occurrence of an event, the resolution and frame rate of video data transmitted by the in-vehicle electronic device to a server, the on / off setting of overwrite mode, the on / off of a beep sound when an event occurs, and removable media. Initialization, firmware update, etc. The sensitivity for detecting the occurrence of an event is represented by, for example, the threshold value of the acceleration applied to the vehicle. When the overwrite mode is on, if there is not enough free space on the removable media, the old moving image is erased and the new moving image is overwritten. When the overwrite mode is off, if there is not enough free space on the removable media, the old moving image will be left and the new moving image will not be recorded. When the initialization of the removable media is instructed, the in-vehicle electronic device initializes the removable media and then restarts the recording of the moving image data. When initializing removable media or updating firmware, it is necessary to stop recording video data.

The in-vehicle electronic device that has received the command for changing the operating condition may notify the driver of the execution of the operating condition change process. For example, it is advisable to display the message "Change the setting of operating conditions. Do not turn off the engine until the change is completed." On the display means of the in-vehicle electronic device.

(23) The vehicle information includes position data indicating the position of the vehicle when the image of the frame of the moving image data associated with the vehicle information is acquired.
The processing means receives the moving image data lively distributed from the server, causes the display means to display a map based on the position data added in association with each frame of the received moving image data. A client terminal having a function of displaying a symbol indicating a vehicle corresponding to the received moving image data at a position on a map indicated by position data may be used.

The administrator who operates the client terminal can see the moving image around the specific vehicle to be managed and can easily grasp the position of the vehicle on the map. Since the position data is associated with the frame of the moving image data, the processing means of the client terminal can easily associate the current frame image of the moving image being reproduced with the position of the vehicle at that time.

(24) The processing means receives position data indicating the current position of at least a part of the plurality of vehicles to be managed from the server, and is receiving the position data on the map displayed on the display means. In addition to the current position of the vehicle associated with the moving image data, the client terminal may be a client terminal that displays a symbol indicating the vehicle at a position on a map corresponding to the current position of another vehicle.

The administrator who operates the client terminal can easily grasp the current positions of a plurality of vehicles to be managed. For a vehicle different from the vehicle associated with the moving image data being received, it is preferable to send and receive position data and the like without transmitting and receiving the moving image data. By doing so, the amount of transmitted / received data can be reduced.

A function of transmitting the vehicle information of a specific vehicle requested from the client terminal to the client terminal and a function of transmitting the vehicle information of a vehicle to be managed other than the specific vehicle to the client terminal to the server shown in (10) above. It is good to have.

When displaying the positions of the vehicle associated with the received moving image data and other vehicles on the map, it is preferable to display the map on the full display screen without displaying the moving image of the moving image data. By doing so, it is possible to confirm the current positions of a plurality of vehicles in detail on a large map. It is preferable that the mode for displaying the moving image of the moving image data and the mode for displaying the large map can be switched by the operation of the administrator. Even in the mode in which the map is displayed large, the video data is continuously received for the specific vehicle of interest, so when the mode is switched to the mode in which the moving image of the video data is displayed, the moving image is immediately displayed. It can be displayed.

When the symbol indicating the vehicle displayed on the map is selected by clicking or tapping, the processing means of the client terminal shifts the screen displayed on the display means to the vehicle data screen of the selected vehicle from the map display screen. You should try to do it.

(25) The moving image data based on the moving image captured by the imaging means mounted on the vehicle, the position information indicating the position of the vehicle, and the time information indicating the date and time are associated with each other and recorded in the storage means, and the position is recorded. An in-vehicle electronic device having a processing means having a function of transmitting information and the time information to a server in association with a vehicle ID that identifies the vehicle may be used.

(26) The vehicle ID is provided with time information indicating the date and time when the moving image was captured, position information indicating the position where the moving image was captured, and a vehicle ID that identifies the vehicle on which the vehicle-mounted electronic device that captured the moving image is mounted. It is preferable that the server has a processing means having a function of receiving from an electronic device and creating a database configured so that the vehicle ID can be searched by using the time information and the position information as a search key.

(27) When the processing means of the server receives a request from the client terminal to search the database by designating the location information and the time information, the database using the designated location information and the time information as a search key. It is preferable to use a server having a function of searching for and returning the search result to the client terminal.

(28) A function that allows the user to enter information (time information and location information) that specifies the date and time and location of the image to be confirmed, and a database search for the server by specifying the entered time information and location information. It is preferable that the client terminal has a processing means having a function of requesting the information and a function of receiving the search result from the server and displaying the search result on the display means.

The amount of transmitted data can be reduced as compared with the case where moving image data is transmitted from the in-vehicle electronic device to the server in addition to the location information and the time information. As a result, the cost of data transfer can be reduced. In addition, since the video data is not transmitted to the server, it is possible to prevent the video data on the server from being read by a third party without the consent of the owner of the in-vehicle electronic device, thus protecting privacy. Can be planned.

It is preferable to register the vehicle ID that identifies the vehicle on which the in-vehicle electronic device is mounted and the information (account) that identifies the owner of the in-vehicle electronic device in association with each other in the server. The processing means of the server may be to return the account of the owner of the in-vehicle electronic device to the client terminal together with the search result of the database. It's even better to reply with the account attributes along with the owner's account. For example, the name or name of the owner may be included in the account attributes to be returned. The processing means of the client terminal may display the owner's account or account attribute on the display means together with the search result of the database. In this way, the user of the client terminal can know the owner of the in-vehicle electronic device mounted on the vehicle specified by the vehicle ID.

The user of the client terminal can see the search result returned from the server and request the owner of the in-vehicle electronic device to provide the moving image data by designating the date and time and the place. When the video data is provided by the owner of the in-vehicle electronic device, it is possible to reproduce the moving image at the designated date and time and the designated place from the provided video data. This video data can be used as evidence of accidents, crimes, etc. By utilizing these evidences in criminal investigations, false positive arrests can be prevented. Furthermore, if it is socially recognized that a moving image captured by an in-vehicle electronic device of a third-party vehicle that happens to be present at the scene of a crime can be used for a crime investigation, the effect of deterring the crime can be obtained.

For transmission of location information and time information from the in-vehicle electronic device to the server, for example, wireless communication such as WiFi standard or LTE standard may be used. The processing means of the in-vehicle electronic device may be such that the position information and the time information are periodically transmitted (uploaded) to the server at predetermined time intervals. The processing means of the in-vehicle electronic device may have a function of automatically uploading without requiring an operation by the owner of the in-vehicle electronic device or the driver of the vehicle. If the processing means of the in-vehicle electronic device has an automatic upload function, it is possible to prevent the occurrence of a situation in which the position information and the time information are not uploaded due to an operation error (forgot to operate).

Instead of the method of wirelessly transmitting location information and time information from the in-vehicle electronic device to the server, the external electronic device that reads the moving image data recorded on the removable media and reproduces the moving image is the route that has been traveled so far. It may have a function of transmitting (uploading) location information and time information to a server. In this case, it is not necessary to provide the in-vehicle electronic device with a wireless communication function.

As an external electronic device having this function, for example, a personal computer, a tablet terminal, a smartphone, or the like can be used. This function may be realized by a PC viewer installed on a personal computer, an application program (smartphone application) installed on a tablet terminal or a smartphone, or the like. It is further preferable that the external electronic device has a function of managing whether or not the position information and the time information included in the moving image data recorded on the removable media have already been uploaded to the server. When the removable media is attached, the external electronic device may extract unuploaded position information and time information from the moving image data, and upload the unuploaded position information and time information. By doing so, it is possible to avoid uploading the same information more than once.

The processing means of the server may include the position information and the time information of the vehicle found by the search for a certain period of time before and after the specified time in the search result returned to the client terminal. The processing means of the client terminal may have a function of displaying a map on the display means in a manner in which the traveling route of the vehicle can be determined based on the returned search result. The user of the client terminal can look at the traveling route of the vehicle and extract the owner of the in-vehicle electronic device that may have useful video data.

As an in-vehicle electronic device, for example, a drive recorder may be used. The position information of the vehicle may be acquired from the GPS receiver mounted on the vehicle. It is even better to incorporate a GPS receiver in the in-vehicle electronic device. The time information may be acquired from the GPS receiver or the built-in clock of the in-vehicle electronic device. The "time information" may include, for example, "year / month / day" information and "hour / minute / second" information. As a storage means for recording moving image data, it is preferable to use a removable medium such as an SD card. In this way, the removable media can be removed from the in-vehicle electronic device, and the moving image data recorded on the removable media can be read out and the moving image can be reproduced by another external electronic device such as a personal computer or a tablet terminal.

(29) The processing means of the client terminal has a function of designating the owner of an in-vehicle electronic device mounted on a vehicle traveling at a designated place on a designated date and time and accepting a request for providing a moving image, and video data. It is preferable to have a function to send a message requesting provision.

(30) When the processing means of the server receives a message specifying the account of the owner who is the request destination for providing the video data from the client terminal, the processing means of the server stores the account of the owner specified in the received message. When it is detected that the external electronic device is logged in with the account of the owner who is requested to provide the video data, it is preferable to have a function of notifying the external electronic device that there is a request to provide the video data. ..

(31) In the processing means of the external electronic device, when the owner of the in-vehicle electronic device inputs an account and logs in, the account of the logged-in owner is transmitted to the server, and the server requests the provision of video data. When notified that there is, it is preferable to have a function of outputting information notifying that the provision of video data is requested from the output means.

By operating the client terminal, the user of the client terminal can request the owner to provide a desired moving image. The owner of the in-vehicle electronic device can notice the information displayed from the output means of the external electronic device and know that he / she has been requested to provide the video data stored in the vehicle.

When the processing means of the client terminal displays the search result of the server based on the specified time information and location information on the display means, the account attribute of the owner of the in-vehicle electronic device found by the search, for example, the name or name. It is good to display the list. The processing means of the client terminal may have a function of selecting a part or all the owners by the operation of the user of the client terminal from the list of owners displayed on the display means. When the user of the client terminal selects the owner who wants to request the provision of video data from the list of owners, the processing means of the client terminal has a function of requesting the selected owner to provide the video data. It is good.

The processing means of the external electronic device may have a function of allowing the owner of the in-vehicle electronic device to select whether to accept or decline the request for providing the moving image data. When the owner of the in-vehicle electronic device chooses to receive the request for providing the moving image data, the processing means of the external electronic device may have a function of reading the moving image data from the removable media and uploading it to the server. It is even better to be able to specify the video data to be uploaded according to the imaging date and time. In this way, the owner of the in-vehicle electronic device can exclude the video data that he / she does not want to provide and select and upload only the video data that may be provided.

The server may notify the external electronic device that there is a request for providing the video data, or may send an e-mail to the owner of the request destination for providing the video data instead of notifying the external electronic device. The owner's email address should be registered on the server as one of the account attributes.

In the inventions described in (25) to (31) above, the moving image data is not transmitted from the in-vehicle electronic device to the server, but as in the inventions described in (1) and (24) above, the moving image is transmitted from the in-vehicle electronic device to the server. You may want to send the data. In this way, as in the invention described in (30) above, when the server receives a request for providing video data from the client terminal, it is immediately after obtaining the consent of the owner who is the request destination for providing the video data. Video data can be sent to the client terminal.

The inventions shown in (1) to (24) above can be arbitrarily combined. For example, the configuration may be such that at least a part of the configuration of at least one invention after (2) is added to all or part of the configuration of the invention shown in (1). In particular, the invention shown in (1) may be an invention in which at least a part of at least one of the inventions after (2) is added. Further, an arbitrary configuration may be extracted from the inventions shown in (1) to (24), and the extracted configurations may be combined. The applicant of the present application intends to acquire rights to the invention including these configurations.

The inventions shown in (25) to (31) above can be arbitrarily combined. For example, at least a part of the structure of at least one invention after (26) may be added to all or part of the structure of the invention shown in (25). In particular, the invention shown in (25) may be an invention in which at least a part of at least one of the inventions after (26) is added. Further, an arbitrary configuration may be extracted from the inventions shown in (25) to (31), and the extracted configurations may be combined. The applicant of the present application intends to acquire rights to the invention including these configurations.

The specific method of the present invention described above is an example, and a part may be extended or a part may be limited.

The effect of the invention of the present application is not limited to this, and the effect produced from the part of the configuration disclosed in the present specification, drawings, etc. is also disclosed, and the right of the configuration exhibiting the effect is acquired by divisional application, amendment, etc. Have the intention to do. For example, in the present specification, the part described as "can be" is a description that clearly indicates the effect to be exerted, and there is a part that shows the effect even if there is no description of "can be". Moreover, even if there is no such description, there is an effect that can be grasped by the configuration.

The increase in the amount of video data transmitted from the in-vehicle electronic device to the server is suppressed.

FIG. 1 is a block diagram of an in-vehicle electronic device, a server, and a client terminal of the vehicle management system according to the first embodiment. FIG. 2 is a flowchart of processing executed by the processing unit of the in-vehicle electronic device of the first embodiment. FIG. 3 is a diagram showing an outline of a frame configuration of high-resolution moving image data and low-resolution moving image data. FIG. 4 is a flowchart of the shutdown process in step SA7. FIG. 5A is a diagram showing an example of a menu screen displayed on the display by the processing unit of the client terminal (FIG. 1), and FIG. 5B is a diagram showing an example of the screen displayed on the display of the client terminal. FIG. 6 is a diagram showing a configuration of a frame of data transmitted to a server by an in-vehicle electronic device that has stopped constantly transmitting low-resolution moving image data. FIG. 7 is a flowchart of processing executed by the processing unit of the in-vehicle electronic device according to the third embodiment. FIG. 8 is a flowchart executed by the server of the vehicle management system according to the fourth embodiment. FIG. 9A is a diagram showing a menu screen displayed on the display of the client terminal of the vehicle management system according to the fifth embodiment, and FIG. 9B is a diagram showing a management vehicle list screen displayed on the display. FIG. 10 is a diagram showing an example of a vehicle data display screen displayed on the display. FIG. 11 is a diagram showing an example of a map screen displayed on the display. FIG. 12 is a diagram showing an example of a vehicle data display screen displayed on the client terminal of the vehicle management system according to the sixth embodiment. FIG. 13 is a diagram showing a signal transmission / reception sequence of the vehicle management system when the “date / time registration” button is clicked or tapped. FIG. 14A is a diagram showing a menu screen displayed on the display of the client terminal of the vehicle management system according to the seventh embodiment, and FIG. 14B is a diagram showing a menu screen for realizing the function of moving image reproduction. FIG. 15 is a diagram showing a transmission / reception sequence of various messages transmitted / received between a client terminal, a server, and an in-vehicle electronic device of the vehicle management system according to the eighth embodiment. FIG. 16A is a diagram showing a menu screen displayed on the display of the client terminal of the vehicle management system according to the ninth embodiment, and FIG. 16B is a diagram displayed on the display when the processing unit executes the event detection threshold value change process. It is a figure which shows the image. FIG. 17 is a diagram showing a signal transmission / reception sequence between the vehicle-mounted electronic device, the server, and the client terminal of the vehicle management system according to the tenth embodiment. FIG. 18 is a diagram showing a sequence of sending and receiving messages between the in-vehicle electronic device of the vehicle management system and the server according to the twelfth embodiment. FIG. 19 is a diagram showing a signal transmission / reception sequence of the vehicle search system according to the thirteenth embodiment. FIG. 20 is a diagram showing an example of a position and date / time input screen displayed on the client terminal of the vehicle search system according to the thirteenth embodiment. FIG. 21 is a diagram showing an example of a screen for selecting an owner displayed on a client terminal of the vehicle search system according to the thirteenth embodiment. FIG. 22 is a diagram showing an example of a screen after login displayed on an external electronic device (personal computer) of the vehicle search system according to the thirteenth embodiment.

[First Example]
The vehicle management system according to the first embodiment will be described with reference to FIGS. 1 to 4. This vehicle management system includes in-vehicle electronic devices, servers, and client terminals.

FIG. 1 is a block diagram of an in-vehicle electronic device 20, a server 40, and a client terminal 50 of the vehicle management system according to the first embodiment. First, the configuration of the in-vehicle electronic device 20 will be described.

The in-vehicle electronic device 20 operates in a state of being mounted on the vehicle. The camera 22 images the surroundings of the vehicle, for example, the front. The moving image obtained by the camera 22 is input to the processing unit 21. The GPS receiver 23 receives radio waves from GPS satellites and calculates the current position information (latitude and longitude) of the vehicle, the current altitude information, and the current time information. The calculation result is input to the processing unit 21.

The direction sensor 24 detects the direction of the vehicle. The acceleration sensor 26 detects acceleration in the front-rear direction, left-right direction, and up-down direction of the vehicle. The detection results of the directional sensor 24 and the acceleration sensor 26 are input to the processing unit 21.

The clock 27 gives the current time information to the processing unit 21. The processing unit 21 periodically calibrates the clock 27 based on the current time information acquired from the GPS receiver 23.

The display 28 displays an image in response to a command from the processing unit 21. The speaker 29 outputs sound or voice according to a command from the processing unit 21. The SD card 32 is attached to the SD card reader 30. The processing unit 21 reads data from the SD card 32 mounted on the SD card reader 30 and writes data to the SD card 32. The LTE module 31 receives a data transmission / reception command from the processing unit 21 and transmits / receives data to / from the server 40 via the network 60.

Various information about the vehicle is input from the ECU 35 of the vehicle to the processing unit 21. The vehicle information obtained from the ECU 35 includes, for example, engine cooling water temperature, engine speed, speed information, and the like.

The processing unit 21 transmits the moving image data generated from the moving image captured by the camera 22 and various vehicle information to the server 40 via the LTE module 31. The process of transmitting these data will be described later with reference to FIG.

The server 40 includes a processing unit 41 and a storage device 42. The processing unit 41 transmits / receives data to / from the in-vehicle electronic device 20 and the client terminal 50 via the network 60. The processing unit 41 processes various data received from the in-vehicle electronic device 20, and stores the processing result in the storage device 42.

The client terminal 50 includes a processing unit 51, a storage device 52, a display 53, and an input device 54. The vehicle manager inputs a command to the server 40 or the in-vehicle electronic device 20 by operating the input device 54. The processing unit 51 performs data processing and data communication based on the input command, and displays the processing result on the display 53.

FIG. 2 is a flowchart of processing executed by the processing unit 21 (FIG. 1) of the in-vehicle electronic device 20. The function of the processing unit 21 is realized by executing a program stored in the storage device in advance.

When the accessory switch of the vehicle on which the in-vehicle electronic device 20 is mounted is turned on, the processing unit 21 starts an operation of collecting, storing, and transmitting moving image data. First, the processing unit 21 takes in moving image data (original moving image data) of a predetermined number of frames from the camera 22 (step SA1). Further, the processing unit 21 acquires vehicle information from the GPS receiver 23, the directional sensor 24, the acceleration sensor 26, and the ECU 35 (step SA2). The vehicle information includes GPS data, current time information obtained from the clock 27, acceleration information obtained from the acceleration sensor 26, a terminal ID, and an event flag. The GPS data includes information indicating the position, time, speed, traveling direction, and altitude, and valid / invalid information for each.

The terminal ID is identification information for identifying each of the plurality of vehicle-mounted electronic devices 20, and is recorded in, for example, a non-volatile memory in each processing unit 21 of the vehicle-mounted electronic device 20.

The event flag is a flag for notifying the vehicle that a predetermined event (impact, sudden acceleration, sudden braking, sudden steering, etc.) has occurred. The event flag includes a flag for each event type such as an impact detection flag, a sudden acceleration detection flag, a sudden brake detection flag, and a sudden steering wheel detection flag. The processing unit 21 detects whether or not these events have occurred based on the detection result of the acceleration sensor 26, and when the event occurrence is detected, sets the event flag corresponding to the event. The processing unit 21 determines that an event has occurred when the values of acceleration in the front-back, left-right, and up-down directions measured by the acceleration sensor 26 exceed a predetermined threshold value.

The processing unit 21 generates high-resolution video data and low-resolution video data based on the original video data (step SA3). For example, the frame rate of high-resolution video data is 28 fps, the resolution is full HD, the frame rate of low-resolution video data is 5 to 10 fps, and the resolution is VGA. Each frame of the high-resolution moving image data and the low-resolution moving image data is composed of a frame header and an image data unit for storing the image data of the frame. The processing unit 21 stores the vehicle information at the time when the image of the frame is acquired in the frame header of each frame.

Normally, the vehicle information update cycle and the frame update cycle do not match. The measured value of the accelerometer 26 is updated with a time step width (for example, 10 ms) shorter than the frame update cycle. The processing unit 21 stores the measured value of the acceleration collected from the acquisition time of the immediately preceding frame to the acquisition time of the frame in the frame header of one frame. For example, when the frame rate is 10 fps and the acceleration data update cycle is 100 Hz, the processing unit 21 stores the measured value of acceleration for 10 cycles in the frame header of one frame.

FIG. 3 is a diagram showing an outline of a frame configuration of high-resolution moving image data and low-resolution moving image data. The processing unit 21 is composed of H. High-resolution video data and low-resolution video data are generated by compressing the original video data by applying a codec conforming to the 264 standard. The high-resolution video data and the low-resolution video data are composed of a plurality of I frames that hold all the information of the image of the frame and a plurality of P frames that hold information of only the difference from the image of the I frame. Will be done. Both the I frame and the P frame have a frame header and an image data unit. The image data of each frame generated by compressing the moving image by applying a predetermined codec is stored in the image data unit.

The processing unit 21 generates high-resolution video data and low-resolution video data, and then records the high-resolution video data on the SD card 32 (FIG. 1) (step SA4). Further, the processing unit 21 transmits low-resolution video data to the server 40 (FIG. 1) (step SA5).

The processing unit 21 determines whether or not to end the processing after performing the processing of transmitting the low-resolution moving image data to the server 40 (step SA6). For example, when the accessory switch of the vehicle is turned off, the processing unit 21 executes a shutdown process (step SA7) and then ends the process. If the vehicle accessory switch remains on, the processing unit 21 repeats the processing from step SA1.

FIG. 4 is a flowchart of the shutdown process in step SA7. When the processing unit 21 detects that the accessory switch of the vehicle has been turned off, it transmits a shutdown command to the LTE module 31 (FIG. 1) (step SB1). After that, the processing unit 21 ends the recording of the high-resolution moving image data on the SD card 32 (step SB2). Further, it waits until the shutdown completion notification is received from the LTE module 31 (step SB3). Upon receiving the shutdown completion notification from the LTE module 31, the processing unit 21 transmits a signal notifying the shutdown completion to the server 40 (step SB4).

When the server 40 (FIG. 1) receives the low-resolution moving image data from the in-vehicle electronic device 20, the server 40 (FIG. 1) stores each terminal ID in the storage device 42. Vehicle information is still stored in each frame header of the stored low-resolution video data. When the client terminal 50 requests the distribution of the video data, the server 40 distributes the low-resolution video data to the client terminal 50.

[Effect of the first embodiment]
Next, the excellent effect of the vehicle management system according to the first embodiment will be described.
The low-resolution video data transmitted by the vehicle-mounted electronic device 20 to the server 40 has a smaller amount of data than the high-resolution video data recorded on the SD card 32. Therefore, the amount of data to be transmitted can be reduced as compared with the case where high-resolution moving image data is transmitted to the server 40. In particular, when the moving image captured by the camera 22 is constantly transmitted, a remarkable effect of reducing the amount of data can be obtained.

The vehicle information at the time when the frame is acquired is stored in the frame header of the video data. It is preferable that the client terminal 50 for reproducing the moving image data has a function of extracting vehicle information from the frame header of the moving image data. The client terminal 50 having this function can immediately read the vehicle information at the time of reproduction during the reproduction of the moving image. By reading out the vehicle information, the client terminal 50 can display the vehicle information such as the position of the vehicle and the presence / absence of an event on the display 53 and provide the vehicle manager with the vehicle information.

Generally, the downlink from the network to the terminal is congested, and the congestion of the uplink from the terminal to the network is less than that of the downlink. The method of the first embodiment of transmitting low-resolution video data from the in-vehicle electronic device 20 to the server 40 has an effect that an uplink that is generally less crowded can be effectively used.

In addition, the moving image data recorded on the SD card 32 is likely to become unplayable due to the occurrence of some abnormality. In the first embodiment, even if a situation occurs in which the high-resolution moving image data recorded on the SD card 32 cannot be reproduced, the low-resolution moving image data transmitted to the server 40 and stored in the server 40 is distributed to the client terminal 50. Streaming playback is possible on the client terminal 50.

In the first embodiment, the vehicle-mounted electronic device 20 transmits low-resolution video data to the server 40 regardless of the presence or absence of an event such as an impact on the vehicle. Sending video data regardless of the presence or absence of an event may be called "always sending". In the first embodiment, the server 40 stores moving images of the surroundings of the vehicle not only at the time of event occurrence but also during normal driving. The vehicle manager can view moving images around the vehicle that is normally running.

Since the in-vehicle electronic device 20 transmits low-resolution moving image data to the server 40 in almost real time, the vehicle manager can view the moving image around the vehicle in almost real time.

[Modified example of the first embodiment]
Next, a modified example of the first embodiment will be described.
In the first embodiment, the terminal ID is recorded in the non-volatile memory of the processing unit 21, but the terminal ID may be specified by another method. For example, the ID number of the SIM card inserted in the LTE module 31 may be used as the terminal ID. Further, for example, the terminal ID may be recorded on the SD card 32. In this case, the terminal ID can be associated with the driver by carrying the SD card 32 and attaching the SD card 32 to the in-vehicle electronic device 20 before starting the operation. As a medium for recording the terminal ID, a driver's license in which an IC chip is embedded, a contactless IC card carried by the driver, or the like may be used instead of the SD card 32. In this case, it is preferable to mount a reader such as a driver's license or a contactless IC card in which an IC chip is embedded in the in-vehicle electronic device 20.

[Second Example]
Next, the vehicle management system according to the second embodiment will be described with reference to FIGS. 5A, 5B, and 6. The vehicle management system according to the second embodiment has the function of the vehicle management system according to the first embodiment, and further has a function of stopping the constant transmission of low-resolution moving image data from the in-vehicle electronic device 20 to the server 40.

FIG. 5A is a diagram showing an example of a menu screen displayed on the display 53 of the client terminal 50 (FIG. 1) of the vehicle management system according to the second embodiment. "Always start / stop transmission" is displayed as a selectable menu item. When the administrator selects the item of "constant transmission start / stop", the processing unit 51 of the client terminal 50 displays a screen for inputting the continuous transmission start / stop command on the display 53.

FIG. 5B is a diagram showing an example of a screen displayed on the display 53 of the client terminal 50. The processing unit 51 (FIG. 1) of the client terminal 50 indicates, for each managed vehicle, whether the vehicle is constantly transmitting low-resolution video data or is in a stopped transmission state (video data transmission state). , And the amount of data communication for each vehicle within a predetermined period, and the total amount of data communication for all vehicles are displayed on the display 53 in the form of a list. In the example shown in FIG. 5B, vehicles 1 to 3 and vehicle 5 are constantly transmitting low-resolution video data to the server 40, and vehicle 4 is stopped transmitting. The administrator can display information about the vehicles to be managed other than the vehicles 1 to 5 by operating the slider displayed at the right end of the screen.

When the administrator modifies the contents of the list displayed on the display 53 and selects the "change" button, the client terminal 50 specifies the terminal ID of the vehicle to be changed and starts or transmits the moving image data. A command for instructing the stop is transmitted to the server 40. Upon receiving this command, the server 40 transmits a command for instructing the in-vehicle electronic device 20 of the vehicle to be changed to start or stop the transmission of the moving image data. Upon receiving the command to stop the transmission, the in-vehicle electronic device 20 stops the constant transmission of the low-resolution moving image data. Upon receiving the command for instructing the start of transmission, the in-vehicle electronic device 20 starts constantly transmitting low-resolution moving image data.

FIG. 6 is a diagram showing a configuration of a frame of data transmitted to the server 40 by the in-vehicle electronic device 20 that has stopped constantly transmitting low-resolution moving image data. Similar to the case of the first embodiment shown in FIG. 3, the data transmitted to the server 40 includes an I frame and a P frame. Each frame includes a frame header and an image data unit. When the constant transmission of low-resolution moving image data is stopped, the in-vehicle electronic device 20 blanks the image data portion of all frames. For example, the image stored in the image data unit is made into a single color such as black. At this time, the size of the image data unit is smaller than the size when the low-resolution moving image data is being transmitted. Even during the period when the transmission of the low-resolution video data is stopped, the in-vehicle electronic device 20 stores the same data such as vehicle information in the frame header as when the low-resolution video data is constantly transmitted. ..

[Effect of the second embodiment]
Next, the excellent effect of the vehicle management system according to the second embodiment will be described.
Since the blank image is stored in the image data section during the period when the transmission of the low-resolution moving image data is stopped, the amount of data to be transmitted is smaller than that in the case of transmitting the low-resolution moving image data. Therefore, it is possible to reduce the communication cost.

From the content displayed in FIG. 5B, the administrator can easily grasp the vehicle that constantly transmits the low-resolution moving image data and the vehicle that constantly stops the transmission. Further, the manager can grasp the amount of data communication for each vehicle. If the total data traffic of all vehicles within a predetermined period exceeds the expected upper limit, the transmission of low-resolution video data should be stopped to prevent the data traffic from becoming excessive. Can be done. In addition, the administrator can set priorities for the vehicles to be managed and stop the constant transmission of low-resolution video data in order from the vehicle with the lowest priority.

[Modified example of the second embodiment]
In the second embodiment, the administrator monitors the data traffic, and when the total data traffic within a predetermined period exceeds the expected upper limit, the operation of constantly stopping the transmission of low-resolution video data is performed. went. It is preferable that the server 40 or the client terminal 50 periodically monitors the amount of data communication on behalf of the administrator. The administrator may determine the upper limit of the data communication amount in advance and set it in the server 40 or the client terminal 50. When the server 40 or the client terminal 50 detects that the total amount of data communication exceeds the upper limit, it transmits a command to each vehicle to stop the constant transmission of low-resolution moving image data. By doing so, it is possible to avoid the occurrence of a situation in which the amount of data communication becomes excessive without the administrator regularly monitoring the amount of data communication. Alternatively, when the server 40 or the client terminal 50 detects that the total data communication volume exceeds the set upper limit value, the data communication volume to the administrator's registered e-mail address exceeds the set upper limit value. It's a good idea to send an email notifying you.

The video data transmission state of the in-vehicle electronic device 20 may be inquired from the server 40 to the in-vehicle electronic device 20 as needed. For example, the server 40 may send an inquiry command to the in-vehicle electronic device 20 and receive a response message notifying the in-vehicle electronic device 20 of the moving image data transmission state to determine the moving image data transmission state.

As another method, it is preferable that the server 40 stores the moving image data transmission state for each vehicle. For example, if the image data portion of each frame of the moving image data transmitted from the in-vehicle electronic device 20 is blank, the server 40 determines that the vehicle equipped with the in-vehicle electronic device 20 is constantly stopped transmitting. It is good to do. Alternatively, it is preferable to include information for notifying the video data transmission status in the frame header of the video data. In this way, the server 40 can know the moving image data transmission state without transmitting an inquiry command to the in-vehicle electronic device 20 every time it becomes necessary to know the moving image data transmission state of the vehicle.

In the second embodiment, the data communication amount for each vehicle and the total data communication amount are displayed on the display 53, but the display mode may be changed according to the contract conditions for calculating the communication charge. In the case of a contract in which the communication charge is calculated based on the communication amount for each vehicle, it is preferable to display the data communication amount for each vehicle and not to display the total data communication amount. In the case of a contract in which the communication charge is calculated based on the data communication amount of the entire contract vehicle, it is preferable to display only the total data communication amount without displaying the data communication amount for each vehicle. Alternatively, one mode can be selected from a mode in which both the data traffic for each vehicle and the total data traffic are displayed, a mode in which only the data traffic for each vehicle is displayed, and a mode in which only the total data traffic is displayed. It would be nice to allow the administrator to make a choice. The processing unit 51 may display the screen of the management vehicle list (FIG. 5B) on the display 53 in the selected mode.

In the second embodiment, the data communication amount within the period that is the unit for calculating the communication charge is displayed, but it is preferable to switch the screen to display the history of the past data communication amount. For example, it is preferable to display the monthly data communication amount for the past one year and the total data communication amount for one year for each vehicle.

[Third Example]
Next, the vehicle management system according to the third embodiment will be described with reference to FIG. 7. The vehicle management system according to the third embodiment determines whether or not the in-vehicle electronic device 20 can transmit low-resolution moving image data in addition to the functions of the vehicle management system according to the first embodiment and the second embodiment. Has a function.

In the first embodiment, the vehicle-mounted electronic device 20 constantly transmits the low-resolution video data to the server 40, but the low-resolution video data may not be transmitted when the vehicle enters the tunnel or the like. In the third embodiment, as described below, the processing when the low-resolution moving image data cannot be transmitted is clarified.

FIG. 7 is a flowchart of processing executed by the processing unit 21 of the in-vehicle electronic device 20 according to the third embodiment. Hereinafter, the differences from the first embodiment shown in FIG. 2 will be described.

The processing unit 21 records high-resolution moving image data on the SD card 32 (step SA4), and then determines whether or not data transmission via the LTE module 31 is possible based on the radio wave condition (step SA41). When the data can be transmitted, the processing unit 21 transmits the low-resolution moving image data to the server 40 via the LTE module 31 as in the case of the first embodiment (step SA5). When data transmission is not possible, the processing unit 21 records low-resolution video data on the SD card 32 without transmitting it to the server 40 (step SA51). After step SA5 or step SA51, the processing unit 21 determines whether or not to end the moving image data transmission processing as in the case of the first embodiment (step SA6).

If the transmission process is not completed, the processing unit 21 repeats the process from step SA1. When the transmission process is terminated, for example, when the accessory switch is turned off, the processing unit 21 determines whether or not untransmitted low-resolution video data remains in the SD card 32 (step SA61).

When untransmitted low-resolution video data remains, the processing unit 21 reads the low-resolution video data from the SD card 32 and transmits the low-resolution video data to the server 40 via the LTE module 31 (step SA62). When the transmission of all the low-resolution video data is completed, the processing unit 21 erases the low-resolution video data in the SD card 32 (step SA63). After that, a shutdown process is performed (step SA7).

If it is determined in step SA61 that no untransmitted low-resolution video data remains, the processing unit 21 executes a shutdown process (step SA7).

[Effect of the third embodiment]
Next, the excellent effect of the vehicle management system according to the third embodiment will be described.

In the third embodiment, even if the low-resolution moving image data cannot be transmitted during traveling, the low-resolution moving image data can be recorded on the SD card 32 without being discarded. After the driver stops the engine and turns off the accessory switch, the low-resolution video data is transmitted to the server 40 (step SA62), so that the low-resolution video data acquired during driving is stored in the server 40. be able to.

[Modified example of the third embodiment]
Next, a modified example of the third embodiment will be described. In the third embodiment, after turning off the accessory switch of the vehicle, the low-resolution video data in the SD card 32 was transmitted to the server 40. In the first modification of the third embodiment, when the radio wave condition is restored during traveling, both the low-resolution video data currently being acquired and the low-resolution video data in the SD card 32 are transmitted to the server 40. do. When the communication speed of data communication using the LTE module 31 is sufficiently high, the low-resolution video data currently being acquired and the low-resolution video data read from the SD card 32 are transmitted in parallel in this way. can do.

In the third embodiment, low-resolution video data was recorded on the SD card 32 during a time when the video data could not be transmitted, but in the second modification of the third embodiment, the low-resolution video data was discarded and the video data was low. Remember the time zone when the resolution video data could not be sent. After the accessory switch is turned off, the high-resolution video data in the SD card 32 during the time period during which the low-resolution video data could not be transmitted is read, converted into low-resolution video data, and transmitted to the server 40. With this method, the processing unit 21 needs to have a function of converting high-resolution video data into low-resolution video data, but the low-resolution video data does not consume the storage capacity of the SD card 32. ..

In the third embodiment, the low-resolution moving image data and the high-resolution moving image data are recorded on the same SD card 32. In the third modification of the third embodiment, the low-resolution moving image data is recorded on a recording medium different from the SD card 32 for recording the high-resolution moving image data. For example, it is preferable that two SD cards are attached to the in-vehicle electronic device 20, one for recording high-resolution video data and the other for recording low-resolution video data. In this modification, a part of the area for recording high-resolution video data is not consumed by the low-resolution video data. In this case, it is preferable to automatically format the SD card for recording the low-resolution video data after transmitting all the low-resolution video data to the server 40. As a result, it is possible to prevent the occurrence of a situation in which low-resolution video data cannot be recorded on the SD card due to forgetting to format. Alternatively, after the server 40 receives all the low-resolution video data, the server 40 may send a command for instructing the in-vehicle electronic device 20 to format the SD card for recording the low-resolution video data. ..

In the third embodiment, when data transmission is impossible, low-resolution moving image data is recorded on the SD card 32 without being transmitted to the server 40. In the fourth modification of the third embodiment, the processing unit 21 has a low resolution not only when data transmission is completely impossible but also when it is assumed that a sufficient communication speed cannot be secured due to poor radio wave conditions. The moving image data is recorded on the SD card 32 without being transmitted to the server 40. By doing so, it is possible to eliminate unnecessary transmission retry processing.

[Fourth Example]
Next, the vehicle management system according to the fourth embodiment will be described with reference to FIG. The vehicle management system according to the fourth embodiment has a function of recording an event by the server 40 in addition to the functions of the vehicle management system according to the first to third embodiments.

FIG. 8 is a flowchart executed by the server 40 of the vehicle management system according to the fourth embodiment. The processing unit 41 of the server 40 (FIG. 1) stores the low-resolution moving image data received from each of the plurality of in-vehicle electronic devices 20 in the storage device 42 (FIG. 1) in association with the vehicle ID (step SE1). The processing unit 41 of the server 40 determines whether or not the event flag in the frame header is set when storing the low-resolution moving image data in the storage device 42 (step SE2).

When the event flag is set, the processing unit 41 notifies the vehicle manager that an event has occurred (step SE3). In this embodiment, the administrator's e-mail address is registered in the server 40, and the processing unit 41 sends an e-mail to the registered e-mail address to obtain the vehicle ID, event content, occurrence time, and occurrence location. Etc. are notified.

After that, the processing unit 41 of the server 40 cuts out the low-resolution video data before and after the event occurrence from the low-resolution video data that is constantly transmitted, and stores it in the storage device 42 as event recording data (step SE4). .. The processes from step SE1 to step SE4 are repeated until the server 40 is shut down (step SE5).

[Effect of Fourth Example]
Next, the excellent effect of the vehicle management system according to the fourth embodiment will be described. In the fourth embodiment, the event recording data when the event occurs can be managed separately from the low-resolution moving image data constantly transmitted from the vehicle. For example, when the server 40 has a function to automatically delete the accumulated amount of low-resolution video data that is constantly transmitted when it exceeds the upper limit, the event recording data can be left without being deleted. Become. For example, the event recording data may be stored semi-permanently by the server 40 until the administrator performs an erasing operation.

By looking at the email sent from the server 40, the vehicle manager can immediately know that an event such as an accident has occurred in the managed vehicle.

[Modified example of the fourth embodiment]
Next, various modifications of the fourth embodiment will be described.
In the first modification of the fourth embodiment, the server 40 has a function of storing the event occurrence time points in a list for each vehicle ID, in addition to the function of the server 40 according to the fourth embodiment. In this way, when searching for the event occurrence time point, the event occurrence time point can be found in a short time from the already stored list without reading the low-resolution video data in chronological order.

In the fourth embodiment, when the server 40 receives the low-resolution moving image data that is constantly transmitted, it is determined whether or not an event has occurred almost in the rear time. In the second modification of the fourth embodiment, when the low-resolution moving image data that is constantly transmitted is stored in the storage device 42, it is not determined whether or not an event has occurred. Before erasing the low-resolution moving image data stored in the storage device 42, the processing unit 41 reads the stored low-resolution moving image data and detects the occurrence of an event.

When the occurrence of an event is detected, the processing unit 41 stores low-resolution moving image data before and after the event occurrence in the storage device 42 as event recording data. By doing so, the event recording data can be retained even after the low-resolution moving image data that is constantly transmitted is deleted. Triggers for erasing the constantly transmitted low-resolution video data include when the low-resolution video data stored in the storage device 42 exceeds the predetermined capacity, or when the administrator performs an erasing operation. Be done.

In the third modification of the fourth embodiment, as in the second modification, when the constantly transmitted low-resolution video data is stored in the storage device 42, the presence or absence of an event is not determined, and batch processing is performed periodically. To determine if an event has occurred. For example, this batch process may be started at night when the amount of moving image data received is expected to be small.

In the fourth embodiment, the administrator is notified by sending an e-mail that the event has occurred. In the fourth modification of the fourth embodiment, the server 40 pushes the application program installed in the information terminal of the administrator to notify the administrator that an event has occurred. This method also allows the administrator to immediately know that an event has occurred in the vehicle under management.

In the fifth modification of the fourth embodiment, the server 40 has a function of statistically analyzing the event content, vehicle ID, position information, and the like when an event occurs. It is advisable to generate driving support information such as points that should be driven with particular caution by performing statistical analysis. For example, from the analysis result that the number of sudden braking occurs at a specific point on the map, it is possible to obtain driving support information that the driver should drive particularly carefully at that point.

[Fifth Example]
Next, the vehicle management system according to the fifth embodiment will be described with reference to FIGS. 9A to 11. The vehicle management system according to the fifth embodiment has the functions of the vehicle management system according to the first to fourth embodiments, and as described below, the client terminal 50 is based on the data stored in the server 40. Has the function of providing the manager with information for managing the vehicle.

FIG. 9A is a diagram showing a menu screen displayed on the display 53 of the client terminal 50. When the administrator selects the item of "vehicle management" from the menu screen, the processing unit 51 of the client terminal 50 receives the information from the server 40 and displays the management vehicle list screen on the display 53.

FIG. 9B is a diagram showing a management vehicle list screen displayed on the display 53. Based on the information received from the server 40, the processing unit 51 displays the vehicle ID to be managed, the communication volume for each vehicle, and the occurrence date / time information of a new event that has occurred in the vehicle in a list format. If the information of all managed vehicles cannot be displayed on the screen, a slider is displayed at the right end of the list. The administrator can check the information of all the vehicles to be managed by operating the slider and scrolling the screen display. Further, on the management vehicle list screen, a "vehicle data" button for transitioning to the vehicle data screen, a "map" button for transitioning to the map screen, and a check box for each vehicle are displayed.

A "confirm" button is displayed corresponding to the information on the date and time when the new event occurred. When the administrator selects the "confirm" button, the processing unit 51 displays the content of the event and the "back" button on the display 53. When the administrator confirms the content of the event and selects the "back" button, the processing unit 51 displays the management vehicle list screen on the display 53. The information on the date and time when the confirmed event occurred should not be displayed on the management vehicle list screen.

When the administrator checks the check box of the vehicle for which detailed information is to be confirmed and selects the "vehicle data" button, the processing unit 51 inquires the server 40 for information on the checked vehicle and displays the vehicle data on the display 53. Display the display screen.

FIG. 10 is a diagram showing an example of a vehicle data display screen displayed on the display 53. The display area of the display 53 is divided into a moving image display area 71, a date / time input area 72, an event indicator area 73, a map display area 74, a traveling speed display area 75, a vehicle position display area 76, and an acceleration display area 77. Hereinafter, the contents displayed by the processing unit 51 in each display area will be described.

The low-resolution video display area 71 is received by the server 40 from the vehicle (hereinafter referred to as the vehicle of interest) specified on the management vehicle list screen (FIG. 9B), and is live-streamed by the server 40 to the client terminal 50. A moving image is displayed based on the moving image data.

In the event indicator area 73, an indicator indicating the time when the event occurred and the period during which the low-resolution moving image data was constantly transmitted is displayed. For example, the vertical axis of the event indicator area 73 represents the elapsed time, and an event occurrence mark (for example, a red dot) is displayed at a position corresponding to the time when the event occurs. Further, a constant transmission mark (for example, a green vertical line) indicating constant transmission is displayed at a position corresponding to the period during which low-resolution moving image data is constantly transmitted.

A calendar display button, a "+" button, and a "-" button are displayed in the date / time input area 72. The administrator can select the calendar display button to display the calendar and input the acquisition date / time information of the moving image to be displayed. By operating the "+" button and the "-" button, the scale of the vertical axis of the event indicator area 73 can be changed.

A map including the current position of the vehicle of interest is displayed in the map display area 74, and information on the latitude and longitude of the current position of the vehicle of interest is displayed numerically in the vehicle position display area 76. The current position information of the vehicle of interest is acquired from the vehicle information stored in the frame header of the low-resolution moving image data distributed from the server 40. A mark (icon) indicating the vehicle of interest is displayed at the current position of the vehicle of interest in the map displayed in the map display area 74. When the current position of the vehicle of interest moves, the map displayed in the map display area 74 is automatically scrolled up, down, left, and right so that the current position of the vehicle of interest is located substantially in the center of the map display area 74.

In the traveling speed display area 75, the current traveling speed of the vehicle of interest is displayed numerically. The current traveling speed information of the vehicle of interest is acquired from the vehicle information stored in the frame header of the low-resolution moving image data distributed from the server 40.

In the acceleration display area 77, the time change of the acceleration in the front-rear, left-right, and up-down directions participating in the vehicle of interest is displayed in a graph. The horizontal axis represents the elapsed time, and the vertical axis represents the magnitude of acceleration. Acceleration in the front-back, left-right, and up-down directions is displayed, for example, by polygonal lines of different colors.

Further, a plurality of transition buttons 78 are displayed on the display screen of the display 53. The plurality of transition buttons 78 include a "managed vehicle list" button, a "map" button, a "current image" button, and a "past image" button.

When the manager selects the "managed vehicle list" button, the processing unit 51 displays the managed vehicle list screen (FIG. 9B) on the display 53.

When the administrator selects the "past image" button, the processing unit 51 specifies the date and time input in the date and time input area 72, and transmits a command requesting distribution of low-resolution video data to the server 40. .. Upon receiving this command, the server 40 reads the low-resolution video data of the vehicle of interest at the date and time specified in the date and time information, and streams and distributes it to the client terminal 50 (on-demand distribution). Live distribution is interrupted during on-demand distribution. The client terminal 50 displays a moving image in the moving image display area 71 based on the low-resolution moving image data distributed on demand.

The administrator can also specify the date and time when the video data to be delivered on demand is acquired by clicking or tapping the event occurrence mark or the constant transmission mark displayed in the event indicator area 73 to select it. Further, the administrator can reproduce the moving image at a desired date and time by operating marks such as fast forward, rewind, and slider for viewing the moving image.

When the administrator selects the "current image" button, the processing unit 51 sends a command requesting live distribution to the server 40. Upon receiving this command, the server 40 live-streams the low-resolution video data constantly transmitted from the vehicle of interest to the client terminal 50. The client terminal 50 displays a moving image in the moving image display area 71 based on the low-resolution moving image data delivered live. During live streaming, the "Current Image" button is grayed out and cannot be selected.

FIG. 11 is a diagram showing an example of a map screen displayed on the display 53. Hereinafter, the contents to be displayed on the display 53 by the processing unit 51 will be described.

The map is displayed so that substantially the center of the display area of the display 53 matches the current position of the vehicle of interest. Further, a plurality of transition buttons 78, for example, a "managed vehicle list" button and a "vehicle data" button are displayed on the display 53.

An icon indicating the current position of the vehicle of interest is displayed on this map. Further, when another vehicle to be managed exists in the area indicated by the displayed map, an icon indicating the current position of the other vehicle is displayed on the map. The vehicle 1 whose icon is displayed in FIG. 11 corresponds to the vehicle of interest, and the vehicle 2 and the vehicle 3 correspond to other vehicles to be managed.

Next, the process performed by the server 40 for displaying the map screen will be described.
When the server 40 receives low-resolution video data from a plurality of managed vehicles, the server 40 associates the vehicle ID in the frame header of the video data with the current position information and stores the vehicle position information separately from the video data. .. When the map screen is displayed, the server 40 transmits low-resolution video data of the vehicle of interest and position information of another vehicle to be managed to the client terminal 50. Video data of vehicles other than the vehicle of interest is not transmitted.

When the accessory switch of the vehicle is turned off and the in-vehicle electronic device 20 is shut down, the server 40 stores the current position information in the frame header of the most recently received moving image data as the position information of the vehicle. If the video data is not constantly transmitted and the traveling speed in the frame header of the latest received video data is 0, the current position information in the frame header of the most recently received video data is used. It is stored as vehicle position information. If the video data is not constantly transmitted and the running speed in the frame header of the latest received video data is not 0, it is considered that the video data cannot be transmitted / received due to the entry into the tunnel or the like. Be done. In this case, the current position of the vehicle is indefinite.

Next, the processing performed by the client terminal 50 will be described. When the vehicle of interest moves, the map is scrolled up, down, left, and right so that the current position of the vehicle of interest is located substantially at the center of the display screen of the display 53.

When the manager selects the "managed vehicle list" button, the processing unit 51 causes the display 53 to display the managed vehicle list screen (FIG. 9B). When the administrator selects the "vehicle data" button, the processing unit 51 causes the display 53 to display the vehicle data display screen (FIG. 10).

[Effect of the fifth embodiment]
Next, the excellent effect of the vehicle management system according to the fifth embodiment will be described.
By displaying the vehicle data display screen (FIG. 10) on the display 53, the administrator can view the moving image based on the moving image data lively distributed from the server 40 or the moving image data distributed on demand. The manager can select any vehicle from the managed vehicle list screen and display the vehicle data display screen (FIG. 10). In addition, the administrator can know the current positions of not only the vehicle of interest but also other vehicles to be managed from the map screen (FIG. 11).

Even when the map screen (FIG. 11) is displayed on the display 53, when the vehicle data display screen is displayed on the display 53 because the low-resolution video data of the vehicle of interest is live-distributed to the client terminal 50. , Information about the vehicle of interest can be displayed immediately.

[Modified example of the fifth embodiment]
Next, a modified example of the fifth embodiment will be described. In the modified example, when the client terminal 50 displays a moving image based on the low-resolution video data that is live-streamed, the administrator is informed that the live stream is being delivered in the corner of the video display area 71. Display information to inform, for example, the character string "live". When the client terminal 50 displays a moving image based on low-resolution video data distributed on demand, the client terminal 50 informs the administrator that a past video is being played in the corner of the video display area 71. Information for this purpose, for example, the character string "past video" is displayed. The administrator can easily notice whether the moving image currently being viewed is live-streamed or a past video.

During live distribution, it is preferable that the lower end of the vertical axis of the event indicator area 73 corresponds to the current date and time, and the information of a predetermined period retroactive from the present time is displayed in the area between the upper end and the lower end. Alternatively, the event indicator area 73 may be blank during live distribution.

When the map screen (FIG. 11) is displayed on the display 53, a specific point may be fixed at the center of the display area and the current position of the vehicle may be moved on the map. Immediately after the map screen is displayed, the map may be displayed so that the current position of the vehicle of interest is located at the center of the display area of the display 53.

When the map screen (FIG. 11) is displayed on the display 53, the position information of the vehicle other than the vehicle of interest is not the frame interval of the moving image data, but a time step width longer than the frame interval, for example, 1 second interval, 5 second interval. It is good to send by etc. Further, the position information about the vehicle other than the vehicle of interest may be transmitted only when the client terminal 50 requests the server 40 to transmit the position information. As a result, it is possible to suppress an increase in the amount of data communication.

In the fifth embodiment, the managed vehicle ID is displayed on the managed vehicle list screen (FIG. 9B), but it is preferable to display the name of the driver who is driving the vehicle together with the vehicle ID. The driver's name may be associated with the vehicle ID. This association may be stored in at least one of the server 40 and the client terminal 50.

[Sixth Example]
Next, the vehicle management system according to the sixth embodiment will be described with reference to FIGS. 12 and 13. The vehicle management system according to the sixth embodiment, in addition to the functions of the vehicle management system according to the first to fifth embodiments, obtains high-resolution moving image data of a specified date and time recorded on the SD card 32 (FIG. 1). It has a function to reproduce.

FIG. 12 is a diagram showing an example of a vehicle data display screen displayed on the client terminal 50 of the vehicle management system according to the sixth embodiment. In the sixth embodiment, the "date and time registration" button 79 is further displayed on the vehicle data display screen (FIG. 10) displayed on the client terminal 50 of the vehicle management system according to the fifth embodiment.

The administrator can register the date and time of the moving image to be reproduced by clicking or tapping the "date and time registration" button 79 during the reproduction of the moving image.

FIG. 13 is a diagram showing a signal transmission / reception sequence of the vehicle management system when the “date / time registration” button 79 is clicked or tapped. When the processing unit 51 detects that the "date and time registration" button 79 (FIG. 12) is clicked or tapped by the administrator during playback of the moving image (step SG1), the client terminal 50 instructs the server 40 to submit the SD card. Send a command to command. The server 40 transfers a command for instructing the SD card submission to the in-vehicle electronic device 20.

The vehicle-mounted electronic device 20 that has received the command for instructing the SD card submission stores that the command has been received. When the vehicle engine is stopped (step SG2), the processing unit 21 of the in-vehicle electronic device 20 causes the display 28 to display a message prompting the administrator to submit the SD card (step SG3). The sound may be output from the speaker 29.

When the driver of the vehicle notices this message, the SD card 32 is removed from the in-vehicle electronic device 20 (step SG4) and submitted to the administrator. The administrator receives the SD card from the driver and attaches it to the client terminal 50 (step SG5). When the administrator performs an operation to read the video data of the SD card 32, the processing unit 51 of the client terminal 50 starts moving images from the registered date and time based on the high-resolution video data recorded on the SD card 32. To play.

[Effect of the sixth embodiment]
Next, the excellent effect of the vehicle management system according to the sixth embodiment will be described. If the administrator discovers a point of concern when playing a moving image based on live-streamed low-resolution video data and wants to check the high-resolution moving image, "Register date and time" Click or tap the button 79 (FIG. 12). Then, the driver of the target vehicle is notified of the message to submit the SD card 32, so that the manager can obtain the SD card 32 from the driver.

The administrator can attach the SD card 32 inserted and removed from the driver to the client terminal 50, and cue and reproduce the moving image based on the high-resolution moving image data from the date and time when the point of concern occurs. Therefore, it is possible to save the trouble of manually cueing. Items that were difficult to confirm from a low-resolution moving image can be confirmed from a high-resolution moving image.

[Modified example of the sixth embodiment]
Next, a vehicle management system according to a modified example of the sixth embodiment will be described. In the sixth embodiment, the driver of the vehicle submits the SD card 32 to the administrator, but in this modified example, the high-resolution video data in the SD card 32 is sent to the server 40 as described below. Send to.

The client terminal 50 transmits a command requesting transmission of high-resolution moving image data to the in-vehicle electronic device 20 via the server 40. Upon receiving this command, the vehicle-mounted electronic device 20 returns to the depot and stops the engine, and then transmits the high-resolution video data in the SD card 32 to the server 40. The LTE module 31 (FIG. 1) may be used for transmitting the moving image data, and it is more preferable to use a communication module conforming to a short-range wireless communication standard such as WiFi. In order to realize this function, it is preferable to mount the built-in battery in the in-vehicle electronic device 20, and it is further preferable to supply power to the in-vehicle electronic device 20 from the vehicle battery even after the accessory switch is turned off.

In this modification, the driver can save the trouble of removing the SD card 32 from the in-vehicle electronic device 20 and submitting it to the administrator. As the high-resolution video data to be transmitted to the server 40, it is preferable to use video data only for a predetermined period before and after the registered date and time. By doing so, the amount of data to be transmitted can be reduced.

[7th Example]
Next, the vehicle management system according to the seventh embodiment will be described with reference to FIGS. 14A and 14B. The client terminal 50 of the vehicle management system according to the seventh embodiment has a moving image delivered live or on-demand from the server 40 in addition to the functions of the client terminal 50 of the vehicle management system according to the first to sixth embodiments. It has a function of streaming and reproducing data and storing the data in the storage device 52. The frame header of the moving image data stored in the client terminal 50 is the same as the frame header of the moving image data stored in the server 40, and the vehicle information is stored in the frame header.

FIG. 14A is a diagram showing a menu screen displayed on the display 53 of the client terminal 50. "Video playback" is displayed as one of the menu items. When the administrator selects the item of "video playback", the client terminal 50 executes the video playback process.

FIG. 14B is a diagram showing a menu screen for realizing the function of moving image reproduction. "Live playback", "server saved video playback", "terminal saved video playback", and "SD card saved video playback" are displayed as video playback menu items. When the administrator selects any of the menu items, the client terminal 50 reproduces the moving image corresponding to the selected menu item.

When the administrator selects the "live playback" item, the client terminal 50 asks the administrator for the vehicle ID to be played live. When the administrator inputs the vehicle ID, the client terminal 50 identifies the vehicle ID to the server 40 and transmits a command requesting live distribution. When the server 40 live-streams the moving image of the vehicle, the client terminal 50 reproduces the live-streamed moving image. Further, the moving image data that is live-distributed is stored in the storage device 52.

When the administrator selects the item of "playback of the video saved on the server", the client terminal 50 asks the administrator for the vehicle ID and the date and time for reproducing the moving image. When the administrator inputs the vehicle ID and the date and time information, the client terminal 50 specifies the vehicle ID and the date and time and sends a command requesting on-demand distribution to the server 40. When the server 40 delivers the moving image from the designated date and time of the vehicle on demand, the client terminal 50 streams and reproduces the moving image delivered on demand. Further, the moving image data distributed on demand is stored in the storage device 52.

When the administrator selects the item of "terminal saved video playback", the client terminal 50 asks the administrator for the vehicle ID and the date and time for reproducing the moving image. When the administrator inputs the vehicle ID and the date and time information, the processing unit 51 reads the corresponding moving image data from the storage device 52 and reproduces the moving image.

When the administrator selects the item of "SD card saved moving image playback", the client terminal 50 reads high-resolution moving image data from the installed SD card and reproduces the moving image.

[Effect of the 7th Example]
Next, the excellent effect of the vehicle management system according to the seventh embodiment will be described.
In the seventh embodiment, the moving image data stored in the server 40 can be stored in the client terminal 50. For example, even if the video data stored in the server 40 has a capacity limit or a storage period limit, the video data can be transferred to the client terminal without being restricted by the capacity limit or the storage period limit of the server 40. It can be stored in 50.

[Modified example of the seventh embodiment]
When the client terminal 50 reproduces a moving image that is live-distributed or on-demand-distributed, it is preferable to ask the administrator whether or not to save the moving image data in the storage device 52 of the client terminal 50. The processing unit 51 saves the moving image data in the storage device 52 only when the administrator inputs an instruction to save the moving image data. As a result, it is possible to prevent moving image data that does not need to be stored from being stored in the storage device 52 of the client terminal 50.

When the video data stored in the server 40 is delivered on demand and the moving image is played back, and when the moving image data stored in the client terminal 50 is read out and the moving image is played back. The color or shape of the constant transmission mark displayed in the event indicator area 73 (FIG. 10) may be different. For example, when the continuous transmission mark when receiving on-demand distribution from the server 40 and playing back the moving image is a thin vertical line, when the moving image data stored in the client terminal 50 is read out and the moving image is played back. The constant transmission mark of is recommended to be a thick vertical line. In this way, the administrator can easily know whether or not the moving image data of the moving image currently being reproduced is stored in the client terminal 50.

[8th Example]
Next, the vehicle management system according to the eighth embodiment will be described with reference to FIG. The vehicle management system according to the eighth embodiment transmits and receives various messages between the client terminal 50, the server 40, and the in-vehicle electronic device 20 in addition to the functions of the vehicle management system according to the first to seventh embodiments. Has a function.

FIG. 15 is a diagram showing a transmission / reception sequence of various messages transmitted / received between the client terminal 50, the server 40, and the in-vehicle electronic device 20. When the server 40 analyzes the vehicle information embedded in the frame header of the low-resolution video data constantly transmitted from the in-vehicle electronic device 20 and detects the occurrence of an abnormality (step SJ1), the server 40 is sent to the in-vehicle electronic device 20. Send a warning message. For example, it is advisable to include an excess of the traveling speed in the abnormality to be detected.

Upon receiving the warning message, the processing unit 21 of the in-vehicle electronic device 20 displays the content of the received message on the display 28 (FIG. 1) and outputs a warning sound from the speaker 29 (FIG. 1) (step SJ2). The driver of the vehicle will notice the warning message and try to drive safely.

The in-vehicle electronic device 20 is provided with a function that allows the driver to request relief by operating the in-vehicle electronic device 20 when a situation in which some kind of relief is required in the vehicle, for example, a traffic accident or the like occurs. For example, the in-vehicle electronic device 20 is provided with a help button or the like, and the driver can request help by pressing the help button.

When the driver operates the in-vehicle electronic device 20 to request a rescue request (step SJ3), the processing unit 21 of the in-vehicle electronic device 20 transmits a message requesting a rescue request to the server 40. The server 40 forwards this message to the client terminal 50. When the client terminal 50 receives the rescue request message, the client terminal 50 displays the content of the rescue request message on the display 53 (FIG. 1) (step SJ4). When the manager notices the message of the request for help, he / she can take appropriate measures such as contacting the police, contacting the insurance company, and dispatching necessary personnel to the site.

When the administrator operates the client terminal 50 to input a general message (step SJ5), the client terminal 50 transmits the general message to the in-vehicle electronic device 20 via the server 40. The processing unit 21 of the in-vehicle electronic device 20 displays the content of the received general message on the display 28 (step SJ6).

When the driver operates the vehicle-mounted electronic device 20 to input a general message (step SJ7), the vehicle-mounted electronic device 20 transmits the general message to the client terminal 50 via the server 40. When the processing unit 51 of the client terminal 50 receives the general message, the processing unit 51 displays the content on the display 53 (step SJ8).

By enabling the transmission and reception of general messages in this way, it is possible to communicate between the vehicle manager and the driver. Upon receiving the general message, the in-vehicle electronic device 20 may wait for the display of the content of the general message until the vehicle stops due to waiting for a signal or the like. This allows the driver to concentrate on the driving operation while driving.

[9th Example]
Next, the vehicle management system according to the ninth embodiment will be described with reference to FIGS. 16A and 16B. In the vehicle management system according to the ninth embodiment, in addition to the functions of the vehicle management system according to the first to eighth embodiments, a threshold value (event detection threshold value) for the in-vehicle electronic device 20 to detect the occurrence of an event is set from the client terminal 50. It has a function to change.

FIG. 16A is a diagram showing a menu screen displayed on the display 53 of the client terminal 50. "Event detection threshold change" is displayed as one of the menu items. When the administrator selects the item of "change event detection threshold value", the client terminal 50 prompts the administrator to input the vehicle ID to be changed, and when the vehicle ID is input, the process of changing the event detection threshold value is executed.

FIG. 16B is a diagram showing an image displayed on the display 53 when the processing unit 51 executes the event detection threshold value changing process. The processing unit 51 displays in a graph format the measured values of acceleration in the front-rear direction (x direction), the left-right direction (y direction), and the up-down direction (z direction) of the vehicle ID to be changed in the most recent period up to the present time. Let me. This graph is generated based on the vehicle information in the frame header of the low-resolution moving image data constantly transmitted from the in-vehicle electronic device 20 to the server 40, and is updated in real time. Further, in the graph, the threshold values Tx, Ty, and Tz of the acceleration for detecting the occurrence of the event in the x-direction, y-direction, and z-direction are displayed by broken lines. The absolute values of the positive threshold and the negative threshold are the same.

The administrator operates the mouse to move the broken line indicating the threshold value to the position corresponding to the threshold value of the change destination. This operation is realized, for example, by a drag-and-drop operation. If one of the dashed lines indicating the positive threshold value and the dashed line indicating the negative threshold value is moved, the other dashed line is automatically moved as well.

The processing unit 51 obtains the size of the threshold value corresponding to the position after the movement of the broken line indicating the threshold value, and sends a command command for changing the threshold value to the in-vehicle electronic device 20 via the server 40. Upon receiving this command command, the vehicle-mounted electronic device 20 immediately changes the event detection threshold value, and determines whether or not an event has occurred based on the changed threshold value.

[Effect of 9th Example]
Next, the excellent effect of the vehicle management system according to the ninth embodiment will be described. In the ninth embodiment, the administrator can change the event detection threshold value of the in-vehicle electronic device 20 without going to the vehicle. In addition, the manager can change the threshold value while checking the time change of the measured value of the acceleration applied to the vehicle to be changed in real time on the graph. Therefore, the administrator can intuitively find the optimum threshold value.

[Modified example of the ninth embodiment]
In the ninth embodiment, the vehicle ID whose threshold value is to be changed is specified, and the event detection threshold value of the in-vehicle electronic device 20 mounted on the vehicle is changed. However, the client terminal 50 detects the event of the specific vehicle. After changing the threshold value, it is preferable to have a function of changing the event detection threshold value of another vehicle to be managed to the same value. In this way, it is not necessary to perform the operation of changing the event detection threshold value for each vehicle to be managed, so that the time and effort of the administrator's operation can be saved.

In the ninth embodiment, the changed threshold value is specified by moving the broken line indicating the threshold value displayed on the graph by the operation of the administrator. As another method, the threshold value may be input numerically.

In the ninth embodiment, the target to be changed by remote control is set as the event detection threshold value, but other setting items of the in-vehicle electronic device 20 may be changed by remote control. Depending on the item to be changed, it may not be preferable to change immediately when the change command command is received. Such setting items may be changed, for example, when the in-vehicle electronic device 20 is activated. The item to be changed when the in-vehicle electronic device 20 is started is that the processing unit 51 stores the new setting value in the buffer area, and when the in-vehicle electronic device 20 is started, the new setting value is read from the buffer area. It is good to set it to. For example, the firmware update or the like may be executed when the in-vehicle electronic device 20 is started.

When it is necessary to stop the acquisition of the moving image due to the change of the setting item of the in-vehicle electronic device 20, the processing unit 51 temporarily acquires the moving image after the administrator operates the client terminal 50. It's a good idea to let the administrator know that you need to stop. The administrator can consider this notification and decide whether to change or cancel the setting item. For example, the client terminal 50 displays an inquiry message on the display 53, "The acquisition of the moving image is stopped for XX seconds to change the setting. Do you want to stop the acquisition of the moving image and change the setting?" It is preferable to display it on the display 53.

The in-vehicle electronic device 20 may notify the driver that the setting item is to be changed before the setting item is changed. For example, the processing unit 21 may display the message "Change the settings. Do not turn off the engine until the changes are completed." On the display 28.

In addition to the event detection threshold value, the setting items of the in-vehicle electronic device 20 include, for example, the resolution of high-resolution and low-resolution moving image data, the frame rate, and the like.

[10th Example]
Next, the vehicle management system according to the tenth embodiment will be described with reference to FIG. In the vehicle management system according to the tenth embodiment, in addition to the functions of the vehicle management system according to the first to ninth embodiments, high-resolution video data from the in-vehicle electronic device 20 to the server 40 when a predetermined condition is satisfied. Has the function of transmitting.

FIG. 17 is a diagram showing a signal transmission / reception sequence between the in-vehicle electronic device 20, the server 40, and the client terminal 50. Low-resolution video data is constantly transmitted from the in-vehicle electronic device 20 to the server 40. When the server 40 detects that the event flag in the frame header of the low-resolution video data is set, the server 40 sets the event occurrence date and time to the in-vehicle electronic device 20 that has transmitted the video data in which the event flag is set. Specify and send a command instructing to send high-resolution video data. Further, a message is transmitted to the client terminal 50 notifying that the occurrence of the event has been detected.

Upon receiving this message, the processing unit 51 of the client terminal 50 causes the display 53 to display a message notifying the administrator that an event has occurred (step SK2). Further, a message asking the administrator whether or not to reproduce the high-resolution moving image is displayed on the display 53 (step SK3). The administrator instructs the client terminal 50 whether or not to reproduce the high-resolution moving image.

When the in-vehicle electronic device 20 receives the command instructing the transmission of the high-resolution video data, the vehicle-mounted electronic device 20 transmits the high-resolution video data before and after the event occurrence date and time to the server 40. The constant transmission of low-resolution video data will continue.

When the server 40 receives the high-resolution video data, it distributes it to the client terminal 50. When instructed to reproduce the high-resolution moving image, the client terminal 50 streams and reproduces the moving image based on the distributed high-resolution moving image data (step SK4).

[Effect of the 10th Example]
Next, the excellent effect of the vehicle management system according to the tenth embodiment will be described.
When an event such as an accident occurs in the vehicle, the administrator can view high-resolution moving images before and after the event occurrence. This makes it possible to know in detail the situation around the vehicle before and after the event occurs.

[Modified example of the tenth embodiment]
In the tenth embodiment, when the server 40 detects the occurrence of an event, a command for instructing the transmission of high-resolution moving image data is transmitted to the in-vehicle electronic device 20 regardless of the type of the event. As a modification of the tenth embodiment, it is preferable to limit the types of events that trigger the transmission instruction of high-resolution moving image data. The limited event type may be input by the administrator by operating the client terminal 50. As a result, when an event of low importance occurs, high-resolution video data is not transmitted, so that an increase in data communication volume can be suppressed.

[11th Example]
Next, the vehicle management system according to the eleventh embodiment will be described. In the vehicle management system according to the eleventh embodiment, in addition to the functions of the vehicle management system according to the first to tenth embodiments, the server 40 is included in the moving image included in the moving image data and the frame header of the moving image data. It has a function of machine learning based on vehicle information.

For example, the server 40 can find out a place where a traffic accident is likely to occur, a place where a sudden braking is likely to be applied, a situation where a sudden braking is applied, and the like, based on a moving image and vehicle information. Furthermore, although no accident has occurred, a situation in which the risk of an accident has increased can be found from the moving image, and machine learning can be performed by associating this situation with the vehicle information. For example, it is possible to find out from a moving image a situation in which a pedestrian is not repelled but is about to be repelled.

By applying machine learning to low-resolution video data collected from multiple vehicles, it is advisable to find out situations where the risk of accidents has increased and create a database. In addition, it is advisable to classify the causes of increased danger into a database by classifying them into overspeeding, suspension violations, approaching pedestrians and bicycles, and the like.

The server 40 may evaluate whether or not the current driving is a driving with a high risk of an accident by applying the learning result to the low-resolution moving image data currently received. The evaluation result may be transmitted to the client terminal 50 to notify the administrator.

Since the moving image and the vehicle information are embedded in the low-resolution moving image data, machine learning in which the two are associated can be easily performed.

[12th Example]
Next, the vehicle management system according to the twelfth embodiment will be described with reference to FIG. In the vehicle management system according to the twelfth embodiment, in addition to the functions of the vehicle management system according to the first to eleventh embodiments, the means for ensuring communication when the IP address of the in-vehicle electronic device 20 is changed is clarified. Will be done.

The IP address of the in-vehicle electronic device 20 is constantly notified to the server 40 during the period in which the in-vehicle electronic device 20 constantly transmits low-resolution moving image data to the server 40. Therefore, when the IP address of the vehicle-mounted electronic device 20 changes, the server 40 can immediately know that the IP address of the vehicle-mounted electronic device 20 has changed. The server 40 may send various messages to the latest IP address of the in-vehicle electronic device 20.

Next, a procedure for the server 40 to know the latest IP address of the vehicle-mounted electronic device 20 when no signal is transmitted from the vehicle-mounted electronic device 20 will be described.

FIG. 18 is a diagram showing a sequence of sending and receiving messages between the in-vehicle electronic device 20 and the server 40. The IP address of the server 40 is fixed, for example 200.200.200.1. The IP address of the in-vehicle electronic device 20 changes dynamically. The initial IP address of the in-vehicle electronic device 20 is, for example, 100.100.100.1. Messages # 001 and # 002 are stored in the message queue 90 of the server 40, and are in a transmission waiting state.

The in-vehicle electronic device 20 periodically sends an inquiry message to the server 40. The inquiry message includes the terminal ID and the IP address of the in-vehicle electronic device 20. By receiving the inquiry message SS1, the server 40 can know the current IP address of the in-vehicle electronic device 20. The server 40 transmits the response message SS2 including the message # 001 to the IP address included in the inquiry message SS1 from the in-vehicle electronic device 20. When the server 40 receives the message SS3 confirming the receipt of the message # 001 from the in-vehicle electronic device 20, the message # 001 is deleted from the message queue 90.

The in-vehicle electronic device 20 transmits the inquiry message SS4 again. The server 40 transmits the response message SS5 including the message # 002 to the IP address included in the inquiry message in response to the inquiry message SS4 from the in-vehicle electronic device 20. An example in which the IP address of the in-vehicle electronic device 20 changes to 100.100.100.2 immediately after the in-vehicle electronic device 20 transmits an inquiry message will be described.

Since the IP address of the in-vehicle electronic device 20 has changed, the response message SS5 transmitted from the server 40 to the old IP address does not reach the in-vehicle electronic device 20. Message # 002 is stored in the message queue 90 and the state is continued.

The in-vehicle electronic device 20 transmits the inquiry message SS6 again. The inquiry message SS6 includes a new IP address of the in-vehicle electronic device 20. Upon receiving this inquiry message SS6, the server 40 sends a response message SS7 including message # 002 to the new IP address. When the server 40 receives the message SS8 confirming the receipt of the message # 002 from the in-vehicle electronic device 20, the message # 002 is deleted from the message queue 90. As a result, the message queue 90 becomes empty.

After that, when the in-vehicle electronic device 20 transmits the inquiry message SS9, the server 40 transmits the response message SS10 notifying that there is no untransmitted message to the IP address included in the inquiry message SS9. The in-vehicle electronic device 20 transmits a receipt confirmation message SS11 notifying that the response message SS10 notifying that there is no untransmitted message has been received to the server 40.

In the twelfth embodiment, since the vehicle-mounted electronic device 20 periodically transmits an inquiry message to the server 40, the server 40 knows the change in the IP address when the IP address of the vehicle-mounted electronic device 20 changes. Can be done. As a result, communication from the server 40 to the in-vehicle electronic device 20 is secured.

[13th Example]
Next, the vehicle search system according to the thirteenth embodiment will be described with reference to FIGS. 19 to 22. The vehicle management system according to the first to twelfth embodiments was for supporting the vehicle management by the vehicle manager, but the vehicle search system according to the thirteenth embodiment is based on the position information and the time information. It searches for vehicles and assists in receiving moving images captured by in-vehicle electronic devices mounted on the searched vehicles.

In the first to twelfth embodiments, the vehicle-mounted electronic device 20 transmits low-resolution video data to the server 40 (FIG. 1) and records the high-resolution video data on the SD card 32. Then, the high-resolution moving image data is recorded on the SD card 32 without transmitting the low-resolution moving image data. The in-vehicle electronic device 20 transmits the current position information and time information of the vehicle to the server 40 together with the vehicle ID instead of the low-resolution moving image data. Further, in the first to twelfth embodiments, the user of the client terminal was the vehicle manager, but in the thirteenth embodiment, the user of the client terminal is the owner or manager of the vehicle. An unrelated third party.

FIG. 19 is a diagram showing a sequence of transmitting and receiving signals between the vehicle-mounted electronic device 20, the server 40, the client terminal 50, and the personal computer 80 of the vehicle search system according to the thirteenth embodiment. A plurality of in-vehicle electronic devices 20 mounted on the plurality of vehicles periodically transmit the vehicle position information and the time information together with the vehicle ID to the server 40.

The server 40 stores the information received from the in-vehicle electronic device 20 in the database 45 that can search the vehicle ID using the position information and the time information as search keys. Further, the vehicle ID and the account of the owner of the in-vehicle electronic device 20 mounted on the vehicle are associated and registered in the server 40.

When the user of the client terminal 50 operates the client terminal and inputs a search condition, the client terminal 50 specifies the search condition to the server 40 and sends a search request message.

FIG. 20 is a diagram showing an example of a screen for the user of the client terminal 50 to input search conditions. The display screen of the client terminal 50 is divided into a map area 55 and a search condition input area 56. A map is displayed in the map area 55. Items to be search conditions are displayed in the search condition input area 56. The search condition items include "position", "date and time", "range", and "purpose of use". A "search start" button is further displayed in the search condition input area 56.

The user of the client terminal 50 scrolls the map displayed in the map area 55 and specifies a place (position) on the map where he / she wants to check the moving image. When the position is specified on the map, the specified position is displayed in the search condition input area 56 in latitude and longitude.

Further, the user selects the item of "date and time" in the search condition input area 56, and specifies the date and time when he / she wants to confirm the moving image. For example, a period having a time width can be specified by the date and time at the start time and the date and time at the end time. The date and time are input by, for example, selecting from a pull-down menu.

Further, the user selects the item of "range" and specifies the range of the search target. The search target range is specified by a radius centered on the position specified in the position information. The value of this radius is input by, for example, selecting from a pull-down menu.

Further, the user inputs the purpose of use of the moving image. The purpose of use includes, for example, accident situation collection, criminal investigation, damage situation collection, and the like. The purpose of use is input by, for example, selecting from a pull-down menu.

When the user selects by clicking or tapping the "start search" button, the client terminal 50 specifies the location information (including the condition of the range) and the time information and sends the search request message to the server 40.

The server 40 (FIG. 19) that has received the search request message searches the database 45 using the designated position information and time information as a search key, and extracts the vehicle ID. For example, the server 40 extracts the vehicle ID of the vehicle that was traveling within the range specified by the position information in the time zone specified by the time information. The server 40 returns the search result to the client terminal 50. The search result includes the vehicle ID and the account attributes (for example, name or name) of the owner of the vehicle-mounted electronic device 20 specified by the vehicle ID. When the client terminal 50 receives the search result, the client terminal 50 displays the search result on the screen.

FIG. 21 is a diagram showing an example of a screen of the client terminal 50 on which the search result is displayed. The screen of the client terminal 50 is divided into a map area 55 and a search result display area 57. The processing means of the client terminal 50 causes the search result display area 57 to display the name or name of the owner corresponding to the vehicle ID extracted by the search, and the check box. Further, the "request" button is displayed in the search result display area 57.

In the map area 55, the map and the traveling route of the vehicle extracted by the search are displayed. When a plurality of vehicles are extracted, the owners of the in-vehicle electronic devices mounted on the vehicles and the traveling routes are displayed in a corresponding manner. For example, when three vehicles are extracted, the owners of each vehicle are displayed in a list, and a circled number symbol is displayed in association with each owner, and the travel route is marked with a corresponding circle. Add a number symbol.

When the user checks the check box of the owner of the in-vehicle electronic device 20 for which he / she wants to request the provision of the moving image and selects the "request" button, the client terminal 50 identifies the owner of the request destination to the server 40. And send a video data provision request message. The server 40 registers the account of the owner of the request destination in the list of request destinations for providing video data.

When the owner of the in-vehicle electronic device 20 activates the PC viewer of the personal computer 80 (FIG. 19) and logs in, the personal computer 80 notifies the server 40 of the login information. When the account of the logged-in owner is registered in the list of request destinations for providing video data, the personal computer 80 is notified that there is a request for providing video data. Upon receiving this notification, the personal computer 80 notifies the owner that there is a request for providing the moving image data.

FIG. 22 is a diagram showing an example of a screen after login of the personal computer 80 notified of the request to provide the moving image data. For example, the processing means stage of the personal computer 80 displays the "Do not allow" button and the "Next" button on the display screen together with the message "I received a request to share information from Mr. XX."

When the owner selects the "Do not allow" button, for example, a process of reading the moving image data recorded on the SD card and reproducing the moving image is executed without transmitting the moving image data to the server 40. When the owner selects the "Next" button, the personal computer 80 transitions to the screen for executing the process of uploading the moving image data.

On the processing screen for uploading video data, an operation is performed to cut out video data that may be uploaded from the video data recorded on the SD card. Furthermore, it is confirmed whether or not the traveling speed, the image inside the vehicle, the audio data, etc. may be uploaded. The personal computer 80 uploads the moving image data and other data that the owner has permitted to upload to the server 40.

The server 40 transfers the uploaded moving image data to the client terminal 50. By operating the client terminal 50, the user of the client terminal 50 can read the transferred moving image data and reproduce the moving image.

[Effect of 13th Example]
Next, the excellent effect of the vehicle search system according to the thirteenth embodiment will be described.
In the thirteenth embodiment, the provision of the moving image data is postponed, and only the GPS log such as the position information and the time information is uploaded to the server 40. Since the moving image data is not transmitted from the in-vehicle electronic device 20 to the server 40, the amount of transmitted data can be reduced. As a result, the cost of data transfer can be reduced. Further, since the video data is not always transmitted to the server 40, it is possible to prevent the video data on the server 40 from being read by a third party without the consent of the owner of the in-vehicle electronic device 20. It is possible to protect privacy.

The moving image data provided by the owner of the in-vehicle electronic device 20 can be used as useful information for accident investigation, and can also be used as evidence of a crime or the like. By utilizing these evidences in criminal investigations, false positive arrests can be prevented. Furthermore, if it is socially recognized that the moving image captured by the in-vehicle electronic device 20 of the vehicle of a third party who happened to be at the scene of the crime can be used for the crime investigation, the effect of deterring the crime can be obtained. ..

Further, in the thirteenth embodiment, the provider of the moving image data can cut out and provide only the moving image data that may be provided from all the captured moving image data. Further, information that is not desired to be provided to a third party, such as traveling speed, audio data, and an image inside the vehicle, can be prevented from being uploaded to the server 40. As a result, privacy can be protected and the information provider can be prevented from being damaged.

[Modified example of the thirteenth embodiment]
Next, a vehicle search system based on a modified example of the thirteenth embodiment will be described. In the thirteenth embodiment, the position information and the time information are wirelessly transmitted from the in-vehicle electronic device to the server, but the external electronic device such as the personal computer 80 transmits the position information and the time information of the route traveled so far to the server 40. It may have a function to (upload). In this case, it is not necessary to provide the in-vehicle electronic device 20 with a wireless communication function.

For example, the owner of the in-vehicle electronic device 20 has the SD card 32 (FIG. 1) in which the moving image data is recorded mounted on the personal computer 80 in which the PC viewer is installed, and the personal computer 80 is recorded on the SD card 32. It is preferable to read the position information and the time information included in the moving image data and upload them to the server 40.

In the thirteenth embodiment, it is not always necessary to distinguish between the client terminal 50 and the personal computer 80. By adding the function of the client terminal 50 according to the thirteenth embodiment to the PC viewer of the personal computer 80, the personal computer 80 in which the PC viewer is installed can be used as the client terminal 50. In this case, the owner of the in-vehicle electronic device 20 can be a provider of the moving image data and also a user who receives the moving image data of another person. In this case, providing the video data to a third party can be considered as sharing the video data with the third party.

The server 40 may manage the owner of the in-vehicle electronic device 20 with an account with a password. This guarantees that the provider of the moving image data is the owner of the in-vehicle electronic device 20. Later, when the video data is needed as evidence, the video data can be treated as valid.

The scope of the invention is not limited to the configurations expressly described herein, but also includes combinations of various aspects of the invention disclosed herein. Of the present invention, the configuration for which a patent is sought is specified in the appended claims, but even if the configuration is not currently specified in the claims, it is disclosed in the present specification. We intend to make this configuration the scope of claims in the future.

The invention of the present application is not limited to the configuration described in the above-described embodiment. The components of each of the above-described embodiments and modifications may be arbitrarily selected and combined. Further, any component of each embodiment or modification, and any component described in the means for solving the invention or a component described in the means for solving the invention are embodied. And may be configured in any combination. We also intend to acquire the rights to these in the amendment or divisional application of the present application.

In addition, he / she intends to acquire the right to the whole design or the partial design by filing a change application to a design application. Although the entire drawing of the device is drawn with solid lines, it is a drawing that includes not only the whole design but also the partial design requested for a part of the device. For example, it is a drawing which includes a part of the device as a partial design regardless of the member as well as a part of the member of the device as a partial design. As a part of the device, it may be a part of the device or a part of the member. Not only the whole design, but also the partial design in which any part of the solid line part of the drawing is a broken line part is intended to be granted the right.

20 In-vehicle electronic device 21 In-vehicle electronic device processing unit 22 Camera 23 GPS receiver 24 Direction sensor 26 Accelerometer 27 Clock 28 Display 29 Speaker 30 SD card reader 31 LTE module 32 SD card 35 ECU
40 Server 41 Server processing unit 42 Storage device 50 Client terminal 51 Client terminal processing unit 52 Storage device 53 Display 54 Input device 55 Map area 56 Search condition input area 57 Search result display area 60 Network 71 Video display area 72 Date and time input area 73 Event indicator area 74 Map display area 75 Traveling speed display area 76 Position display area 77 Acceleration display area 78 Transition button 79 Date and time registration button 80 PC 90 Message queue

Claims (6)

Based on the moving image captured by the imaging means mounted on a vehicle, and generates moving image data in which the vehicle information is added to the vehicle, the front kidou image data to the server on the network via the wireless communication means An in-vehicle electronic device having a processing means having a transmission function .
When the processing means receives a command from the server to stop transmitting a moving image, the in-vehicle electronic device has a function of blanking an image portion of the moving image data and transmitting the moving image data to which the vehicle information is added to the server. .. The processing means has a function of generating other moving image data having a larger amount of data than the moving image data based on a moving image captured by an imaging means mounted on a vehicle and storing the other moving image data in the storage means. The vehicle-mounted electronic device according to claim 1, further comprising. A moving image captured by the imaging means mounted on each of the plurality of vehicles managed, the video data including the vehicle information of the vehicle received from the server, is displayed on the display unit a video image included in the video data A processing means having a function of taking out the vehicle information included in the moving image data and displaying the vehicle information in association with a moving image to be displayed on the display means .
A client terminal having a reading means for reading data on the mounted removable media .
When the processing means receives a date and time registration command input by the operator during the period in which the moving image included in the moving image data is displayed on the display means, the processing means displays the moving image on the display means at the time of receiving the date and time registration command. The imaging date and time data of the frame of the moving image is extracted as the command date and time, and the frame at the time based on the command date and time is extracted from the moving image recorded on the removable media mounted on the reading means, and the display is described. A client terminal that has a function to be displayed by means. A moving image captured by the imaging means mounted on each of the plurality of vehicles managed, the video data including the vehicle information of the vehicle received from the server, is displayed on the display unit a video image included in the video data A client terminal having a processing means having a function of taking out the vehicle information included in the moving image data and displaying the vehicle information in association with a moving image to be displayed on the display means .
When a command for specifying at least one of a plurality of vehicles to be managed and changing the operating conditions of the in-vehicle electronic device of the specified vehicle is input, the processing means changes the operating conditions to be changed. When it is necessary to stop the acquisition of the moving image from the imaging means, the operator is informed that it is necessary to stop the acquisition of the moving image before transmitting the command for changing the operating conditions to the server. A client terminal that has a function to notify. A program for realizing the function of the in-vehicle electronic device according to claim 1 or 2 in a computer. A program for realizing the function of the client terminal according to claim 3 or 4 in a computer.

Images