JP7302227B2 - Photographed image recording system and photographed image recording method - Google Patents

Description

The present invention relates to a captured image recording system and a captured image recording method.

An increasing number of vehicles are equipped with drive recorders that record images outside the vehicle. Images from drive recorders are useful, for example, in investigating the causes of vehicle accidents.

Conventional drive recorders mainly record images for several tens of seconds before and after an event such as a collision occurs. In addition, although there are some devices that record images by user operations, images are not recorded unless user operations are performed.

A drive recorder with a constant recording function has also been proposed. For example, a drive recorder that continuously records images while a vehicle is running reliably records images when an event such as a collision occurs, but requires a large-capacity memory.

It takes time and effort to replace the memory card with another memory card each time the storage capacity of the memory becomes full. Therefore, a drive recorder with a constant recording function performs loop recording in which old images are erased and current images are overwritten when the memory capacity becomes full. With such a method, there is a possibility that valuable videos that you want to save will be overwritten and deleted.

JP 2016-28332 A

The present invention provides a photographed image recording system and a photographed image recording method that can determine whether a photographed image by continuous recording should be saved or deleted, and save an image that is valuable to the user. The challenge is to

A photographed image recording system of the present invention is a photographed image recording system comprising a photographing device and a server device, wherein the photographing device transmits a photographed image together with position information to the server device, and the server device A storage unit having a first storage area for loop-recording captured images received from an imaging device and a second storage area for storing data so as not to be overwritten; and a determining unit that determines that the photographed image is stored in the second storage area when the inside of any of the first areas of is indicated.

In one aspect of the present invention, the server device receives a setting of a second region wider than the first region from the user terminal, and the determination unit determines that the position information received together with the captured image from the imaging device is the second region. If it indicates the inside of the area and the inside of any one of the plurality of predetermined first areas, it is determined that the captured image is to be stored in the second storage area.

In one aspect of the present invention, the server device accepts selection of a category of the object to be photographed from the user terminal, and the determination unit determines that the position information received together with the photographed image from the photographing device is within the second area and in the plurality of locations. and further analyzes the photographed image and determines to store the photographed image in the second storage area when the selected category is captured. .

In one aspect of the present invention, the photographing device continuously photographs at a predetermined frame rate.

A photographed image recording system of the present invention is a photographed image recording system including a photographing device and a server device, wherein the photographing device transmits a photographed image to the server device, and the server device photographs from a user terminal. A storage unit having a user setting reception unit that receives selection of a category of an object, a first storage area that loop-records captured images received from the imaging device, and a second storage area that stores data so as not to be overwritten, a determination unit that analyzes the captured image received from the imaging device and determines that the captured image is to be stored in the second storage area when an image of the selected category is captured.

A photographed image recording method of the present invention is a photographed image recording method using a photographing device and a server device, wherein the photographing device transmits the photographed image together with position information to the server device, and the server device transmits the photographed image to the server device. When a photographed image received from a photographing device is loop-recorded in a first storage area of a storage unit, and the position information received together with the photographed image from the photographing device indicates the inside of any one of a plurality of predetermined first regions, this The captured image is stored in the second storage area of the storage unit so as not to be overwritten.

A captured image recording method of the present invention is a captured image recording method using a capturing device and a server device, wherein the capturing device transmits the captured image to the server device, and the server device captures the captured image from the user terminal. A selection of a category of an object is accepted, a photographed image received from the photographing device is loop-recorded in a first storage area of a storage unit, the photographed image received from the photographing device is analyzed, and images of the selected category are captured. In this case, the photographed image is stored in the second storage area of the storage unit so as not to be overwritten.

According to the present invention, it is possible to determine whether an image captured by continuous recording should be saved or whether it can be deleted, and save an image that is valuable to the user.

It is a figure which shows the usage example of the picked-up image recording system which concerns on embodiment of this invention. It is a figure which shows the example of a user setting screen. (a) and (b) are diagrams showing an example of determination of a captured image. It is a functional block diagram of an imaging device. It is a functional block diagram of a server device. 4 is a flowchart for explaining a captured image recording method; It is a figure which shows the example of a user setting screen.

Embodiments will be described below with reference to the drawings.

FIG. 1 shows a usage example of a photographed image recording system according to an embodiment of the present invention. The captured image recording system includes a server device 1 and an imaging device 3 . The photographing device 3 is mounted on a moving object such as an automobile or a bicycle, constantly photographs, and transmits the photographed images (moving images and still images) to the server device 1 . The server device 1 stores the captured image received from the imaging device 3 . In this embodiment, an example in which the imaging device 3 is mounted on a vehicle C and used as a drive recorder will be described.

In the server device 1, area information such as sightseeing spots and scenic spots is set in advance by a service provider. For example, area information is set for sightseeing spots such as Tokyo Sky Tree, Tokyo Tower, Tokyo Station, Tokyo Disney Resort, and scenic spots such as Shonan Coast, Onjuku Coast, Oarai Coast, Lake Okutama, Lake Chuzenji, and Mt. Fuji. there is Area information has a predetermined size. For example, an area with a radius of 1 km around Tokyo Station and an area with a width of 200 m along the coast. In the specified area (first area) indicated by the area information, there is a high possibility that a valuable image will be captured.

Before boarding, the user accesses the website provided by the server device 1 using the user terminal 2, logs in by entering the user ID, etc., and sets the area (second area) in which the image is to be saved. . Here, rather than individually selecting specified areas such as tourist spots and scenic spots described above, a general area is set.

FIG. 2 shows an example of a user setting screen displayed on the user terminal 1. As shown in FIG. For example, the user selects an area in which captured images are desired to be saved, from roughly wide areas such as the entire Tokyo area, the 23 wards, and the Tama area. A rough area (second area) includes a plurality of the specified areas (first area).

In addition, a category of photographed objects desired to be saved may be further selected.

After selecting an area (and category), the user gets into car C and starts driving. The photographing device 3 always takes pictures, and transmits the photographed images to the server device 1 together with position information by GPS.

When the server device 1 receives the captured image and the position information from the imaging device 3, the server device 1 determines whether or not the position information is within the specified area in the area set by the user. As shown in FIG. 3A, when the position information is not within the specified area A in the area set by the user, the server device 1 loop-records the captured image D1. Loop recording is a recording method that erases old image data and overwrites and saves new image data when the amount of stored image data reaches a predetermined value.

As shown in FIG. 3B, when the position information is within the specified area A in the area set by the user, the server apparatus 1 saves the captured image D2 so as not to be overwritten.

For example, if the user has set the 23 wards of Tokyo as an area, the server device 1 saves (so as not to overwrite) images taken in a designated area within the 23 wards of Tokyo, for example, around Tokyo Skytree or around Tokyo Station. do. Images shot outside the specified area, even within the 23 wards of Tokyo, are loop-recorded. Even if it is within the specified area, if it is not within the 23 wards of Tokyo set by the user, for example, images shot around Lake Okutama are loop-recorded.

Further, for example, if the user sets the 23 wards of Tokyo as an area and sets the station as a category, the server device 1 analyzes the photographed image photographed in the designated area within the 23 wards of Tokyo, and determines whether the station is included in the image. to save the image.

The position information of the captured image is confirmed on the server device 1 side, and whether it is a captured image that can be overwritten and saved, or whether it is a captured image that is captured in a designated area and has value that should be saved without being deleted. and switch the save method. Even if the user does not perform any particular operation while driving, the server device 1 automatically accumulates valuable images that will become memories later.

When the car C is shared by a plurality of users, the photographing device 3 photographs the occupant, identifies the occupant from the face image, and notifies the server device 1 of the user ID. The photographing device 3 may transmit the face image of the passenger to the server device 1, and the server device 1 may identify which user the passenger of the car C is. If the user is associated with the imaging device 3 mounted on the vehicle C on a one-to-one basis, there is no need to identify the user by photographing the passenger.

Next, the photographing device 3 will be described. As shown in FIG. 4, the imaging device 3 has an imaging unit 31, a moving body detection sensor 32, a user identification unit 33, a GPS sensor 34, and a communication unit 35.

The photographing unit 31 is, for example, a digital camera, and continuously photographs an area including the front of the vehicle. For example, the frame rate is approximately 30 fps. The photographing unit 31 can also photograph the interior of the vehicle.

The moving object detection sensor 32 is a sensor that detects a moving object, such as an occupant getting into the car C. As shown in FIG. When the moving object detection sensor 32 detects a moving object, the imaging unit 31 takes an image.

The user identification unit 33 identifies which user the occupant is based on the captured face image of the occupant.

The GPS sensor 34 acquires current position information based on signals from GPS satellites.

The communication unit 35 communicates with the server device 1 . For example, the communication unit 35 transmits the image captured by the image capturing unit 31 and the position information acquired by the GPS sensor 34 to the server device 1 . When the user identification unit 33 has identified the user, the communication unit 35 transmits the user ID to the server device 1 together with the photographed image or the like or prior to departure of the car C. FIG.

FIG. 5 shows functions of the server device 1 . The server device 1 is a computer having a storage unit 10, and implements functions of a user setting receiving unit 11, an image receiving unit 12, and a determining unit 13 by the CPU executing a captured image recording program.

The storage unit 10 has a first storage area 10A for loop-recording captured images and a second storage area 10B for storing captured images so as not to be overwritten. All captured images are loop-recorded in the first storage area 10A in order to maintain the continuity of the recorded video. Of the captured images, the captured images within the designated area described above are also stored in the second storage area 10B. The image data stored in the first storage area 10A and the second storage area 10B can be browsed using the user terminal 2. FIG. The first storage area 10A and the second storage area 10B may be provided in different storage devices.

Designated area information selected in advance by a service provider or the like is registered in the storage unit 10 .

The user setting acceptance unit 11 accepts (roughly) the setting of the captured image recording area from the user terminal 2 . For example, the 23 wards, Tama district, Shonan/Kamakura, etc. are accepted as the photographed image recording areas. The user setting reception unit 11 also receives the setting of the category of the object to be photographed that is desired to be saved. The accepted user settings are registered in the storage unit 10 .

The image receiving unit 12 receives the captured image to which the position information is added from the imaging device 3 .

The determination unit 13 determines whether or not to store the captured image received from the imaging device 3 in the second storage area 10B based on the position information.

For example, if the position information of the captured image is within the user-set area and within the specified area, the determination unit 13 determines to store the captured image in the first storage area 10A and the second storage area 10B.

If the position information of the captured image is within the user set area but outside the designated area, or if it is outside the user set area, the determination unit 13 determines that the captured image is saved only in the first storage area 10A.

When a category is set, the determination unit 13 performs image analysis of the captured image, determines whether or not an object of the set category is captured, and if it is captured, stores the captured image in the second storage area 10B. If not, it is determined that the photographed image is to be stored only in the first storage area 10A. For example, the determination unit 13 learns a large amount of image data using deep learning, performs object detection, and determines whether or not a target object is captured.

Next, the photographed image recording method according to this embodiment will be described along the flowchart shown in FIG.

First, before boarding the vehicle, the user accesses the website provided by the server device 1 using the user terminal 2, and sets a rough area in which captured images are to be stored (step S1). You can select all areas.

The user gets into the car C and starts the engine (step S2). By starting the engine, the photographing device 3 starts continuous photographing.

The photographing device 3 takes a photograph and transfers the photographed image and position information to the server device 1 (step S3).

Based on the position information of the captured image, the server device 1 determines whether or not the image is captured within the user setting area and within the specified area (step S4). If the image is captured within the user-set area and within the designated area (step S4_Yes), the captured image is also stored in the second storage area 10B so as not to be overwritten.

In the case of an image taken outside the user-set area or an image inside the user-set area but outside the specified area (step S4_No), the shot image is overwritten only in the first storage area 10A.

Steps S3 to S6 are repeated until the car C stops and the engine is turned off (step S7).

As described above, according to the present embodiment, even if the user does not perform any particular operation while driving, a valuable image that will become a memory later is automatically stored in the server device 1 (second storage area 10B). Accumulated.

As shown in FIG. 7, only the category may be selected and set without setting the area on the user setting screen. In this case, the server device 1 analyzes the captured image received from the imaging device 3, and stores the captured image including the set target in the second storage area 10B.

For example, when "sea/lake" and "tower" are selected as categories, images of lighthouses and offshore windmills are also saved in the second storage area 10B.

In the above-described embodiment, an example in which the imaging device 3 is mounted on the vehicle C has been described, but it may be a mobile device such as a wearable device such as smart glasses.

In the above embodiment, an example in which the service provider sets the designated area in advance has been described, but the user may additionally set using the user terminal 2 .

It should be noted that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying constituent elements without departing from the scope of the present invention at the implementation stage. Further, various inventions can be formed by appropriate combinations of the plurality of constituent elements disclosed in the above embodiments. For example, some components may be omitted from all components shown in the embodiments. Furthermore, components across different embodiments may be combined as appropriate.

REFERENCE SIGNS LIST 1 server device 2 user terminal 3 imaging device 10 storage unit 10A first storage area 10B second storage area 11 user setting reception unit 12 image reception unit 13 determination unit

Claims (6)

A photographed image recording system comprising a photographing device and a server device,
The photographing device transmits the photographed image to the server device together with position information,
The server device
a storage unit having a first storage area for loop-recording captured images received from the imaging device and a second storage area for storing data so as not to be overwritten;
If the position information received together with the photographed image from the photographing device indicates the inside of any one of a plurality of predetermined first areas and the second area wider than the first area whose setting is received from the user terminal , this photographing a determination unit that determines to save the image in the second storage area;
A captured image recording system comprising: The server device accepts selection of a category of an object to be photographed from a user terminal,
The determination unit determines that the position information received together with the photographed image from the photographing device indicates that the position information is within the second region and within any one of the plurality of predetermined first regions, further analyzes the photographed image, and selects the position information. 2. The photographed image recording system according to claim 1 , wherein when an image belonging to the above category is photographed, it is determined that the photographed image is stored in the second storage area. 3. The photographed image recording system according to claim 1, wherein said photographing device continuously photographs at a predetermined frame rate. A photographed image recording system comprising a photographing device and a server device,
The imaging device transmits the captured image to the server device,
The server device
a user setting reception unit that receives selection of a category of an object to be photographed from a user terminal;
a storage unit having a first storage area for loop-recording captured images received from the imaging device and a second storage area for storing data so as not to be overwritten;
a determination unit that analyzes the captured image received from the imaging device and determines that the captured image is to be stored in the second storage area when an image of the selected category is captured;
A captured image recording system comprising: A photographed image recording method using a photographing device and a server device,
The photographing device transmits the photographed image together with the position information to the server device,
The server device
loop-recording the captured image received from the imaging device in a first storage area of the storage unit;
If the position information received together with the photographed image from the photographing device indicates the inside of any one of a plurality of predetermined first areas and the second area wider than the first area whose setting is received from the user terminal , this photographing A photographed image recording method, characterized in that the image is stored in a second storage area of the storage unit so as not to be overwritten. A photographed image recording method using a photographing device and a server device,
The photographing device transmits the photographed image to the server device,
The server device
Receiving the selection of the category of the shooting object from the user terminal,
loop-recording the captured image received from the imaging device in a first storage area of the storage unit;
A photographing characterized by analyzing a photographed image received from the photographing device, and storing the photographed image in a second storage area of the storage unit so as not to be overwritten when an image of the selected category is captured. Image recording method.

Images