WO2020044646A1

WO2020044646A1 - Image processing device, image processing method, and program

Info

Publication number: WO2020044646A1
Application number: PCT/JP2019/015214
Authority: WO
Inventors: 齋藤　靖
Original assignee: 日本電気株式会社
Priority date: 2018-08-30
Filing date: 2019-04-05
Publication date: 2020-03-05
Also published as: JPWO2020044646A1

Abstract

The present invention provides an image processing device (10) comprising: an image capture part (11) attached to a mobile body for capturing images of the outside of the mobile body; an analysis part (12) for analyzing captured image data generated by the image capture part (11) and generating attribute data relating to an object appearing in the captured image data; a registration part (13) for registering the object identified with the attribute data as index data relating to the captured image data; a request acquisition part (15) for acquiring a request for captured image data wherein an object matching a prescribed condition appears; a determination part (16) for determining whether the object matching the prescribed condition is registered in the index data; and a transmission part (17) for transmitting at least a portion of the captured image data to an external device if it is determined that the object matching the prescribed condition is registered in the index data.

Description

Image processing apparatus, image processing method, and program

The present invention relates to an image processing device, an image processing method, and a program.

By installing surveillance cameras at various locations, it is possible to record and check events such as incidents and accidents occurring at various locations, as well as moving objects, people, animals, etc. passing through various locations. However, huge costs are required for installing a large number of surveillance cameras and for maintenance after the installation. Means for solving the problem is disclosed in Patent Document 1.

Patent Literature 1 discloses an image recording device attached to a car, which calculates an image acquiring unit that acquires an image, an image encoding unit that encodes an acquired image, and a position and a time when the image is acquired. Generating means for generating position information and time information, recording means for recording the encoded image on the recording medium in association with the position information and time information, and, from among the images recorded by the recording means, There is disclosed an image recording apparatus including an extracting unit that extracts an image based on the extracted position information and time information, and an output unit that outputs the extracted image to the outside.

JP 2010-158038 A

However, in the case of the device described in Patent Literature 1 that extracts an image based on only position information and time information, the image to be extracted is insufficiently narrowed down. In this case, a large number of images are extracted, and a large number of images are transmitted to the outside, and the communication load increases.

The present invention has an object to reduce a communication load in a system for transmitting a predetermined image generated by a photographing unit attached to a moving body to the outside.

According to the present invention,
Photographing means attached to a moving body, for photographing the outside of the moving body,
Analyzing means for analyzing the photographing data generated by the photographing means and generating attribute data of an object reflected in the photographing data;
Registration means for registering the object specified by the attribute data as index data of the photographing data,
Request acquisition means for acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
Determining means for determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission unit that transmits at least a part of the imaging data to an external device,
Is provided.

According to the present invention,
Computer
A photographing step attached to the moving body and photographing the outside of the moving body,
Analyzing the photographing data generated in the photographing step, an analyzing step of generating attribute data of an object reflected in the photographing data,
A registration step of registering the object specified by the attribute data as index data of the photographing data,
A request acquisition step of acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
A determining step of determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission step of transmitting at least a part of the imaging data to an external device,
Is provided.

According to the present invention,
Computer
Photographing means attached to a moving body and photographing the outside of the moving body,
Analyzing means for analyzing the photographing data generated by the photographing means and generating attribute data of an object reflected in the photographing data;
Registration means for registering the object specified by the attribute data as index data of the photographing data,
Request acquisition means for acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
Determining means for determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmitting unit that transmits at least a part of the photographing data to an external device,
A program to function as a program is provided.

According to the present invention, a communication load can be reduced in a system for transmitting a predetermined image captured by a capturing unit attached to a moving object to the outside.

The above and other objects, features and advantages will become more apparent from the preferred embodiments described below and the accompanying drawings.

FIG. 1 is an example of a functional block diagram of an image processing system according to an embodiment. FIG. 2 is a diagram illustrating a realization example of the image processing apparatus 10 according to the embodiment. FIG. 2 is a diagram illustrating a realization example of the image processing apparatus 10 according to the embodiment. FIG. 2 is a diagram illustrating a realization example of the image processing apparatus 10 according to the embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of the image processing apparatus according to the embodiment. FIG. 2 is an example of a functional block diagram of the image processing apparatus 10 of the present embodiment. FIG. 4 is a diagram schematically illustrating an example of information processed by the image processing apparatus 10 according to the embodiment. FIG. 3 is a sequence diagram illustrating an example of a processing flow of the image processing system according to the embodiment. FIG. 3 is a flowchart illustrating an example of a processing flow of the image processing apparatus 10 according to the embodiment. FIG. 2 is an example of a functional block diagram of a photographing unit 11 of the present embodiment. FIG. 4 is a diagram schematically illustrating an example of information processed by the image processing apparatus 10 according to the embodiment. FIG. 3 is a diagram for describing an example of a process of the image processing apparatus 10 of the present embodiment.

<First embodiment>
"Overview and Overview of Image Processing System"
First, an overall image of the image processing system according to the present embodiment will be described with reference to FIG. As shown in FIG. 1, the image processing system includes a plurality of image processing devices 10 and a request device 20. Each of the plurality of image processing devices 10 and the request device 20 are configured to be able to communicate with each other.

The plurality of image processing apparatuses 10 are used by being attached to different moving bodies, respectively. The moving body is an object configured to be movable on the ground, under the ground, on the water, underwater or in the air, and examples thereof include an automobile, a motorcycle, a bicycle, a train, a ship, an airplane, and an unmanned aerial vehicle. It is not limited to.

For example, the image processing device 10 may be the mobile object mounting device 1 as shown in FIG. The moving body mounting device 1 is a device that is mounted on the moving body and is basically always attached to a predetermined position of the moving body.

として As another example, the image processing device 10 may be a portable device 2 as shown in FIG. Examples of the portable device 2 include, but are not limited to, a smartphone, a tablet terminal, and a mobile phone. For example, when the owner of the portable device 2 moves on the moving body, the portable device 2 is brought inside the moving body and attached to a predetermined position of the moving body.

As another example, the image processing apparatus 10 may be realized by interlocking the mobile device 1 and the portable device 2 as shown in FIG. The moving body mounting device 1 is mounted on a moving body and basically always attached to a predetermined position of the moving body. The portable device 2 is brought inside the moving object when the owner of the portable device 2 moves by the moving object, and is attached to a predetermined position of the moving object. The mobile device 1 and the portable device 2 are connected by wire and / or wirelessly, and execute predetermined processing in conjunction with each other.

The image processing device 10 is attached to the moving body, and captures an image of the outside of the moving body, analyzes the captured data, generates attribute data of the object reflected in the captured data, and outputs the object specified by the attribute data. For registering as the index data of the photographing data.

The image processing apparatus 10 further includes: a unit that acquires a request for photographing data in which an object that meets a predetermined condition is reflected; a unit that determines whether an object that meets a predetermined condition is registered in the index data; Means for transmitting at least a part of the photographing data to the request device 20 (external device) when it is determined that an object meeting the condition is registered in the index data. The timing at which the imaging data is transmitted to the request terminal 20 is, for example, the timing at which the user operates the image processing apparatus 10 to permit the transmission of the imaging data, but is not limited to this.

According to such an image processing device 10, it is possible to extract, from the photographing data generated by the photographing means attached to the moving body, photographing data in which a predetermined object is reflected, and transmit the photographing data to the request device 20. . Since the imaging data can be sufficiently narrowed down based on whether or not a predetermined object is reflected in the imaging data, the image processing apparatus 10 can reduce the imaging data transmitted to the request device 20 in response to the request. As a result, the communication load between the image processing device 10 and the request device 20 can be reduced.

“Configuration of Image Processing Device 10”
Next, the configuration of the image processing apparatus 10 will be described in detail. First, an example of a hardware configuration of the image processing apparatus 10 will be described. The functional units included in the image processing apparatus 10 of the present embodiment include a CPU (Central Processing Unit) of an arbitrary computer, a memory, a program loaded into the memory, and a storage unit such as a hard disk for storing the program (the apparatus is shipped in advance). In addition to the programs stored from the initial stage, it can also store storage media such as CDs (Compact Discs) and programs downloaded from servers on the Internet.) It is realized by any combination. It will be understood by those skilled in the art that there are various modifications in the method and apparatus for realizing the method.

FIG. 5 is a block diagram illustrating a hardware configuration of the image processing apparatus 10 according to the present embodiment. As shown in FIG. 5, the image processing apparatus 10 includes a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The image processing device 10 may not have the peripheral circuit 4A. Note that the image processing device 10 may be configured by a plurality of physically separated devices. In this case, each of the plurality of devices can have the above hardware configuration.

The bus 5A is a data transmission path through which the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A mutually transmit and receive data. The processor 1A is an arithmetic processing device such as a CPU and a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, and the like, and an interface for outputting information to an output device, an external device, an external server, and the like. . The input device is, for example, a keyboard, a mouse, a microphone, and the like. The output device is, for example, a display, a speaker, a printer, a mailer, or the like. The processor 1A can issue a command to each module and perform a calculation based on the calculation results.

FIG. 6 shows an example of a functional block diagram of the image processing apparatus 10. As illustrated, the image processing device 10 includes an imaging unit 11, an analysis unit 12, a registration unit 13, a data storage unit 14, a request acquisition unit 15, a determination unit 16, and a transmission unit 17. Note that the image processing apparatus 10 may not have the data storage unit 14. In this case, an external device configured to be able to communicate with the image processing device 10 includes the data storage unit 14.

(4) The photographing unit 11 is attached to the moving body, and photographs the outside of the moving body. Since the definition of the moving object is as described above, the description here is omitted. The photographing unit 11 may generate moving image data, or may photograph still image data regularly or irregularly.

The analysis unit 12 analyzes the photographing data (moving image data, still image data, etc.) generated by the photographing unit 11 and generates attribute data of the object reflected in the photographing data.

When the photographing unit 11 generates moving image data, the analyzing unit 12 may analyze all of a plurality of frame data included in the moving image data or analyze a part of frame data, for example, frame data every predetermined number of frames. It may be targeted. When the imaging unit 11 generates still image data, the analysis unit 12 may analyze all still image data.

Here, the contents of the processing performed by the analysis unit 12 on the data to be analyzed will be described. First, the analysis unit 12 extracts an object shown in the image. When a plurality of objects appear in the image, the analysis unit 12 can extract the plurality of objects. Object extraction can be realized by using, for example, a contour extraction process, a template matching process, or the like, but the means for realizing the object extraction is not limited. Examples of the object to be extracted from the image include, but are not limited to, a person, another animal, a moving object, a light-emitting object, and the like.

After extracting the object from the image, the analysis unit 12 generates attribute data indicating the appearance characteristics of each of the extracted objects. The analysis unit 12 analyzes an image according to a predetermined rule according to various objects, and generates attribute data of the extracted objects.

For example, when the extracted object is a person, the analysis unit 12 may detect the face of the person and generate attribute data indicating gender, age, and the like from the features of the appearance of the face. In addition, the analysis unit 12 may generate attribute data indicating the presence or absence of a wearing object (eg, glasses, sunglasses, a mask, or the like) on the face. In addition, the analysis unit 12 may generate attribute data indicating the characteristics of the clothes of the person (eg, the colors and shapes of the upper body and lower body clothes). In addition, the analysis unit 12 may generate attribute data such as a person's body type (eg, normal, thin, thick) and height. In addition, the analysis unit 12 collates the reference data indicating the appearance characteristics of each of a plurality of persons held in advance with the appearance characteristics of the persons appearing in the image, so that who is the person appearing in the image. May be specified, and attribute data for identifying the person may be generated.

If the extracted object is a moving object, the analysis unit 12 generates attribute data indicating the type of the moving object, the vehicle type, the maker, the color of the moving object, information described on a license plate, the number of occupants, and the like. Is also good.

In the case where the extracted object is an animal other than a human, the analysis unit 12 may generate attribute data indicating the type of the animal, the color of the body, and the like.

If the extracted object is a light-emitting object, the analysis unit 12 may generate attribute data indicating the shape, color, size, emitting light, and the like of the object.

The analysis unit 12 can generate the above-described attribute data by analyzing an image using any image analysis technology.

The registration unit 13 registers an object specified by the attribute data generated by the analysis unit 12 as index data of shooting data.

FIG. 7 schematically shows an example of the index data. In the illustrated example, an image ID (identifier) and an object specified by attribute data are registered in association with each other. The image ID is information for identifying each image analyzed by the analysis unit 12.

データ The data storage unit 14 shown in FIG. 6 stores the index data. Further, the data storage unit 14 stores the photographing data generated by the photographing unit 11. When the imaging unit 11 generates moving image data, the data storage unit 14 may classify the imaging data generated by the imaging unit 11 into a plurality of groups and store the data, or may store the data without classification. Good. Examples of classification include, but are not limited to, an example in which a group from the start of shooting to the end of shooting is grouped into one group, and an example of grouping based on shooting date and time (eg, grouping by shooting date).

The request acquisition unit 15 acquires a request for imaging data in which an object meeting a predetermined condition is shown.

For example, an operator who is searching for imaging data showing a predetermined object inputs predetermined conditions via an input device of the request device 20 or an input device connected to the request device 20, and inputs the predetermined conditions. The user makes an input requesting shooting data in which an object suitable for is displayed. In response to the input, the request device 20 transmits a request for imaging data in which an object meeting a predetermined condition is shown to a plurality of image processing devices 10 registered in advance. The request acquisition unit 15 acquires the request transmitted from the request device 20 in this manner.

The predetermined condition is a condition for specifying an object with the same type of information as the attribute data generated by the analysis unit 12. For example, the predetermined condition may be represented by a logical expression in which information of the same type as the attribute data is connected by a logical operator. An example of such a predetermined condition is “person” + “30s” + “male” + “wearing glasses”.

The determination unit 16 determines whether an object meeting a predetermined condition is registered in the index data. The "object meeting the predetermined condition" may include an object satisfying the predetermined condition at a predetermined level or more, in addition to an object satisfying the predetermined condition 100%. An object that satisfies the predetermined condition at a predetermined level or higher is, for example, a case where the predetermined condition is configured by combining a plurality of attribute data such as “person” + “30s” + “male” + “wearing glasses”. Alternatively, an object that satisfies attribute data of a predetermined ratio or more (eg, 60%, 70%, etc.) among a plurality of attribute data may be used.

The transmission unit 17 transmits at least a part of the photographing data to the request device 20 when it is determined that an object meeting a predetermined condition is registered in the index data.

When the imaging unit 11 generates moving image data (imaging data), the transmission unit 17 may transmit all the moving image data generated by the imaging unit 11 and stored in the data storage unit 14 to the request device 20. . However, with such a configuration, the amount of data transmitted and received may be enormous.

Therefore, the transmission unit 17 may transmit a part of the moving image data generated by the imaging unit 11 and stored in the data storage unit 14 to the request device 20. For example, when the data storage unit 14 stores moving image data classified into a plurality of groups, the transmission unit 17 determines the image ID (FIG. 7) in which the index data is associated with an object that meets a predetermined condition. ) May be transmitted to the requesting device 20 only.

In addition, the transmission unit 17 may transmit to the request device 20 only moving image data for a predetermined time before and after an image ID (see FIG. 7) associated with an object meeting a predetermined condition in the index data. .

"Processing flow of image processing system"
Next, an example of the processing flow of the image processing system will be described with reference to the sequence diagram of FIG.

First, an operator who is searching for photographing data showing a predetermined object inputs predetermined conditions via an input device of the request device 20 or an input device connected to the request device 20, and inputs the predetermined conditions. The user makes an input requesting shooting data in which an object suitable for is displayed. In response to the input, the request device 20 transmits a request for photographing data in which an object meeting a predetermined condition is shown to a plurality of image processing devices 10 registered in advance (S10).

Next, the image processing apparatus 10 determines whether or not an object meeting a predetermined condition is registered in the index data of the photographing data (see FIG. 7) (S11).

Then, the image processing device 10 transmits the determination result to the request device 20 (S12). For example, when an object meeting a predetermined condition is registered in the index data of the photographing data, the image processing device 10 can transmit at least a part of the photographing data to the request device 20. On the other hand, when an object matching the predetermined condition is not registered in the index data of the shooting data, the image processing device 10 can notify the request device 20 that there is no shooting data matching the condition.

Note that the image processing apparatus 10 may output information for inquiring whether to transmit the photographing data to the requesting apparatus 20 before transmitting at least a part of the photographing data to the requesting apparatus 20. Then, the image processing device 10 may transmit at least a part of the photographing data to the request device 20 after obtaining the answer of “transmittable” in response to the inquiry. Note that, when the image processing apparatus 10 obtains a “transmission impossible” response to the inquiry, the image processing apparatus 10 does not transmit at least a part of the imaging data to the request device 20. The image processing device 10 outputs the inquiry to the user having the image processing device 10. Then, the image processing apparatus 10 acquires a response to the inquiry from the user. For example, the image processing apparatus 10 may display the inquiry on a display of the image processing apparatus 10 or a display connected to the image processing apparatus 10. Then, the image processing device 10 may receive an input of a response to the inquiry via an input device included in the image processing device 10 or an input device connected to the image processing device 10. Examples of the input device include a touch panel display, physical buttons, and a microphone, but are not limited thereto.

In addition, the image processing apparatus 10 may output information indicating a reward that can be obtained when the imaging data is transmitted to the requesting apparatus 20 in addition to the information to be inquired. The image processing device 10 can receive information indicating a reward from the request device 20.

The output of the information indicating the inquiry or the reward may be displayed on a display provided in the image processing apparatus 10 or a display connected to the image processing apparatus 10, or may be an e-mail addressed to a pre-registered e-mail address. May be transmitted.

Next, an example of a process in which the image processing apparatus 10 generates index data will be described with reference to the flowchart in FIG.

(4) Upon detecting the index data generation timing (Yes in S20), the image processing apparatus 10 analyzes the photographing data to generate attribute data (S21) and registers it as index data (S22).

The index data generation timing may be, for example, the timing at which the imaging unit 11 has finished imaging. In this example, each time the imaging unit 11 ends imaging, the image processing apparatus 10 analyzes newly generated imaging data by batch processing, generates attribute data, and registers it as index data. As described above, the analysis processing is not performed in parallel with the imaging processing of the imaging unit 11 but is performed at the timing when the imaging processing of the imaging unit 11 is completed, so that the processing load on the image processing apparatus 10 can be reduced. .

In addition, the index data generation timing may be, for example, the timing at which the imaging unit 11 starts imaging. In this example, when the imaging unit 11 starts imaging, the image processing apparatus 10 analyzes newly generated imaging data by real-time processing, generates attribute data, and registers it as index data. With such real-time processing, it is possible to respond to a request for real-time imaging data immediately after a predetermined event such as an incident or accident has occurred.

"Effects"
According to the image processing apparatus 10 of the present embodiment described above, the imaging data including a predetermined object is extracted from the imaging data generated by the imaging unit attached to the moving object, and transmitted to the request device 20. can do. Since the image data can be sufficiently narrowed down depending on whether or not a predetermined object is reflected in the image data, the image processing device 10 can reduce the image data transmitted to the request device 20 in response to the request. As a result, the communication load between the image processing device 10 and the request device 20 can be reduced.

Further, when the moving image data is generated as the photographing data, the image processing device 10 of the present embodiment does not transmit all the moving image data to the request device 20 in response to the request, but includes a portion where a predetermined object is reflected. May be transmitted to the requesting device 20. As a result, the communication load between the image processing device 10 and the request device 20 can be reduced.

According to the image processing system including the image processing device 10 and the request device 20 according to the present embodiment, for example, it is possible to efficiently collect moving image data obtained by photographing the site of an incident or accident. In addition, for example, it is possible to efficiently collect moving image data obtained by accidentally photographing a visitor (eg, a criminal, a runaway person, a missing person, etc.) or a lost animal. In addition, it becomes possible to efficiently collect moving image data obtained by accidentally photographing meteorites, unidentified objects, and the like.

In addition, in the image processing system according to the present embodiment, the image processing apparatus 10 that generates and stores an image can determine the presence or absence of the corresponding data, and transmit the imaging data to the requesting apparatus 20 as necessary. For this reason, all of the photographing data stored in the image processing apparatus 10 is transmitted to the requesting apparatus 20, and compared with the case where the requesting apparatus 20 determines the presence or absence of the corresponding data, the image processing apparatus 10 and the requesting apparatus 20 are compared. The communication load between them can be reduced.

Further, since the image processing apparatus 10 determines the presence or absence of the corresponding data in response to the request, the owner of the image processing apparatus 10 recognizes the presence or absence of the corresponding data without performing the troublesome work of visually checking the image. be able to.

When the image processing apparatus 10 determines that the image data has the corresponding data, the image processing apparatus 10 can inquire of the owner of the image processing apparatus 10 whether or not the imaging data can be transmitted, and can perform a process corresponding to the answer. For this reason, it is possible to suppress the inconvenience that the photographing data that is not desired by the owner of the image processing apparatus 10 is transmitted to the outside without intention.

{Circle around (4)} In addition to the above inquiry, the image processing apparatus 10 can output a reward obtained when the photographing data is provided. By outputting the reward information at an appropriate timing, the owner of the image processing apparatus 10 can quickly determine whether or not to provide the reward.

<Second embodiment>
"Overview and Overview of Image Processing System"
The overall image of the image processing system is the same as in the first embodiment. The image processing apparatus 10 according to the present embodiment is photographed at a predetermined position and / or at a predetermined date and time from a photographing data generated by photographing means attached to a moving object, and a predetermined object is reflected. The photographing data can be extracted and transmitted to the request device 20. In addition to whether or not a predetermined object is reflected in the photographing data, the photographing data can be sufficiently narrowed down using the photographing position and / or the photographing date and time. Can reduce the number of pieces of photographing data to be transmitted.

“Configuration of Image Processing Device 10”
An example of the hardware configuration of the image processing apparatus 10 is the same as in the first embodiment.

An example of a functional block diagram of the image processing apparatus 10 is shown in FIG. 6, as in the first embodiment.

The image capturing unit 11 includes a position detecting unit 111 and a date and time detecting unit 112, as shown in FIG. The position detection unit 111 detects a current position. The detection of the current position includes, for example, the use of a GPS (global positioning system), but is not limited thereto. The date and time detection unit 112 detects the current date and time. The detection of the current date and time includes, for example, use of a built-in clock incorporated in the image processing apparatus 10, but is not limited thereto.

(4) The photographing unit 11 can use the values detected by the position detecting unit 111 and the date and time detecting unit 112 to associate the photographing position and the photographing date and time with the photographing data. Other configurations of the imaging unit 11 are the same as those of the first embodiment.

The configuration of the analysis unit 12 is the same as that of the first embodiment.

The registration unit 13 registers the shooting position and shooting date and time of the shooting data generated by the shooting unit 11 as index data of the shooting data.

FIG. 11 schematically shows an example of the index data. In the illustrated example, date and time information indicating a shooting date and time, position information indicating a shooting position, an image ID, and an object specified by attribute data are registered in association with each other.

The configuration of the data storage unit 14 is the same as that of the first embodiment.

The request acquisition unit 15 acquires a request for imaging data in which an object meeting a predetermined condition is shown and at least one of the imaging position and the imaging date and time is further specified. Other configurations of the request acquisition unit 15 are the same as those of the first embodiment.

For example, an operator who is searching for photographing data in which a predetermined object is reflected can use an input device included in the request device 20 or an input device connected to the request device 20 to change the condition of the object, the photographing position, the photographing date and time, and the like. And input to request photographing data.

In this input, the shooting date and time may be specified in a time zone such as “13:00 to 14:00 on August 20, 2018”, or may be specified in “13:00 on August 20, 2018”. As described above.

In addition, in the input, the shooting location may be designated by a place name, such as “XX city” or “XX town”. In addition, the request device 20 may receive an input for designating a shooting location via a UI (user @ interface) screen that accepts an input for designating a predetermined area on the map while displaying the map. For example, a frame whose display position, size, shape, and the like are changed based on a user input may be displayed on a map. Then, an area inside this frame may be designated as a shooting location.

Based on the index data, the determination unit 16 determines whether an object matching a predetermined condition is reflected and that the shooting data whose shooting position and / or shooting date and time match the specified content is stored in the data storage unit 14. judge.

For example, the determination unit 16 determines whether an object meeting a predetermined condition is registered in the index data. Then, if registered, the shooting position and / or shooting date and time of the image ID (see FIG. 11) associated with an object meeting the predetermined condition is changed to the shooting position and / or shooting date and time specified in the request. Judge whether or not it matches.

構成 The configuration of the transmission unit 17 is the same as that of the first embodiment.

"Processing flow of image processing system"
An example of the processing flow of the image processing system is the same as in the first embodiment.

Note that the index data generation timing of the present embodiment may be the same as the example described in the first embodiment, or as another example, the timing at which a photographing data request (S10 in FIG. 8) is received. You may. In this case, the image processing apparatus 10 processes only the photographing data generated at the photographing date and time specified by the photographing data request, generates attribute data, and registers the attribute data as index data. As described above, by minimizing the amount of imaging data to be processed in response to a request for imaging data, an effect of reducing the processing load can be obtained.

"Effects"
According to the image processing apparatus 10 of the present embodiment described above, the same operation and effect as those of the first embodiment can be realized.

Further, according to the image processing apparatus 10 of the present embodiment, it is possible to sufficiently narrow down desired photographing data using the photographing position and / or photographing date and time in addition to whether or not a predetermined object is reflected in the photographing data. Therefore, the image processing apparatus 10 can reduce the number of pieces of imaging data transmitted to the request apparatus 20 in response to the request. As a result, the communication load between the image processing device 10 and the request device 20 can be reduced.

<Third embodiment>
"Overview and Overview of Image Processing System"
The overall image of the image processing system is the same as in the first and second embodiments. The image processing apparatus 10 according to the present embodiment can change the type and amount of attribute data registered as index data according to a shooting environment at the time of shooting of shooting data, an object reflected in the shooting data, and the like.

“Configuration of Image Processing Device 10”
An example of the hardware configuration of the image processing apparatus 10 is the same as in the first and second embodiments.

An example of a functional block diagram of the image processing apparatus 10 is shown in FIG. 6, as in the first and second embodiments.

The configurations of the imaging unit 11, the data storage unit 14, the request acquisition unit 15, the determination unit 16, and the transmission unit 17 are the same as in the first and second embodiments.

The analysis unit 12 changes at least one of the type and the amount of the generated attribute data according to the shooting environment at the time of shooting the shooting data.

For example, the analysis unit 12 may generate attribute data based on a generation rule in which the type and amount of attribute data generated for each shooting environment are determined in advance. The increase or decrease in the amount of attribute data may be realized by increasing or decreasing the number of types of attribute data to be generated, or may be realized by increasing or decreasing the number of frame data to be processed in the moving image data.

(4) The registration unit 13 changes at least one of the type and the amount of the attribute data to be registered as the index data according to the shooting environment at the time of shooting the shooting data.

The shooting environment is exemplified by a shooting position, a shooting time, a shooting date, a shooting day, a weather at the time of shooting, specifications of the shooting device (image resolution and the like), and the like. The analysis unit 12 can acquire information indicating the shooting environment by any means.

For example, in an area, a time zone, a day, and a day of the week where the number of people or moving objects is relatively large, the amount of generated attribute data may be relatively small. Many people and moving objects are reflected in the photographing data generated in such a photographing environment. If many types of attribute data are generated and registered by analyzing such photographing data, the processing load of the image processing apparatus 10 increases and the storage capacity may be reduced. Therefore, when photographing data is generated in such a photographing environment, the load on the image processing apparatus 10 is reduced by reducing the type of attribute data to be generated or the number of frame data to be processed. To reduce

On the other hand, in an area, a time zone, a day, and a day of the week in which the number of people and moving objects is relatively small, the above-described problem hardly occurs. Therefore, the amount of attribute data to be generated may be relatively large.

In addition, in an imaging environment in which it is difficult to generate an image in which an object is clearly reflected, for example, in a night time zone, on a rainy day, when the specifications of the imaging device are low (for example, the resolution of the image is lower than a predetermined level), the attribute to be generated is The amount of data may be relatively small. The imaging data generated in such an imaging environment has a low utility value. Therefore, when photographing data is generated in such a photographing environment, the load on the image processing apparatus 10 is reduced by reducing the type of attribute data to be generated or the number of frame data to be processed. To reduce

On the other hand, in a shooting environment in which an image in which an object is clearly reflected is easily generated, for example, in the daytime, on a sunny day, or when the specification of the shooting device is high (eg, the resolution of the image is equal to or higher than a predetermined level), the attribute to be generated is set. The amount of data may be relatively large. Since photographing data generated in such a photographing environment has a high utility value, various and large amounts of attribute data are generated and registered.

{Circle around (4)} The analysis unit 12 can change at least one of the type and the amount of the attribute data to be generated according to the object reflected in the photographing data.

For example, the analysis unit 12 may generate the attribute data based on a generation rule in which the type and amount of the attribute data generated for each object reflected in the shooting data are determined in advance. The increase or decrease in the amount of attribute data may be realized by increasing or decreasing the number of types of attribute data to be generated, or may be realized by increasing or decreasing the number of frame data to be processed in the moving image data.

(4) The registration unit 13 changes at least one of the type and the amount of the attribute data to be registered as the index data according to the object reflected in the photographing data.

For example, when a moving object having a relatively fast moving speed is included in the photographing data, the number of frame data to be processed is increased (for example, all frame data are processed, and a relatively small number is set). And the amount of attribute data to be generated may be relatively large. By doing so, the object reflected in the photographing data can be registered in the index data without leaking.

On the other hand, when a moving object having a relatively fast moving speed is not included in the photographing data, the number of frame data to be processed is reduced (eg, a relatively large number of frame data is processed). The amount of attribute data to be generated may be relatively reduced. When a moving object having a relatively fast moving speed is not reflected in the photographing data, and an object having a relatively slow moving speed is reflected in the photographing data, the moving object is reflected in the photographing data even if the number of frame data to be processed is reduced. Objects can be extracted without leaking and registered in the index data.

Here, a specific example of a process of changing the type and amount of attribute data registered as index data according to a shooting environment at the time of shooting of shooting data, an object reflected in the shooting data, and the like will be described. As shown in FIG. 12, the type of attribute data registered as index data is defined in advance for each object (person, vehicle, etc.) reflected in the photographing data. When relatively increasing the amount of attribute data to be generated, the analysis unit 12 generates all or most of the illustrated types of attribute data. On the other hand, when the amount of attribute data to be generated is relatively reduced, the analysis unit 12 generates only a part of the illustrated plurality of types of attribute data. When only a part of the plurality of attribute data is generated, the analysis unit 12 may be set to generate, for example, attribute data (attribute data located on the vague side illustrated in the drawing) that makes it difficult to identify an individual or an individual. Good. This reduces the amount of data and the processing load on the computer. It should be noted that, in advance, the type of attribute data to be generated is determined for each of the shooting environment at the time of shooting of the shooting data and each object reflected in the shooting data. The type can be determined.

"Processing flow of image processing system"
An example of the processing flow of the image processing system is the same as in the first and second embodiments.

"Effects"
According to the image processing apparatus 10 of the present embodiment described above, the same functions and effects as those of the first and second embodiments can be realized.

In addition, by changing the type and amount of attribute data registered as index data according to the shooting environment at the time of shooting the shooting data and the object reflected in the shooting data, etc., while registering necessary attribute data as index data, The processing load on the image processing device 10 can be reduced.

Hereinafter, examples of the reference embodiment will be additionally described.
1. Photographing means attached to a moving body, for photographing the outside of the moving body,
Analyzing means for analyzing the photographing data generated by the photographing means and generating attribute data of an object reflected in the photographing data;
Registration means for registering the object specified by the attribute data as index data of the photographing data,
Request acquisition means for acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
Determining means for determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission unit that transmits at least a part of the imaging data to an external device,
An image processing apparatus having:
2. In the image processing apparatus according to 1,
The photographing unit has a position detecting unit that detects a current position, and a date and time detecting unit that detects a current date and time,
The image processing apparatus, wherein the registration unit registers a shooting position and a shooting date and time of the shooting data as index data of the shooting data.
3. 2. In the image processing apparatus according to 2,
The image processing apparatus, wherein the request acquiring unit acquires a request for the photographing data further specifying at least one of a photographing position and a photographing date and time.
4. The image processing apparatus according to any one of 1 to 3,
The image processing apparatus, wherein the registration unit changes a type of the attribute data to be registered as index data of the shooting data according to a shooting environment at the time of shooting the shooting data.
5. The image processing apparatus according to any one of 1 to 4,
The image processing device, wherein the registration unit changes an amount of the attribute data to be registered as index data of the shooting data according to a shooting environment at the time of shooting the shooting data.
6. The image processing apparatus according to any one of 1 to 5,
The image processing device, wherein the registration unit changes a type of the attribute data to be registered as index data of the shooting data according to an object reflected in the shooting data.
7. The image processing apparatus according to any one of 1 to 6,
The image processing device, wherein the registration unit changes an amount of the attribute data to be registered as index data of the shooting data according to an object reflected in the shooting data.
8. The image processing apparatus according to any one of 1 to 7,
The image processing device, wherein the attribute data includes at least one of information on a physique of a person, a feature of clothes, a color of a moving object, a vehicle type, and a license plate.
9. The image processing apparatus according to any one of 1 to 8,
The image processing apparatus is an image processing apparatus including one or both of a mobile device and a portable device.
10. Computer
A photographing step attached to the moving body and photographing the outside of the moving body,
Analyzing the photographing data generated in the photographing step, an analyzing step of generating attribute data of an object reflected in the photographing data,
A registration step of registering the object specified by the attribute data as index data of the photographing data,
A request acquisition step of acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
A determining step of determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission step of transmitting at least a part of the imaging data to an external device,
Image processing method to execute.
11. Computer
Photographing means attached to a moving body and photographing the outside of the moving body,
Analyzing means for analyzing the photographing data generated by the photographing means and generating attribute data of an object reflected in the photographing data;
Registration means for registering the object specified by the attribute data as index data of the photographing data,
Request acquisition means for acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
Determining means for determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission unit that transmits at least a part of the imaging data to an external device,
A program to function as

This application claims priority based on Japanese Patent Application No. 2018-161893 filed on Aug. 30, 2018, the entire disclosure of which is incorporated herein.

Claims

Photographing means attached to a moving body, for photographing the outside of the moving body,
Analyzing means for analyzing the photographing data generated by the photographing means and generating attribute data of an object reflected in the photographing data;
Registration means for registering the object specified by the attribute data as index data of the photographing data,
Request acquisition means for acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
Determining means for determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission unit that transmits at least a part of the imaging data to an external device,
An image processing apparatus having:
The image processing apparatus according to claim 1,
The photographing unit has a position detecting unit that detects a current position, and a date and time detecting unit that detects a current date and time,
The image processing apparatus, wherein the registration unit registers a shooting position and a shooting date and time of the shooting data as index data of the shooting data.
The image processing apparatus according to claim 2,
The image processing apparatus, wherein the request acquiring unit acquires a request for the photographing data further specifying at least one of a photographing position and a photographing date and time.
The image processing apparatus according to any one of claims 1 to 3,
The image processing apparatus, wherein the registration unit changes a type of the attribute data to be registered as index data of the shooting data according to a shooting environment at the time of shooting the shooting data.
The image processing apparatus according to claim 1, wherein:
The image processing device, wherein the registration unit changes an amount of the attribute data to be registered as index data of the shooting data according to a shooting environment at the time of shooting the shooting data.
The image processing apparatus according to any one of claims 1 to 5,
The image processing device, wherein the registration unit changes a type of the attribute data to be registered as index data of the shooting data according to an object reflected in the shooting data.
The image processing apparatus according to any one of claims 1 to 6,
The image processing device, wherein the registration unit changes an amount of the attribute data to be registered as index data of the shooting data according to an object reflected in the shooting data.
The image processing apparatus according to any one of claims 1 to 7,
The image processing device, wherein the attribute data includes at least one of information on a physique of a person, a feature of clothes, a color of a moving object, a vehicle type, and a license plate.
The image processing apparatus according to any one of claims 1 to 8,
The image processing apparatus is an image processing apparatus including one or both of a mobile device and a portable device.
Computer
A photographing step attached to the moving body and photographing the outside of the moving body,
Analyzing the photographing data generated in the photographing step, an analyzing step of generating attribute data of an object reflected in the photographing data,
A registration step of registering the object specified by the attribute data as index data of the photographing data,
A request acquisition step of acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
A determining step of determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmission step of transmitting at least a part of the imaging data to an external device,
Image processing method to execute.
Computer
Photographing means attached to a moving body and photographing the outside of the moving body,
Analyzing means for analyzing the photographing data generated by the photographing means and generating attribute data of an object reflected in the photographing data;
Registration means for registering the object specified by the attribute data as index data of the photographing data,
Request acquisition means for acquiring a request for the imaging data in which an object meeting a predetermined condition is reflected,
Determining means for determining whether an object meeting the predetermined condition is registered in the index data,
When it is determined that an object that meets the predetermined condition is registered in the index data, a transmitting unit that transmits at least a part of the photographing data to an external device,
A program to function as