JP2019192976A - Imaging control device and imaging system - Google Patents

Abstract

To enable a highly reliable captured image in which a user is imaged to be output to the user.SOLUTION: An imaging control device 1 according one embodiment of the present invention includes: a characterized image registration part 111 that registers a characterized image indicating a characterized part associated with a user to a storage part 13; an imaging instruction part 113 that transmits an instruction of imaging to an imaging apparatus when a position of a communication terminal of the user is in a region associated with the pre-registered imaging apparatus; a captured image reception part 114 that receives a plurality of captured images captured by the imaging apparatus to which the instruction of the imaging has been transmitted by the imaging instruction part 113; and a captured image extraction part 115 that extracts the captured image including the characterized image indicated by the characterized image pre-registered in association with the user from the plurality of captured images.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an imaging control apparatus and an imaging system that capture a user and acquire a captured image.

  Patent Document 1 describes a system that automatically captures a user who enters a predetermined area and provides the captured image to the user. With such a system, the user can acquire a captured image around a place where the user has passed without consciously capturing an image.

Patent No. 5830729

  However, since the system described in Patent Literature 1 unconditionally transmits a captured image captured within a predetermined area to the user's terminal, the user is hidden by an obstacle or another user. For some reason, there is a possibility that the user is not shown in the captured image. Even when a captured image in which the user is not shown is transmitted to the user, there is a problem in that the user needs to select a plurality of received captured images, which is inconvenient.

  Therefore, the present invention has been made in view of these points, and an object of the present invention is to provide an imaging control apparatus and an imaging system that can output to a user a captured image with high certainty that the user is captured.

  An imaging control apparatus according to a first aspect of the present invention includes an imaging unit in which a registration unit that registers a feature image indicating a feature unit associated with a user in a storage unit and a position of a communication terminal that the user has are registered in advance. An instruction unit that transmits an imaging instruction to the imaging device and a plurality of captured images captured by the imaging device that has transmitted the imaging instruction by the instruction unit when the imaging unit is within an area associated with the device A receiving unit; and an extraction unit that extracts a captured image including the feature indicated by the feature image registered in advance in association with the user from the plurality of captured images.

  The instruction unit may transmit an instruction to change at least one of an orientation and an enlargement ratio of the imaging device based on a position of the communication terminal in addition to the imaging instruction.

  The instruction unit may transmit an instruction to move the imaging device based on the position of the communication terminal, in addition to the imaging instruction, to the movable imaging device.

  The instruction unit may transmit the imaging instruction to the imaging device at a timing when the position of the user is included in a range in which the imaging device can capture the feature.

  The instruction unit may identify the direction of movement of the user based on the position of the communication terminal, and transmit the imaging instruction to the imaging device at a timing when the direction of movement faces the imaging device. Good.

  An imaging system according to a second aspect of the present invention includes a communication terminal possessed by a user, an imaging device, and an imaging control device, and the communication terminal receives an area associated with the imaging device registered in advance. And a determination unit that determines whether the position of the communication terminal is within the region, and the determination unit determines that the position of the communication terminal is within the region, An imaging unit that transmits an imaging instruction to the imaging device, the imaging device includes an imaging unit that captures an image when receiving the imaging instruction from the communication terminal, and the imaging control device A registration unit for registering a feature image indicating an associated feature unit in a storage unit; and a feature unit indicated by the feature image registered in advance in association with the user among a plurality of captured images captured by the imaging unit. Extract captured images including Having an extraction unit, a.

  According to the present invention, it is possible to output a highly reliable captured image showing a user to the user.

It is a mimetic diagram of an imaging system concerning this embodiment. It is a block diagram of the imaging system concerning this embodiment. It is a figure which shows the exemplary feature image which concerns on this embodiment. It is a schematic diagram of the imaging control process which concerns on this embodiment. It is a schematic diagram of the imaging control process which concerns on this embodiment. It is a schematic diagram of the imaging control process which concerns on this embodiment. It is a figure which shows the flowchart of the imaging control method which concerns on this embodiment. It is a block diagram of the imaging system concerning this embodiment.

(Embodiment)
[Outline of Imaging System S]
FIG. 1 is a schematic diagram of an imaging system S according to the present embodiment. The imaging system S includes an imaging control device 1, a communication terminal 2, an imaging device 3, and a movable device 4. The imaging control device 1, the communication terminal 2, the imaging device 3, and the movable device 4 communicate with each other via a network N such as the Internet. The numbers of the communication terminal 2, the imaging device 3, and the movable device 4 included in the imaging system S are not limited. The imaging system S may include devices such as other servers and terminals.

  The communication terminal 2 is a terminal used by a user who uses a service provided by the imaging system S, and is a communication device capable of performing wireless communication. The communication terminal 2 is a mobile terminal such as a smartphone or a tablet terminal. The communication terminal 2 communicates with the imaging control device 1 via the network N.

  The imaging device 3 is an imaging device having an imaging unit that captures a predetermined imaging range. The imaging device 3 is fixed at a predetermined position. The orientation and enlargement ratio of the imaging unit of the imaging apparatus 3 can be changed by a signal from the imaging control apparatus 1, and the imaging range is changed by changing the orientation and enlargement ratio of the imaging apparatus 3. The imaging device 3 is connected to the network N by wire or wirelessly. The imaging device 3 captures an imaging range, acquires a captured image, and transmits the captured image to the imaging control device 1 via the network N.

  The movable device 4 is an imaging device having an imaging unit that images a predetermined imaging range. The movable device 4 is movable by flying or traveling, for example, a drone. The imaging range of the movable device 4 changes as the movable device 4 moves. Therefore, the movable range of the movable device 4 and the surrounding range can be an imaging range. Further, the orientation and magnification of the imaging unit of the movable device 4 may be changeable by a signal from the imaging control device 1. The movable device 4 is wirelessly connected to the network N. The movable device 4 captures an imaging range, acquires a captured image, and transmits the captured image to the imaging control device 1 via the network N.

  The imaging device 3 and the movable device 4 are each associated with a predetermined area A. The area A may coincide with the imaging range of the imaging device 3 and the movable device 4, or may be a part of the imaging range of the imaging device 3 and the movable device 4.

  The imaging control device 1 is a computer that controls imaging by the imaging device 3 and the movable device 4 and extracts and outputs a captured image showing a user from captured images captured by the imaging device 3 and the movable device 4. The imaging control device 1 is connected to the network N by wire or wirelessly. The imaging control device 1 may be configured integrally with any one of the imaging device 3 and the movable device 4. That is, any one of the imaging device 3 and the movable device 4 may have a function of the imaging control device 1 described later.

[Configuration Overview of Imaging System S]
FIG. 2 is a block diagram of the imaging system S according to the present embodiment. In FIG. 2, arrows indicate main data flows, and there may be data flows other than those shown in FIG. In FIG. 2, each block represents a functional unit configuration, not a hardware (device) unit configuration. Therefore, the blocks shown in FIG. 2 may be implemented in a single device, or may be separately implemented in a plurality of devices. Data exchange between the blocks may be performed via any means such as a data bus, a network, a portable storage medium, or the like.

  The imaging control device 1 includes a control unit 11, a communication unit 12, and a storage unit 13. The control unit 11 includes a feature image registration unit 111, a position determination unit 112, an imaging instruction unit 113, a captured image reception unit 114, a captured image extraction unit 115, and an output unit 116. The storage unit 13 includes a feature image storage unit 131, a region information storage unit 132, and a captured image storage unit 133.

  The communication unit 12 is a communication interface for communicating with the communication terminal 2, the imaging device 3, and the movable device 4 via the network N. The communication unit 12 includes a processor, a connector, an electric circuit, and the like for executing communication. The communication unit 12 performs predetermined processing on a communication signal received from the outside to acquire data, and inputs the acquired data to the control unit 11. The communication unit 12 performs a predetermined process on the data input from the control unit 11 to generate a communication signal, and transmits the generated communication signal to the outside.

  The storage unit 13 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, and the like. The storage unit 13 stores a program executed by the control unit 11 in advance. The storage unit 13 may be provided outside the imaging control apparatus 1, and in that case, data may be exchanged with the control unit 11 via the communication unit 12.

  The feature image storage unit 131 stores a feature image indicating a feature portion associated with the user. The area information storage unit 132 stores area information indicating areas associated with the imaging device 3 and the movable device 4. The captured image storage unit 133 stores captured images captured by the imaging device 3 and the movable device 4. The feature image storage unit 131, the region information storage unit 132, and the captured image storage unit 133 may be a database stored in the storage unit 13 or a storage area in the storage unit 13.

  The control unit 11 is a processor such as a CPU (Central Processing Unit), for example, and by executing a program stored in the storage unit 13, a feature image registration unit 111, a position determination unit 112, an imaging instruction unit 113, and a captured image. It functions as a reception unit 114, a captured image extraction unit 115, and an output unit 116. Processing performed by the feature image registration unit 111, the position determination unit 112, the imaging instruction unit 113, the captured image reception unit 114, the captured image extraction unit 115, and the output unit 116 will be described later with reference to FIGS. At least a part of the function of the control unit 11 may be executed by an electric circuit. Moreover, at least a part of the functions of the control unit 11 may be executed by a program executed via a network.

  The communication terminal 2 includes an imaging unit 21 and a position specifying unit 22. The imaging unit 21 includes an imaging element such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The imaging unit 21 captures an image according to a user operation. The imaging unit 21 captures a predetermined imaging range and transmits it to the imaging control device 1 as a captured image.

  The position specifying unit 22 includes, for example, a GPS (Global Positioning System) receiver and a processor that measures the position of the communication terminal 2 based on a positioning signal received by the GPS receiver from a GPS satellite. The processor of the position specifying unit 22 calculates the position of the communication terminal 2 using the position of the GPS satellite indicated by the positioning signal received by the GPS receiver. Further, the position specifying unit 22 may specify the position of the communication terminal 2 based on a communication signal received by wireless communication. The method by which the position specifying unit 22 specifies the position of the communication terminal 2 is not limited to a specific method, and other positioning methods may be used.

  The imaging device 3 has an imaging unit 31, and the movable device 4 has an imaging unit 41. The imaging units 31 and 41 include imaging elements such as a CCD sensor and a CMOS sensor. The imaging units 31 and 41 capture an image according to an imaging instruction signal received from the imaging control device 1. Further, the orientation and magnification of the imaging units 31 and 41 can be changed by a signal from the imaging control device 1. The imaging units 31 and 41 capture a predetermined imaging range and transmit the captured image as a captured image to the imaging control apparatus 1.

  The imaging system S according to the present embodiment is not limited to the specific configuration shown in FIG. For example, the imaging control device 1 is not limited to a single device, and may be configured by connecting two or more physically separated devices in a wired or wireless manner.

[Description of feature image registration process]
In the imaging control method according to the present embodiment, first, the feature image registration unit 111 of the imaging control device 1 executes a feature image registration process in which a feature image indicating a feature associated with a user is registered in the feature image storage unit 131. To do. The feature part is a feature of the appearance of the user himself / herself or a feature of the appearance of an object located in the vicinity of the user. For example, the characteristic part is a user's face, a user's clothes, an accessory worn by the user (for example, a helmet), a license plate or a color of a vehicle (for example, an automobile or a motorcycle) used by the user. The feature portion may be a combination of a plurality of features.

  FIG. 3A to FIG. 3C are diagrams illustrating an exemplary feature image F. FIG. A feature image F in FIG. 3A shows a feature portion F1 including a user's face. By registering the user's face as a feature, the imaging control device 1 can extract a captured image showing the user with high accuracy. A feature image F in FIG. 3B shows a feature portion F2 including a user's clothes. By registering the user's clothes as a feature, the imaging control device 1 can extract a captured image showing the user even when the user's face is hidden by sunglasses or a hat.

  A feature image F in FIG. 3C shows a feature portion F3 including a license plate of a vehicle used by the user. When the user is in a vehicle, the user's face is often hidden in the vehicle or helmet. By registering the license plate of the vehicle as a feature, the imaging control device 1 can extract a captured image showing the user even when the user is on the vehicle.

  The user uses the imaging unit 21 of the communication terminal 2 to capture an image of a characteristic part related to the user (for example, the user himself or a vehicle used by the user) and transmits the image to the imaging control device 1. The feature image registration unit 111 of the imaging control device 1 stores the image received from the communication terminal 2 in the feature image storage unit 131 as a feature image indicating a feature part associated with a user who uses the communication terminal 2. The feature image storage unit 131 stores one or more feature images in association with a user (specifically, identification information such as a user ID).

[Description of Imaging Control Processing for Imaging Device 3]
The imaging control process for the imaging device 3 will be described with reference to FIGS. 4 and 5. FIG. 4 is a schematic diagram of imaging control processing according to the present embodiment. After performing the feature image registration process, the imaging control apparatus 1 starts the imaging control process by receiving an instruction from the user. First, in the communication terminal 2, the position specifying unit 22 periodically specifies the position of the communication terminal 2 at a predetermined time interval and transmits the position to the imaging control device 1 (a). In the imaging control device 1, the position determination unit 112 receives and acquires the position of the communication terminal 2.

  In the area information storage unit 132, area information indicating predetermined areas A respectively associated with one or more imaging devices 3 is registered in advance. The area A is information indicating a geographical range. For example, the area A represents a geographical range by the coordinates of one point on the geography and the radius around the point.

  The position determination unit 112 acquires area information stored in the area information storage unit 132. Then, the position determination unit 112 compares the position of the communication terminal 2 with the area A associated with each imaging device 3 to determine which imaging apparatus 3 the position of the communication terminal 2 is included in. (B). If the position of the communication terminal 2 is not included in the area A of any imaging device 3, the position determination unit 112 repeatedly receives and determines the position of the communication terminal 2.

  When the position of the communication terminal 2 is included in the area A of any one of the imaging devices 3, the imaging instruction unit 113 sends a signal indicating the imaging instruction to the imaging device 3 associated with the area A including the position of the communication terminal 2. (C). The signal indicating the imaging instruction may include an instruction to change the orientation and enlargement ratio of the imaging unit 31 of the imaging device 3. In this case, the imaging instruction unit 113 determines the orientation and enlargement ratio of the imaging unit 31 so that the imaging range includes the communication terminal 2 based on the position of the communication terminal 2 and the position of the imaging device 3, and the imaging instruction At the same time, the image is transmitted to the imaging device 3.

  When the positions of the plurality of communication terminals 2 are included in one region A at the same time, the imaging instruction unit 113 sequentially issues the plurality of imaging instructions to the imaging device 3 so as to capture the plurality of communication terminals 2 in a predetermined order. Send.

  For example, the imaging instruction unit 113 may determine the order in which the distance from the center of the region A is small for the plurality of communication terminals 2 as the imaging order. The area A is usually set so that the best image can be taken at the center thereof. For this reason, it is easy to acquire a better captured image by capturing the user in order of increasing distance from the center of the region A.

  Further, the imaging instruction unit 113 may determine the order in which the plurality of communication terminals 2 enter the area A as the imaging order. Since the user who first entered the area A tends to exit the area A first, the probability that the user having all the communication terminals 2 that entered the area A can be imaged can be increased by imaging in this order. .

  The imaging instruction unit 113 transmits an instruction to change the orientation and magnification ratio of the imaging unit 31 in order with the imaging instruction to the imaging apparatus 3 so that the plurality of communication terminals 2 are included in the imaging range of the imaging unit 31 in the determined order. To do.

  When the imaging device 3 receives a signal indicating an imaging instruction from the imaging control device 1, the imaging device 3 images the imaging range (d). When the signal indicating the imaging instruction includes an instruction to change the orientation and the enlargement ratio of the imaging unit 31, the imaging device 3 performs imaging after changing the orientation and the enlargement ratio of the imaging unit 31 according to the signal. The imaging device 3 transmits the captured content to the imaging control device 1 as a captured image (e). In the imaging control device 1, the captured image receiving unit 114 receives the captured image from the imaging device 3 and stores it in the captured image storage unit 133 in association with the communication terminal 2.

  The captured image extraction unit 115 extracts a captured image including the feature portion of the user registered in the feature image storage unit 131 from the captured images stored in the captured image storage unit 133 (f). Specifically, the captured image extraction unit 115 acquires one or more feature images associated with the user of the communication terminal 2 from the feature image storage unit 131. The captured image extraction unit 115 compares each captured image associated with the communication terminal 2 in the captured image storage unit 133 with the feature image acquired from the feature image storage unit 131. Then, the captured image extraction unit 115 extracts a captured image including a feature (such as a user's face, clothes, license plate) corresponding to the feature image.

  The captured image extraction unit 115 can use a known method in order to determine whether or not the captured image includes a feature corresponding to the feature image. For example, the captured image extraction unit 115 calculates a feature amount indicating an edge or a corner in each of the captured image and the feature image. Then, the captured image extraction unit 115 compares the feature amount of the captured image with the feature amount of the feature image, and if the predetermined condition (for example, the similarity of the feature amount is equal to or greater than a predetermined threshold) is satisfied, the captured image is the feature image. It is determined that the feature part corresponding to is included. The captured image extraction unit 115 is not limited to a specific method, and may determine whether or not the captured image includes a characteristic portion by another method.

  The captured image extraction unit 115 may periodically extract captured images at predetermined time intervals. Alternatively, the captured image extraction unit 115 may extract a captured image every time the captured image reception unit 114 receives a captured image from the imaging device 3.

  The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user. For example, the output unit 116 may transmit the captured image extracted by the captured image extraction unit 115 to the user communication terminal 2 by e-mail or the like. The output unit 116 may store the captured image extracted by the captured image extraction unit 115 in a storage area (for example, a cloud server) associated with the user. The output unit 116 may print the captured image extracted by the captured image extraction unit 115 on paper using a printer.

  The output unit 116 may receive designation of a location or time from the user and output a captured image corresponding to the designated location or time. When the user designates a location, when the area A where the captured image extracted by the captured image extraction unit 115 is captured is close to the location specified by the user (for example, the distance from the location specified by the user to the region A is predetermined) The output unit 116 outputs the captured image. When the user specifies a time range, when the time when the captured image extracted by the captured image extraction unit 115 is captured is included in the time range specified by the user, the output unit 116 outputs the captured image. Thereby, the user can acquire a captured image in which the user is photographed for each place and time.

  The captured image extracted by the captured image extraction unit 115 may include other users in addition to the user. Therefore, the output unit 116 may output the captured image extracted by the captured image extraction unit 115 after performing image processing for hiding other users. In this case, the output unit 116 specifies the peripheral region of the feature part corresponding to the feature image in the captured image extracted by the captured image extraction unit 115. Then, the output unit recognizes a person located outside the peripheral region of the feature part, and performs image processing for hiding the part of the person. The output unit 116 may conceal the human part by performing mosaic processing as the image processing, or conceal the human by synthesizing the captured image (that is, the background image) in a state where the human is not captured with the human part. May be. Thereby, the imaging control apparatus 1 can ensure the privacy of other users.

  According to the imaging control process illustrated in FIG. 4, the imaging control device 1 includes a captured image including a user's characteristic portion from among the captured images captured when the user enters a predetermined area associated with the imaging device 3. Therefore, it is possible to output a captured image with high certainty that the user is captured to the user.

  The imaging control device 1 may specify the timing when the user faces the imaging device 3 and may give an imaging instruction to the imaging device 3 at the specified timing. FIG. 5 is a schematic diagram of imaging control processing according to the present embodiment.

  First, as in FIG. 4, in the communication terminal 2, the position specifying unit 22 periodically specifies the position of the communication terminal 2 at predetermined time intervals and transmits the position to the imaging control device 1 (a). The position determination unit 112 of the imaging control apparatus 1 compares the position of the communication terminal 2 with the area A associated with each imaging apparatus 3, and the position of the communication terminal 2 is included in the area A of any imaging apparatus 3. (B).

  Then, the position determination unit 112 specifies the imaging timing based on the position of the communication terminal 2 (b ′). For example, the position determination unit 112 specifies the imaging timing based on the direction in which the communication terminal 2 (user) is moving. The position determination unit 112 determines the direction in which the communication terminal 2 is moving from the position of the communication terminal 2 acquired at the previous time (for example, the previous time) to the position of the communication terminal 2 acquired at the latest time. As specified.

  Usually, the user's face is oriented in the direction in which the user is moving. Therefore, the position determination unit 112 specifies the timing at which the position of the imaging device 3 is in the direction in which the user is moving as the imaging timing. By doing in this way, the probability that the imaging device 3 can produce | generate the captured image in which the user's face was reflected can be raised.

  Further, the position determination unit 112 may specify the imaging timing based on whether or not the user's characteristic part is included in the imaging range of the imaging device 3. In this case, the position determination unit 112 acquires one or more feature images associated with the user of the communication terminal 2 from the feature image storage unit 131. The position determination unit 112 periodically acquires a temporary image having a resolution lower than that of the captured image from the imaging device 3 at a predetermined time interval, and compares the temporary image with the feature image acquired from the feature image storage unit 131. Since the temporary image is not output to the user, the processing load can be reduced by using a temporary image having a resolution that is low enough to recognize the feature portion.

  The position determination unit 112 determines whether or not the temporary image includes a feature corresponding to the feature image by the same method as the captured image extraction unit 115. Then, the position determination unit 112 identifies the timing at which the temporary image includes the feature corresponding to the feature image as the imaging timing. The position determination unit 112 may stop the imaging control process if a temporary image including a feature corresponding to the feature image cannot be obtained even after a predetermined time has elapsed since the position of the communication terminal 2 entered the region A. Good. In this way, by determining in real time whether or not the user's characteristic part is included in the imaging range of the imaging apparatus 3 and determining the timing of imaging, the imaging apparatus 3 captures the captured image in which the user's characteristic part is reflected. It is possible to further increase the probability that can be generated.

  Further, the position determination unit 112 may specify the imaging timing based on the optical signal emitted from the communication terminal 2. In this case, the communication terminal 2 generates a predetermined optical signal by blinking a lamp or a screen according to a predetermined rule. When the imaging device 3 detects a predetermined optical signal, the imaging device 3 transmits a signal indicating that the optical signal has been detected to the imaging control device 1. Then, the position determination unit 112 specifies the timing at which the signal indicating that the optical signal is detected from the imaging device 3 as the imaging timing.

  At the imaging timing specified by the position determination unit 112, the imaging instruction unit 113 transmits a signal indicating the imaging instruction to the imaging device 3 associated with the region A including the position of the communication terminal 2 (c).

  4, when the imaging device 3 receives a signal indicating an imaging instruction from the imaging control device 1, the imaging device 3 images the imaging range (d), and transmits the captured content to the imaging control device 1 as a captured image. (E). The captured image extraction unit 115 extracts a captured image including the user's feature registered in the feature image storage unit 131 (f). The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user.

  According to the imaging control process illustrated in FIG. 5, the imaging control device 1 captures images at a timing with high certainty that the user can be imaged. Therefore, it is possible to suppress unnecessary imaging at a timing when the user is not facing the imaging device 3. . The imaging device 3 or the movable device 4 may specify its own imaging timing and perform imaging at the specified timing.

[Description of Imaging Control Processing for Movable Device 4]
The imaging control process for the movable device 4 will be described with reference to FIG. FIG. 6 is a schematic diagram of imaging control processing according to the present embodiment. First, as in FIG. 4, in the communication terminal 2, the position specifying unit 22 periodically specifies the position of the communication terminal 2 at predetermined time intervals and transmits the position to the imaging control device 1 (a). The position determination unit 112 of the imaging control device 1 compares the position of the communication terminal 2 with the region A associated with each movable device 4, and the position of the communication terminal 2 is included in the region A of any movable device 4. (B).

  When the position of the communication terminal 2 is included in the area A of any of the movable devices 4, the imaging instruction unit 113 transmits a signal indicating an imaging instruction to the movable device 4 associated with the area A including the position of the communication terminal 2. (C). At this time, the signal indicating the imaging instruction includes a movement instruction for moving the movable device 4 to a position where the user can image. The movable device 4 moves based on a movement instruction included in the signal received from the imaging control device 1 (c ′).

  The movement instruction may indicate a route from the movable device 4 to the communication terminal 2. In this case, the imaging instruction unit 113 determines a route based on the position of the movable device 4 and the position of the communication terminal 2 and transmits the route to the movable device 4. The movable device 4 moves according to the received route. The movement instruction may indicate only the position of the communication terminal 2 (user). In this case, the movable device 4 autonomously moves to the received position of the communication terminal 2.

  When the positions of the plurality of communication terminals 2 are included in one region A at the same time, the imaging instruction unit 113 sequentially sends the plurality of imaging instructions to the movable device 4 so as to capture the plurality of communication terminals 2 in a predetermined order. Send.

  For example, the imaging instruction unit 113 may determine the order in which the distance from the position of the movable device 4 for the plurality of communication terminals 2 is small as the imaging order. As a result, the movable device 4 can be moved in order from the closest user, and imaging can be performed efficiently. In addition, as described above, the imaging instruction unit 113 determines the order in which the distance from the center of the area A for the plurality of communication terminals 2 is small, or the order in which the plurality of communication terminals 2 enter the area A as the imaging order. May be.

  The imaging instruction unit 113 transmits a movement instruction to move the movable device 4 to the movable device 4 together with the imaging instruction so that the plurality of communication terminals 2 are included in the imaging range of the imaging unit 31 in the determined order.

  When the positions of a plurality of communication terminals 2 are simultaneously included in one region A, the imaging instruction unit 113 may increase the frequency of transmitting the imaging instruction and the movement instruction to the movable device 4. Thereby, the probability that the user who has all the communication terminals 2 which entered the area | region A can be imaged can be raised.

  After completing the movement based on the movement instruction, the movable device 4 images the imaging range (d), and transmits the captured content to the imaging control device 1 as a captured image (e). As in FIG. 4, the captured image extraction unit 115 extracts a captured image including the user's feature registered in the feature image storage unit 131 (f). The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user.

  Since the movable device 4 can change the imaging range by moving itself, the movable device 4 is associated with a region A wider than the imaging device 3. Therefore, according to the imaging control process shown in FIG. 6, the movable device 4 can automatically image the user in the wide area A without providing a large number of imaging devices 3.

[Description of Flow of Imaging Control Method]
FIG. 7 is a diagram illustrating a flowchart of the imaging control method according to the present embodiment. The flowchart of FIG. 7 is started by receiving an instruction from the user after the feature image registration process is completed.

  In the imaging control device 1, the position determination unit 112 receives and acquires the position of the communication terminal 2 from the communication terminal 2, and acquires the region information stored in the region information storage unit 132 (S11). The position determination unit 112 compares the position of the communication terminal 2 with the region A associated with each imaging device 3 or the movable device 4, and the position of the communication terminal 2 is the region A of any imaging device 3 or movable device 4. (S12).

  When the position of the communication terminal 2 is not included in the area A of any imaging device 3 or movable device 4 (NO in S13), the imaging control device 1 proceeds to step S19. When the position of the communication terminal 2 is included in the area A of any imaging device 3 or movable device 4 (YES in S13), the imaging instruction unit 113 is associated with the area A including the position of the communication terminal 2. A signal indicating an imaging instruction is transmitted to the imaging device 3 or the movable device 4 (S14). The captured image receiving unit 114 receives the captured image from the imaging device 3 or the movable device 4, and stores the captured image in the captured image storage unit 133 in association with the communication terminal 2 (S15).

  The captured image extraction unit 115 acquires one or a plurality of feature images associated with the user of the communication terminal 2 from the feature image storage unit 131 (S16). The captured image extraction unit 115 compares each captured image associated with the communication terminal 2 in the captured image storage unit 133 with the feature image acquired from the feature image storage unit 131. Then, the captured image extraction unit 115 extracts a captured image including a feature portion corresponding to the feature image (S17). The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user (S18).

  When a predetermined end condition (for example, the user performing a predetermined end operation) is not satisfied (NO in S19), the imaging control device 1 returns to step S11 and repeats the process. When the predetermined end condition is satisfied (YES in S19), the imaging control device 1 ends the process.

[Effect of the embodiment]
According to the present embodiment, the imaging control device 1 includes a pre-registered feature of the user from among the captured images captured when the user enters a predetermined area associated with the imaging device 3. To extract. Therefore, the imaging control apparatus 1 can output a captured image with high certainty that the user is captured to the user, and the user can save time and effort to select a captured image from a large number of captured images.

  By setting the region A associated with the imaging device 3 and the movable device 4 as a good imaging spot (sightseeing spot etc.), the imaging control device 1 can detect the imaging spot even if the user does not know the imaging spot. A captured image showing the user can be provided to the user afterwards.

[Modification of Embodiment]
In the above-described embodiment, the imaging control device 1 issues an imaging instruction to the imaging device 3 and the movable device 4. However, the communication terminal 2 may issue an imaging instruction to the imaging device 3 and the movable device 4. FIG. 8 is a block diagram of a modification of the imaging system S according to the present embodiment. The communication terminal 2 includes an area reception unit 23, a position determination unit 24, and an imaging instruction unit 25 in addition to the imaging unit 21 and the position specifying unit 22 described above.

  The processor of the communication terminal 2 functions as the area reception unit 23, the position determination unit 24, and the imaging instruction unit 25 by executing the program. The area receiving unit 23 receives and acquires area information stored in the area information storage unit 132 from the imaging control apparatus 1. The area receiving unit 23 stores the received area information in the storage unit of the communication terminal 2.

  The position determination unit 24 compares the position of the communication terminal 2 specified by the position specifying unit 22 with the region A indicated by the region information received from the imaging control device 1, and the position of the communication terminal 2 is any imaging device 3 or It is determined whether it is included in the area A of the movable device 4.

  When the position of the communication terminal 2 is included in the area A of any one of the imaging device 3 or the movable device 4, the imaging instruction unit 25 captures the imaging device 3 or the movable device associated with the region A including the position of the communication terminal 2. A signal indicating an imaging instruction is transmitted to 4. The imaging instruction unit 25 may transmit a signal directly to the imaging device 3 or the movable device 4 or may transmit a signal via the imaging control device 1. Other processes in the imaging system S are the same as those in FIG.

  As described above, since the communication terminal 2 issues an imaging instruction to the imaging device 3 or the movable device 4, the communication terminal 2 does not need to sequentially transmit its position to the imaging control device 1. The amount of communication with the device 1 can be reduced.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment, A various deformation | transformation and change are possible within the range of the summary. is there. For example, the specific embodiments of device distribution / integration are not limited to the above-described embodiments, and all or a part of them may be configured to be functionally or physically distributed / integrated in arbitrary units. Can do. In addition, new embodiments generated by any combination of a plurality of embodiments are also included in the embodiments of the present invention. The effect of the new embodiment produced by the combination has the effect of the original embodiment.

  The control unit 11 (processor) of the imaging control apparatus 1 is a main component of each step (process) included in the method shown in FIG. That is, the control unit 11 reads out a program for executing the method shown in FIG. 7 from the storage unit 13, and executes the method shown in FIG. 7 by executing the program and controlling each part of the imaging control apparatus 1. To do.

S imaging system 1 imaging control device 11 control unit 111 feature image registration unit 112 position determination unit 113 imaging instruction unit 114 captured image reception unit 115 captured image extraction unit 13 storage unit 2 communication terminal 23 area reception unit 24 position determination unit 25 imaging instruction Unit 3 imaging device 31 imaging unit 4 movable device 41 imaging unit

Claims (6)

A registration unit for registering in the storage unit a feature image indicating the feature unit associated with the user;
An instruction unit that transmits an imaging instruction to the imaging device when the position of the communication terminal possessed by the user is within an area associated with a previously registered imaging device;
A receiving unit that receives a plurality of captured images captured by the imaging device to which the instruction unit has transmitted the imaging instruction;
An extraction unit that extracts a captured image including the feature part indicated by the feature image registered in advance in association with the user from among the plurality of captured images;
An imaging control apparatus having   The instruction unit transmits an instruction for changing at least one of an orientation and an enlargement ratio of the imaging device based on a position of the communication terminal, in addition to the imaging instruction, to the imaging device. The imaging control device according to 1.   The imaging control according to claim 1, wherein the instruction unit transmits an instruction to move the imaging device based on a position of the communication terminal to the movable imaging device in addition to the imaging instruction. apparatus.   4. The device according to claim 1, wherein the instruction unit transmits the imaging instruction to the imaging device at a timing when the position of the user is included in a range in which the imaging device can capture the feature unit. The imaging control device according to one item.   The instruction unit specifies a direction of movement of the user based on a position of the communication terminal, and transmits the imaging instruction to the imaging device at a timing when the direction of movement faces the imaging device. Item 5. The imaging control device according to any one of Items 1 to 4. A user has a communication terminal, an imaging device, and an imaging control device;
The communication terminal is
A receiving unit that receives an area associated with the imaging device registered in advance;
A determination unit that determines whether or not the position of the communication terminal is within the region;
An instruction unit that transmits an imaging instruction to the imaging device when the determination unit determines that the position of the communication terminal is within the area;
Have
The imaging device
An imaging unit that captures an image when receiving the imaging instruction from the communication terminal;
The imaging control device includes:
A registration unit for registering in the storage unit a feature image indicating the feature unit associated with the user;
An extraction unit that extracts a captured image including the feature indicated by the feature image registered in advance in association with the user from among a plurality of captured images captured by the imaging unit;
An imaging system.

Images