JP7124411B2 - Imaging control device and imaging system - Google Patents

Description

The present invention relates to an imaging control device and an imaging system for imaging a user and obtaining a captured image.

Patent Literature 1 describes a system that automatically captures an image of a user entering a predetermined area and provides the captured image to the user. With such a system, the user can acquire a captured image of the vicinity of the place through which the user has passed without intentionally capturing an image.

Patent No. 5830729

However, the system described in Patent Literature 1 unconditionally transmits captured images captured during the time the user is in a predetermined area to the user's terminal, so the user is hidden behind obstacles or other users. For some reason, the user may not appear in the captured image. Even if a captured image in which the user is not captured is transmitted to the user, the user has to sort out the received multiple captured images, which is inconvenient.

Therefore, the present invention has been made in view of these points, and it is an object of the present invention to provide an imaging control device and an imaging system capable of outputting to the user a captured image with high certainty that the user is captured.

An image capturing control apparatus according to a first aspect of the present invention includes a registration unit that registers a characteristic image indicating a characteristic portion associated with a user in a storage unit, and an image capturing device in which the position of a communication terminal owned by the user is registered in advance. an instruction unit that transmits an imaging instruction to the imaging device when the area is within a region associated with the device; and the instruction unit that receives a plurality of captured images captured by the imaging device that has transmitted the imaging instruction a receiving unit; and an extracting unit that extracts, from among the plurality of captured images, a captured image including the characteristic portion indicated by the characteristic image registered in advance in association with the user.

The instruction unit may transmit, to the imaging device, an instruction to change at least one of an orientation and a magnification of the imaging device based on the position of the communication terminal, in addition to the imaging instruction.

The instruction unit may transmit an instruction to move the imaging device based on the position of the communication terminal, in addition to the imaging instruction, to the movable imaging device.

The instruction unit may transmit the imaging instruction to the imaging device at a timing when the position of the user is included in a range in which the imaging device can capture the characteristic portion.

The instruction unit may identify the direction of movement of the user based on the position of the communication terminal, and transmit the instruction to capture the image to the imaging device at the timing when the direction of movement faces the imaging device. good.

An imaging system according to a second aspect of the present invention includes a communication terminal owned by a user, an imaging device, and an imaging control device, wherein the communication terminal receives an area associated with the pre-registered imaging device. a receiving unit for determining whether or not the position of the communication terminal is within the area; and when the determining unit determines that the position of the communication terminal is within the area, the an instruction unit that transmits an imaging instruction to an imaging device, the imaging device having an imaging unit that performs imaging when receiving the imaging instruction from the communication terminal, and the imaging control device that instructs the user to a registering unit for registering, in a storage unit, a characteristic image indicating an associated characteristic portion; and an extraction unit that extracts the captured image containing the image.

ADVANTAGE OF THE INVENTION According to this invention, it is effective in the ability to output to a user the captured image with high certainty that a user is captured.

1 is a schematic diagram of an imaging system according to this embodiment; FIG. 1 is a block diagram of an imaging system according to this embodiment; FIG. FIG. 4 is a diagram showing an exemplary feature image according to this embodiment; 4 is a schematic diagram of imaging control processing according to the present embodiment; FIG. 4 is a schematic diagram of imaging control processing according to the present embodiment; FIG. 4 is a schematic diagram of imaging control processing according to the present embodiment; FIG. It is a figure which shows the flowchart of the imaging control method which concerns on this embodiment. 1 is a block diagram of an imaging system according to this embodiment; FIG.

(embodiment)
[Overview of Imaging System S]
FIG. 1 is a schematic diagram of an imaging system S according to this embodiment. The imaging system S includes an imaging control device 1 , a communication terminal 2 , an imaging device 3 and a movable device 4 . The imaging control device 1, the communication terminal 2, the imaging device 3, and the movable device 4 communicate with each other via a network N such as the Internet. The number of communication terminals 2, imaging devices 3, and movable devices 4 included in imaging system S is not limited. The imaging system S may include devices such as other servers and terminals.

The communication terminal 2 is a terminal used by a user who uses the service provided by the imaging system S, and is a communication device capable of wireless communication. The communication terminal 2 is, for example, a mobile terminal such as a smart phone or a tablet terminal. The communication terminal 2 communicates with the imaging control device 1 via the network N. FIG.

The imaging device 3 is an imaging device having an imaging unit for imaging a predetermined imaging range. The imaging device 3 is fixed at a predetermined position. The orientation and magnification of the imaging unit of the imaging device 3 can be changed by a signal from the imaging control device 1, and the imaging range changes as the orientation and magnification of the imaging device 3 are changed. The imaging device 3 is connected to the network N by wire or wirelessly. The imaging device 3 acquires a captured image by imaging an imaging range, and transmits the captured image to the imaging control device 1 via the network N.

The movable device 4 is an imaging device having an imaging unit that images a predetermined imaging range. The mobile device 4 can move by flying or running, and is, for example, a drone. The imaging range of the movable device 4 changes as the movable device 4 moves. Therefore, the range in which the movable device 4 can move and the range around it can be the imaging range. Also, the orientation and magnification of the imaging unit of the movable device 4 may be changeable by a signal from the imaging control device 1 . The mobile device 4 is wirelessly connected to the network N. The movable device 4 acquires a captured image by capturing an image of the imaging range, and transmits the captured image to the imaging control device 1 via the network N.

The imaging device 3 and the movable device 4 are associated with a predetermined area A, respectively. The area A may match the imaging ranges of the imaging device 3 and the movable device 4 , or may be part of the imaging ranges of the imaging device 3 and the movable device 4 .

The imaging control device 1 is a computer that controls imaging by the imaging device 3 and the movable device 4 and extracts and outputs a captured image of the user from the captured images captured by the imaging device 3 and the movable device 4 . The imaging control device 1 is connected to the network N by wire or wirelessly. The imaging control device 1 may be configured integrally with any one of the imaging device 3 and the movable device 4 . That is, any one of the imaging device 3 and the movable device 4 may have the function of the imaging control device 1 described later.

[Overview of Configuration of Imaging System S]
FIG. 2 is a block diagram of the imaging system S according to this embodiment. In FIG. 2, arrows indicate main data flows, and there may be data flows other than those shown in FIG. In FIG. 2, each block does not show the configuration in units of hardware (apparatus), but the configuration in units of functions. As such, the blocks shown in FIG. 2 may be implemented within a single device, or may be implemented separately within multiple devices. Data exchange between blocks may be performed via any means such as a data bus, network, or portable storage medium.

The imaging control device 1 has a control section 11 , a communication section 12 and a storage section 13 . The control unit 11 has a feature image registration unit 111 , a position determination unit 112 , an imaging instruction unit 113 , a captured image reception unit 114 , a captured image extraction unit 115 and an output unit 116 . The storage unit 13 has a characteristic image storage unit 131 , an area information storage unit 132 and a captured image storage unit 133 .

The communication unit 12 is a communication interface for communicating with the communication terminal 2, the imaging device 3, and the movable device 4 via the network N. The communication unit 12 includes a processor, connectors, electric circuits, etc. for executing communication. The communication unit 12 acquires data by performing predetermined processing on a communication signal received from the outside, and inputs the acquired data to the control unit 11 . Further, the communication unit 12 performs predetermined processing on data input from the control unit 11 to generate a communication signal, and transmits the generated communication signal to the outside.

The storage unit 13 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, and the like. The storage unit 13 stores programs executed by the control unit 11 in advance. The storage unit 13 may be provided outside the imaging control device 1 , in which case data may be exchanged with the control unit 11 via the communication unit 12 .

The feature image storage unit 131 stores feature images indicating feature parts associated with users. The area information storage unit 132 stores area information indicating areas associated with the imaging device 3 and the movable device 4 . The captured image storage unit 133 stores captured images captured by the imaging device 3 and the movable device 4 . The feature image storage unit 131 , the area information storage unit 132 and the captured image storage unit 133 may be databases stored in the storage unit 13 or may be storage areas in the storage unit 13 .

The control unit 11 is a processor such as a CPU (Central Processing Unit), for example. It functions as a receiving unit 114 , a captured image extracting unit 115 and an output unit 116 . Processing performed by the characteristic image registration unit 111, the position determination unit 112, the imaging instruction unit 113, the captured image reception unit 114, the captured image extraction unit 115, and the output unit 116 will be described later with reference to FIGS. At least part of the functions of the control unit 11 may be performed by an electric circuit. Moreover, at least part of the functions of the control unit 11 may be executed by a program executed via a network.

The communication terminal 2 has an imaging section 21 and a position specifying section 22 . The imaging unit 21 includes an imaging device such as a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, or the like. The imaging unit 21 takes an image according to the user's operation. The imaging unit 21 images a predetermined imaging range and transmits the captured image to the imaging control device 1 .

The position specifying unit 22 includes, for example, a GPS (Global Positioning System) receiver and a processor that measures the position of the communication terminal 2 based on positioning signals received by the GPS receiver from GPS satellites. The processor of the position specifying unit 22 calculates the position of the communication terminal 2 using the positions of the GPS satellites indicated by the positioning signals received by the GPS receiver. Also, the position specifying unit 22 may specify the position of the communication terminal 2 based on a communication signal received by wireless communication. The method by which the position specifying unit 22 specifies the position of the communication terminal 2 is not limited to a specific method, and other positioning methods may be used.

The imaging device 3 has an imaging section 31 and the movable device 4 has an imaging section 41 . The imaging units 31 and 41 include imaging elements such as CCD sensors and CMOS sensors. The imaging units 31 and 41 perform imaging according to imaging instruction signals received from the imaging control device 1 . Also, the directions and enlargement ratios of the imaging units 31 and 41 can be changed by signals from the imaging control device 1 . The imaging units 31 and 41 capture an image of a predetermined imaging range and transmit the captured image to the imaging control device 1 .

The imaging system S according to this embodiment is not limited to the specific configuration shown in FIG. For example, the imaging control device 1 is not limited to one device, and may be configured by connecting two or more physically separated devices by wire or wirelessly.

[Description of Feature Image Registration Processing]
In the imaging control method according to the present embodiment, the feature image registration unit 111 of the imaging control device 1 first executes a feature image registration process of registering, in the feature image storage unit 131, a feature image indicating a feature associated with the user. do. Features are features of the user's own appearance or features of the appearance of objects located in the vicinity of the user. For example, the features are the user's face, the user's clothes, the accessory worn by the user (eg, helmet), the license plate or color of the vehicle used by the user (eg, automobile or motorcycle). A feature may be a combination of features.

3(a) to 3(c) are diagrams showing an exemplary feature image F. FIG. A feature image F in FIG. 3A shows a feature portion F1 including the user's face. By registering the user's face as a characteristic part, the imaging control device 1 can extract the captured image in which the user is captured with high accuracy. A feature image F in FIG. 3B shows a feature portion F2 including the user's clothes. By registering the user's clothing as a characteristic part, the imaging control device 1 can extract a captured image in which the user is captured even when the user's face is hidden by sunglasses or a hat.

A feature image F in FIG. 3(c) shows a feature portion F3 including the license plate of the vehicle used by the user. When the user is riding in a vehicle, the user's face is often hidden by the vehicle or helmet. By registering the license plate of the vehicle as the characteristic portion, the imaging control device 1 can extract the captured image of the user even when the user is in the vehicle.

The user uses the imaging unit 21 of the communication terminal 2 to capture an image of a feature related to the user (for example, the user or the vehicle used by the user), and transmits the captured image to the imaging control device 1 . The feature image registration unit 111 of the imaging control device 1 stores the image received from the communication terminal 2 in the feature image storage unit 131 as a feature image representing a feature associated with the user using the communication terminal 2 . The feature image storage unit 131 stores one or more feature images in association with a user (specifically, identification information such as a user ID).

[Description of Imaging Control Processing for Imaging Device 3]
The imaging control process for the imaging device 3 will be described with reference to FIGS. 4 and 5. FIG. FIG. 4 is a schematic diagram of imaging control processing according to the present embodiment. After performing the characteristic image registration process, the imaging control apparatus 1 starts the imaging control process upon receiving an instruction from the user. First, in the communication terminal 2, the position specifying unit 22 specifies the position of the communication terminal 2 periodically at predetermined time intervals, and transmits the position to the imaging control device 1 (a). In the imaging control device 1 , the position determination unit 112 receives and acquires the position of the communication terminal 2 .

In the area information storage unit 132, area information indicating predetermined areas A respectively associated with one or more imaging devices 3 is registered in advance. Area A is information indicating a geographical range. For example, area A represents a geographical range by the coordinates of one geographical point and the radius centered on that point.

The position determination unit 112 acquires area information stored in the area information storage unit 132 . Then, the position determination unit 112 compares the position of the communication terminal 2 with the area A associated with each imaging device 3, and determines which imaging device 3's area A includes the position of the communication terminal 2. (b). When the position of the communication terminal 2 is not included in the area A of any imaging device 3, the position determination unit 112 repeatedly receives the position of the communication terminal 2 and determines.

When the position of the communication terminal 2 is included in the area A of any imaging device 3, the imaging instruction unit 113 sends a signal indicating an imaging instruction to the imaging device 3 associated with the area A including the position of the communication terminal 2. (c). The signal indicating the imaging instruction may include an instruction to change the orientation and magnification of the imaging unit 31 of the imaging device 3 . In this case, the imaging instruction unit 113 determines the direction and magnification of the imaging unit 31 so that the imaging range includes the communication terminal 2 based on the position of the communication terminal 2 and the position of the imaging device 3, and instructs the imaging. together with the image pickup device 3.

When the positions of a plurality of communication terminals 2 are simultaneously included in one area A, the image capturing instruction unit 113 sequentially issues a plurality of image capturing instructions to the image capturing device 3 so as to capture images of the plurality of communication terminals 2 in a predetermined order. Send.

For example, the image capturing instruction unit 113 may determine the order of decreasing the distance from the center of the area A as the image capturing order for the plurality of communication terminals 2 . Region A is usually set so that it can be best imaged at its center. Therefore, by capturing images of users in ascending order of distance from the center of area A, it is easy to obtain a better captured image.

Further, the imaging instruction unit 113 may determine the order in which the plurality of communication terminals 2 enter the area A as the imaging order. Users who enter area A first tend to exit area A first, so by taking images in this order, the probability of capturing images of all users having communication terminals 2 who have entered area A can be increased. .

The imaging instruction unit 113 transmits an instruction to sequentially change the orientation and magnification of the imaging unit 31 together with the imaging instruction to the imaging device 3 so that the plurality of communication terminals 2 are included in the imaging range of the imaging unit 31 in the determined order. do.

When the imaging device 3 receives the signal indicating the imaging instruction from the imaging control device 1, the imaging device 3 images the imaging range (d). When the signal indicating the imaging instruction includes an instruction to change the orientation and magnification of the imaging unit 31, the imaging device 3 takes an image after changing the orientation and magnification of the imaging unit 31 according to the signal. The imaging device 3 transmits the imaged content to the imaging control device 1 as a captured image (e). In the imaging control device 1 , the captured image receiving unit 114 receives the captured image from the imaging device 3 and stores it in the captured image storage unit 133 in association with the communication terminal 2 .

The captured image extracting unit 115 extracts, from the captured images stored in the captured image storage unit 133, a captured image including the characteristic part of the user registered in the characteristic image storage unit 131 (f). Specifically, the captured image extraction unit 115 acquires one or more characteristic images associated with the user of the communication terminal 2 from the characteristic image storage unit 131 . The captured image extraction unit 115 compares each captured image associated with the communication terminal 2 in the captured image storage unit 133 with the characteristic image acquired from the characteristic image storage unit 131 . Then, the captured image extracting unit 115 extracts a captured image including a characteristic portion (user's face, clothes, license plate, etc.) corresponding to the characteristic image.

The captured image extraction unit 115 can use a known method to determine whether or not the captured image includes a characteristic portion corresponding to the characteristic image. For example, the captured image extraction unit 115 calculates feature amounts indicating edges and corners in each of the captured image and the feature image. Then, the captured image extraction unit 115 compares the feature amount of the captured image and the feature amount of the feature image, and if a predetermined condition (for example, the similarity of the feature amount is equal to or greater than a predetermined threshold value) is satisfied, the captured image is the feature image. is determined to include a feature corresponding to . The captured image extraction unit 115 is not limited to a specific method, and may determine whether or not the captured image includes the characteristic portion by other methods.

The captured image extraction unit 115 may periodically extract the captured image at predetermined time intervals. Alternatively, the captured image extracting unit 115 may extract the captured image each time the captured image receiving unit 114 receives the captured image from the imaging device 3 .

The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user. For example, the output unit 116 may transmit the captured image extracted by the captured image extraction unit 115 to the communication terminal 2 of the user by e-mail or the like. Also, the output unit 116 may store the captured image extracted by the captured image extraction unit 115 in a storage area (for example, a cloud server) associated with the user. Further, the output unit 116 may print the captured image extracted by the captured image extraction unit 115 on paper using a printer.

The output unit 116 may accept designation of a place or time from the user and output a captured image corresponding to the designated place or time. When the user designates a location, if the area A in which the captured image extracted by the captured image extracting unit 115 is captured is close to the location specified by the user (for example, the distance from the location specified by the user to the area A is a predetermined distance). within the threshold of), the output unit 116 outputs the captured image. When the user designates a time range, the output unit 116 outputs the captured image when the captured image extracted by the captured image extracting unit 115 is captured within the time range specified by the user. As a result, the user can acquire captured images in which the user himself/herself is photographed for each place and time.

The captured image extracted by the captured image extraction unit 115 may include other users in addition to the user. Therefore, the output unit 116 may output the captured image extracted by the captured image extraction unit 115 after performing image processing to hide other users. In this case, the output unit 116 identifies the peripheral area of the feature portion corresponding to the feature image in the captured image extracted by the captured image extraction unit 115 . Then, the output unit recognizes a person positioned outside the peripheral area of the characteristic portion, and performs image processing to hide the person's part. As image processing, the output unit 116 may hide the human part by performing mosaic processing, or hide the human by synthesizing a captured image in which the human is not captured (that is, a background image) with the human part. may Thereby, the imaging control device 1 can ensure the privacy of other users.

According to the imaging control process shown in FIG. 4, the imaging control device 1 selects the captured image including the characteristic portion of the user from among the captured images captured when the user enters a predetermined area associated with the imaging device 3. is extracted, a picked-up image with high certainty that the user is captured can be output to the user.

The imaging control device 1 may specify the timing at which the user faces the imaging device 3 and instruct the imaging device 3 to take an image at the specified timing. FIG. 5 is a schematic diagram of imaging control processing according to the present embodiment.

First, as in FIG. 4, in the communication terminal 2, the position identifying unit 22 periodically identifies the position of the communication terminal 2 at predetermined time intervals and transmits it to the imaging control device 1 (a). The position determination unit 112 of the imaging control device 1 compares the position of the communication terminal 2 with the area A associated with each imaging device 3, and determines that the position of the communication terminal 2 is included in the area A of which imaging device 3. (b).

Then, the position determination unit 112 specifies the timing of imaging based on the position of the communication terminal 2 (b'). For example, the position determination unit 112 identifies the timing of imaging based on the direction in which the communication terminal 2 (user) is moving. The position determining unit 112 determines the direction in which the communication terminal 2 is moving from the position of the communication terminal 2 acquired at a past time (for example, one time before) to the position of the communication terminal 2 acquired at the latest time. Identify as

The user's face is usually oriented in the direction in which the user is moving. Therefore, the position determination unit 112 identifies the timing at which the imaging device 3 is positioned in the direction in which the user is moving, as the imaging timing. By doing so, it is possible to increase the probability that the imaging device 3 can generate a captured image in which the user's face is captured.

Further, the position determination unit 112 may specify the timing of imaging based on whether or not the user's feature part is included in the imaging range of the imaging device 3 . In this case, the position determination unit 112 acquires one or more feature images associated with the user of the communication terminal 2 from the feature image storage unit 131 . The position determination unit 112 periodically acquires a temporary image having a resolution lower than that of the captured image from the imaging device 3 at predetermined time intervals, and compares it with the characteristic image acquired from the characteristic image storage unit 131 . Since the provisional image is not output to the user, the processing load can be reduced by using a provisional image with a resolution that is low enough to allow recognition of the characteristic portion.

The position determination unit 112 determines whether or not the provisional image includes a characteristic portion corresponding to the characteristic image by the same method as the captured image extraction unit 115 . Then, the position determination unit 112 identifies the timing at which the provisional image includes the characteristic portion corresponding to the characteristic image as the imaging timing. If the position determination unit 112 cannot acquire the provisional image including the feature part corresponding to the feature image even after a predetermined time has passed since the position of the communication terminal 2 entered the area A, the position determination unit 112 may stop the imaging control process. good. In this way, by determining in real time whether or not the user's characteristic portion is included in the imaging range of the imaging device 3 and determining the timing of imaging, the imaging device 3 can produce a captured image showing the user's characteristic portion. can be further increased.

Also, the position determination unit 112 may specify the timing of imaging based on the optical signal emitted by the communication terminal 2 . In this case, the communication terminal 2 generates a predetermined light signal by blinking the lamp or screen according to a predetermined rule. When the imaging device 3 detects a predetermined optical signal, the imaging device 3 transmits a signal indicating that the optical signal has been detected to the imaging control device 1 . Then, the position determination unit 112 identifies the timing at which the signal indicating that the optical signal has been detected from the imaging device 3 is received as the imaging timing.

At the imaging timing specified by the position determination unit 112, the imaging instruction unit 113 transmits a signal indicating an imaging instruction to the imaging device 3 associated with the area A including the position of the communication terminal 2 (c).

Then, as in FIG. 4, when the imaging device 3 receives a signal indicating an imaging instruction from the imaging control device 1, the imaging device 3 takes an image of the imaging range (d), and transmits the captured content to the imaging control device 1 as a captured image. (e). The captured image extracting unit 115 extracts a captured image including the user's characteristic portion registered in the characteristic image storage unit 131 (f). The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user.

According to the imaging control process shown in FIG. 5, the imaging control device 1 captures an image at a timing with high certainty that the user can be imaged, so it is possible to suppress wasteful imaging at a timing when the imaging device 3 is not facing the user. . The imaging device 3 or the movable device 4 may specify its own imaging timing, and may capture an image at the specified timing.

[Explanation of imaging control processing for movable device 4]
The imaging control process for the movable device 4 will be described with reference to FIG. 6 . FIG. 6 is a schematic diagram of imaging control processing according to the present embodiment. First, as in FIG. 4, in the communication terminal 2, the position identifying unit 22 periodically identifies the position of the communication terminal 2 at predetermined time intervals and transmits it to the imaging control device 1 (a). The position determination unit 112 of the imaging control device 1 compares the position of the communication terminal 2 with the area A associated with each mobile device 4, and the position of the communication terminal 2 is included in the area A of any mobile device 4. (b).

When the position of the communication terminal 2 is included in the area A of any of the mobile devices 4, the imaging instruction unit 113 sends a signal indicating an imaging instruction to the mobile device 4 associated with the area A including the position of the communication terminal 2. (c). At this time, the signal indicating the imaging instruction includes a movement instruction for moving the movable device 4 to a position where the user can be imaged. The movable device 4 moves based on the movement instruction included in the signal received from the imaging control device 1 (c').

The movement instruction may indicate a route from mobile device 4 to communication terminal 2 . In this case, the imaging instruction unit 113 determines a route based on the position of the mobile device 4 and the position of the communication terminal 2 and transmits the route to the mobile device 4 . The movable device 4 then moves according to the received route. The movement instruction may indicate only the position of the communication terminal 2 (user). In this case, and the mobile device 4 moves autonomously to the position of the communication terminal 2 received.

When the positions of a plurality of communication terminals 2 are simultaneously included in one region A, the image capturing instruction unit 113 sequentially issues a plurality of image capturing instructions to the mobile device 4 so as to image the plurality of communication terminals 2 in a predetermined order. Send.

For example, the image capturing instruction unit 113 may determine the order of decreasing the distance from the position of the mobile device 4 as the image capturing order for the plurality of communication terminals 2 . As a result, the movable device 4 can be moved in order from the closest user, and images can be efficiently captured. Further, as described above, the imaging instruction unit 113 determines the order in which the plurality of communication terminals 2 are located in the smallest distance from the center of the area A or the order in which the plurality of communication terminals 2 enter the area A as the imaging order. may

The imaging instruction unit 113 transmits a movement instruction to move the movable device 4 together with the imaging instruction to the movable device 4 so that the plurality of communication terminals 2 are included in the imaging range of the imaging unit 31 in the determined order.

When the positions of a plurality of communication terminals 2 are included in one area A at the same time, the imaging instruction unit 113 may increase the frequency of transmitting the imaging instruction and the movement instruction to the movable device 4 . This increases the probability that all users having communication terminals 2 that have entered the area A can be imaged.

After completing the movement based on the movement instruction, the movable device 4 captures an image of the imaging range (d), and transmits the imaged content to the imaging control device 1 as a captured image (e). Then, similarly to FIG. 4, the captured image extracting unit 115 extracts a captured image including the user's characteristic portion registered in the characteristic image storage unit 131 (f). The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user.

Since the movable device 4 can change the imaging range by moving itself, the movable device 4 is associated with an area A wider than that of the imaging device 3 . Therefore, according to the imaging control process shown in FIG. 6 , the movable device 4 can automatically image the user in the wide area A without providing many imaging devices 3 .

[Description of flow of imaging control method]
FIG. 7 is a diagram showing a flowchart of the imaging control method according to this embodiment. The flowchart in FIG. 7 is started by receiving an instruction from the user after the characteristic image registration process is completed.

In the imaging control device 1, the position determination unit 112 receives and acquires the position of the communication terminal 2 from the communication terminal 2, and acquires the area information stored in the area information storage unit 132 (S11). The position determination unit 112 compares the position of the communication terminal 2 with the area A associated with each imaging device 3 or movable device 4, and determines whether the position of the communication terminal 2 is the region A of any imaging device 3 or movable device 4. (S12).

If the position of the communication terminal 2 is not included in the area A of any imaging device 3 or movable device 4 (NO in S13), the imaging control device 1 proceeds to step S19. If the position of the communication terminal 2 is included in the area A of any imaging device 3 or mobile device 4 (YES in S13), the imaging instruction unit 113 is associated with the area A including the position of the communication terminal 2. A signal indicating an imaging instruction is transmitted to the imaging device 3 or the movable device 4 (S14). The captured image receiving unit 114 receives the captured image from the imaging device 3 or the movable device 4, associates it with the communication terminal 2, and stores it in the captured image storage unit 133 (S15).

The captured image extraction unit 115 acquires one or more characteristic images associated with the user of the communication terminal 2 from the characteristic image storage unit 131 (S16). The captured image extraction unit 115 compares each captured image associated with the communication terminal 2 in the captured image storage unit 133 with the characteristic image acquired from the characteristic image storage unit 131 . Then, the captured image extracting unit 115 extracts a captured image including the characteristic portion corresponding to the characteristic image (S17). The output unit 116 outputs the captured image extracted by the captured image extraction unit 115 to the user (S18).

If a predetermined termination condition (for example, the user performs a predetermined termination operation) is not satisfied (NO in S19), the imaging control device 1 returns to step S11 and repeats the process. If the predetermined end condition is satisfied (YES in S19), the imaging control device 1 ends the process.

[Effects of Embodiment]
According to the present embodiment, the imaging control device 1 selects a captured image that includes a pre-registered characteristic portion of the user from captured images captured when the user enters a predetermined area associated with the imaging device 3. to extract Therefore, the imaging control device 1 can output to the user a captured image with a high degree of certainty that the user is captured, and can save the user the trouble of selecting an image in which the user is captured from among a large number of captured images.

By setting the area A associated with the imaging device 3 and the movable device 4 to be a good imaging spot (such as a tourist attraction), the imaging control device 1 can A captured image showing the user can be provided to the user after the fact.

[Modification of Embodiment]
In the above-described embodiment, the imaging control device 1 instructs the imaging device 3 and the movable device 4 to shoot, but the communication terminal 2 may instruct the imaging device 3 and the movable device 4 to shoot. FIG. 8 is a block diagram of a modification of the imaging system S according to this embodiment. The communication terminal 2 has an area reception section 23 , a position determination section 24 , and an imaging instruction section 25 in addition to the imaging section 21 and the position specifying section 22 described above.

The processor of the communication terminal 2 functions as an area reception unit 23, a position determination unit 24, and an imaging instruction unit 25 by executing programs. The region reception unit 23 receives and acquires the region information stored in the region information storage unit 132 from the imaging control device 1 . The area reception unit 23 stores the received area information in the storage unit of the communication terminal 2 .

The position determining unit 24 compares the position of the communication terminal 2 specified by the position specifying unit 22 with the area A indicated by the area information received from the imaging control device 1, and determines which imaging device 3 or It is determined whether it is included in the area A of the mobile device 4 .

When the position of the communication terminal 2 is included in the area A of any imaging device 3 or mobile device 4, the imaging instruction unit 25 selects the imaging device 3 or mobile device associated with the area A including the position of the communication terminal 2. 4, a signal indicating an imaging instruction is transmitted. The imaging instruction unit 25 may directly transmit a signal to the imaging device 3 or the movable device 4 or may transmit a signal via the imaging control device 1 . Other processing in the imaging system S is the same as in FIG.

As described above, the communication terminal 2 does not need to sequentially transmit its own position to the imaging control device 1 by giving the imaging instruction to the imaging device 3 or the movable device 4. Therefore, the communication terminal 2 and the imaging control The amount of communication with the device 1 can be reduced.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist thereof. be. For example, specific embodiments of device distribution/integration are not limited to the above-described embodiments. can be done. In addition, new embodiments resulting from arbitrary combinations of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment caused by the combination has the effect of the original embodiment.

The control unit 11 (processor) of the imaging control device 1 is the subject of each step (process) included in the method shown in FIG. That is, the control unit 11 reads a program for executing the method shown in FIG. do.

S imaging system 1 imaging control device 11 control unit 111 characteristic image registration unit 112 position determination unit 113 imaging instruction unit 114 captured image reception unit 115 captured image extraction unit 13 storage unit 2 communication terminal 23 area reception unit 24 position determination unit 25 imaging instruction Part 3 Imaging device 31 Imaging unit 4 Movable device 41 Imaging unit

Claims (6)

a registration unit that registers a feature image indicating a feature associated with a user in a storage unit;
When the position of the communication terminal owned by the user is within an area associated with a pre-registered imaging device, the imaging device is instructed to take an image and the orientation of the imaging device based on the position of the communication terminal. and an instruction unit that transmits an instruction to change at least one of the magnification and
a receiving unit that receives a plurality of captured images captured by the imaging device to which the instruction unit has transmitted the imaging instruction;
an extraction unit that extracts, from among the plurality of captured images, a captured image that includes the characteristic portion indicated by the characteristic image registered in advance in association with the user;
has
The instruction unit specifies the direction of movement of the user based on the position of the communication terminal, and instructs the imaging device to take the image and the instruction to change at the timing when the direction of movement turns toward the imaging device. to send a
Imaging control device. a registration unit that registers a feature image indicating a feature associated with a user in a storage unit;
When the position of the communication terminal owned by the user is within an area associated with a pre-registered imaging device, the imaging device is instructed to take an image and the orientation of the imaging device based on the position of the communication terminal. and an instruction unit that transmits an instruction to change at least one of the magnification and
a receiving unit that receives a plurality of captured images captured by the imaging device to which the instruction unit has transmitted the imaging instruction;
an extraction unit that extracts, from among the plurality of captured images, a captured image that includes the characteristic portion indicated by the characteristic image registered in advance in association with the user;
has
When the positions of the plurality of communication terminals are within the area, the instruction unit determines an imaging order, which is the order in which the plurality of communication terminals are to be imaged, and arranges the plurality of communication terminals in the imaging range according to the imaging order. sending the imaging instructions and the changing instructions to the imaging device to include in
Imaging control device. The instruction unit determines an order in which the distance between the plurality of communication terminals and the center of the area is the smallest, as the imaging order.
The imaging control device according to claim 2. The instruction unit determines the order in which the plurality of communication terminals enter the area as the imaging order.
The imaging control device according to claim 2. a registration unit that registers a feature image indicating a feature associated with a user in a storage unit;
When the position of the communication terminal owned by the user is within an area associated with a pre-registered imaging device, the imaging device is instructed to take an image and the orientation of the imaging device based on the position of the communication terminal. and an instruction unit that transmits an instruction to change at least one of the magnification and
a receiving unit that receives a plurality of captured images captured by the imaging device to which the instruction unit has transmitted the imaging instruction;
an extracting unit for extracting, from among the plurality of captured images, a captured image including the characteristic portion indicated by the characteristic image registered in advance in association with the user;
has
The instruction unit transmits the imaging instruction and the change instruction to the imaging device at the timing of receiving from the imaging device a signal indicating that the imaging device has detected a predetermined optical signal emitted by the communication terminal. do,
Imaging control device. A communication terminal owned by a user, an imaging device, and an imaging control device,
The communication terminal is
a receiving unit that receives an area associated with the imaging device registered in advance;
a determination unit that determines whether the position of the communication terminal is within the area;
When the determination unit determines that the position of the communication terminal is within the area, the imaging device is instructed to take an image, and at least the direction and magnification of the imaging device are determined based on the position of the communication terminal. an instruction unit for transmitting an instruction to change one ;
has
The imaging device is
an imaging unit that, upon receiving the imaging instruction from the communication terminal, captures an image of at least one of the direction and magnification of the imaging device indicated by the instruction to change ;
The imaging control device is
a registration unit that registers, in a storage unit, a feature image indicating a feature associated with the user;
an extraction unit for extracting, from among a plurality of captured images captured by the imaging unit, a captured image including the characteristic portion indicated by the characteristic image registered in advance in association with the user;
has
The instruction unit specifies the direction of movement of the user based on the position of the communication terminal, and instructs the imaging device to take the image and the instruction to change at the timing when the direction of movement turns toward the imaging device. to send a
imaging system.

Images