JP7346365B2 - Photography management system, photography management device, management device, method of controlling the photography management device, method of controlling the management device, and program - Google Patents

Description

The present invention relates to a photography management system, a photography management device, a management device, a method of controlling the photography management device, a method of controlling the management device, and a program.

Patent Document 1 discloses a technique for generating an album by selecting images related to a vehicle and a driver from among images taken using identification information of a person who wishes to take a photograph.

International Publication No. 2018/179310

Depending on the type of moving object such as a motorcycle, there are also needs such as enjoying riding in a group made up of multiple people or wanting to take pictures in a group. However, the technique disclosed in Patent Document 1 is based on the premise of photographing a person who wishes to take a photo while traveling alone, and does not take into consideration photography when the vehicle is traveling in a group.

In addition, although the technology of Patent Document 1 automates shooting, if a situation arises in which automatic shooting does not go well, the service cannot be continued, so operators must manually operate shooting devices such as drones and cameras. It is desirable to provide a photography management service so that people can take pictures at

In view of the above-mentioned prior art, the present invention aims to provide a technology that enables the following photography management.

That is, the identification information of the user who wishes to be photographed and the group information for setting the group to be photographed are stored before photographing, and it is possible to perform photographing with a specific group as the photographic subject at the time of photographing. Additionally, in addition to user identification information, group information and location information of each user are sent to the operating device for photographing users who are moving on a mobile device, so that automatic or manual photographing can be performed using the photographing device. At the same time, the operation device side can easily identify a specific group of subjects to be photographed and the presence or absence of a group within the photographing area for photographing, thereby improving the efficiency of photographing management. .

A photography management system according to a first aspect of the present invention includes a user's terminal device, a photography management device that manages photography of a user who moves in a mobile body, and a photography management device that communicates with the photography management device in order to perform the photography. A shooting management system having a management device,
The terminal device is
Group information that sets the user alone or a plurality of users including at least the user as a shooting target, and identification information that identifies a combination of the user set in the group information and the mobile object used by the user. comprising a communication means for transmitting to the photographing management device before photographing,
The photographing management device includes:
storage means for registering the identification information and the group information;
The position information of each user's terminal device set in the group information is acquired by the communication means, and when the terminal device is located at least within the photographing area for performing the photographing, the position information is registered in the storage means. and a photographing management processing means for transmitting the identification information and the group information, and the position information, to the management device.

In the photography management system according to the second aspect of the present invention, the identification information includes information that specifies the appearance of the moving object and information that specifies the appearance of the user.

In the photographing management system according to the third aspect of the present invention, the photographing management processing means compares the position information with map information including the photographing area, and determines the position of the terminal device with respect to the photographing area. Area broadcast information is transmitted to the terminal device.

In the photographing management system according to the fourth aspect of the present invention, the photographing management processing means may include a plurality of moving objects in the photographing area or a predetermined preparation area set in front of the photographing area, based on the comparison. If it is determined that at least one of them has entered,
The photographing management processing means generates area notification information for notifying the user that the user has entered the photographing area or the preparation area, and transmits it to the terminal device.

In the photography management system according to the fifth aspect of the present invention, the photography management processing means includes:
The distance between vehicles of a plurality of moving objects traveling in the photographing area or a predetermined preparation area set in front of the photographing area is obtained based on the position information, and the distance between vehicles is the upper limit of a predetermined reference distance range. If it is determined that the
The photographing management processing means includes:
A distance notification signal is transmitted to the user's terminal device to notify the user that the inter-vehicle distance exceeds the upper limit distance of the reference distance range.

In the photography management system according to the sixth aspect of the present invention, the photography management processing means includes:
The distance between vehicles of a plurality of moving objects traveling in the photographing area or a predetermined preparation area set in front of the photographing area is obtained based on the position information, and the distance between vehicles is the lower limit of a predetermined reference distance range. If it is determined that:
The photographing management processing means includes:
An approach notification signal is transmitted to the user's terminal device to notify the user that the inter-vehicle distance is less than or equal to the lower limit of the reference distance range.

In the photographing management system according to the seventh aspect of the present invention, the photographing management processing means compares the position information with map information including the photographing area, and determines that the moving object has left the photographing area. or when completion information indicating that photographing has been completed is received from the management device, the transmission of the identification information, the group information, and the position information to the management device is stopped.

In the photographing management system according to the eighth aspect of the present invention, the photographing management processing means uses a timer for measuring time to link time information of each user in the photographing area with identification information of each user. The time information and the identification information are combined and stored in the storage means.

In the photography management system according to the ninth aspect of the present invention, the management device includes:
an operation processing means for generating a control signal for controlling the photographing device in a manual photographing mode based on an operator's operation or in an automatic photographing mode based on the identification information, the group information, and the position information;
Storage means for storing photographic data photographed by the photographing device,
The management processing means is
In response to a request from the user of the terminal device, an image search is performed based on the user's identification information and information on the time that the user was present in the photographing area, and the photographic data of the user is retrieved from the terminal device. Deliver to.

In the photography management system according to the tenth aspect of the present invention, the management processing means:
an image processing unit that performs image processing to extract the user's face from photographic data photographed by the photographing device;
further comprising image determining means for determining whether or not faces for the number of users set in the group information have been photographed based on the result of the image processing,
The management processing means is
When faces for the number of users set in the group information are not photographed, the automatic photographing mode is changed to the manual photographing mode.

In the photography management system according to the eleventh aspect of the present invention,
The operating device is
comprising an operation processing means for generating a control signal for controlling the photographing device in a manual photographing mode based on an operator's operation or in an automatic photographing mode based on the identification information, the group information, and the position information;
When a plurality of photographing targets specified by the group information are present in the photographing area, the management processing means displays each photographic target in a different display format on the display device.

In the photographing management system according to the twelfth aspect of the present invention, when a plurality of photographing targets specified by the group information are present in the photographing area, the management processing means selects a photographing target in manual photographing mode and an automatic photographing target. Discrimination information for distinguishing from the photographic subject in the photographing mode is displayed on the display device.

In the photographing management system according to the thirteenth aspect of the present invention, when the photographing target specified by the group information is composed of a plurality of users, the operation processing means is configured to control the distance between vehicles used by each user. is acquired and displayed based on the difference in the position information of each user's terminal device SP received from the photographing management device.

In the photographing management system according to the fourteenth aspect of the present invention, the management processing means acquires and displays vehicle speed information based on temporal changes in position information received from the photographing management device.

A photography management device according to a fifteenth aspect of the present invention is a photography management device for photographing a user who moves in a mobile body, and comprises:
Identification that combines group information that sets the user alone or a plurality of users including at least the user as a photographing target, appearance information of the user set in the group information, and vehicle information of a moving body used by the user. information, and a storage means for registering the information before shooting;
The location information of each user's terminal device set in the group information is acquired, and when the terminal device is located at least within the shooting area for performing the shooting, the identification information and the group information, and the and a photographing management processing means for transmitting position information to an operating device that communicates with the photographing management device in order to perform the photographing.

An operating device according to a sixteenth aspect of the present invention is an operating device for photographing a user who moves in a mobile body,
Group information that sets the user or a plurality of users including at least the user as the shooting target, which is transmitted from the user's terminal device to the shooting management device, and the user set in the group information and the use of the user. communication means for receiving from the photographing management device identification information for identifying a combination with a mobile object and position information of each user's terminal device set in the group information,
The communication means receives the identification information, the group information, and the position information when the terminal device is located at least within the photographing area for performing the photographing.

A method for controlling a photographing management device according to a seventeenth aspect of the present invention is a method for controlling a photographing management device for photographing a user who is moving in a mobile body, the method comprising:
The storage means includes group information in which the user or a plurality of users including at least the user is set as a photographing target, appearance information of the user set in the group information, and vehicle information of a moving body used by the user. identification information that combines the information, and a storage process that registers the information before photographing.
The photographing management processing means acquires the position information of the terminal device of each user set in the group information, and when the terminal device is located at least within the photographing area for performing the photographing, the photographing management processing means acquires the position information of the terminal device of each user set in the group information and stores the identification information and and a photographing management processing step of transmitting the group information and the position information to an operation device that communicates with the photographing management device in order to perform the photographing.

A method for controlling an operating device according to an eighteenth aspect of the present invention is a method for controlling an operating device for photographing a user who is moving in a mobile body, the method comprising:
Identification by which the communication means identifies a combination of group information in which a single user or a plurality of users including at least the user is set as a photographing target, and a user set in the group information and a mobile object used by the user. and the positional information of each user's terminal device set in the group information when the positional information indicates that the terminal device is located at least within the photographing area for performing the photographing.

A program according to a nineteenth aspect of the present invention is a program that causes a computer to execute each step of a control method for a photographing management device for photographing a user who moves in a mobile body, the control method comprising:
The storage means includes group information in which the user or a plurality of users including at least the user is set as a photographing target, appearance information of the user set in the group information, and vehicle information of a moving body used by the user. identification information that combines the information, and a storage process that registers the information before photographing.
The photographing management processing means acquires the position information of the terminal device of each user set in the group information, and when the terminal device is located at least within the photographing area for performing the photographing, the photographing management processing means acquires the position information of the terminal device of each user set in the group information and stores the identification information and and a photographing management processing step of transmitting the group information and the position information to an operation device that communicates with the photographing management device in order to perform the photographing.

A program according to a twentieth aspect of the present invention is a program that causes a computer to execute each step of a control method for an operating device for photographing a user who moves in a mobile body, the control method comprising:
Identification by which the communication means identifies a combination of group information in which a single user or a plurality of users including at least the user is set as a photographing target, and a user set in the group information and a mobile object used by the user. and the positional information of each user's terminal device set in the group information when the positional information indicates that the terminal device is located at least within the photographing area for performing the photographing.

According to the photographing management system of the first aspect of the present invention, identification information of a user who desires to be photographed and group information for setting a group of photographic subjects are stored before photographing, and a specific group is selected during photographing. It becomes possible to take pictures of the subject.

Additionally, in addition to user identification information, group information and location information of each user are sent to the operating device for photographing users who are moving on a mobile device, so that automatic or manual photographing can be performed using the photographing device. In this case, the operation device side can easily identify a specific group of subjects to be photographed and the presence or absence of a group within the photographing area for photographing, thereby improving the efficiency of photographing management. .

According to the photographing management system of the second aspect of the present invention, by including the user's appearance information in the identification information, even if the vehicle information of vehicles used by a plurality of users is the same, there is a difference in the appearance information. This makes it possible to identify each user. Furthermore, by including the vehicle information of the mobile body in the identification information, even if the appearance information of a plurality of users matches, it becomes possible to identify each user based on the difference in the vehicle information.

According to the shooting management systems of the third and fourth aspects of the present invention, by transmitting area notification information to the terminal device according to the position of the terminal device with respect to the shooting area, the user can start shooting, during shooting, Alternatively, it becomes possible to know when shooting has ended, and it becomes possible to shoot a video that meets the user's needs, thereby improving convenience for the user.

According to the photographing management system of the fifth aspect of the present invention, if the distance between vehicles is too wide, it may not be possible to photograph multiple users at the same time when driving in the photographing area, so the distance between vehicles is the standard. By transmitting a distance notification signal to multiple vehicles to notify the user that the distance exceeds the upper limit of the distance range, it becomes possible to encourage the user to shorten the distance between the vehicles.

According to the photography management system of the sixth aspect of the present invention, if the distance between vehicles is too close, multiple users may overlap when driving in the photography area and cannot take pictures at the same time, so the distance between vehicles is the standard. By transmitting an approach notification signal to a plurality of vehicles to notify the user that the distance is below the lower limit of the distance range, it becomes possible to encourage the user to increase the distance between the vehicles.

According to the photographing management system of the seventh aspect of the present invention, while ensuring the communication ability to communicate necessary information before the start of photographing, when the moving object to be photographed leaves the photographing area, or When the process is completed, it becomes possible to reduce the communication load by stopping the transmission of identification information, group information, and position information to the operating device.

According to the photographing management system of the eighth aspect of the present invention, each user stores the time information existing in the photographing area in combination with the identification information, so that the photographing management device manages the combination of time information and identification information. It becomes possible to provide the information to the device. By comparing the combined time information and identification information with the time information added to the photographed data, the management device can easily identify the user appearing in the photographed data, making it more efficient. It becomes possible to provide photographic data.

According to the photographing management system of the ninth aspect of the present invention, the operating device controls the photographing device in a manual photographing mode based on operator operations or in an automatic photographing mode based on identification information, group information, and position information. This makes it possible to take pictures. The operating device searches for photographic data taken in one of the multiple photographing modes in response to a request from the user of the terminal device, and allows the user to distribute the photographed data. become.

According to the photography management system of the tenth aspect of the present invention, even if the photography data taken by the user cannot be obtained by photography in the automatic photography mode, the photography data taken in the manual photography mode is transferred to the terminal device. It becomes possible to search and distribute photographic data taken by the user in response to a user's request.

According to the imaging management system of the eleventh, twelfth, thirteenth, and fourteenth aspects of the present invention, when a plurality of imaging targets specified by group information exist in the imaging area; Also, it becomes possible to easily grasp the group visually.

A photography management device according to a fifteenth aspect of the present invention, a management device according to a sixteenth aspect, a method for controlling a photography management device according to a seventeenth aspect, a method for controlling a management device according to an eighteenth aspect, a nineteenth aspect, and a twentieth aspect of the present invention. According to the program according to the aspect, before photographing, identification information of a user who wishes to be photographed and group information for setting a group to be photographed are stored, and at the time of photographing, a specific group is to be photographed. becomes possible.

Additionally, in addition to user identification information, group information and location information of each user are sent to the operating device for photographing users who are moving on a mobile device, so that automatic or manual photographing can be performed using the photographing device. In this case, the operation device side can easily identify a specific group of subjects to be photographed and the presence or absence of a group within the photographing area for photographing, thereby improving the efficiency of photographing management. .

FIG. 1 is a block diagram for explaining an example of a photography management system according to an embodiment. FIG. 1 is a block diagram showing the functional configuration of a vehicle. ST21 is a block diagram illustrating the functional configuration of the unmanned aircraft, ST22 is a block diagram illustrating the functional configuration of the processing unit of the imaging management device, and ST23 is a block diagram illustrating the functional configuration of the processing unit of the management device. FIG. 3 is a diagram schematically explaining processing of a determination unit of the imaging management device. The figure explaining the flow of processing of a photographing management device and an operation device. FIG. 3 is a diagram illustrating the flow of processing by an image processing unit and an image determination unit of the management device. The figure explaining the flow of the adjustment process of the inter-vehicle distance of several vehicles which a photography management apparatus performs. The figure explaining the flow of the adjustment process of the speed difference of a plurality of vehicles which a photographing management device performs. FIG. 3 is a diagram illustrating display control by a processing unit of the management device. The figure explaining the flow of processing of an operation device and a photography management device in response to a user's purchase request.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the claimed invention, and not all combinations of features described in the embodiments are essential to the invention. Two or more features among the plurality of features described in the embodiments may be arbitrarily combined. In addition, the same or similar configurations are given the same reference numerals, and duplicate explanations will be omitted.

(Structure of shooting management system)
FIG. 1 is a diagram illustrating an example of the configuration of a photography management system STM according to an embodiment. The photographing management system STM is a photographing management system capable of photographing a user who moves with a mobile body. The photography management system STM communicates with, for example, a user's terminal device SP, a photography management device CNT that manages photography of a user who is moving in a mobile body, and a photography management device CNT to perform photography of a user who is moving in a mobile body. It has an operation device OPT that performs. The terminal device SP, the photography management device CNT, and the operation device OPT can communicate with each other via the network NT.

Further, the information processing device 18 is connected to the network NT, and can provide information to the terminal device SP, the shooting management device CNT, and the operation device OPT. The terminal device SP has a communication function, a camera function, and an information processing function, and is configured as, for example, a portable terminal device such as a smartphone, or a wearable terminal device that is attached to a part of the human body. It is possible to do so. Note that the terminal device SP is not limited to a terminal device owned by the user, but may be a lent portable terminal device such as a smartphone, or a wearable terminal device.

The operating device OPT has at least a communication function, an information processing function, and a memory function for storing information, and is capable of transmitting and receiving information and processing the transmitted and received information by wireless communication with the photographing device (200a, 200b). . The operation device OPT may be, for example, a portable information processing device such as a smartphone, or a wearable information processing device. Further, it may be a tablet-type information processing device or a desktop-type information processing device as long as it has similar functions. The photographing devices (200a, 200b) include an unmanned aerial vehicle DRN having a photographing device 200a (camera) capable of photographing in flight, and a photographing device 200b (camera) installed in a photographing area.

The operating device OPT is connected to the network NT via a communication interface unit 33 (communication I/F). The operation device OPT is capable of communicating with the photographing device (200a, 200b) via the network NT, and is capable of communicating with the photographing device (200a, 200b) based on a control signal generated by the operation processing unit (hereinafter referred to as “processing unit 31”). ), it is possible to photograph a subject in automatic photographing mode.

Furthermore, when a situation arises in which automatic photographing does not go well, the operating device OPT transmits an operator operation signal input by the operator from the operation unit 34 to the photographing device (200a, 200b), and remotely controls the photographing device (200a, 200b). , 200b) to photograph a subject in manual photographing mode. In this embodiment, an example including an automatic shooting mode and a manual shooting mode is described as an embodiment, but the embodiment is not limited to this and may be an embodiment including only an automatic shooting mode.

Furthermore, the embodiments of the present invention can be applied even if it is assumed that only manual photography is performed. If it is assumed that only manual photography is to be performed, the operation unit 34 and the processing unit 31 (signal generation unit 320 shown in FIG. 2B) are separate from the operation device OPT, and the operator can operate the photography device (200a, 200b). It can be configured as an operating device for operation. The operation device OPT can also be configured as a device that receives object identification information, group information, and position information from the photography management device CNT, and displays the received information to an operator who manages the operation device OPT.

The subject includes, for example, a user of a single vehicle or users of multiple vehicles. In this embodiment, an example will be described in which users of a plurality of vehicles constituting a subject are described as a group to be photographed. Note that the composition of the subjects is not limited to this example, and may be, for example, a user of a single vehicle as in group C in FIG. 8.

The information processing device 18 is an external terminal that manages vehicle rental (vehicle usage service). When a vehicle is rented to a user, the information processing device 18 collects vehicle information for identifying the rented vehicle, such as the car model name. Information such as a photograph of the exterior of the vehicle and the color of the vehicle) is transmitted to the user's terminal device SP. Note that the information processing device 18 can also transmit vehicle information to the photographing management device CNT and the operation device OPT together with the user's terminal device SP. The information processing device 18 (external terminal) can be installed, for example, at an external base (agency) such as a hotel, a rental car company, or a dealer that sells vehicles and provides maintenance services. If the vehicle is the user's property, the information processing device 18 may be omitted.

The user's terminal device SP transmits identification information that is a combination of external appearance information of the user who wishes to be photographed and vehicle information of the mobile object used by the user to the photographing management device CNT before photographing. Here, the user's appearance information is information taken by an external photographing device (camera) or a photographing device (camera) built into the terminal device SP, and the user's appearance information includes the user (for example, Information such as the clothes of users A and B in FIG. 1, the color and pattern of the clothes, and the color of the helmet that the users wear when moving is included.

By including the user's appearance information in the identification information, even if the vehicle information of vehicles used by a plurality of users matches, each user can be identified based on the difference in the appearance information.

The vehicle information of the mobile body used by the user is information transmitted from the information processing device 18 (external terminal), and includes information specifying the appearance of the mobile body (for example, 1A and 1B in FIG. 1), such as the vehicle type. This information includes information such as vehicle exterior photos, vehicle color, etc. By including the vehicle information of the moving body in the identification information, even if the appearance information of a plurality of users matches, each user can be identified based on the difference in the vehicle information. Note that if the vehicle is the property of the user, the vehicle information may be transmitted from the user's terminal device SP.

In addition, the user's terminal device SP transmits group information to the imaging management device CNT before imaging, together with identification information, as information for specifying the configuration of a group to be imaged.

Here, the group information is information for setting and registering a single user (for example, user A in FIG. 1) or a plurality of users (for example, users A and B in FIG. 1) including at least the user as a shooting target. . For example, in the group information, if "single" is set in user A's terminal device SP, user A alone is set as a group to be photographed. Furthermore, if "multiple" is set in user A's terminal device SP and the identification information of another user (for example, user B) is set, multiple users A and B are set as a group to be photographed. Ru. When setting multiple users as group information, if the identification information of the other user is set from the terminal device SP of at least one of users A and B, the set user will be assigned to the group to be photographed ( group).

By transmitting identification information to the photography management device CNT before photographing, appearance information and vehicle information of each user to be photographed can be registered in the photography management device CNT. Furthermore, by transmitting group information to the imaging management device CNT before photographing, the configuration of the group to be photographed can be registered in the imaging management device CNT.

When the imaging management device CNT obtains the identification information and group information transmitted from the user's terminal device SP via the communication interface unit 23 (communication I/F) before imaging, the imaging management device CNT registers them in the database DB of the storage unit 22. . When setting the users of the plurality of vehicles constituting the subject as a group to be photographed, the photographing management device CNT stores group information in the storage unit 22 in which the users A and B of the plurality of vehicles 1A and 1B are set as one group GR. Register in the database DB.

The photography management processing unit (hereinafter referred to as “processing unit 21”) of the photography management device CNT acquires the position information of the terminal device SP of each user (user A, B) set in the group information or the position information of each vehicle. When the terminal device SP or each vehicle is located at least within the shooting area for photographing, the identification information and group information, and the location information of the terminal device SP or the location information of each vehicle are provided to the operation device OPT. do.

When the processing unit 31 of the operation device OPT obtains the identification information and group information, and the position information of the terminal device SP or the position information of each vehicle via the communication interface unit 33 (communication I/F), the processing unit 31 starts shooting. A control signal for controlling the device (200a, 200b) is generated and transmitted to the imaging device (200a, 200b) via the network NT.

The photographing devices (200a, 200b) can perform photographing based on a control signal transmitted from the processing unit 31 of the operation device OPT. The photographic data (still images and moving images) photographed by the photographing devices (200a, 200b) is transmitted to the operating device OPT via the network NT and stored in the storage unit 32 of the operating device OPT. When the rented vehicle is returned, the photographed photographic data can be previewed (viewed) on the information processing device 18 (external terminal) or the terminal devices SP of the plurality of users A and B. If B likes the photographic data, he can purchase the photographic data. When purchasing photographic data, the processing unit 31 of the operating device OPT may generate an album based on the purchased photographic data and download the photographic data to the terminal devices SP of the plurality of users A and B. It is also possible to store the photographic data in a storage medium such as a CD-ROM or DVD and provide it to users A and B.

In the embodiment, as an example of a plurality of vehicles, the vehicles 1A and 1B may be electric vehicles such as straddle-type vehicles, two-wheeled vehicles or three-wheeled vehicles powered by an engine, or self-propelled bicycles. It is. Note that the straddle-type vehicle refers to a type of vehicle in which the driver rides astride the vehicle body, and the concept also includes scooter-type two-wheeled vehicles and the like. Further, the vehicle can include various wheeled moving bodies such as a kick skater and a four-wheeled vehicle.

Vehicle A and vehicle B have similar configurations, and in the following description, the configuration of vehicle 1A will be explained as a representative. As an example of a plurality of vehicles, FIG. 1 shows an example of two vehicles 1A and 1B, but the present invention is not limited to this example, and it is also possible to form a group with three or more vehicles.

FIG. 2A is a block diagram showing the functional configuration of the vehicle, and the vehicle 1A includes a power source 11, a battery 12 (power supply device) that supplies power to the vehicle, an operating mechanism 13, a vehicle control device 14 that controls the vehicle, and a communication device. 15. In the embodiment, the power source 11 is an electric motor, and the battery 12 is capable of supplying power to the power source 11 and each element of the vehicle 1. For example, a rechargeable secondary battery is used as the battery 12, and examples thereof include a lead acid battery, a lithium ion battery, a nickel metal hydride battery, and the like. The battery 12 can be charged by connecting it via a cable to a power source capable of supplying a predetermined voltage. Alternatively, the battery 12 may be replaced with a charged battery at a battery exchange station provided along the travel route, and the charged battery 12 may be installed in the vehicle.

The operating mechanism 13 is configured to be able to input an operation for controlling the power source 11, and outputs a predetermined signal to a vehicle control device 14, which will be described later, based on the operation input by the user, for example. Examples of operation inputs to the operation mechanism 13 include rotation operation using a predetermined key corresponding to the vehicle (ignition key, remote key, etc.), pressing operation using a push switch (start switch, etc.), etc. It will be done.

The vehicle control device 14 is an ECU (electronic control unit) that can control the operation of the entire vehicle 1A, and, for example, transmits and receives signals to and from each component of the vehicle 1A via a predetermined signal line. It is possible to do so. As an example, the vehicle control device 14 can receive a signal corresponding to an operation input to the operation mechanism 13 and control the power source 11 to start.

The functions of the vehicle control device 14 can be realized by either hardware or software. For example, the functions of the vehicle control device 14 may be realized by a CPU (central processing unit) executing a predetermined program using a memory. Alternatively, the functions of the vehicle control device 14 may be realized by a known semiconductor device such as a PLD (programmable logic device) or an ASIC (application-specific semiconductor integrated circuit). Further, although the vehicle control device 14 is shown here as a single element, the vehicle control device 14 may be divided into two or more elements as necessary.

Communication device 15 has an antenna for realizing communication via network NT. Furthermore, the communication device 15 includes a TCU (telematics control unit), etc. that performs signal processing to realize communication with the imaging management device CNT and the information processing device 18 via the network NT.

The TCU is capable of acquiring voltage information indicating the voltage value of the battery 12 from the battery 12, and the TCU is also capable of acquiring control information indicating the control state of the vehicle 1 from the vehicle control unit 14 (ECU). The TCU can output the acquired voltage information of the battery 12 and control information of the vehicle control unit 14 (ECU) via the network NT.

The communication device 15 is capable of performing vehicle-to-vehicle communication between a plurality of vehicles that make up a group GR set by group information, and the communication device 15 of the vehicle 1A can perform inter-vehicle communication with other vehicles 1B that make up the group GR. It is possible to perform wireless communication and exchange information between vehicles. The vehicle control device 14 can perform control such that the speed and vehicle distance when traveling through the photographing area are adjusted within the group GR through vehicle-to-vehicle communication between the vehicles.

The detection device 16 includes various sensors that detect various states of the vehicle 1A, and includes, for example, a gyro sensor, a GPS sensor, a vehicle speed sensor that detects vehicle speed information, and the like. The vehicle control device 14 can control the vehicle 1A based on the information detected by the detection device 16, and the communication device 15 can send the detection results of the detection device 16 to the photography management device CNT via the network NT. It is possible to do so.

The gyro sensor detects rotational movement of the vehicle 1A. The vehicle control device 14 can determine the course of the vehicle 1A based on the detection results of the gyro sensor, the vehicle speed sensor, and the like. The GPS sensor detects the current position of the vehicle 1A. Furthermore, the communication device 15 can perform wireless communication with a server device that provides map information and traffic information, and can also acquire information on the current position of the vehicle 1A.

In the embodiment, the communication device 15 and the detection device 16 function as an acquisition unit that acquires vehicle position information, and the communication device 15 functions as a vehicle communication unit that transmits vehicle position information via the network NT. . The photographing management device CNT can also acquire vehicle position information based on information transmitted from the communication device 15.

The display device 17 is configured to be able to display the remaining battery power of the battery 12 and notification information received from the photography management device CNT, as well as a vehicle speed meter and a tachometer. When driving in the shooting area, when receiving notification information regarding the vehicle speed and inter-vehicle distance between vehicles in the group GR from the shooting management device CNT, the display device 17 displays the notification information to the user and allows adjustment regarding the vehicle speed and inter-vehicle distance. It is possible to prompt the user. Thereby, in preparation for photographing, it becomes possible to drive through the photographing area with the vehicle speed and inter-vehicle distance adjusted within the group GR.

The photography management device CNT includes a processing section 21, a storage section 22, and a communication interface section 23 (communication I/F). The processing unit 21 includes a processor including a CPU and a memory, and the storage unit 22 includes a RAM serving as a processing area for programs, a ROM that stores various programs and data, and a relatively large-capacity HDD (hard disk drive). configured. Further, it may be distributed and arranged on the cloud. The processing unit 21 communicates with the vehicles 1A, 1B, each user's terminal device SP, and the operation device OPT via the network NT by the communication interface unit 23, and can perform signal processing based on bidirectional data communication. It is possible.

(Functional configuration of unmanned aerial vehicle DRN)
Next, the functional configuration of the unmanned aircraft DRN will be explained. ST21 in FIG. 2B is a block diagram illustrating the functional configuration of the unmanned aircraft DRN. The photographing device 200a is a photographing device (camera) mounted on the unmanned aerial vehicle DRN, and the photographing device 200a is configured to be capable of photographing the unmanned aerial vehicle DRN in flight. The photographing device 200a of the unmanned aerial vehicle DRN is capable of photographing still images or moving images. Furthermore, the photographing device 200b installed in the photographing area is also capable of photographing still images or moving images.

The communication interface unit 201 (communication I/F) is capable of communicating with the operating device OPT via the network NT. The communication interface unit 201 transmits photographic data photographed by the photographing device 200a to the operation device OPT. Note that the photographic data may be read into the operating device OPT via a recording medium mounted on the unmanned aircraft.

The identifying unit 202 identifies a moving subject based on the subject's identification information, group information, and position information transmitted from the operating device OPT. The photographing control section 203 controls the photographing device 200a based on the control signal to control photographing of the subject specified by the specifying section 202. Upon receiving the control signal (parameter control signal) transmitted from the operation device OPT, the photographing control unit 203 performs control (Pan control) to move the angle of view of the photographing device 200a in the horizontal direction, based on the control signal, It is possible to perform control to move the angle of view of 200a in a vertical direction (Tilt control), and control to enlarge (zoom up) or reduce (zoom out) the angle of view for photographing.

The rotor 204 rotates using a motor 205 as a driving source, and generates the propulsion force of the unmanned aerial vehicle DRN. In order to control the attitude in the flight state, the unmanned aircraft DRN is provided with at least four rotors 204 and motors 205, and the flight control unit 207 can control the output of the motors 205. The flight control unit 207 can turn to change the flight position or change the flight altitude based on the control signal transmitted from the operation device OPT. The sensor 206 is, for example, a distance sensor, and detects the distance between the subject specified by the specifying unit 202 and the unmanned aerial vehicle DRN.

(Functional configuration of the processing unit 21 of the shooting management device and the processing unit 31 of the management device)
Next, the specific functional configurations of the processing section 21 of the photographing management device CNT and the processing section 31 of the operation device OPT will be explained. ST22 in FIG. 2B is a block diagram illustrating the functional configuration of the processing section 21 in the imaging management device CNT, and the processing section 21 includes a determination section 210, a signal generation section 220, and a communication control section 230. FIG. 3 is a diagram schematically explaining the processing of the determination unit 210.

ST23 is a block diagram illustrating the functional configuration of the processing unit 31 in the operation device OPT, and the processing unit 31 includes a signal generation unit 320, a communication control unit 330, an image processing unit 340, and an image determination unit 350.

The determination unit 210 is capable of performing various determination processes, and determines whether the subject is in a predetermined shooting position based on the location information and map information acquired through communication with the subject's terminal device SP (or vehicle 1A, 1B). Determine whether it exists in the area.

For example, when the subjects are users (A, B) of a plurality of vehicles (1A, 1B), the determination unit 210 determines whether the terminal devices SP of the plurality of subjects set as one group (group GR) (or the vehicle 1A , 1B) and the map information, it is determined whether the plurality of subject vehicles 1A and 1B are traveling in a predetermined photographing area.

The determining unit 210 can access a database of map information built in the storage unit 22, and the determining unit 210 compares the position information and the map information to determine whether the plurality of subject vehicles 1A and 1B are set in a predetermined location. It is determined whether the vehicle is traveling in the photographing area.

For example, as shown in ST31 in FIG. 3, the determination unit 210 When determining that at least one vehicle (vehicle 1A) among the plurality of vehicles 1A and 1B set as group GR has entered the photographing area, the determination unit 210 determines whether the plurality of vehicles 1A and 1B are traveling in the photographing area. It is determined that it is inside.

In addition, as shown in ST32 in FIG. 3, when the shooting area is larger (longer distance) than the reference area, if all of the multiple vehicles 1A and 1B set as group GR enter the shooting area. In this case, the determining unit 210 determines that a plurality of vehicles are traveling in the photographing area.

The signal generation section 220 can generate various signals based on the determination by the determination section 210. The determination result of the determination unit 210 is transmitted to the operation device OPT. The signal generation unit 320 in the processing unit 31 of the operation device OPT generates a control signal for controlling the photographing devices (200a, 200b) based on the determination result of the determination unit 210.

If the determining unit 210 determines that a plurality of vehicles are traveling in the photographing area without starting photographing, the signal generating unit 320 of the operation device OPT generates a control signal instructing to start photographing.

Further, after the shooting starts, if the determination unit 210 determines that at least one of the plurality of vehicles is traveling in the shooting area, the signal generation unit 320 of the operation device OPT generates a control signal instructing to continue shooting. generate.

Then, as shown in ST33 in FIG. 3, when the determining unit 210 determines that all of the plurality of vehicles 1A and 1B have left the photographing area, the signal generating unit 320 of the operation device OPT sends a control signal instructing to end photographing. generate.

The communication control unit 230 of the imaging management device CNT can transmit the signal generated by the signal generation unit 220 via the communication interface unit 23, and for example, the communication control unit 230 can transmit the control signal generated by the signal generation unit 220. , is transmitted to the user's terminal device SP, vehicles 1A, 1B, and operation device OPT via the communication interface section 23.

When starting photography, the communication control unit 330 in the processing unit 31 of the operation device OPT transmits the identification information, group information, and position information transmitted from the photography management device CNT to the photography devices (200a, 200b). Then, the identifying unit 202 identifies the subject based on the subject identification information, group information, and position information transmitted from the operating device OPT, and the shooting control unit 203 controls the shooting device (200a, 200b) based on the control signal. to control the photographing of the subject specified by the specifying unit 202.

Note that when the determining unit 210 determines that at least one of the plurality of vehicles has entered the photographing area or a predetermined preparation area set in front of the photographing area, the signal generating unit 220 It is also possible for the communication control unit 230 to generate area notification information to notify the user that the vehicle has entered the vehicle, and to transmit the area notification information to the user's terminal device SP and the plurality of vehicles 1A and 1B.

By notifying the user of area notification information before photographing, it becomes possible to drive in preparation for photographing, such as arranging a formation of vehicles in group GR.

When continuing imaging or terminating imaging, the communication control unit 330 of the processing unit 31 transmits a control signal generated by the signal generation unit 320 instructing to continue imaging or a control signal instructing to end imaging to the imaging device 200a, 200b.

The photographing control unit 203 of the unmanned aerial vehicle DRN controls the photographing device 200a to continue photographing based on a control signal instructing continuation of photographing. Furthermore, the photographing control unit 203 of the unmanned aircraft DRN controls the photographing device 200a to end the photographing based on a control signal instructing the end of photographing.

The image processing unit 340 can perform image processing to extract the user's face from the photographic data taken by the photographing devices 200a and 200b. When the photographic data is a moving image, the image processing unit 340 performs image processing on each frame image. The image processing unit 340 can also perform image processing on images sampled at a predetermined frame rate.

The image determination unit 350 determines whether or not the faces of the users set as the group GR have been photographed, based on the image processing result, identification information, and group information. For example, if the faces of two users, users A and B, who are set as group GR, are extracted by image processing, that is, the set number of group GR (N1) and the number of extractions extracted by image processing (N2). ) are equal (N1=N2), the image determination unit 350 determines that the faces of all users forming the group GR have been photographed.

On the other hand, when the number of user faces extracted as a result of image processing is for one user, that is, when the set number of group GRs (N1 = 2) and the number of extractions extracted by image processing (N2 = 1) are not equal. (In this case, N1>N2), the image determination unit 350 determines that the faces of the number of users set as the group GR have not been photographed. In this case, the image determining section 350 determines that the photographing in the automatic photographing mode was not successful, and the signal generating section 320 shifts to re-photographing in the manual photographing mode.

(Processing flow)
FIG. 4 is a diagram illustrating the processing flow of the photographing management device CNT and the operation device OPT. Here, an example will be described in which the operation device OPT photographs a subject using the photographing device 200a of the unmanned aerial vehicle DRN.

In step S400, the storage unit 22 of the photographing management device CNT registers the identification information and group information transmitted from the terminal device SP before photographing. When the photographing management device CNT acquires the information (identification information and group information) transmitted from the terminal device SP via the communication interface section 23, the storage section 22 stores information about the users A and B of the plurality of vehicles 1A and 1B. Identification information and group information are registered in the database DB as one group (group GR).

In step S405, the determination unit 210 acquires map information from the map information database built in the storage unit 22.

In step S410, while the plurality of vehicles 1A and 1B are traveling, the determination unit 210 acquires the position information of the subject terminal device SP (or the vehicles 1A and 1B), and in step S415, the determination unit 210 acquires the position information and the map. Based on the comparison with the information, it is determined whether the plurality of vehicles 1A and 1B are traveling in a predetermined preparation area set in front of the photographing area.

If it is determined in step S415 that the vehicles 1A and 1B are not traveling in the preparation area (S415-No), the determination unit 210 returns the process to step S410 and repeats the same process.

On the other hand, if it is determined in step S415 that the vehicles 1A and 1B are traveling in the preparation area (S415-Yes), the process proceeds to step S417, and in step S417, the communication control unit 230 transmits the identification information of the subject, Send group information and position information to the operation device OPT. The communication control unit 230 communicates the identification information and group information registered in the database DB of the storage unit 22 when the user's terminal device SP (vehicles 1A, 1B) is located at least within the photographing area for photographing. , and the location information acquired in S410, to the operating device OPT. Until the user's terminal device SP (vehicles 1A, 1B) leaves the shooting area, the communication control unit 230 continuously transmits the identification information, group information, and position information of the subject to the operation device OPT in real time.

The communication control unit 330 of the operation device OPT transmits group information that sets a single user or a plurality of users including at least the user as a shooting target, and group information transmitted from the user's terminal device SP to the shooting management device CNT. The shooting management device collects identification information that identifies the combination of the set user and the mobile object used by the user, and the position information of each user's terminal device SP (or vehicle 1A, 1B) set in the group information. Receive from CNT. The communication control unit 330 receives identification information, group information, and position information when the terminal device SP (or the vehicle 1A, 1B) is located at least within a photographing area for photographing.

In step S420, upon receiving the subject identification information, group information, and position information transmitted from the imaging management device CNT, the signal generation unit 320 of the operation device OPT generates a control signal instructing the imaging device 200a to start imaging. .

Then, in step S425, the communication control unit 330 of the operation device OPT transmits the information (identification information, group information, and position information) of the group GR registered as one group and the control signal for the unmanned aircraft DRN generated in S420. do.

The unmanned aerial vehicle DRN flies aiming at the traveling position of the group GR based on the position information, and the identification unit 202 of the unmanned aerial vehicle DRN identifies multiple vehicles constituting the group (group GR) based on the identification information and group information. The plurality of identified vehicles are photographed using the photographing device 200a.

The photographing mode by the photographing device 200a includes an automatic photographing mode in which the photographing device (200a, 200b) automatically identifies and photographs a subject based on the control of the processing unit 31 of the operation device OPT, and an automatic photographing mode in which the photographing device (200a, 200b) automatically identifies and photographs a subject, and an operator operation input mode. This includes a manual photographing mode in which the photographing apparatus (200a, 200b) performs photographing based on a control signal (parameter control signal) generated by the processing unit 31 based on the above.

When the photographing device 200a starts photographing, the processing unit 31 of the operating device OPT displays the information received from the photographing management device CNT about the subject running in the photographing area on the display device of the operating device OPT. Display control is performed based on (identification information, group information, and position information).

FIG. 8 is a diagram illustrating display control by the processing unit 31. ST81 in FIG. 8 is a diagram showing a state in which a plurality of groups are running within the photographing area. When a plurality of photographing targets specified by the group information are present in the photographing area, the processing unit 31 displays each photographing target in a different display format on the display device. When a plurality of photographic targets specified by the group information exist in the photographing area, the processing unit 31 distinguishes the photographic targets by group, or distinguishes between groups of photographic targets in manual photographing mode and those in automatic photographing mode. Discrimination information for distinguishing from the group to be photographed is displayed on the display device.

The processing unit 31 can display text information such as "manual shooting" or "automatic shooting" on the display device as the discrimination information, or display icons such as figures and symbols on the display device.

Furthermore, the processing unit 31 may display the group to be photographed in a different color in the manual shooting mode based on the identification information and the group information, so that the group to be photographed in the automatic shooting mode is displayed in a different color. It is also possible to display each group within the photographing area in different display formats.

ST82 and ST83 in FIG. 8 are diagrams illustrating variations of the distinction information. As differentiation information, the processing unit 31 displays the vehicles in the group to be photographed in the manual photographing mode so as to be surrounded by a frame 801 (ST82), or displays a connecting line 802 connecting the vehicles in the group on the display device. (ST83), it is also possible to control the display so that the composition of the group to be photographed can be easily distinguished.

Furthermore, when the group of photographing targets specified by the group information is composed of multiple users (multiple vehicles), the processing unit 31 of the operation device OPT determines the distance between the moving bodies (vehicles) used by each user. (inter-vehicle distance) is obtained and displayed based on the difference in the position information of each user's terminal device SP (or vehicles 1A, 1B) received from the shooting management device CNT, and distinguishing information (display of text information, icon It is also possible to control the display in combination with a group display, a color-coded display of groups, a frame surrounding the vehicles forming the group, and a connecting line connecting the vehicles.

Furthermore, the processing unit 31 can control the vehicle speed information to be acquired and displayed based on the temporal change in the position information received from the photography management device CNT, or to display it in combination with the discrimination information. The processing unit 31 can also control the driving information (including inter-vehicle distance and vehicle speed information) to be displayed in combination with the discrimination information.

By checking the display of the group distinction information displayed on the display device, the operator specifies the object to be photographed in the manual photographing mode, and manually operates the operation unit 34 to control the unmanned aircraft DRN and the photographing device 200a. It is possible to operate. Note that it is desirable that these distinguishing information be displayed together with the map display.

In step S430, the determining unit 210 of the photographing management device CNT determines whether all of the plurality of vehicles 1A and 1B have left the photographing area, and if all the vehicles have not left the photographing area (S430-No), that is, If the determination unit 210 determines that at least one of the plurality of vehicles is traveling in the photographing area, the determination result of the determination unit 210 is transmitted to the operation device OPT, and the process proceeds to step S435.

In step S435, the signal generation unit 320 of the operation device OPT generates a control signal instructing to continue imaging, and in step S440, the communication control unit 330 of the operation device OPT generates an instruction to continue imaging generated by the signal generation unit 320. A control signal is sent to the unmanned aerial vehicle DRN. Upon receiving the control signal instructing continuation of photographing, the photographing control unit 203 of the unmanned aerial vehicle DRN controls the photographing device 200a to continue photographing based on the control signal instructing continuation of photographing.

On the other hand, if the determination unit 210 determines in step S430 that all of the plurality of vehicles 1A and 1B have left the imaging area (S430-Yes), the determination result of the determination unit 210 is transmitted to the operation device OPT, In step S445, the signal generation unit 320 of the operation device OPT generates a control signal instructing the end of imaging.

Then, in step S450, the communication control unit 330 of the operation device OPT transmits a control signal generated by the signal generation unit 320 instructing the end of photography to the unmanned aircraft DRN. Upon receiving the control signal instructing the end of imaging, the imaging control unit 203 of the unmanned aerial vehicle DRN controls the imaging device 200a to end the imaging based on the control signal instructing the end of imaging. Then, the communication control unit 330 of the operation device OPT transmits completion information indicating that the shooting has been completed to the shooting management device CNT, and the series of processing ends.

When the processing unit 21 determines that the moving object has exited the photographing area (S430-Yes), or when receiving completion information indicating that photographing has been completed from the operation device OPT (S450), the processing unit 21 transmits identification information to the operation device, Stop sending group information and location information.

(Processing flow of image processing section and image judgment section)
FIG. 5 is a diagram illustrating the processing flow of the image processing section 340 and the image determination section 350 in the operation device OPT. In step S500, the image processing unit 340 acquires photographic data photographed by the photographing device 200a of the unmanned aerial vehicle DRN.

In step S510, the image processing unit 340 performs image processing to extract the user's face from the photographic data photographed by the photographing device 200a.

In step S520, the image determination unit 350 performs an image determination to determine whether or not faces for the number of users set in the group information (group GR) have been photographed, based on the result of the image processing acquired in step S510. .

If it is determined in step S520 that the faces of the set number of users have been photographed (S520-Yes), the process proceeds to step S530.

Then, in step S530, the storage unit 32 of the operation device OPT stores the photographed data in the database, and the process ends.

On the other hand, if it is determined in step S520 that faces for the number of users set in the group information have not been photographed (S520-No), the process proceeds to step S540.

In step S540, the processing unit 31 changes the shooting mode from automatic shooting mode to manual shooting mode. In the manual photography mode, the signal generation unit 320 generates a parameter control signal for controlling photography parameters based on an operator operation signal input by the operator from the operation unit 34.

When an operation signal by an operator's manual operation is input from the operation unit 34 to the signal generation unit 320, the signal generation unit 320 generates a parameter control signal for controlling the imaging parameters of the imaging device 200a based on the operation signal. The signal generation unit 320 generates a parameter control signal for moving the field of view of the photographing device 200a in the horizontal direction as a photographing parameter for Pan control, or a parameter control signal for moving the field of view of the photographing device 200a in a vertical direction as a photographing parameter for Tilt control. It is possible to generate a parameter control signal to move. Furthermore, it is possible to generate a parameter control signal for photographing by enlarging (zooming up) or reducing (zooming out) the angle of view.

In step S550, the communication control unit 330 transmits the parameter control signal generated by the signal generation unit 320 to the unmanned aircraft DRN. In step S560, upon receiving the parameter control signal transmitted from the communication control unit 330 of the operation device OPT, the photographing control unit 203 of the unmanned aircraft DRN controls the photographing device 200a based on the received parameter control signal to Perform manual shooting while moving on the aircraft DRN. By controlling the angle of view of the photographing device 200a based on the parameter control signal, it is possible to photograph the faces of all members of the group. After step S560, the process returns to step S500, and the same process is repeated thereafter.

(Distribution processing of shooting data)
In step S530 of FIG. 5 described above, the storage unit 32 of the operating device OPT stores the photographed photographic data in the database. Here, the photographic data stored in the database is stored on the information processing device 18 (external terminal) or the terminal devices SP of the plurality of users A and B at the time of returning the vehicle lent to the user or at an appropriate time after the photographing. It is possible to provide a preview display.

If users A and B like the captured images, they can purchase the captured data, and in this case, the operating device OPT can distribute the captured data to the mobile terminals SP (smartphones) of multiple users A and B. (download). It is also possible to save the photographic data in a storage medium and provide it to the user.

FIG. 9 is a diagram illustrating the flow of processing by the operating device OPT and the photographing management device CNT in response to a user's purchase request.

In step S910, the processing unit 31 of the operation device OPT determines whether request information indicating a purchase request for photographic data transmitted from the user's terminal device SP has been received. If the request information has not been received (S910-No), the server waits for reception. Here, the request information is combined with identification information for identifying each user, and is transmitted from the user's terminal device SP to the operation device OPT. On the other hand, if the request information is received in step S910 (S910-Yes), the processing unit 31 advances the process to step S920.

In step S920, the processing unit 31 transmits the identification information of the person requesting the purchase of the imaging data to the imaging management device CNT. The processing unit 21 of the photography management device CNT uses an internal timer (timekeeping unit) to record information on the time each user existed in the photography area from the start of photography to the completion of photography (information on the year, month, and day that each user existed in the photography area). It is measured in association with the user's identification information and stored in the database DB of the storage unit 22.

In step S930, the processing unit 21 of the photographing management device CNT uses the identification information of the purchase requester received from the operation device OPT as key information to determine from the database DB of the storage unit 22 that the user corresponding to the purchase requester is in the photographing area. Get the existing time information. Then, the processing unit 21 combines the time information and identification information and transmits the combination to the operation device OPT.

In step S940, the processing unit 31 of the operation device OPT executes a search for photographic data based on the time information and identification information received from the photographic management device CNT, and searches the storage unit 32 for photographic data corresponding to the time information. . The photographing data photographed by the photographing devices 200a and 200b has time information (information on the photographing date) when the photographing was executed added as a time stamp, and the processing unit 31 receives the photographic data from the photographing management device CNT. The time information is compared with the time information added to the photographed data, and photographed data whose time information matches (overlapping time zones) is acquired from the storage unit 32. The processing unit 31 calculates the similarity of the user photographed in the photographic data acquired from the storage unit 32 based on the user's appearance information included in the identification information and the time information, and calculates the similarity of the user photographed in the photographic data acquired from the storage unit 32, and determines the degree of similarity equal to or higher than a reference threshold value. is selected from the photographic data acquired from the storage unit 32.

In step S950, the processing unit 31 of the operating device OPT delivers the photographic data retrieved by executing the image search to the terminal device SP of the purchase requester. The processing unit 31 of the operation device OPT distributes, among the photographic data acquired from the storage unit 32 based on the time information, photographic data having a degree of similarity equal to or higher than a reference threshold to the terminal device SP of the purchase requester. The photographic data to be distributed is not limited to a single piece of data, and if a plurality of photographic data are retrieved, the processing unit 31 distributes the plurality of retrieved photographic data to the terminal device SP of the purchase requester.

By using time information for image search, it becomes possible to easily link a purchase requester and photographic data.

The search for photographic data is not limited to the process flow of FIG. 9; for example, when requesting identification information in step S920, the processing unit 31 of the operation device OPT transmits photographed photographic data to the photographic management device CNT. However, it is also possible for the processing unit 21 of the imaging management device CNT to compare the time information.

In this case, as the process of step S930, the processing unit 21 of the photography management device CNT compares the time information that each user was present in the photography area from the start of photography to the completion of photography with the time information added to the photography data. , identifies at least one of the identification information and group information of users whose time information matches (time zones overlap), and transmits it to the operation device OPT.

Then, as the process of step S940, the processing unit 31 of the operation device OPT uses at least one of the identification information and group information received from the shooting management device CNT as key information to link the user's identification information and the user's group information. It is also possible to search the photographic data stored in the storage section 32 at the same time.

In addition, as another usage, the identification information of a specific user is transmitted from the operation device OPT to the photography management device CNT, and the processing unit 21 of the photography management device CNT receives the identification information of the specific user received from the management device OPT. Using this as key information, information on the time that the particular user was present in the photographing area is acquired from the database DB of the storage unit 22. Then, the processing unit 21 combines the time information and identification information and transmits the combination to the operation device OPT. The information obtained by combining the time information and the identification information may be displayed on the display device of the operating device OPT, or may be configured to be outputtable from the operating device OPT. This makes it easy for the operator using the operating device OPT to compare and check the information obtained by combining the acquired time information and identification information with the time information of the photographed data.

(Driving area guidance processing and inter-vehicle distance adjustment processing for multiple vehicles)
The photographing management device CNT sets the plurality of vehicles 1A, 1B in front of the photographing area based on the comparison between the position information acquired from the user's terminal device SP (or the plurality of vehicles 1A, 1B) and the map information. It is determined whether the vehicle is traveling through a predetermined preparation area or a photographing area. Then, the photographing management device CNT transmits area guidance information based on the determination result to each user's terminal device SP and the plurality of vehicles 1A and 1B. The area guide information is displayed on the display unit of the terminal device SP and the display device 17 of each vehicle.

For example, the shooting management device CNT may display text information such as "Preparation area soon", "Shooting area soon", "Running in the shooting area", "Passing the shooting area", etc. as area guide information, depending on the location information. The information is transmitted to the terminal device SP of each user and the plurality of vehicles 1A and 1B. Area guide information is not limited to text information, and icons such as figures and symbols can be switched and displayed for each area. Further, it is also possible to display guide information for an area by switching blinking, lighting/extinguishing, and display color of indicators provided on the display unit of the terminal device SP and the display device 17 of each vehicle for each area.

By checking the area guidance information displayed on the display unit of the terminal device SP and the display device 17 of each vehicle, the user can visually check which area the vehicle is currently traveling in. .

Further, the photographing management device CNT checks the inter-vehicle distance when the plurality of vehicles 1A, 1B travel in the photographing area or a predetermined preparation area set in front of the photographing area, and determines the inter-vehicle distance (predetermined) suitable for photographing. The notification information is transmitted to each user's terminal device SP and the plurality of vehicles 1A and 1B so that the distance falls within the reference distance range of .

When the inter-vehicle distance exceeds the upper limit distance of a predetermined reference distance range, a distance notification signal is sent to each user's terminal device SP and to the plurality of vehicles 1A and 1B to notify that the inter-vehicle distance is too wide. to notify the users of each vehicle.

For example, when the inter-vehicle distance is too wide, the photographing management device CNT transmits text information such as "Please come a little closer" to each user's terminal device SP and the plurality of vehicles 1A and 1B as a distance notification signal. The display of the distance notification signal is not limited to displaying text information, but icons such as figures and symbols can also be displayed according to the distance between vehicles. Further, it is also possible to display indicators provided on the display unit of the terminal device SP and the display device 17 of each vehicle by switching blinking, lighting/extinguishing, and display color according to the inter-vehicle distance.

Further, when the inter-vehicle distance is less than or equal to the lower limit of a predetermined reference distance range, an approach notification signal is sent to each user's terminal device SP, the plurality of vehicles 1A, 1B to notify the users of each vehicle.

For example, when the distance between the vehicles is too close, the photographing management device CNT transmits text information such as "Please move a little further away" to each user's terminal device SP and the plurality of vehicles 1A and 1B as an approach notification signal. Similar to the distance notification signal, the display of the approach notification signal is not limited to the display of text information, but it is also possible to display icons such as figures and symbols according to the distance between vehicles. Further, it is also possible to display indicators provided on the display unit of the terminal device SP and the display device 17 of each vehicle by switching blinking, lighting/extinguishing, and display color according to the inter-vehicle distance.

FIG. 6 is a diagram illustrating the flow of a process for adjusting inter-vehicle distances between a plurality of vehicles. In step S600, while the plurality of vehicles 1A and 1B are traveling, the determination unit 210 acquires the position information of the subject terminal device SP (or vehicles 1A and 1B), and based on the comparison between the position information and the map information, It is determined whether the plurality of vehicles 1A and 1B are traveling in a predetermined preparation area set in front of the photographing area or in the photographing area.

In step S605, the signal generation unit 220 generates area guidance information based on the determination result, and the communication control unit 230 transmits the area guidance information to each user's terminal device SP and the plurality of vehicles 1A and 1B.

In step S610, the determination unit 210 obtains the inter-vehicle distance between the plurality of vehicles 1A and 1B based on the position information. For example, the determination unit 210 can obtain the inter-vehicle distance based on the difference in position information.

In step S620, when determining that the acquired inter-vehicle distance exceeds the upper limit distance of the predetermined reference distance range (S620-Yes), the determination unit 210 advances the process to step S630.

In step S630, the signal generation unit 220 generates a distance notification signal that notifies the user that the inter-vehicle distance exceeds the upper limit distance of the reference distance range. Then, in step S640, the communication control unit 230 transmits a distance notification signal to each user's terminal device SP and the plurality of vehicles 1A and 1B. If the distance between vehicles is too wide, it may not be possible to shoot multiple users at the same time when driving in the shooting area, so the distance that alerts you that the distance between vehicles exceeds the upper limit of the standard distance range. By transmitting a notification signal to multiple vehicles and notifying the user, it becomes possible to encourage the user to shorten the distance between vehicles.

Further, in the determination in step S620, if the acquired inter-vehicle distance does not exceed the upper limit distance of the predetermined reference distance range (S620-No), the determination unit 210 advances the process to step S650.

In step S650, if the determination unit 210 determines that the acquired inter-vehicle distance is not equal to or less than the lower limit of the reference distance range (S650-No), the determination unit 210 returns the process to step S600 and repeats the same process. . In this case, the inter-vehicle distance between the plurality of vehicles 1A and 1B is an inter-vehicle distance suitable for photographing (distance that falls within a predetermined reference distance range), and no notification signal (distance notification signal, approach notification signal) is generated. Continuously executes the following distance check process.

On the other hand, if it is determined in step S650 that the acquired inter-vehicle distance is equal to or less than the lower limit of the predetermined reference distance range (S650-Yes), the determination unit 210 advances the process to step S660.

In step S660, the signal generation unit 220 generates an approach notification signal that notifies the user that the inter-vehicle distance is less than or equal to the lower limit of the reference distance range.

Then, in step S670, communication control unit 230 transmits an approach notification signal to a plurality of vehicles. If the distance between vehicles is too close, multiple users may overlap when driving in the shooting area and may not be able to take pictures at the same time. Therefore, an approach notification is used to notify that the distance between vehicles is less than the lower limit of the standard distance range. By transmitting a signal to multiple vehicles and notifying the user, it is possible to encourage the user to increase the distance between vehicles.

(Adjustment process for speed differences between multiple vehicles)
The photographing management device CNT checks the speed difference between the plurality of vehicles 1A and 1B when they travel in the photographing area or a predetermined preparation area set in front of the photographing area, and determines the speed difference suitable for photographing. (below a predetermined reference speed), a speed notification signal is transmitted to a plurality of vehicles.

FIG. 7 is a diagram illustrating the flow of adjustment processing for speed differences between a plurality of vehicles. In step S700, the determination unit 210 acquires speed information of the plurality of vehicles 1A and 1B traveling in the shooting area or a predetermined preparation area set in front of the shooting area. In step S710, the determination unit 210 obtains the speed difference between the plurality of vehicles 1A and 1B based on the speed information of the plurality of vehicles 1A and 1B. For example, the determination unit 210 can obtain the speed difference between vehicles based on the difference in speed information.

In step S720, if the acquired speed difference does not exceed the reference speed (S720-No), the determination unit 210 returns the process to step S700 and repeats the same process. In this case, the speed difference between the plurality of vehicles 1A and 1B is a speed difference suitable for photographing (below a predetermined reference speed), and the speed difference checking process is continuously executed without generating a speed notification signal. .

On the other hand, if it is determined in step S720 that the speed difference exceeds the predetermined reference speed (S720-Yes), the determination unit 210 advances the process to step S730.

In step S730, the signal generation unit 220 generates a speed notification signal that notifies the user that the speed difference exceeds the reference speed.

Then, in step S740, the communication control unit 230 transmits a speed notification signal to the plurality of vehicles 1A and 1B.

If the speed difference exceeds the standard speed, there is a possibility that multiple users cannot be photographed at the same time when driving through the shooting area, so a speed notification signal is sent to multiple vehicles to notify them that the speed difference exceeds the standard speed. By transmitting and notifying the user, it is possible to urge the user to reduce the speed difference.

(Other embodiments)
The present invention supplies a program that realizes the functions of the above-described embodiments to a photography management system or device (photography management device, operation device) via a network or a storage medium, and It can also be realized by a process in which one or more processors in a computer (operating device) read and execute a program.

The invention is not limited to the above-described embodiments, and various modifications and changes can be made within the scope of the invention.

1A, 1B: Vehicle, DRN: Unmanned aerial vehicle, 200a, 200b: Photographing device,
201: Communication interface unit (communication I/F), 202: Specification unit,
203: Photography control unit, 207: Flight control unit, CNT: Photography management device,
210: determination unit, 220: signal generation unit, 230: communication control unit,
OPT: Operation device, 340: Image processing section, 350: Image judgment section

Claims (20)

A photography management system comprising: a user's terminal device; a photography management device that manages photography by a user who moves in a mobile body; and an operation device that communicates with the photography management device in order to perform the photography.
The terminal device is
Group information that sets the user alone or a plurality of users including at least the user as a shooting target, and identification information that identifies a combination of the user set in the group information and the mobile object used by the user. comprising a communication means for transmitting to the photographing management device before photographing,
The photographing management device includes:
storage means for registering the identification information and the group information;
The position information of each user's terminal device set in the group information is acquired by the communication means, and when the terminal device is located at least within the photographing area for performing the photographing, the position information is registered in the storage means. photographing management processing means for transmitting the identification information and the group information, and the position information to the management device;
A shooting management system comprising: 2. The photographing management system according to claim 1, wherein the identification information includes information specifying the external appearance of the moving object and information specifying the external appearance of the user. The photographing management processing means compares the position information with map information including the photographing area, and transmits area notification information to the terminal device according to the position of the terminal device with respect to the photographing area. The photographing management system according to claim 1 or 2. When the photographing management processing means determines, based on the comparison, that at least one of the plurality of moving objects has entered the photographing area or a predetermined preparation area set in front of the photographing area,
The photographing management processing unit according to claim 3, wherein the photographing management processing means generates area notification information for notifying the user that he/she has entered the photographing area or the preparation area, and transmits it to the terminal device. system. The photographing management processing means includes:
The distance between vehicles of a plurality of moving objects traveling in the photographing area or a predetermined preparation area set in front of the photographing area is obtained based on the position information, and the distance between vehicles is the upper limit of a predetermined reference distance range. If it is determined that the
The photographing management processing means includes:
5. A distance notification signal is transmitted to the user's terminal device to notify the user that the inter-vehicle distance exceeds an upper limit distance of the reference distance range. Shooting management system described in . The photographing management processing means includes:
The distance between vehicles of a plurality of moving objects traveling in the photographing area or a predetermined preparation area set in front of the photographing area is obtained based on the position information, and the distance between vehicles is the lower limit of a predetermined reference distance range. If it is determined that:
The photographing management processing means includes:
5. The vehicle according to claim 1, further comprising: transmitting an approach notification signal to the user's terminal device to notify the user that the inter-vehicle distance is less than or equal to the lower limit of the reference distance range. Photography management system described. The photographing management processing means compares the position information with map information including the photographing area, and when it is determined that the moving object has left the photographing area, or when the operation device indicates that the photographing has been completed. The photographing management system according to any one of claims 1 to 4, wherein when the information is received, transmission of the identification information, the group information, and the position information to the management device is stopped. The photographing management processing means measures the time information of each user by linking the time information existing in the photographing area with the identification information of each user, and combines the time information and the identification information using a time measuring means that measures time. The photographing management system according to any one of claims 1 to 7, wherein the photographic information is stored in the storage means. The operating device is
an operation processing means for generating a control signal for controlling the photographing device in a manual photographing mode based on an operator's operation or in an automatic photographing mode based on the identification information, the group information, and the position information;
Storage means for storing photographic data photographed by the photographing device,
The management processing means is
In response to a request from the user of the terminal device, an image search is performed based on the user's identification information and information on the time that the user was present in the photographing area, and the photographic data of the user is retrieved from the terminal device. 2. The photographing management system according to claim 1, wherein the photographing management system distributes the photographic information to the following. The management processing means is
an image processing unit that performs image processing to extract the user's face from photographic data photographed by the photographing device;
further comprising image determining means for determining whether or not faces for the number of users set in the group information have been photographed based on the result of the image processing,
The management processing means is
10. The photographing management system according to claim 9, wherein the automatic photographing mode is changed to the manual photographing mode when faces corresponding to the number of users set in the group information are not photographed. The operating device is
comprising an operation processing means for generating a control signal for controlling the photographing device in a manual photographing mode based on an operator's operation or in an automatic photographing mode based on the identification information, the group information, and the position information;
2. The operation processing means, when a plurality of photographing targets specified by the group information are present in the photographing area, displays each of the photographing targets in a different display format on a display device. shooting management system. When a plurality of photographing targets specified by the group information exist in the photographing area, the management processing means generates discrimination information for distinguishing between the photographic targets in the manual photographing mode and the photographic targets in the automatic photographing mode. 12. The photographing management system according to claim 9, wherein the photographing management system displays on a display device. When the photographing target specified by the group information is composed of a plurality of users, the management processing means transmits the inter-vehicle distance of the moving body used by each user to the terminal device of each user that has received it from the photographing management device. 13. The photographing management system according to claim 11 or 12, wherein the photographing management system acquires and displays the acquired position information based on a difference in position information. The photography management system according to any one of claims 11 to 13, wherein the management processing means acquires and displays vehicle speed information based on time changes in position information received from the photography management device. . A photographing management device for photographing a user moving in a mobile body,
Identification that combines group information that sets the user alone or a plurality of users including at least the user as a photographing target, appearance information of the user set in the group information, and vehicle information of a moving body used by the user. information, and a storage means for registering the information before shooting;
The location information of each user's terminal device set in the group information is acquired, and when the terminal device is located at least within the shooting area for performing the shooting, the identification information and the group information, and the a photographing management processing means for transmitting the position information to an operating device that communicates with the photographing management device in order to perform the photographing;
A photography management device comprising: An operating device for photographing a user moving in a mobile body,
Group information that sets the user or a plurality of users including at least the user as the shooting target, which is transmitted from the user's terminal device to the shooting management device, and the user set in the group information and the use of the user. communication means for receiving from the photographing management device identification information for identifying a combination with a mobile object and position information of each user's terminal device set in the group information,
The operating device is characterized in that the communication means receives the identification information, the group information, and the position information when the terminal device is located at least within a photographing area for performing the photographing. A method of controlling a photographing management device for photographing a user who moves in a mobile body, the method comprising:
The storage means includes group information in which the user or a plurality of users including at least the user is set as a photographing target, appearance information of the user set in the group information, and vehicle information of a moving body used by the user. identification information that combines the information, and a storage process that registers the information before photographing.
The photographing management processing means acquires the position information of the terminal device of each user set in the group information, and when the terminal device is located at least within the photographing area for performing the photographing, the photographing management processing means acquires the position information of the terminal device of each user set in the group information and stores the identification information and a photographing management processing step of transmitting the group information and the position information to an operating device that communicates with the photographing management device in order to perform the photographing;
1. A method of controlling a photographing management device, comprising: A method of controlling an operating device for photographing a user moving in a mobile body, the method comprising:
Identification by which the communication means identifies a combination of group information in which a single user or a plurality of users including at least the user is set as a photographing target, and a user set in the group information and a mobile object used by the user. information and location information of each user's terminal device set in the group information when the location information is located at least within a shooting area for performing the shooting. A method for controlling operating equipment. A program that causes a computer to execute each step of a method for controlling a photographing management device for photographing a user who moves in a mobile body, the control method comprising:
The storage means includes group information in which the user or a plurality of users including at least the user is set as a photographing target, appearance information of the user set in the group information, and vehicle information of a moving object used by the user. identification information that combines the information, and a storage process that registers the information before photographing.
The photographing management processing means acquires the position information of the terminal device of each user set in the group information, and when the terminal device is located at least within the photographing area for performing the photographing, the photographing management processing means acquires the position information of the terminal device of each user set in the group information and stores the identification information and a photographing management processing step of transmitting the group information and the position information to an operating device that communicates with the photographing management device in order to perform the photographing;
A program characterized by having. A program that causes a computer to execute steps of a control method for an operating device for photographing a user who moves in a mobile body, the control method comprising:
Identification by which the communication means identifies a combination of group information in which a single user or a plurality of users including at least the user is set as a photographing target, and a user set in the group information and a mobile object used by the user. information and location information of each user's terminal device set in the group information when the location information is located at least within a shooting area for performing the shooting. program to do.

Images