JP2019146074A - Imaging system and imaging control device - Google Patents

Abstract

To move a moving body, having an imaging device loaded thereon, to a user position according to a request from the user, to easily perform commemorative photography.SOLUTION: An imaging system includes: a moving body having a camera loaded thereon; and an imaging control device which controls the moving body according to operation information from the terminal operated by the use. The imaging control device moves the moving body to a place corresponding to the terminal position, to and compares the terminal identification information, received from the terminal, with identification information included in a radio wave received by the moving body from the terminal, to identify the user. If the user cannot be identified by the comparison of the identification information, the imaging control device acquires the face image of the user from the terminal, and collates the image captured by the camera with the face image to identify the user from the captured image, so as to control the camera to image the identified user.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging system and an imaging control device.

  In theme parks, staff take pictures of visitors in sequence, and the printed photos are pasted on original mounts and sold to visitors. It was easy for the staff to shoot and create interesting poses and compositions.

  In a tourist spot, a theme park, a stadium where events such as sports and concerts are held, a commemorative photographing system for automatically photographing a person and a background landscape may be installed. However, in order to take a commemorative photo, the user has to move to the place where the commemorative photo system is installed, which is troublesome.

  In recent years, flying cameras that perform aerial photography, such as so-called drones, and movable robots equipped with cameras are becoming popular. There is a need for a service that makes it easy to take a commemorative photo using such a moving imaging device.

JP 2007-367798 A

  It is an object of the present invention to provide a photographing system and a photographing control device that perform a commemorative photographing when a moving body equipped with a photographing device moves to a user in response to a request from a user.

  An imaging system according to the present invention is an imaging system comprising: a moving body equipped with a camera; and an imaging control device that controls the moving body based on operation information from a terminal operated by a user. The apparatus moves the mobile body to a location corresponding to the position of the terminal, and compares the identification information of the terminal received from the terminal with the identification information included in the radio wave received from the terminal by the mobile body. If the user cannot be identified from the comparison of the identification information, the user's face image is acquired from the terminal, the captured image of the camera and the face image are collated, The user is identified from the photographed image, and the camera is controlled to photograph the identified user.

  In one embodiment of the present invention, the moving body is provided with a display unit that displays a captured image of the camera.

  In one aspect of the present invention, the photographing control device receives a photographed image of the camera from the moving body and causes the display device to display the photographed image.

  In one embodiment of the present invention, the moving body is an airship or a drone.

  In one embodiment of the present invention, a wheel is provided at the bottom of the movable body.

  In one aspect of the present invention, the moving body is a ship moving on water or a submarine moving in water.

  In one aspect of the present invention, the movable body has a conveyor lane for a rotating sushi counter.

  The imaging control apparatus of the present invention receives an application for imaging using a mobile object equipped with a camera from a terminal, and receives an identification information of the terminal, and obtains a user's face image from the terminal A facial image acquisition unit, a movement control unit that moves the moving body to a location corresponding to the position of the terminal, identification information of the terminal received from the terminal, and radio waves received from the terminal by the moving body When the user is identified by comparing the identification information included, and the user cannot be identified from the comparison of the identification information, the user's face image acquired from the terminal and the captured image of the camera are A user identification unit that collates and identifies the user from the photographed image, and a photographing control unit that controls the camera to photograph the identified user.

  According to the present invention, in response to a request from a user, a moving body equipped with an imaging device moves to the user, and commemorative photography can be easily performed.

(A) (b) is a schematic block diagram of the imaging | photography system which concerns on embodiment of this invention. It is a figure which shows the example of a face photography screen. It is a figure which shows the example of the operation screen of a terminal. It is a schematic block diagram of an imaging | photography control apparatus. It is a functional block diagram of a terminal. It is a schematic block diagram of a moving body. It is a flowchart explaining the imaging | photography method which concerns on the same embodiment. It is a schematic block diagram of the imaging | photography system which concerns on another embodiment. (A) (b) is a schematic block diagram of the imaging | photography system which concerns on another embodiment. (A) (b) is a schematic block diagram of the imaging | photography system which concerns on another embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  In the photographing system according to the embodiment of the present invention, when an application for commemorative photography is received from a user, a moving body equipped with a photographing device moves to the user and performs commemorative photography. In the present embodiment, as shown in FIGS. 1A and 1B, an imaging system that uses an airship 3 as a moving body and performs a commemorative photo of a user U in a spectator seat of a stadium will be described.

  A terminal 2 having a touch panel is installed in each spectator seat. When the user U operates the terminal 2 to apply for a commemorative photo, the airship 3 flies near the user U and takes a picture with the camera (imaging device) 31 mounted on the airship 3.

  The terminal 2 applies to the server device 1 functioning as a photographing control device for use of the commemorative photographing service and is included in the seat number where the terminal 2 is installed and the radio wave (for example, beacon signal) transmitted by the terminal 2 Identification information to be transmitted.

  The server device 1 notifies the airship 3 of the seat coordinates of the terminal 2. The airship 3 flies to the vicinity of the seat indicated by the received seat coordinates. The airship 3 floats in the air, for example, by filling it with helium gas, and is provided with a motor and a propeller so that thrust can be generated in each of the three axial directions of X, Y, and Z. The airship 3 autonomously flies to the target position by a combination of linear movement and the like.

  The airship 3 always transmits an image (video) taken by the camera 31 to the server device 1. In addition, the airship 3 is provided with a display unit 32 that displays a captured image of the camera 31. When the airship 3 flies to the position indicated by the seat information, it stops in the air and receives radio waves (signals) from the terminal 2. The terminal 2 that has applied for the commemorative photo continues to transmit radio waves, and the airship 3 notifies the server device 1 of the intensity of the received radio waves and the identification information included in the radio waves.

  The server device 1 determines whether or not the identification information received from the terminal 2 and the identification information notified from the airship 3 are the same. While changing the position of the airship 3, the server device 1 specifies the position of the seat where the user U is sitting based on the fluctuation of the radio wave reception intensity by the airship 3.

  When the airship 3 cannot receive radio waves from the terminal 2 or when the reception intensity is weak, the server device 1 instructs the terminal 2 to shoot a face image of the user U. The terminal 2 activates the built-in camera and displays a face photography guide screen as shown in FIG. The terminal 2 captures the face image of the user U with the built-in camera 20 and transmits the face image to the server device 1. The server device 1 performs face recognition processing using the face image of the user U received from the terminal 2 and identifies the user U from the camera video of the airship 3.

  The server device 1 notifies the terminal 2 that the user U has been specified. The terminal 2 displays the operation screen of the airship 3 on its own touch panel. The operation information input by the user U via the operation screen is transmitted to the server device 1. The server device 1 controls the airship 3 and the camera 31 based on the operation information.

  For example, the terminal 2 displays an operation screen as shown in FIG. On the operation screen, an image captured by the camera 31 of the airship 3 may be displayed in live view together with various operation buttons.

  By pressing various operation buttons, the airship 3 can be moved up and down and left and right around the position of the user U, and the shooting angle and zoom magnification of the camera 31 can be changed. When the user U confirms the composition with the video displayed on the display unit 32 and presses the shooting button B1 on the operation screen, the shutter operation of the camera 31 is performed, and the shooting process is executed. After the shooting process, the airship 3 returns to the base.

  Shooting image data (still images and moving images) is transmitted from the airship 3 to the server device 1. The captured image data may be stored in a memory provided in the airship 3, and the captured image data may be collected from the memory after returning to the base. The captured image data may be downloaded from the server device 1 using a user terminal such as a smartphone owned by the user U. Or you may sell the printed matter of a picked-up image in a goods department etc.

  Thus, according to the present embodiment, the user U can apply for a commemorative photo from the terminal 2 installed on the seat and perform a commemorative photo with the camera 31 of the airship 3. Because the photo is taken from the airship 3, a commemorative photo can be taken with a composition that cannot be taken with an instrument such as a tripod or a selfie stick. Since the position of the airship 3 and the angle of the camera 31 can be adjusted, the composition can be freely changed. By taking pictures from the air, you can also take commemorative pictures with many people. By displaying the captured image on the display unit 32 provided on the airship 3, the composition can be confirmed by all the groups.

  Next, the configuration of the server device 1 will be described. The server device 1 may be composed of a single computer or a plurality of computers. As illustrated in FIG. 4, the server device 1 includes a control unit 10, a storage unit M, and a communication unit C. The control unit 10 is a central processing unit (CPU) that controls the entire server device 1. The control unit 10 implements various functions by reading and executing an operating system (OS) and application programs stored in the storage unit M.

  The storage unit M is a storage area for storing programs and data necessary for the control unit 10 to execute various processes, and a hard disk, a semiconductor memory, or the like is used. The storage unit M includes a seat information DB (database) and a captured image DB.

  The seat information DB is a storage area for storing position information of each seat. The position information of each seat may be route information from the base of the airship 3 to the seat.

  The communication unit C communicates with the terminal 2 and the airship 3 via a network such as the Internet or a LAN.

  The control unit 10 has functions of a shooting application receiving unit 11, a face image acquiring unit 12, a user specifying unit 13, an operation information receiving unit 14, a shooting image receiving unit 15, a flight control unit 16, and a shooting control unit 17.

  The photographing application accepting unit 11 accepts a use application for the commemorative photographing service from the terminal 2. The photographing application reception unit 11 receives the seat number of the seat where the terminal 2 is installed and the identification information included in the radio wave transmitted by the terminal 2 together with the use application.

  The face image acquisition unit 12 requests and acquires the face image of the user U from the terminal 2 when the user U cannot be specified using the radio wave transmitted from the terminal 2.

  The user specifying unit 13 compares the identification information received from the terminal 2 with the identification information included in the radio wave received from the terminal 2 by the airship 3. If they match, the user specifying unit 13 adjusts the position of the airship 3 while adjusting the position. A change in reception intensity is detected, and the position of the terminal 2, that is, the user U is specified. When the identification information does not match, or when the radio wave reception intensity is a predetermined value or less, the user specifying method is changed to a method using a face image. The user specifying unit 13 compares the video captured by the camera 31 with the face image of the user U acquired by the face image acquisition unit 12, and specifies the user U from the camera video.

  The operation information receiving unit 14 notifies the terminal 2 that the user U has been specified, and then receives the operation information input from the user U from the terminal 2 via the operation screen displayed on the terminal 2. Receive. The operation information includes instructions for the position of the airship 3 and the shooting angle of the camera 31.

  The captured image receiving unit 15 receives the captured image (still image or video (moving image)) of the camera 31 from the airship 3. The photographed image receiving unit 15 stores still images and moving images (including flip-motion moving images including continuous still images) received from the airship 3 in the photographed image DB of the storage unit M.

  The flight control unit (movement control unit) 16 refers to the seat position information in the seat information DB, notifies the airship 3 of the movement route to the seat of the seat number received from the terminal 2, and instructs flight. The flight control unit 18 controls the position of the airship 3 based on operation information from the user U.

  The imaging control unit 17 adjusts the imaging angle (orientation) of the camera 31 so that the identified user U is within the imaging range. Further, the shooting control unit 19 controls the shooting angle of the camera 31 or causes the camera 31 to execute shooting processing based on operation information from the user U. You may enable it to adjust the brightness, contrast, etc. of the image picked up by the camera 31.

  FIG. 5 is a functional block diagram of the terminal 2 installed in each seat. The terminal 2 is, for example, a tablet terminal, and by executing an application program installed in the terminal in advance, a photographing application unit 21, a face image transmission processing unit 22, an operation screen display unit 23, as shown in FIG. And the operation information transmission part 24 is implement | achieved.

  The photographing application unit 21 applies to the server device 1 to use the commemorative photographing service. The photographing application unit 21 notifies the server device 1 of the seat number of the seat where the terminal is installed and the identification information included in the radio wave transmitted by the terminal.

  When the face image transmission processing unit 22 receives a request for the face image of the user U from the server device 1, the face image transmission processing unit 22 activates the built-in camera 20 of the terminal 2, photographs the user U, and sends the user U's face to the server device 1. Send an image.

  When the operation screen display unit 23 receives a notification that the user U has been specified from the server device 1, the operation screen display unit 23 displays an operation screen (see FIG. 3) including various operation buttons on the touch panel T. A camera image of the airship 3 may be received from the server device 1 and displayed live on the operation screen. Thereby, not only the display part 32 attached to the airship 3 but the terminal 2 at hand can confirm the image which the airship 3 image | photographed.

  The operation information transmission unit 24 transmits operation information input from the user U to the server device 1 via the operation screen.

  FIG. 6 is a schematic configuration diagram of the airship 3. The airship 3 includes a control unit 30, a camera 31, a display unit 32, a communication unit 33, a radio wave reception unit 34, and the like. The airship 3 is also provided with an electric motor, a propeller, a battery, etc., but illustration is omitted.

  The control unit 30 has functions of a positioning unit 301, a flight control unit 302, a camera control unit 303, a display processing unit 304, and an information transmission unit 305. The positioning unit 301 measures the position of the airship 3 from the rotation speed and flight time of each motor.

  The flight control unit 302 controls the rotation speed of each electric motor so that the airship 3 flies along the route information notified from the server device 1.

  The camera control unit 303 controls the shooting angle and zoom magnification of the camera 31.

  The display processing unit 304 displays the captured image of the camera 31 on the display unit 32. The display processing unit 304 controls the orientation and angle of the display unit 32 so that the display unit 32 faces the user U.

  The information transmission unit 305 transmits the photographing data from the camera 31, the identification information included in the radio wave received by the radio wave reception unit 34 from the terminal 2, the radio wave reception intensity, and the like to the server device 1 using the communication unit 33.

  Next, a commemorative photographing method using the photographing system according to the present embodiment will be described.

  The user U activates the application program of the terminal 2 and makes a use application for the commemorative photography service (step S1). Along with the use application, the number of the seat where the terminal 2 is installed and the identification information included in the radio wave transmitted by the terminal 2 are transmitted to the server device 1.

  The server device 1 determines whether to accept the application. For example, when the number of reservations for taking a commemorative photo has reached a predetermined number, or when the airship 3 is not usable, the application is not accepted (step S2_No).

  When the server device 1 accepts the application (step S2_Yes), the route information to the seat is transmitted to the airship 3 to give a flight instruction, and the airship 3 is dispatched to the user U (step S3).

  When the airship 3 moves to the position designated by the server device 1, it receives the radio wave transmitted from the terminal 2 and notifies the server device 1 of the received intensity and the identification information included in the radio wave. The server device 1 compares the identification information received from the terminal 2 in step S1 with the identification information notified from the airship 3. If the comparison results match, it is determined that the user U has been identified (step S4_Yes).

  If the comparison result does not match or the radio wave reception intensity is a predetermined value or less, the server device 1 determines that the user U cannot be identified by the radio wave from the terminal 2 (step S4_No), and the user is informed to the terminal 2 Request U's face image. The terminal 2 captures the user U and transmits a face image to the server device 1 (step S5).

  The server device 1 collates the face of the person shown in the camera image of the airship 3 with the face image of the user U. When the user U is specified (step S4_Yes, step S6_Yes), the server apparatus 1 notifies the terminal 2 that the user has been specified.

  The terminal 2 displays an operation screen including various operation buttons. The operation information input by the user U via the operation screen is given to the airship 3 via the server device 1. The user U adjusts the position of the airship and the direction of the camera 31 while confirming the image displayed on the display unit 32 of the airship 3, and designates the composition (step S7).

  When the photographing process by the camera 31 is performed (step S8), the airship 3 flies autonomously to the base and returns (step S9).

  The user can call the airship 3 using the terminal 2 and take a commemorative photo. Since the position of the airship 3 and the angle of the camera 31 can be adjusted, the composition can be freely changed. By displaying the captured image on the display unit 32 provided on the airship 3, the composition can be confirmed by all the groups.

  In the above embodiment, an example in which a captured image of the airship 3 is displayed on the display unit 32 mounted on the airship 3 has been described. However, the image may be displayed on a large display installed in the stadium. In this case, the server device 1 displays the image captured by the airship 3 on the large display.

  Instead of the airship 3, a drone that is a quadcopter using four rotor blades for takeoff and propulsion may be used. When the stadium is outdoors, the drone may specify its own position by radio waves from GPS and autonomously fly to a location indicated by the GPS coordinates of the seat where the terminal 2 is installed. For example, it is possible to fly to each seat by using a signal from a quasi-zenith satellite system composed of geostationary satellites.

  The moving body that moves to the user and shoots is not limited to a flying object such as an airship 3 or a drone. For example, a robot 3A having an omnidirectional movement mechanism having an omni wheel at the bottom as shown in FIG. 8 may be used. A camera 31 and a display unit 32 are mounted on the robot 3A. For example, a terminal 2 is installed at each table in the party venue, and the user operates the terminal 2 to apply for a commemorative photo. The robot 3A moves to the table where the terminal 2 that has applied for the commemorative photo is installed and performs the commemorative photo. The video taken by the camera 31 may be displayed on a large display in the venue.

  The moving body may be a small ship 3B as shown in FIG. A waterproof camera 31 and a display unit 32 are installed on the ship 3B. For example, as shown in FIG. 9B, the terminal 2 is installed at the peripheral edge of the pool P, and the user operates the terminal 2 to apply for a commemorative photo. The ship 3B sails to the position of the terminal 2 that applied for the commemorative photo, and performs the commemorative photo.

  It may be a submarine type that moves underwater instead of a ship type that sails on water.

  As shown in FIG. 10 (a), a camera 31 and a display unit 32 are installed on the plate D, and as shown in FIG. 10 (b), the plate D is moved by the conveyor lane L2 of the rotating sushi counter. May be. In the conveyor lane L1, dishes with sushi go around the store. Terminals 2 are installed at each table in the store, and the user operates the terminal 2 to apply for a commemorative photo. In the conveyor lane L2, the dish D is moved to the table on which the terminal 2 that has applied for the commemorative photo is installed, and the commemorative photo is taken.

  In the above-described embodiment, an example of applying for a commemorative photo using the terminal 2 installed in a seat or the like has been described. It may be.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 Server device 2 Terminal 3 Airship 3A Robot 3B Ship

Claims (8)

A moving body equipped with a camera;
An imaging control device for controlling the moving body based on operation information from a terminal operated by a user;
A photographing system comprising:
The imaging control apparatus moves the moving body to a location corresponding to the position of the terminal, and receives identification information of the terminal received from the terminal, and identification information included in a radio wave received from the terminal by the moving body, If the user cannot be specified from the comparison of the identification information, the user's face image is obtained from the terminal, and the captured image of the camera and the face image are obtained. An imaging system comprising: collating, identifying the user from the captured image, and controlling the camera so as to capture the identified user.   The photographing system according to claim 1, wherein the moving body is provided with a display unit that displays a photographed image of the camera.   The photographing system according to claim 1, wherein the photographing control device receives a photographed image of the camera from the moving body and displays the photographed image on a display device.   The imaging system according to claim 1, wherein the moving body is an airship or a drone.   The imaging system according to any one of claims 1 to 3, wherein a wheel is provided at a bottom of the moving body.   The imaging system according to claim 1, wherein the moving body is a ship moving on water or a submarine moving in water.   The photographing system according to claim 1, wherein the moving body has a conveyor lane of a rotating sushi counter. While accepting an application for photographing using a mobile body equipped with a camera from a terminal, a photographing application accepting unit that receives identification information of the terminal;
A face image acquisition unit for acquiring a user's face image from the terminal;
A movement control unit that moves the moving body to a location corresponding to the position of the terminal;
The identification information of the terminal received from the terminal and the identification information contained in the radio wave received from the terminal by the mobile unit are identified to identify the user, and the user is identified from the comparison of the identification information If not, the user's face image acquired from the terminal and the captured image of the camera are collated, and a user specifying unit that specifies the user from the captured image,
A shooting control unit that controls the camera to shoot the identified user;
An imaging control apparatus comprising:

Images