JP6196403B2 - Imaging system and program - Google Patents

Description

  The present disclosure relates to an imaging system.

In recent years, with the spread of camera-equipped mobile phones and inexpensive and small digital cameras, so-called self-photographing has been widely performed by photographers.
In order to take a photo that cannot be taken by a general photographer's camera, in the aquarium, a camera for photographing guests outside the aquarium through the aquarium is placed in the aquarium, and the camera is remotely controlled. An imaging system for imaging a guest outside the aquarium is also known (see, for example, Patent Document 1).

Japanese Patent Laying-Open No. 2015-144369

  By the way, when people see a magnificent landscape, they often want to take a picture of this magnificent landscape with themselves. However, since the distance from the camera to the photographer is short in the self-photographing, it is difficult to fit a magnificent landscape in the frame. Therefore, it is difficult for the photographer to take a photo that satisfies the photographer.

  On the other hand, when shooting with a camera using a tripod, it is possible to shoot a camera with a magnificent landscape within the frame, rather than when the photographer takes a camera with his / her hand without using a tripod. it can. However, shooting using a tripod requires the photographer to carry the tripod. That is, remote shooting using a tripod is not easy for the general public.

  In addition, there is a limit to fit a spectacular landscape within the frame even when performing remote photography using a tripod. Furthermore, when a magnificent landscape is put in a frame and taken by a camera, a person is taken with a small and low resolution.

  Therefore, according to one aspect of the present disclosure, it is desirable to be able to provide a technique capable of generating captured image data that can clearly recognize a subject in a magnificent background.

  An imaging system according to one aspect of the present disclosure includes a camera, a storage unit, and an image processing unit. The camera captures a subject according to a command from the remote control device, and generates image data representing a captured image of the subject. The storage unit stores background image data representing a captured image of a background that is wider than the background of the subject that can be captured by the camera. The background image data may be background image data generated by photographing a wide background for each section.

  The image processing unit arranges the photographed image of the subject on the wide background by combining the photographed image of the subject represented by the image data generated by the camera with the photographed image of the background represented by the background image data stored in the storage unit. It is configured to generate composite image data.

According to this photographing system, it is possible to photograph a target subject with a camera at high resolution, and to generate composite image data including a magnificent background around the subject using the photographed image data. Therefore, according to this photographing system, it is possible to generate image data that can clearly recognize a subject in a magnificent background.

  According to one aspect of the present disclosure, the image processing unit uses the composite image data, and includes moving image data that includes at least one of a moving image data in which a subject is captured and a moving image that zooms in on the subject and a moving image that zooms out from the subject, In addition, at least one of still image data sets that are still image data in which a subject is captured and that is a set of still image data having different angles of view may be generated as processed image data.

  According to one aspect of the present disclosure, for example, by providing the processed image data described above to a user corresponding to a subject, the captured image data of a subject that is easy to handle or enjoy for the user is provided to the user corresponding to the subject. be able to.

  According to one aspect of the present disclosure, the imaging system may include a communication unit that is connected to the camera and that transmits image data generated by the camera to the image processing unit through a wide area network. The image processing unit may be arranged apart from the camera together with the storage unit. The image processing unit may be configured to acquire image data generated by a camera through a wide area network, and generate composite image data using the acquired image data and background image data stored in the storage unit.

  According to one aspect of the present disclosure, a common image processing unit may be provided for cameras installed in a plurality of shooting locations. The image processing unit may be configured to acquire image data from a camera at each shooting location through a wide area network.

  According to another aspect of the present disclosure, a group of cameras that operate according to a command from a remote control device, capture a subject together with a background, and generate narrow-area image data that is still image data representing the captured image. A wide-area camera and one or more wide-area cameras that capture a wide-area background than the background captured by the narrow-area camera together with the subject and generate wide-area image data that is still image data representing the captured image. An imaging system including a group and an image processing unit may be provided.

  The image processing unit uses the narrow-area image data and the wide-area image data generated by a group of cameras, and includes at least one of a moving-image data in which the subject is captured and a moving-image that zooms in on the subject and a moving-image that zooms out from the subject Data and at least one of still image data that is a set of still image data with different angles of view, which is still image data in which the subject is captured, may be generated as processed image data. Even with this photographing system, it is possible to generate image data that allows a subject to be clearly recognized in a magnificent background.

  The photographing system includes a communication unit that is connected to the group of cameras and transmits the narrow area image data and the wide area image data generated by the group of cameras to the image processing unit through the wide area network. May be. The image processing unit is arranged apart from the group of cameras, acquires the narrow area image data and the wide area image data generated by the group of cameras through the wide area network, and acquires the acquired narrow area image data and the wide area image data May be used to generate the processed image data.

The image processing unit may be configured to distribute the processed image data to at least one of the user terminal associated with the subject and the remote operation device. The remote control device may be a communication terminal possessed or owned by a user corresponding to the subject. In this case, the image processing unit may be configured to distribute the generated processed image data to the communication terminal. The image processing unit may be configured to store the processed image data in a server device accessible by a user corresponding to the subject.

  In order to restrict the use of the imaging system, the imaging system may be configured to issue an authentication code to a user corresponding to the subject. For example, the photographing system issues an authentication code to a user corresponding to the subject, and receives an instruction from the remote operation device on condition that the issued authentication code is input, and activates the camera. It can be set as the structure provided with. The camera may be configured to operate under the control of the operation control unit and to capture a subject.

The functions as the operation control unit and the image processing unit may be realized by a common server device.
According to one aspect of the present disclosure, a program for causing a computer to realize the function as the image processing unit included in the imaging system may be provided. According to one aspect of the present disclosure, a program for causing a computer to realize the function as the operation control unit included in the imaging system may be provided. According to one aspect of the present disclosure, a computer-readable non-transitory recording medium that stores one or more of these programs may be provided.

It is a figure explaining the camera arrangement | positioning with respect to an imaging | photography spot. It is a figure explaining the relationship of the imaging region between cameras. It is a block diagram showing the structure of an imaging | photography system. It is a flowchart showing the process which a guidance apparatus performs. It is a flowchart showing the imaging | photography control processing which a service provision system performs. It is the figure explaining the transition of the screen displayed on the display of a user terminal. It is a flowchart showing the delivery preparation process which a service provision system performs. It is a flowchart showing the process which the control apparatus of a camera side system performs. It is a figure explaining the production | generation method of moving image data. It is a figure which illustrates animation content. It is a flowchart showing the delivery process which a service provision system performs. It is a block diagram showing the structure of the camera side system in 2nd embodiment. It is a flowchart showing the process which the control apparatus of the camera side system performs in 2nd embodiment. It is a flowchart showing the delivery preparation process which a service provision system performs in 2nd embodiment. It is a block diagram showing the structure of the camera side system of 3rd embodiment. It is a flowchart showing the process which the control apparatus of the camera side system performs in 3rd embodiment. It is explanatory drawing regarding the production | generation method of the synthetic image data in 3rd embodiment. It is a flowchart showing the delivery preparation process which a service provision system performs in 3rd embodiment. It is a figure explaining the production | generation method of the moving image data in 3rd embodiment.

Exemplary embodiments of the present disclosure are described below with reference to the drawings.
[First embodiment]
The photographing system 1 of the present embodiment generates photographed image data (moving image / still image) that can clearly recognize a user who is a subject in a magnificent landscape at a sightseeing spot, a scenic spot, and the like, and provides it to the user. It is a configured system.

  As shown in FIG. 1, the photographing system 1 includes a guide device 10 for guiding the user to use the photographing system 1 in the vicinity of the photographing spot Z, and from the photographing spot Z to photograph the user. A plurality of cameras 21, 22 and 23 are provided at remote locations. The guide device 10 is installed so as not to stand out at a position slightly away from the shooting point, which is the user's standing position at the time of shooting.

  The plurality of cameras 21, 22, and 23 are installed so that the background area size photographed together with the subject TR is different between the cameras 21, 22, and 23. For example, the plurality of cameras 21, 22, and 23 are fixedly arranged at different distances from the subject TR as shown in FIGS. 1 and 2.

  According to the example shown in FIG. 2, among the plurality of cameras 21, 22, and 23, the first camera 21 is disposed at a position closest to the subject TR, and the second camera 22 is more subject TR than the first camera 21. The third camera 23 is disposed at a position further away from the subject TR than the second camera 22 is. The second camera 22 is arranged so that a background wider than the background including the background photographed by the first camera 21 can be photographed. The third camera 23 is arranged so that a background wider than the background including the background photographed by the second camera 22 can be photographed. The arrows shown in FIG. 2 conceptually indicate the relationship between the shooting ranges of the first camera 21, the second camera 22, and the third camera 23.

  According to the example shown in FIG. 2, these cameras 21, 22, and 23 are fixed to a tripod. Preferably, these cameras 21, 22, and 23 are installed so that other cameras 21, 22, and 23 do not appear in the captured image by adjusting the height, direction, angle of view, magnification, and the like of the lens. The

  In the present embodiment, each of the cameras 21, 22, and 23 is connected to an individual control device 30. The control device 30 controls the corresponding cameras 21, 22, and 23 according to the imaging command transmitted remotely, causes the cameras 21, 22, and 23 to perform imaging operations, and obtains still image data representing the captured images. , Configured to transmit to the service providing system 60 (see FIG. 3). The service providing system 60 manages the photographing system 1 and provides various services to the user.

  In the following, still image data representing an image captured by the first camera 21 is also expressed as first camera image data, still image data representing an image captured by the second camera 22 is also expressed as second camera image data, Still image data representing an image captured by the three cameras 23 is also expressed as third camera image data. When the first camera image data, the second camera image data, and the third camera image data are not distinguished, they are simply expressed as camera image data.

  As shown in FIG. 3, the control device 30 includes a processing unit 31, a storage unit 32, a wireless communication unit 33, and a connection unit 34. The processing unit 31 includes a CPU and a RAM (not shown), and executes processing according to a program stored in the storage unit 32. The storage unit 32 is configured by an auxiliary storage device such as a hard disk device, and stores a program executed by the processing unit 31 and data used for execution of the program. The wireless communication unit 33 is a communication interface capable of bidirectional communication with the service providing system 60 through the wide area network NT. The wide area network NT includes a cellular network.

The connection unit 34 is an interface for connecting the cameras 21, 22 and 23 to the control device 30. The connection unit 34 is configured by a USB interface, for example. The connection of the cameras 21, 22, 23 to the control device 30 through the connection unit 34 means that the processing unit 31 controls the cameras 21, 22, 23 and acquires camera image data from the cameras 21, 22, 23. to enable. Hereinafter, a group of the cameras 21, 22, 23 and the control device 30 that are arranged at a distance to capture a user of the shooting spot Z is also referred to as a camera-side system 40.

As shown in FIG. 3, the guidance device 10 installed around the photographing spot Z is also configured to be capable of bidirectional communication with the service providing system 60 through the wide area network NT.
As shown in FIG. 3, the guide device 10 includes a processing unit 11, a storage unit 12, a wireless communication unit 13, a display 15, and an input unit 17. The processing unit 11 includes a CPU and a RAM (not shown), and executes processing according to a program stored in the storage unit 12. The storage unit 12 stores a program executed by the processing unit 11 and data used for execution of the program. The wireless communication unit 13 is configured to be capable of bidirectional communication with the service providing system 60 through the wide area network NT.

  The display 15 is controlled by the processing unit 11 and configured to display a guidance screen to the user. The display 15 is configured by, for example, a liquid crystal display. The input unit 17 is configured to accept a user operation on the guidance device 10. The input unit 17 is configured by a touch panel on the display 15, for example.

  In this guide device 10, when an operation from the user is received through the input unit 17, the processing unit 11 executes the processing shown in FIG. When the processing unit 11 starts the process shown in FIG. 4, various guidance screens are displayed on the display 15 in accordance with an operation from the user (S <b> 110). When a shooting request is input from the user through the input unit 17 (Yes in S120), a process of issuing a one-time password to the user is executed in order to perform exclusive control related to the shooting operation (S130).

  In S <b> 130, the processing unit 11 controls the display 15 to display a password issuance screen in which the one-time password is written. The processing unit 11 requests the service providing system 60 for a one-time password to be issued to the user through the wireless communication unit 13, and causes the display 15 to display the one-time password provided from the service providing system 60. A one-time password can be issued. The service providing system 60 can manage the one-time password together with the issue date and time.

  On the password issuing screen, a message for guiding the user to input a one-time password at the website providing the shutter button can be described together with a message for guiding the website. This website is realized by the service providing system 60.

  As shown in FIG. 3, the service providing system 60 includes a front-end server 70 and a back-end server 80. The front end server 70 and the back end server 80 are composed of one or more server devices.

The front end server 70 includes a processing unit 71 and a storage unit 72. The processing unit 71 includes a CPU and a RAM (not shown), and executes processing according to a program stored in the storage unit 72. The storage unit 72 stores a program executed by the processing unit 71 and data used for executing the program. When the processing unit 71 executes the program, the front-end server 70 functions as the website described above.

  The back-end server 80 controls the cameras 21, 22, and 23 according to instructions from the user through the website, processes the still image data received from the cameras 21, 22, and 23, and processes the processed image data Are provided to users through a website. The back end server 80 includes a processing unit 81 and a storage unit 82. The processing unit 81 includes a CPU and a RAM (not shown), and is configured to execute processing according to a program stored in the storage unit 82. The storage unit 82 stores a program executed by the processing unit 81 and data used for executing the program.

  The back end server 80 is installed so as to be able to communicate with the control device 30 and the guide device 10 of the camera side system 40 through the wide area network NT, and the front end server 70 can communicate with the user terminal 90 through the wide area network NT. It is installed so as to be able to communicate with the server 80 through an internal network.

  Examples of the user terminal 90 include portable communication terminals such as smartphones, tablets, mobile computers, and wearable devices. However, the user terminal 90 may not have portability. For example, the user terminal 90 may be an in-vehicle device. The user terminal 90 does not need to be able to access the wide area network NT alone, and may be a communication terminal that can access the wide area network NT through a relay such as a mobile router and a wireless access point. For example, as shown in FIG. 3, the user terminal 90 includes a processing unit 91 including a CPU and a RAM, a storage unit 92 that stores programs, a wireless communication unit 93, a display 95, and an input unit 97 such as a touch panel. Made up.

  The processing unit 71 of the front-end server 70 performs the shooting control process shown in FIG. 5 when the user terminal 90 accesses a URL guided by the guidance device 10 in order to provide a software shutter button to the user terminal 90. Run. The function of the website providing the shutter button is realized by this shooting control process.

  When the processing unit 71 starts the photographing control process, the processing unit 71 transmits a top page (not shown) to the access source user terminal 90 to display the top page on the display 95 of the user terminal 90, and then the one-time password input page G1. Is transmitted to the access source user terminal 90 through the wide area network NT, and this input page G1 is displayed on the display 95 of the user terminal 90 (S210). An example of the input page G1 is shown in the upper left of FIG.

  In S210, the processing unit 71 receives an input operation of a one-time password for the input page G1, and when the one-time password is received from the user terminal 90, the one-time password is issued by the guidance device 10 and used once. Further, it is further determined whether or not there is a valid password entered within a certain period from the issue time (S220). If the processing unit 71 determines that the password is valid, the processing unit 71 proceeds to step S230. If the processing unit 71 determines that the password is not valid, the processing unit 71 displays the one-time password input page G1 on the user terminal 90 again, and displays the one-time password. Require user to re-enter. The processing unit 71 may operate so as to cut off the connection from the access source when an unauthorized password is input a plurality of times.

In S230, the processing unit 71 transmits the shutter operation reception page G2 to the user terminal 90, and displays the reception page G2 on the display 95 of the user terminal 90. An example of the shutter operation acceptance page G2 is shown in the upper right of FIG. When there is a preceding user who wants to shoot using the cameras 21, 22, 23 at the shooting spot Z, the processing unit 71 replaces the shutter operation reception page G2 until shooting of the preceding user is completed. It is conceivable to display a page that guides the standby on the user terminal 90. Alternatively, it is conceivable that the issuance of the one-time password in the guidance device 10 is suspended until the shooting of the preceding user is completed.

  The shutter operation acceptance page G2 shown in FIG. 6 includes a shutter button R1 as an operation object. The reception page G2 includes an image R2 that guides the camera position. The image R2 is a composite image in which a pointer R3 indicating a camera position is combined with a captured image around the shooting point. The image R <b> 2 may be a dynamic display image that matches the orientation of the user terminal 90 based on orientation information from the electronic compass 99 provided in the user terminal 90.

  For example, the front-end server 70 can store in the storage unit 72 panoramic image data obtained by photographing the cameras 21, 22, and 23 from the photographing points and combining the pointer R3. The processing unit 71 regards the orientation of the user terminal 90 identified from the orientation information as the orientation of the user, extracts an image corresponding to the field of view visible to the user from the panoramic image data, and the extracted image is used as the image R2 as a shutter. Communication with the user terminal 90 can be performed as displayed on the operation reception page G2.

  Thereafter, the processing unit 71 waits until an operation signal indicating that the shutter button R1 has been pressed is received from the user terminal 90 (S240). When the operation signal is received (Yes in S240), the process proceeds to S250. Execute the shooting process.

  In S250, the processing unit 71 communicates with the user terminal 90 so that a countdown display is made on the shutter operation reception page G2. The configuration of the shutter operation reception page G2 during countdown display is illustrated in the lower right of FIG. Further, the processing unit 71 executes the process of transmitting a shooting command to the control device 30 of the camera side system 40 to the back-end server 80 so that the shooting operation is executed by the camera side system 40 at the end of the countdown. Ask. Thereafter, the processing unit 71 proceeds to S260.

  In S260, the processing unit 71 transmits to the user terminal 90 an input page G4 for requesting input of the user's mail address corresponding to the subject TR, and displays the input page G4 on the display 95 of the user terminal 90 (S260). . An example of the input page G4 is shown in the lower left of FIG.

  When the processing unit 71 accepts an input operation of the mail address for the input page G4 through the user terminal 90 and receives the information of the input mail address from the user terminal 90 (Yes in S270), the processing unit 71 converts the mail address into a captured image. The backend server 80 is notified as the mail address of the data providing destination (S280). Thereafter, the processing unit 71 of the front-end server 70 ends the shooting control process shown in FIG.

  When the processing unit 81 of the back-end server 80 receives from the front-end server 70 an execution request for processing to transmit a shooting command by executing the shooting processing (S250) in the front-end server 70, the distribution preparation processing shown in FIG. Start.

  When the distribution preparation process shown in FIG. 7 is started, the processing unit 81 follows the request from the front-end server 70 so that the camera-side system 40 executes a shooting operation in accordance with the end of the countdown. A photographing command is transmitted to the control device 30 (S310).

  When the control device 30 of the first camera 21, the control device 30 of the second camera 22, and the control device 30 of the third camera 23 receive this shooting command from the back-end server 80, the connected cameras To cause the camera to perform a shooting operation. This camera control according to the shooting command is realized by the processing unit 31 of the control device 30 executing the processing shown in FIG.

  As shown in FIG. 8, when the processing unit 31 of the control device 30 receives a shooting command from the back-end server 80 (S410), it controls the camera connected to its own control device 30, and Execute the shooting operation. And the still image data which the camera produced | generated by imaging | photography operation | movement is acquired from the connected camera (S420).

  The processing unit 31 transmits the still image data obtained in this way as the camera image data to the back-end server 80 that is the photographing command transmission source (S430). The processing unit 31 executes the above-described processes of S420 and S430 every time it receives a shooting command.

  Accordingly, when the processing unit 81 of the back-end server 80 transmits the shooting command in S310, in the subsequent S320, the first camera image data, the second camera image data, and the third camera image data generated based on the shooting command are transmitted. The data is received from the control device 30 of the first camera 21, the second camera 22, and the third camera 23 through the wide area network NT.

  Thereafter, the processing unit 81 uses the received first camera image data, second camera image data, and third camera image data, and is moving image data that shows the user who is the subject TR and that is zoomed out from the user. A process of generating data is executed (S330).

  The moving image data generation method in S330 will be described in detail with reference to FIG. Here, an example of generating moving image data of 1920 × 720 pixels will be described. The shooting area E1 illustrated in FIG. 9 corresponds to the shooting area by the first camera 21, the shooting area E2 corresponds to the shooting area by the second camera 22, and the shooting area E3 is the shooting area by the third camera 23. Corresponding to

  In this case, the first camera image data generated by the shooting operation of the first camera 21 is still image data in which the subject TR and the background BG in the shooting area E1 are captured, and is generated by the shooting operation of the second camera 22. The second camera image data is still image data in which the subject TR and the background BG in the shooting region E2 are captured, and the third camera image data generated by the shooting operation of the third camera 23 is the subject TR in the shooting region E3. And background image BG. The first camera image data, the second camera image data, and the third camera image data are each generated as image data having a number of pixels larger than 1920 × 720 pixels.

  In order to generate moving image data, the back-end server 80 corresponds to the pixel position P1 on the second camera image data corresponding to the end point of the first camera image data and the end point of the second camera image data in the storage unit 82. The pixel position P2 on the third camera image data is stored. By referring to the information of the pixel positions P1 and P2, the processing unit 81 can specify an image area corresponding to the shooting area of the first camera image data in the second camera image data. The image area corresponding to the shooting area of the second camera image data can be specified.

In the first step for generating moving image data, the processing unit 81 takes in the image data of the region F in which the subject's bust-up appears from the first camera image data, and uses the image data of this region F as the first data in the moving image data. Set to frame image data. The area F is an area of 1920 × 720 pixels. The area F can be fixedly defined with respect to the imaging area E1, for example. Alternatively, the region F may be dynamically determined based on the result of detecting a person by analyzing the first camera image data. When the subject TR appears excessively large in the first camera image data, the image data of the area F larger than 1920 × 720 pixels is taken from the first camera image data, the image data is reduced to 1920 × 720 pixels, and the first frame The image data may be set.

  Based on this area F, the processing unit 81 divides the area from the area F to the outer edge of the shooting area E3 by a rectangular frame similar to the area F into a number one less than the number N of frames of the moving image data, and the shooting area E3. An image capture area from the second frame to the Nth frame defined by the rectangular frame is set in the area up to the outer edge of the frame. From the second frame to the first camera end frame, which is a frame in which the image capture area is within the shooting area E1, for each frame, from the first camera image data, the image capture area corresponding to that frame is stored. Image data is taken in as reduced image data of 1920 × 720 pixels, and this image data is set as image data of a corresponding frame.

  From the next frame of the first camera end frame to the second camera end frame, which is a frame in which the image capture area falls within the shooting area E2, the processing unit 81 starts from the second camera image data for each frame. The image data of the image capture area corresponding to is captured as reduced image data of 1920 × 720 pixels, and this image data is set as the image data of the corresponding frame.

  For each frame from the next frame of the second camera end frame to the Nth frame as the end frame, the processing unit 81 sets the image data of the image capture area corresponding to the frame from the third camera image data to 1920 × 720. This is taken in as reduced image data of pixels, and this image data is set as image data of a corresponding frame.

  The processing unit 81 arranges the image data of the first frame to the Nth frame generated in this way in time series, and generates moving image data that is a moving image of the user who is the subject TR and is zoomed out from the user. FIG. 10 illustrates a moving image generated from the still image data illustrated in FIG.

  This moving image data generation method is characterized in that a frame is generated using the first camera image data without using the second and third camera image data for a frame in which the subject TR is greatly captured. According to this generation method, moving image data capable of clearly recognizing a subject located in a magnificent background can be generated.

  The processing unit 81 stores the generated moving image data in the storage unit 82 and registers this moving image data as distribution data (S340). Specifically, a URL for distribution is assigned to the moving image data, and association information between the URL and the moving image data is stored (S340).

  After that, the processing unit 81 sends the e-mail describing the distribution URL assigned to the moving image data in S340, and the e-mail address acquired by the front-end server 70 in S260 and S270 from the user terminal 90 that has operated the shutter button R1. First, the process shown in FIG. 7 ends. A user who has received this e-mail through the user terminal 90 or other electronic device accesses the URL destination described in the e-mail through the user terminal 90 or other electronic device, so that the moving image associated with the URL is displayed. Receive data distribution. Examples of other electronic devices include a personal computer owned by a user.

  When the processing unit 71 of the front-end server 70 repeatedly executes the processing shown in FIG. 11 and accesses the distribution URL (Yes in S510), the moving image associated with the URL is transmitted to the access source terminal. Data is transmitted (S520). As another example, the processing unit 71 may reproduce the moving image data and provide the moving image reproduction service to the access source terminal without distributing the moving image data itself in S520.

  The imaging system 1 of the first embodiment described above may be modified as follows. For example, the photographing system 1 may be configured to transmit an e-mail attached with the moving image data generated in S330 instead of the e-mail describing the moving image data distribution URL. In S520, the service providing system 60 may be configured to provide a moving image data reproduction service free of charge to the user and a moving image data download service for a fee. The moving image data may be generated or reproduced so that an advertisement is inserted at the beginning or end. Distribution of moving image data in the present disclosure includes a mode of transmitting a reproduction signal of moving image data in addition to a mode of transmitting moving image data itself.

  In addition, in order to avoid erroneous delivery to a person who is not a user corresponding to the subject, the service providing system 60 may be configured to perform user authentication when delivering moving image data through a website. . User authentication can be performed using a password, for example. The password for authentication can be acquired from the user terminal 90 in S260 and S270 together with the mail address.

  In addition, the service providing system 60 may be configured to generate moving image data that zooms in on the user who is the subject in S330. The moving image data to be zoomed in by the user can be generated by reversing the arrangement of the frames constituting the moving image data to be zoomed out from the user. The service providing system 60 may be configured to generate moving image data including both a moving image to be zoomed in and a moving image to be zoomed out.

  The service providing system 60 may be configured to generate a still image data set in S330 instead of the moving image data or in addition to the moving image data. For example, the service providing system 60 extracts some still image data with different angles of view zoomed in / out from the subject from the moving image data, and the set of the extracted still image data is converted into the still image data. You may make it the structure produced | generated as a set. The still image data set at this time includes still image data having an intermediate angle of view between the first camera image data and the second camera image data, and an intermediate image between the second camera image data and the third camera image data. It may be generated as a still image data set including one or both of still image data having a corner. According to the present embodiment, it is possible to generate a still image data set having various angles of view that are not limited to the angles of view of the cameras 21, 22, and 23.

  In addition, in this embodiment, the guide device 10 is provided at the shooting spot Z. However, the function as the guide device 10 may be realized using hardware resources of the user terminal 90. That is, the function as the guidance device 10 is based on a command from the user input through the input unit 97 of the user terminal 90, the service providing system 60 transmits a web page to the user terminal 90, and the processing unit 91 of the user terminal 90. May be realized by displaying a web page on the display 95. In this case, the service providing system 60 can acquire position information from the user terminal 90 and issue a one-time password only to the user terminal 90 located at the shooting spot Z based on the position information.

The imaging system 1 may be configured to provide a wireless access point at the imaging spot Z and issue a one-time password only to the user terminal 90 that has accessed through the wireless access point. Issuing such a one-time password can suppress the use of the camera by a user who does not exist at the shooting spot Z. Further, according to the display restriction on the shutter operation reception page G2 using the one-time password (S220, S230), it is possible to suppress the occurrence of a collision of camera use by a plurality of users, and an exclusive shooting operation for each user. Can be executed appropriately.

  The correspondence between terms is as follows. The user terminal 90 of the present embodiment corresponds to an example of a remote operation device, and an operation signal transmitted from the user terminal 90 to the service providing system 60 when the shutter button R1 is pressed is an example of a command from the remote operation device. Corresponding to The guide device 10 and the service providing system 60 restricting the use based on the one-time password (S130, S210-S250) corresponds to an example of a function realized by the operation control unit. The moving image data generation processing (S330) and the moving image distribution processing (S340, S350, S520) executed by the service providing system 60 correspond to an example of functions realized by the image processing unit. The control device 30 that transmits the camera image data generated by the cameras 21, 22, and 23 to the back-end server 80 through the wide area network NT corresponds to an example of a communication unit. The first camera 21 corresponds to an example of a narrow area camera, and the second camera 22 and the third camera 23 correspond to an example of a wide area camera.

[Second Embodiment]
The imaging system 1 of the second embodiment is the first embodiment in that the control device 30 is provided in common to the plurality of cameras 21, 22, and 23, and the control device 30 generates moving image data. Unlike the first embodiment, the second embodiment basically corresponds to the first embodiment in other points. Below, as a structure of the imaging system 1 of 2nd embodiment, the structure different from 1st embodiment is selectively demonstrated, and description of the structure which is common in 1st embodiment is abbreviate | omitted suitably.

  As shown in FIG. 12, the camera-side system 40 of the present embodiment includes a control device 30 that is common to the first camera 21, the second camera 22, and the third camera 23. As in the first embodiment, the control device 30 includes a processing unit 31, a storage unit 32, a wireless communication unit 33 that can communicate with the service providing system 60 through the wide area network NT, and a connection unit 34. However, the connection unit 34 of the present embodiment has a plurality of connection ports, and all the cameras 21, 22, and 23 of the camera side system 40 provided for one photographing spot Z are connected to the connection unit 34. Is done.

  As shown in FIG. 13, the processing unit 31 in the control device 30 receives the shooting command from the back-end server 80 (S610), controls the cameras 21, 22, and 23, and controls the cameras 21, 22, and 23. Perform shooting operations simultaneously. Then, the first camera image data, the second camera image data, and the third camera image data generated by the cameras 21, 22, and 23 by the shooting operation are acquired from the cameras 21, 22, and 23 (S620).

  In this way, the processing unit 31 uses the first camera image data, the second camera image data, and the third camera image data acquired from the cameras 21, 22, and 23, and the moving image data that shows the user who is the subject TR The moving image data to be zoomed out from the user is generated (S630). The method for generating moving image data is the same as in the first embodiment. The moving image data may be moving image data that zooms in on the user, or moving image data that includes both a moving image that zooms out from the user and a moving image that zooms in on the user.

  The processing unit 31 transmits the generated moving image data to the back-end server 80 that is the transmission source of the shooting command (S640). The processing unit 31 executes the above-described processing of S620-S640 every time it receives a shooting command.

  In the back-end server 80, in accordance with the configuration of the control device 30, the processing unit 81 executes the distribution preparation process shown in FIG. 14 instead of the distribution preparation process shown in FIG. The processing unit 81 of the back-end server 80 transmits a shooting command to the control device 30 of the camera-side system 40 in accordance with a request from the front-end server 70, similarly to S310 in the first embodiment (S710).

  Thereafter, the processing unit 81 receives the moving image data generated by the camera-side system 40 based on the shooting command from the control device 30 through the wide area network NT (S720), and regarding the received moving image data, S340 of the first embodiment. , S350 is executed (S730, S740). That is, the processing unit 81 stores the received moving image data in the storage unit 82 and registers it as distribution data (S730). Further, the processing unit 81 transmits an e-mail describing the URL for moving image data distribution to the e-mail address of the user corresponding to the subject TR (S740), and ends the process shown in FIG.

  According to the imaging system 1 of the second embodiment described above, since the camera-side system 40 does not have to be provided with the control device 30 for each camera, the first camera 21, the second camera 22, and the third camera 23 are close to each other. Significant when placed in position.

  In the present embodiment, the moving image data is generated by the control device 30, but the moving image data may be generated by the service providing system 60 as in the first embodiment. That is, the imaging system 1 of the second embodiment may have the same configuration as that of the first embodiment, except that the control device 30 is provided in common for the plurality of cameras 21, 22, and 23. The control device 30 may be configured to generate the above-described still image data set and transmit it to the service providing system 60 in S630 and S640 instead of or in addition to the moving image data.

[Third embodiment]
The imaging system 1 of the third embodiment is a panorama in which camera-side system 40 is configured by a single camera 20 and a control device 30 and still image data D1 representing a captured image of the camera 20 is prepared in advance. Unlike the first embodiment, the background image data D2 is combined with the background image data D2, and the moving image data is generated based on the combined image data D3. Below, as a structure of the imaging system 1 of 3rd embodiment, the structure different from 1st embodiment is selectively demonstrated, and description of the structure which is common in 1st embodiment is abbreviate | omitted suitably.

As shown in FIG. 15, the camera-side system 40 of the present embodiment is configured to include a camera 20 corresponding to the first camera 21 and a control device 30 connected to the camera 20.
Similar to the first embodiment, the control device 30 includes a processing unit 31, a storage unit 32, a wireless communication unit 33, and a connection unit 34, and the connection unit 34 is connected to the camera 20. As shown in FIG. 16, the processing unit 31 in the control device 30 receives the shooting command from the back-end server 80 (S810), controls the camera 20, and causes the camera 20 to execute a shooting operation. Then, still image data D1 representing a photographed image of the camera 20 by this photographing operation is acquired from the camera 20 as camera image data D1 (S820).

  Thereafter, as shown in FIG. 17, the processing unit 31 combines the camera image data D1 and the panoramic background image data D2 stored in the storage unit 32 to generate combined image data D3 illustrated in FIG. S830). According to the present embodiment, the camera 20 takes a large image of the user as the subject TR located at the shooting point within a range where the whole body of the user is captured. Accordingly, the subject TR appears large in the camera image data D1 generated by the camera 20.

  On the other hand, the panoramic background image data D2 is image data generated by capturing a wide range of backgrounds BG for each section indicated by a broken line in FIG. 17 and connecting the background image data for each section. In FIG. 17, the panoramic background image data D2 representing the background image of the region surrounded by the thick line is composed of a combination of background image data representing the background image for each section divided by the broken line.

  If the background image data for each section is megapixel image data, the combined panorama background image data D2 is gigapixel image data depending on the number of sections. FIG. 17 simply shows an example in which the panorama background image data D2 has a width corresponding to nine sections, but the actual panorama background image data D2 normally has a larger number of sections. .

  As described above, the panorama background image data D2 stored in the storage unit 32 is image data having a wide range of backgrounds BG, but is configured as high-resolution image data. In addition to the panorama background image data D2, the storage unit 32 of the control device 30 stores data that defines the synthesis position of the camera image data D1 with respect to the panorama background image data D2.

  The processing unit 31 pastes the captured image represented by the camera image data D1 on the specific area of the background image of the panoramic background image data D2 stored in the storage unit 32 based on the data defining the synthesis position, so that the wide area The composite image data D3 is generated in which the captured image of the subject TR is arranged on the background BG.

  The processing unit 31 transmits the composite image data D3 to the back-end server 80 that is the imaging command source through the wide area network NT (S840). The processing unit 31 executes the above-described processing of S820, S830, and S840 every time it receives a shooting command.

  In the back-end server 80, in accordance with the configuration of the control device 30, the processing unit 81 executes the distribution preparation process shown in FIG. 18 instead of the distribution preparation process shown in FIG. The processing unit 81 of the back-end server 80 transmits a shooting command to the control device 30 of the camera-side system 40 in accordance with a request from the front-end server 70, similarly to S310 in the first embodiment (S910).

  Thereafter, the processing unit 81 receives the composite image data D3 generated by the camera-side system 40 based on the shooting command from the control device 30 through the wide area network NT (S920). Furthermore, based on the received composite image data D3, moving image data that shows the user who is the subject TR and that is zoomed out from the user is generated (S930).

The moving image data generation method in S930 will be described in detail with reference to FIG. Here, an example of generating moving image data of 1920 × 720 pixels will be described.
In the first step for generating the moving image data, the processing unit 81 takes in the image data of the region F in which the bust-up of the subject TR is captured from the composite image data D3, and this image data is the first frame image in the moving image data. Set to data. The area F is an area of 1920 × 720 pixels.

The area F may be an area smaller than the image area of the camera image data D1 synthesized with the panorama background image data D2. The area F is fixedly defined with respect to the image area of the composite image data D3, for example. Alternatively, the region F may be dynamically determined based on a person detection result obtained by analyzing the composite image data D3. When the subject TR appears excessively large, the image data of the area F larger than 1920 × 720 pixels is taken from the composite image data D3, the image data is reduced to 1920 × 720 pixels, and the image data of the first frame is set. Also good.

  Based on this area F, the processing unit 81 divides the area from the area F to the outer edge of the shooting area of the composite image data D3 with a rectangular frame similar to the area F into a number one less than the frame number N of the video data, An image capture area from the second frame to the Nth frame defined by a rectangular frame is set in the area up to the outer edge. Then, for each frame from the second frame to the Nth frame, the image data of the image capture area corresponding to that frame is captured as reduced image data of 1920 × 720 pixels from the composite image data D3, and this image data is Set to the image data of the frame to be used.

  The processing unit 81 arranges the image data of the first frame to the Nth frame generated in this way in time series, and generates moving image data that is a moving image of the user who is the subject TR and is zoomed out from the user. The moving image reproduced by the moving image data is the same as that in the first embodiment (see FIG. 10). That is, this moving image is configured as a moving image that can clearly recognize the subject TR located in the magnificent background and can also enjoy the magnificent scenery.

  The processing unit 81 stores the moving image data generated in this way in the storage unit 82 and registers it as distribution data, similarly to S340 of the first embodiment (S940). Further, the processing unit 81 transmits an e-mail describing the distribution URL assigned to the moving image data to the e-mail address obtained from the user terminal 90 operated by pressing the shutter button (S950). The processing shown in FIG.

  According to the imaging system 1 of the third embodiment described above, it is not necessary to install a plurality of cameras in the camera side system 40. As in the first embodiment, the moving image data of the present embodiment may be moving image data that zooms in on the user, or moving image data that includes a moving image that zooms in on the user and a moving image that zooms out from the user. The service providing system 60 may be configured to deliver a still image data set instead of or in addition to the moving image data.

  In addition, the service providing system 60 may be configured to acquire the camera image data D1 instead of the composite image data D3 from the camera side system 40, and generate the composite image data D3 and the moving image data. For example, the control device 30 may be configured such that the processing unit 31 executes a process (S850) of transmitting the camera image data D1 instead of the processes of S830 and S840 as shown in FIG. The back-end server 80 performs a process (S960) in which the processing unit 81 generates composite image data D3 based on the camera image data D1 received from the control device 30, instead of the process of S920, as shown in FIG. It may be configured to execute. In this case, the storage unit 82 of the service providing system 60 can store the panoramic background image data D2.

  The control device 30 of the camera-side system 40 may be configured to generate moving image data based on the composite image data D3 and transmit the generated moving image data to the service providing system 60. The service providing system 60 may be configured to deliver moving image data to a user corresponding to the subject TR in a form attached to an e-mail.

  In addition to this, the camera 20 may be configured to generate moving image data instead of still image data as the camera image data D1, and the imaging system 1 may include moving image data from the camera 20 and a panoramic background that is still image data. The image data D2 may be combined to generate moving image data in which a subject moves in a magnificent background.

  In the present embodiment, the process of generating the composite image data D3 and generating the moving image data based on the composite image data D3, which is realized in at least one of the control device 30 and the back-end server 80, is realized by the image processing unit. This corresponds to an example of processing.

[Other Embodiments]
The imaging system of the present disclosure is not limited to the above embodiment, and can take various forms. For example, in order to inform the user of the camera position, the user terminal 90 activates a built-in camera (not shown), displays an image captured by the camera on the display 95, and indicates the camera position in the image. You may comprise so that the pointer R3 to notify may be displayed. For example, the user terminal 90 can display the pointer R <b> 3 based on the GPS position information and direction information obtained from the built-in device and the camera position information obtained from the service providing system 60.

  In addition, the photographing system 1 may be configured such that a user who has completed photographing can check a moving image through the guidance device 10. In this case, the service providing system 60 may be configured to distribute moving image data to the guidance device 10. Instead of the one-time password, a password that can be used multiple times or for a long time may be used. For example, the guidance device 10 may be configured to issue the same password to a plurality of users by displaying different passwords every day. Even by issuing such a password, it is possible to suppress random use of the camera by a user who does not exist at the shooting spot Z.

  The functions of one constituent element in the above embodiment can be distributed among a plurality of constituent elements. Functions of a plurality of components may be integrated into one component. A part of the configuration of the above embodiment may be omitted. At least a part of the configuration of the embodiment may be added to or replaced with the configuration of the other embodiment. Any aspect included in the technical idea specified by the wording of the claims is an embodiment of the present invention.

DESCRIPTION OF SYMBOLS 1 ... Imaging system, 10 ... Guide apparatus, 11 ... Processing unit, 12 ... Storage unit, 13 ... Wireless communication unit, 15 ... Display, 17 ... Input unit, 20, 21, 22, 23 ... Camera, 30 ... Control device, DESCRIPTION OF SYMBOLS 31 ... Processing unit, 32 ... Storage unit, 33 ... Wireless communication unit, 34 ... Connection unit, 40 ... Camera side system, 60 ... Service providing system, 70 ... Front end server, 71 ... Processing unit, 72 ... Storage unit, 80 ... Back-end server, 81 ... Processing unit, 82 ... Storage unit, 90 ... User terminal, 91 ... Processing unit, 92 ... Storage unit, 93 ... Wireless communication unit, 95 ... Display, 97 ... Input unit, TR ... Subject, BG ... Background, D1 ... Camera image data, D2 ... Panorama background image data, D3 ... Image data, NT ... wide area network, R1 ... shutter button.

Claims (8)

A group of camera operating according to the instructions from the remote control device, taken together with the background of the subject, and the narrow-range camera for generating a still image data representing the captured image, the narrow-range camera for photographing with the subject photographed wide background than the background, including a periphery of the background, a group of camera including the one or more wide area camera, the generating the still image data representing the captured image,
Using a group of the still image data generated by the group of the cameras, the video data including the subject, the video data including at least one of a video that zooms in on the subject and a video that zooms out from the subject, and An image processing unit that generates at least one of still image data that is a set of still image data in which the subject is captured and is a set of still image data having different angles of view equivalent to the moving image data, as processed image data;
The image processing unit generates a plurality of still image data having different angles of view from each of the still image data generated by a group of the cameras as component data of the processed image data, and the processed image The data is configured to generate at least one of the moving image data and the still image data set in which the component element data is arranged,
The image processing unit is before and after switching before and after a camera that has captured a captured image represented by the component data in the array of component data is switched from one of the group of cameras to another camera. In the same way as the imaging system, the imaging system generates at least one of the moving image data and the still image data set in which the component data is arranged so that the captured image represented by the component data changes continuously . A communication unit connected to the group of cameras and transmitting the group of still image data generated by the group of cameras to the image processing unit through a wide area network, the image processing unit comprising: And a group of still images generated by the group of cameras through the wide area network, and the processed image data is generated using the group of the acquired still image data. The imaging system according to 1.   The imaging system according to claim 1, wherein the image processing unit distributes the processed image data to at least one of the remote control device and a user terminal associated with the subject. The remote control device is a communication terminal of a user corresponding to the subject;
The imaging system according to claim 3, wherein the image processing unit is configured to distribute the generated processed image data to the communication terminal.   The imaging system according to claim 1, wherein the image processing unit stores the processed image data in a server device accessible by a user corresponding to the subject. An operation control unit that issues an authentication code to a user corresponding to the subject, receives an instruction from the remote control device, and operates the group of cameras on condition that the issued authentication code is input With
The photographing system according to claim 1, wherein the group of cameras operate under the control of the operation control unit.   The imaging system according to any one of claims 1 to 6, further comprising a notification unit that notifies a user corresponding to the subject of a group of positions of the cameras located remotely.   The program for making a computer implement | achieve the function as the said image processing unit with which the imaging | photography system as described in any one of Claims 1-7 is provided.

Images