JP2012109852A - Remote image display system, apparatus, and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To intuitively and accurately transmit operation instructions intended by an operation instructor to an operator during remote instruction in an operation of image acquisition means.SOLUTION: A remote image display system includes: the image acquisition means including a finder image display section for displaying, as a finder image, an image input from an optical input section, and a finder image output section for outputting the finder image via a communication line; and image display/operation instruction means including a monitor display section for monitor-displaying the finder image input via the communication line, and an operation instruction transmission section for outputting, as operation instruction information, an operation instruction indicative of an operation of image acquisition, including an input direction or composition of the finder image, input to the finder image on the monitor display section. The image acquisition means includes an operation instruction reception section for inputting the operation instruction information output by the image display/operation instruction means and displaying the content of the operation instruction on the finder image display section.

Description

  The present invention relates to a remote image display system, apparatus, and method, and in particular, a remote image display system that displays a remote instruction regarding operation of an image acquisition means sent from an image display operation instruction means on a display unit of the image acquisition means, The present invention relates to an apparatus and a method.

  Video communication, such as videophone, videoconferencing, and remote monitoring using a web camera, has been diversified along with the increase in communication network speed and capacity. In addition, today, mobile phones have become daily necessities for everyone, and most of the mobile phones have a digital camera function added. High-definition digital cameras with more than 10 million pixels are on the market, and there are products that are not strange to say that a digital camera is equipped with a mobile phone function. . Thus, today, it is an environment where it can be said that everyone always carries a camera with a wireless communication function.

  For this reason, various application technologies that fuse cameras and communications have been disclosed. As such application technology, for example, there are technologies disclosed in Patent Document 1 and Patent Document 2.

  The technique disclosed in Patent Document 1 is a technique relating to a photographing apparatus that can take a photograph with a suitable composition even when a camera user is unfamiliar with photographing or at a place where photographing is performed for the first time. According to the technology, by sending the current position of the camera to the server of the network, the reference image captured within a predetermined distance range from the current position and the shooting information related to the reference image are acquired from the server. Can do. The camera displays information for guiding the user to the shooting position of the reference image on the display unit based on the reference image and shooting information acquired from the server and the current position of the camera. And based on a user's imaging | photography state, it has the function to display and teach on a display part so that the composition corresponding to a user's imaging | photography state may become a composition of a reference image.

  The technique disclosed in Patent Document 2 is a technique related to a remote camera system that can frequently repeatedly take and view images by remote operation from a controller. In this remote camera system, a digital camera and a controller are connected via a communication line, and the digital camera is operated remotely using the controller. As a communication line, it is assumed that a wireless LAN (Local Area Network) ad hoc mode is used, and the digital camera and the controller are connected by a wireless line. The controller can perform fine control on the digital camera such as power on / off, zoom adjustment, mode setting switching, in-focus and shooting.

JP 2009-239397 JP 2006-174164 A

  As one application in which the camera and the communication are integrated, a use form in which a finder image input in real time by the camera function of the mobile phone is displayed as an online monitor on a remote communication partner apparatus is possible. The viewfinder image is an image in which a subject image optically captured through a camera lens is displayed as it is on the viewfinder. That is, not only the camera of the mobile phone but also a general digital camera, the camera displays an image that enters through the lens as a finder image on the display unit when the power is on. Various applications can be realized by displaying the finder image on the remote communication partner apparatus.

  In this case, the operator who holds the camera and operates it to capture the subject as a viewfinder image and the viewfinder image sent via the communication line can be viewed remotely to change the camera orientation and composition for the operator. There is an operation instructor who gives instructions. Then, the camera operator operates the camera so that the orientation and composition of the camera intended by the operation instructor is based on the operation instruction in words from the operation instructor.

  However, in a voice instruction by a call between the operation instructor and the operator, it is difficult to intuitively and accurately convey the instruction content intended by the operation instructor to the camera operator.

  The technique disclosed in Patent Document 1 displays guidance information for guiding a user to a shooting position on a display unit based on shooting information received from a server so that a composition of a reference image at a specific location is obtained. is there. Therefore, a remote instruction related to camera operation is not displayed on the display unit at an arbitrary place according to the instruction content intended by the operation instructor.

  The technique disclosed in Patent Document 2 is intended to allow a controller operator to freely operate a remote camera alone. For this reason, the technique disclosed in Patent Document 2 takes into account the function of remotely displaying instruction contents intended by an operation instruction person who gives instructions regarding camera operation by looking at a finder image to an operator who operates the camera. Absent.

  An object of the present invention is to solve the above-described problems, and to display a remote instruction intended by an operation instructor regarding the direction and composition of a finder image on a display unit of an image acquisition unit such as a camera. And to provide a method.

  In order to achieve the above object, a remote image display system according to an aspect of the present invention includes a finder image display unit that displays an image input from an optical input unit as a finder image, and the finder image is transmitted via a communication line. A viewfinder image output unit that outputs the image, a monitor display unit that displays the viewfinder image input via the communication line on a monitor, and the viewfinder image displayed on the monitor display unit. An image display operation instruction means including: an operation instruction transmission unit that outputs an operation instruction that instructs an operation related to image acquisition including an input direction or composition of the finder image that is input as operation instruction information via the communication line. The image acquisition means outputs the operation instruction information output by the image display operation instruction means via the communication line. Type, characterized in that it comprises an operation instruction receiver that displays the content of the operation instruction on the finder image display unit.

  An image acquisition apparatus according to another aspect of the present invention includes a finder image display unit that displays an image input from an optical input unit as a finder image, and a finder image output unit that outputs the finder image via a communication line. And input operation instruction information related to an operation instruction for instructing an operation related to image acquisition including an input direction or composition of the finder image, and display contents of the operation instruction on the finder image display unit. And an operation instruction receiving unit.

  An image display operation instruction device according to another aspect of the present invention includes a monitor display unit that displays an image input from an image acquisition device via a communication line as a finder image, and the monitor display unit that displays the monitor display unit. An operation instruction for instructing an operation related to image acquisition including an input direction or composition of the finder image input to the finder image is output as operation instruction information for displaying on the image acquisition apparatus via the communication line. And an operation instruction transmission unit.

  Further, in the remote image display method according to another aspect of the present invention, the image acquisition means displays an image input from the optical input unit as a finder image on the finder image display unit, and the finder image is displayed via a communication line. The image display operation instruction means outputs the finder image input via the communication line on the monitor display unit and displays the input direction of the finder image input to the finder image displayed on the monitor. Alternatively, an operation instruction for instructing an operation related to image acquisition including composition is output as operation instruction information via the communication line, and the image acquisition unit inputs the operation instruction information via the communication line, and the operation The content of the instruction is displayed on the finder image display unit.

  An image acquisition method according to another aspect of the present invention displays an image input from an optical input unit as a finder image, outputs the finder image via a communication line, and inputs or composes the finder image. Operation instruction information related to an operation instruction for instructing an operation relating to image acquisition including the input is input via the communication line, and the contents of the operation instruction are displayed on the finder image display unit.

  An image display operation instruction method according to another aspect of the present invention displays an image input from an image acquisition device via a communication line as a finder image, and is input to the finder image displayed on the monitor. An operation instruction for instructing an operation related to image acquisition including an input direction or composition of the finder image is output via the communication line as operation instruction information to be displayed on the image acquisition apparatus. .

  According to the present invention, remote instruction information regarding the operation of the image acquisition means sent from the image display operation instruction means is displayed on the display unit of the image acquisition means, and the contents of the operation instruction intended by the operation instruction person are displayed to the operator. Intuitive and accurate.

It is a block diagram which shows the structure of the remote image display system of the 1st Embodiment of this invention. It is a sequence diagram which shows operation | movement of the remote image display system of 1st Embodiment. It is a block diagram which shows the structure of the image acquisition apparatus of 1st Embodiment. It is a sequence diagram which shows operation | movement of the image acquisition apparatus of 1st Embodiment. It is a block diagram which shows the structure of the image display operation instruction | indication apparatus of 1st Embodiment. It is a sequence diagram which shows operation | movement of the image display operation instruction apparatus of 1st Embodiment. It is a block diagram which shows the structure of the 2nd Embodiment of this invention. It is a sequence diagram which shows operation | movement of 2nd Embodiment. It is a figure explaining the relationship between the focal distance of a lens, an image pick-up element size, and a field angle. It is a figure which shows the example of an image display of the finder image display part of the imaging | photography terminal in 2nd Embodiment, and the monitor display part of a photography operation instruction | indication terminal. It is a figure explaining the area | region of the image frame which an imaging | photography terminal image | photographs. It is a flowchart which shows operation | movement of the imaging | photography terminal of 2nd Embodiment. It is a figure which shows the example of a display in the finder image display part corresponding to the example of operation in a monitor display part, and the operation. It is a schematic diagram which shows the example of a display screen in the monitor display part in the modification of 2nd Embodiment, and a finder image display part. It is a schematic diagram which shows another example of a display screen in the monitor display part in the modification of 2nd Embodiment, and a finder image display part. In the modification of 2nd Embodiment, it is a flowchart explaining the operation | movement of the point display in the wide angle display area of the finder image display part based on the point instruction | indication in the wide angle display area of a monitor display part. It is a block diagram which shows the structure of the 3rd Embodiment of this invention. It is a sequence diagram which shows operation | movement of 3rd Embodiment. It is a figure explaining the composite method of the panoramic photograph performed in an image composition part. It is a figure which shows the example of a display of the finder image and panoramic photograph of a monitor display part. It is a figure which shows another example of a display of the finder image of a monitor display part, and a panoramic photograph. It is a figure which shows the example of a display of the finder image display part of the imaging | photography terminal in 3rd Embodiment. In the wide-angle display area of the display example shown in FIG. 20, it is a figure which shows a mode that a point instruction | indication moves with a panoramic photograph with a movement of an imaging | photography terminal. It is a block diagram which shows the structure of the 4th Embodiment of this invention. It is a sequence diagram which shows operation | movement of 4th Embodiment.

  A mode for carrying out the present invention will be described.

  Various applications can be realized by displaying a finder image on a remote communication partner device.

  For example, it can be used when a person who wants to purchase a product requests shopping on behalf of another person.

  When purchasing products such as clothes, bags, kitchen utensils, furniture, etc. that have a strong preference for purchasers in terms of design and color, the proxy purchaser buys it by itself as long as the size and function are sufficient. I can't. In such a case, the proxy purchaser displays the displayed product as a finder image of the camera attached to the mobile phone and transmits it in real time to the purchase requester so that the purchase requester can remotely shop. It can respond by making.

  In such an environment, a person who wants to purchase a product looks at the image that the proxy purchaser copies as a finder image, and selects a product that matches his / her preference. In the selection process, the purchase requester issues an operation instruction indicating which direction the proxy purchaser wants to show with respect to the image captured and which product the user wants to enlarge. The contents of the operation instruction are displayed on the display unit of the mobile phone, and the proxy purchaser moves the camera based on the instruction to change the direction of projection or perform a zoom operation.

  As another example, it can also be used for route guidance.

  A person who has lost his way in the city connects to a road guidance center through a mobile phone, for example. A person who has lost his / her way uses a camera attached to a mobile phone to project the surrounding cityscape in accordance with instructions from a person in charge at the route guidance center, and sends the viewfinder image to the route guidance center. The person in charge at the route guidance center instructs the direction of the viewfinder image to be projected and the enlarged display of the landmark building, etc., in order to explain the direction of the person who gets lost on the basis of the sent viewfinder image. To do. The contents of the instructions are displayed on the display unit of the mobile phone, and the person who gets lost can move the camera based on the instructions, change the direction of the image, or perform the zoom operation. Receive an explanation.

  Of course, it is also possible to use photography remotely.

  The camera operator is at the shooting location, and the subject image to be shot is sent to the remote shooting instruction person as a viewfinder image. The photographing instructor considers the composition while looking at the viewfinder image, and instructs the camera operator to operate the camera so that the target composition is obtained. The contents of the operation instruction are displayed on the finder image display unit of the camera, and the camera operator moves the camera based on the instruction to change the direction of projection or perform a zoom operation. When the target composition is reached, the photographing instructor instructs to take a picture of the composition. The camera operator releases the shutter of the camera based on the instruction.

  An embodiment of the present invention that can be used as described above will be described with reference to the drawings.

  FIG. 1 is a block diagram showing the configuration of the remote image display system according to the first embodiment of the present invention.

  The embodiments are examples, and the disclosed apparatus and system are not limited to the configurations of the following embodiments. In the embodiment, “image” includes “still image” and “moving image”. Also, the input operation performed on the image display operation instruction terminal is referred to as “operation instruction”, the information output by the operation instruction is referred to as “operation instruction information”, and the content that the operation instruction means is referred to as “operation instruction content”. I will explain.

  A remote image display system according to an embodiment of the present invention includes an image acquisition unit 10 and an image display operation instruction unit 11. The image acquisition means 10 includes an optical input unit 101, acquires an image input therefrom as a finder image, and displays it. The image acquisition unit 10 and the image display operation instruction unit 11 are connected via a communication line. Then, the image display operation instruction unit 11 outputs, to the image acquisition unit 10, an operation instruction that instructs an operation related to image acquisition including the input direction or composition of the finder image as operation instruction information.

  The image acquisition unit 10 includes a finder image display unit 102 that displays an image input from the optical input unit 101 as a finder image, and a finder image output unit 103 that outputs the finder image via a communication line.

  The image display operation instruction unit 20 includes a monitor display unit 201 and an operation instruction transmission unit 202. The monitor display unit 201 displays the finder image input via the image acquisition means 10 and the communication line on the monitor. The operation instruction transmission unit 202 operates an operation instruction for instructing an operation related to image acquisition including an input direction or composition of the finder image input to the finder image displayed on the monitor display unit 201 via a communication line. Output as instruction information.

  The image acquisition unit 10 includes an operation instruction receiving unit 104 that receives the operation instruction information output from the image display operation instruction unit 20 and displays the contents of the operation instruction on the finder image display unit 102.

  FIG. 2 is a sequence diagram illustrating the operation of the remote image display system according to the first embodiment.

  The image acquisition means displays an image input from the optical input unit as a finder image on the finder image display unit (S101). Then, the finder image is output via the communication line (S102). The image display operation instruction means displays the finder image input via the communication line on the monitor display unit (S103). An operation instruction for instructing an operation related to image acquisition including the input direction or composition of the finder image input to the finder image displayed on the monitor is output as operation instruction information via the communication line (S104). Then, the image acquisition means inputs the operation instruction information via the communication line, and displays the contents of the operation instruction on the finder image display unit (S105).

  By configuring the remote image display system as described above, the finder image captured in real time by the image acquisition means 10 can be monitored by the image display operation instruction means 20. The operation instructor can input an operation instruction for instructing an operation related to image acquisition including the input direction or composition of the finder image to the finder image displayed on the monitor on the image display operation instruction unit 20. The operation instruction can be sent to the image acquisition unit 10 as operation instruction information via a communication line, and the contents of the operation instruction are displayed on the finder image display unit 102 of the image acquisition unit 10. Therefore, the contents of the operation instruction intended by the operation instructor can be transmitted intuitively and accurately to the operator of the image acquisition means 10.

  FIG. 3 is a block diagram illustrating a configuration of the image acquisition apparatus according to the first embodiment.

  The image acquisition device 30 includes a finder image display unit 32 that displays an image input from the optical input unit 31 as a finder image, a finder image output unit 33 that outputs the finder image via a communication line, and an operation instruction receiving unit. 34. The operation instruction receiving unit 34 inputs operation instruction information related to an operation instruction for instructing an operation related to image acquisition including an input direction or composition of a finder image via a communication line, and the contents of the operation instruction are input to the finder image display unit. indicate.

  FIG. 4 is a sequence diagram illustrating the operation of the image acquisition apparatus according to the first embodiment.

  The image acquisition apparatus displays an image input from the optical input unit as a finder image (S201), and outputs the finder image via a communication line (S202). Then, operation instruction information related to an operation instruction for instructing an operation related to image acquisition including an input direction or composition of the finder image is input via the communication line (S203, YES), and the contents of the operation instruction are displayed in the finder image. (S204).

  By configuring the image acquisition device as described above, a finder image captured in real time can be output to the outside via a communication line. Then, operation instruction information related to an operation instruction for instructing an operation related to image acquisition including an input direction or composition of the finder image can be input via the communication line, and the contents of the operation instruction can be displayed on the finder image display unit. . Therefore, the operator of the image acquisition device 30 can intuitively and accurately grasp the content of the operation instruction related to the image acquisition including the input direction or composition of the finder image.

  FIG. 5 is a block diagram showing the configuration of the image display operation instruction device according to the first embodiment of the present invention.

  The image display operation instruction device 40 includes a monitor display unit 41 and an operation instruction transmission unit 42. The monitor display unit 41 displays an image input from the image acquisition device 30 via a communication line as a finder image on the monitor. The operation instruction transmission unit 42 sends an operation instruction, which is input to the finder image displayed on the monitor display unit 41, to instruct an operation related to image acquisition including the input direction or composition of the finder image to the image acquisition device 30. The operation instruction information for display is output via a communication line.

  FIG. 6 is a sequence diagram showing the operation of the image display operation instruction device according to the first embodiment of the present invention.

  The image display operation instruction device displays on the monitor an image input from the image acquisition device via the communication line as a finder image (S301, S302). Then, an operation instruction for instructing an operation related to image acquisition including the input direction or composition of the finder image input to the finder image displayed on the monitor (YES in S303) is an operation for displaying on the image acquisition device. The instruction information is output via a communication line (S304).

  By configuring the image display operation instruction apparatus as described above, an image input from the image acquisition apparatus can be monitored as a finder image, and the image acquisition including the input direction or composition with respect to the finder image can be performed. An operation instruction for instructing an operation can be input. The input operation instruction is output via the communication line as operation instruction information to be displayed on the image acquisition apparatus, so that the operation instruction person intuitively understands the contents of the intended operation instruction to the operator of the image acquisition apparatus. Can communicate accurately and accurately.

  Next, a second embodiment will be described.

  FIG. 7 is a block diagram showing the configuration of the second exemplary embodiment of the present invention.

  In the second embodiment, the image acquisition means 10 or the image acquisition device 1 in the first embodiment is a photographing terminal 11 capable of taking a photograph. The image display operation instruction unit 20 or the image display operation instruction device 2 in the first embodiment is a photographing operation instruction terminal 21 that can remotely instruct the operation of the photographing terminal 11.

  A person who holds the photographing terminal 11 and operates the photographing terminal 11 is referred to as an “operator”, and a person who holds the photographing operation instruction terminal 21 and remotely instructs the operation of the photographing terminal 11 is referred to as an “operation instruction person”. . Also, the input operation performed by the operation instructor is referred to as “operation instruction”, the information output by the operation instruction is referred to as “operation instruction information”, and the content that the operation instruction means is referred to as “operation instruction content”. To do.

  In the second embodiment, the content of the operation instruction is displayed according to the operation instruction information output based on the operation instruction of the operation instructor, and the operator operates the photographing terminal 11 according to the content of the operation instruction to operate remotely. An example of taking a photograph of a composition intended by the instructor will be described.

  The photographing terminal 11 includes an optical input unit 111, a finder image display unit 112, a finder image output unit 113, a photographing unit 115, a photographed image output unit 116, an operation instruction receiving unit 114, a sensor 118, and a communication control unit 117. The As the photographing terminal 11, for example, a mobile phone with a camera or a digital camera with a mobile communication function can be assumed. The optical input unit 111, the finder image display unit 112, the finder image output unit 113, the imaging unit 115, and the captured image output unit 116 correspond to a camera.

  A subject image incident from the lens of the optical input unit 111 is formed on a light receiving surface of an imaging element (not shown) of the optical input unit 111. The imaging device outputs an electrical signal corresponding to the amount of light of the subject image formed on the light receiving surface by a large number of photoelectric conversion cells arranged in a matrix on the light receiving surface. This electric signal is converted into a digital signal by using an analog / digital conversion circuit (not shown), and further, image processing is performed in a signal processing unit (not shown) and output from the optical input unit 111 as an image signal. The finder image display unit 112 displays the image signal output from the optical input unit 111 as a finder image.

  Note that the image sensor is configured by, for example, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). Further, the finder image display unit 112 is a display unit configured by, for example, a liquid crystal or an organic EL (Electro Luminescence).

  The finder image output unit 113 converts a finder image displayed on the finder image display unit 112 into a video signal, and compresses and outputs the video signal for data transfer via the communication control unit 117.

  The photographing unit 115 stores the subject image on the image sensor exposed only for the time determined by the shutter as a photographed image (still image) in a recording medium (not shown). The captured image output unit 116 compresses and outputs the captured image for data transfer via the communication control unit 117. The finder image output from the finder image output unit 113 and the captured image output from the captured image output unit 116 are transmitted to the imaging operation instruction terminal 21 via the communication control unit 117.

  The operation instruction receiving unit 114 receives operation instruction information, which will be described later, from the imaging operation instruction terminal 21 via the communication control unit 117, and displays the contents of the operation instruction corresponding to the operation instruction information on the finder image display unit 112. The contents of the operation instruction displayed on the finder image display unit 112 include a message for specifying the type of operation and a mark for visually instructing the moving direction and moving amount of the photographing terminal 11.

  The sensor 118 is a geomagnetic sensor and a gravity sensor, and inputs the information on the direction in which the optical input unit 111 of the photographing terminal 11 is directed to the operation instruction receiving unit 114, as will be described in detail later. That is, when the photographing terminal 11 is moved up, down, left, and right, the operation instruction receiving unit 114 can identify information regarding the change in the movement. Further, the information on the shooting direction detected by this sensor is also sent to the shooting operation instruction terminal 21 together with the viewfinder image and the shot image, as will be described later.

  The communication control unit 117 is connected to the photographing operation instruction terminal 21 via a communication line, and transmits and receives signals for communication with the photographing operation instruction terminal 21.

  On the other hand, the imaging operation instruction terminal 21 includes a monitor display unit 211, an operation instruction transmission unit 212, a captured image reception unit 213, a monitor display control unit 214, an operation instruction input unit 215, and a communication control unit 216. The photographing operation instruction terminal 21 can be assumed to be a mobile phone, a personal computer with a communication function, or a portable information terminal with a communication function, for example. In addition, the communication function requested | required of the imaging operation instruction | indication terminal 21 is not restricted to a mobile communication function, A wired communication function may be sufficient.

  The monitor display control unit 214 inputs the video signal of the finder image received from the photographing terminal 11 via the communication control unit 216, cancels the compression, and displays it on the monitor display unit 211. The captured image receiving unit 213 inputs a captured image received from the imaging terminal 11 via the communication control unit 216, cancels the compression, and outputs it to the monitor display control unit 214. When the monitor display control unit 214 receives a captured image from the captured image reception unit 213, the monitor display control unit 214 switches the finder image to the captured image and displays it on the monitor display unit 211.

  The operation instructor inputs an operation instruction from the operation instruction input unit 215. For example, the operation instructor inputs an operation instruction including an instruction to move the photographing terminal 11 so that the finder image displayed on the monitor display unit 211 becomes an image display in an intended direction or an intended composition.

  In order for the operation instructor to intuitively input an operation instruction, the operation instruction input unit 215 is configured with a touch panel, for example. A configuration in which the touch panel is attached to the monitor display unit 211 is desirable so that the position on the finder image displayed on the monitor display unit 211 can be easily associated with the position on the touch panel. The monitor display unit 211 is a display unit configured with, for example, liquid crystal or organic EL. Of course, a CRT (Cathode Ray Tube) may be used.

  The operation instruction transmission unit 212 detects an operation instruction input by the operation instructor via the operation instruction input unit 215 superimposed on the monitor display unit 211, analyzes the operation instruction, and outputs operation instruction information. That is, as will be described later, an operation instructor identifies an operation performed on the touch panel using a stylus pen (handwritten character input pen) as a pointing device, and outputs operation instruction information corresponding to the operation. The operation instruction information is sent to the operation instruction receiving unit 114 of the photographing terminal 11 via the communication control unit 216.

  The communication control unit 216 is connected to the photographing terminal 11 via a communication line, and transmits and receives signals for communication with the photographing terminal 11.

  Although not shown in the above configuration, the photographing terminal 11 and the photographing operation instruction terminal 21 have a function of performing voice communication with each other.

  The operation of the second embodiment configured as described above will be described.

  FIG. 8 is a sequence diagram illustrating the operation of the second embodiment.

  As described above, in the second embodiment, the photographing terminal 11 has a mobile communication function, and the communication function of the photographing operation instruction terminal 21 is not limited to the mobile communication function and may be a wired communication function. It is assumed that the photographing terminal 11 and the photographing operation instruction terminal 21 are connected to each other by session control using SIP (Session Initiation Protocol). Moreover, the form connected with the connection destination desired mutually via the application server installed on the internet like a network camera or a web camera may be sufficient.

  First, a session is established between the communication control unit 117 of the photographing terminal 11 and the communication control unit 216 of the photographing operation instruction terminal 21 using a required protocol (S401). In this case, the session establishment request may be issued from either the photographing terminal 11 or the photographing operation instruction terminal 21. When the session is established, functional information is exchanged between the terminals, and multimedia communication is started between the photographing terminal 11 and the photographing operation instruction terminal 21. At this time, camera function information held by the photographing terminal 11 is notified to the photographing operation instruction terminal 21, and the function conditions of the photographing terminal 11 are set in the photographing operation instruction terminal 21. The camera function information includes, for example, the focal length of the lens, the image sensor size, the resolution (display size) type, the presence / absence of the zoom function, the presence / absence of the remote operation function of the camera, and the like. The remote operation function of the camera is a function capable of remotely operating camera shooting condition settings such as an aperture and a shutter speed, zooming in / out, shutter operation, and the like. In the present embodiment, description will be made assuming that there is no camera remote control function.

  Since voice communication is also established at this time, what is the purpose of the operation instruction performed by voice communication between the operation instructor on the photographing operation instruction terminal 21 side and the operator on the photographing terminal 11 side? Recognize each other. For example, in the second embodiment, an object of the operation instructor is to remotely photograph a landscape near the operator with the photographing terminal 11.

  When the operator turns on the camera function of the photographing terminal 11, a finder image is captured and sent to the photographing operation instruction terminal 21 via the communication line as described with reference to FIG. Is displayed.

  FIG. 8 shows an example in which a transmission request for a finder image is automatically performed at the same time as multimedia communication is started without performing voice communication between the operation instructor and the operator.

  When the session is established and multimedia communication is started, a message requesting transmission of a finder image is transmitted from the photographing operation instruction terminal 21 to the photographing terminal 11 (S402). This finder image transmission request is displayed as a message on the finder image display unit 112 of the photographing terminal 11. The operator looks at the finder image transmission request message on the finder image display unit 112 and turns on the camera function of the photographing terminal 11. Thereby, a finder image is captured and sent to the photographing operation instruction terminal 21 via the communication line (S403).

  The photographing terminal 11 sends information about the photographing direction and the angle of view of the camera together with the finder image to the photographing operation instruction terminal 21. The shooting direction is the azimuth angle and vertical angle of the center of the image frame identified by the geomagnetic sensor and gravity sensor of the shooting terminal 11, and the angle of view is the angle of the range of the image shot by the camera of the shooting terminal 11. is there.

  The angle of view can be obtained as the horizontal angle of view from the left end to the right end of the image frame and the vertical angle of view from the upper side to the lower side of the image frame by the relational expression shown in FIG. . That is, the angle of view is a value determined from the focal length of the lens capturing the finder image and the image sensor size. The information on the angle of view is used to accurately associate the finder image size displayed on the monitor display unit 211 of the photographing operation instruction terminal 21 with the finder image size displayed on the finder image display unit 112 of the photographing terminal 11. Information. That is, it is used to display the operation instruction made on the finder image displayed on the photographing operation instruction terminal 21 as the contents of the operation instruction in association with the finder image displayed on the photographing terminal 11 accurately. Information. The contents of the operation instruction in this case include a movement instruction in the direction in which the finder image is displayed and its movement amount.

  As described above, prior to the start of the multimedia communication, the camera function information held by the photographing terminal 11 is notified to the photographing operation instruction terminal 21, and the function conditions of the photographing terminal 11 are set in the photographing operation instruction terminal 21. Is done. Since the camera function information notified at this time includes the focal length of the lens and the image sensor size, the angle of view can be obtained by the relational expression shown in FIG. However, the information on the angle of view is information necessary for matching the operation instruction information between the photographing terminal 11 and the photographing operation instruction terminal 21. For this reason, in this embodiment, the image is transmitted from the photographing terminal 11 to the photographing operation instruction terminal 21 together with the viewfinder image. Further, the information on the shooting direction and the angle of view transmitted from the shooting terminal 11 to the shooting operation instruction terminal 21 is updated when the information changes. That is, the information on the angle of view is updated when the direction of the camera is changed, and the angle of view is updated when the angle of view is changed by zooming in / out.

  In describing S404 and subsequent steps in FIG. 8, FIG. 10 is also referred to.

  FIG. 10 is a diagram illustrating image display examples of the finder image display unit 112 of the photographing terminal 11 and the monitor display unit 211 of the photographing operation instruction terminal 21 according to the second embodiment.

  With reference to FIG. 10, an operation in which the operation instruction input from the operation instruction input unit 215 of the photographing operation instruction terminal 21 is displayed on the finder image display unit 112 of the photographing terminal 11 will be described. The input of the operation instruction performed from the operation instruction input unit 215 is equivalent to the operation instruction performed on the finder image displayed on the monitor display unit 211. Therefore, in the following description, the input operation performed by the operation instructor on the monitor display unit 211 will be described.

  FIG. 10 illustrates an example of an operation performed by the operation instructor on the monitor display unit 211 of the photographing operation instruction terminal 21 on the right side, and the viewfinder image display unit 112 referred to when the operator performs an operation of moving the photographing terminal 11. A display example is shown on the left. In addition, (A), (B), and (C) of FIG. 10 show respective display transitions in time series.

  First, a finder image in the state of FIG. 10A is displayed. The operation instructor wants to take a picture of a composition in which the building at the left end of the finder image is in the center, and gives an operation instruction to point to the building in the finder image displayed on the monitor display unit 211. That is, an operation of pointing the position of the leftmost building with the stylus pen is performed.

  The point-indicated position is identified as coordinates on the touch panel by the operation instruction transmission unit 212 of FIG. Note that the touch panel has a configuration in which the monitor display unit 211 is overlapped and pasted, and the size and position of the finder image displayed on the monitor display unit 211 are identified by the photographing operation instruction terminal 21. Therefore, in the following description, “coordinates on the touch panel” will be described as “coordinates of the finder image on the monitor display unit 211”.

  The photographing operation instruction terminal 21 operates to display an image frame having a new composition on the finder image display unit 112 with respect to the photographing terminal 11. That is, the operation instruction transmission unit 212 identifies the point-indicated position as the coordinates of the finder image on the monitor display unit 211, and the coordinates based on the information on the shooting direction and the angle of view as described later. It is converted into information on the direction and amount of movement from the base point.

  In FIG. 10, the position pointed on the finder image on the monitor display unit 211 is shown, but such a display may be omitted. When such a point indication position is displayed on the finder image, the operation instruction transmission unit 212 notifies the monitor display control unit 214 of the coordinates of the finder image corresponding to the point-indicated position. The monitor display control unit 214 gives a point instruction to the position corresponding to the notified coordinates.

  Then, the operation instruction transmission unit 212 transmits the movement direction and movement amount from the base point of the image frame to the photographing terminal 11 as operation instruction information as information indicating the point-instructed position. In the photographing terminal 11, the operation instruction information transmitted by the operation instruction transmitting unit 212 is received by the operation instruction receiving unit 114 (S404 in FIG. 8).

  The operation instruction receiving unit 114 generates an image frame having a new composition based on the movement direction and movement amount from the base point of the image frame indicated by the operation instruction information. That is, an image frame having a composition in which the pointed position is in the center is generated.

  The operation instruction receiving unit 114 displays the new composition frame on the finder image display unit 112 as the content of the operation instruction (S405 in FIG. 8). At this time, a mark indicating the direction in which the operator should move the photographing terminal 11 may be attached. (A) on the left side of FIG. 10 illustrates an example in which the composition frame and the moving direction are displayed on the finder image display unit 112. That is, the right end of the composition frame is indicated by a dotted line, and an arrow indicating that the camera is moved in the left direction is indicated.

  Here, the coordinates, the base point of the image frame, the moving direction, and the moving amount will be described with reference to FIG.

  FIG. 11 is a diagram illustrating an area of an image frame captured by the camera. The shape of the image frame taken by the camera is determined by the shape of the image sensor as described above. Here, the captured image is displayed on the finder image display unit 112 and the monitor display unit 211. Therefore, three images are handled: an image formed on the image sensor, an image displayed on the finder image display unit 112, and an image displayed on the monitor display unit 211. Each of these three images may be different in size. However, the shapes are all similar. Even if there is a case where the image is displayed in a similar shape, the display device knows the enlargement / reduction ratio from the original image in the horizontal direction and the vertical direction, so that it can be processed essentially as a similar shape.

  The imaging terminal 11 and the imaging operation instruction terminal 21 know the image sensor size. However, the photographing terminal 11 does not know how the finder image is displayed on the monitor display unit 211 of the photographing operation instruction terminal 21. Conversely, the photographing operation instruction terminal 21 does not know how the finder image is displayed on the finder image display unit 112 of the photographing terminal 11. Therefore, it is necessary to perform control so that the point designated in the finder image displayed on the monitor display unit 211 can be identified on the finder image displayed on the finder image display unit 112.

  One control method can be realized by converting the coordinates of the finder image detected on the monitor display unit 211 into coordinates on the image sensor and notifying them.

  The operation instruction transmission unit 212 receives information on how the viewfinder image is displayed on the monitor display unit 211 from the monitor display control unit 214. Therefore, the operation instruction transmission unit 212 can specify the coordinates of the point instruction position identified by the monitor display unit 211 as the coordinates of the finder image displayed on the monitor display unit 211. Then, the coordinates of the finder image specified by the monitor display unit 211 are converted into the coordinates of the image sensor using the similarity relationship and notified to the operation instruction receiving unit 114.

  The operation instruction receiving unit 114 grasps information on how the viewfinder image is displayed on the viewfinder image display unit 112. Then, using the similarity relationship, the operation instruction receiving unit 114 converts the notified coordinates on the image sensor to the coordinates of the finder image displayed on the finder image display unit 112 and displays the points.

  When the control is performed as described above, it is necessary to perform coordinate conversion between the photographing terminal 11 and the photographing operation instruction terminal 21.

  However, in the present embodiment, control using values that can be directly handled by the photographing terminal 11 and the photographing operation instruction terminal 21 is performed using the moving direction and moving amount from the base point of the image frame.

  As described above, the photographing terminal 11 includes the geomagnetic sensor and the gravity sensor, and can acquire information on the photographing direction with respect to the photographed image. The azimuth angle is detected by the geomagnetic sensor, and the vertical angle is detected by the gravity sensor.

  In FIG. 11, the azimuth angle is displayed at the center in the horizontal direction of the image frame, and the vertical angle is displayed at the center in the vertical direction. The azimuth angle is detected in the order of 90 degrees in the east, 180 degrees in the south, and 270 degrees in the west, with zero (0) degrees in the north. As for the vertical angle, the horizontal angle is zero (0) degrees, and the vertical angle that is facing is detected. Further, as described with reference to FIG. 9, information on the angle of view is also obtained. Information on the shooting direction (azimuth angle, vertical angle) and information on the angle of view are shared by the shooting terminal 11 and the shooting operation instruction terminal 21.

  Accordingly, any finder image displayed on the image sensor, the finder image display unit 112, and the monitor display unit 211 is displayed as an image frame area shown in FIG. The azimuth angle, the vertical angle, and the angle of view are the same values in any finder image.

  That is, the operation instruction receiving unit 114 knows how the viewfinder image is displayed on the viewfinder image display unit 112. Therefore, the coordinates of the finder image display unit 112 can be stored in association with information on the shooting direction (azimuth angle, vertical angle) of the finder image. Similarly, the operation instruction transmission unit 212 cooperates with the monitor display control unit 214 to store the coordinates of the monitor display unit 211 in association with information on the shooting direction (azimuth angle, vertical angle) of the finder image. Can do.

  As shown in FIG. 11, the intersection of a vertical line indicating the azimuth angle of the image frame and a horizontal line indicating the vertical angle is referred to as a base point of the image frame. For example, the coordinates of the point designated by the monitor display unit 211 are identified as information indicating how many times and in what direction the azimuth and vertical angle from the base point of the image frame are. Then, the direction and angle information can be directly applied to the finder image display unit 112 to display a point at the position of the finder image on the finder image display unit 112 corresponding to the point indicated by the monitor display unit 211. .

  In the azimuth angle, the right direction is “plus”, the left direction is “minus”, the upper direction is “plus”, and the lower direction is “minus” in the upper and lower angles to identify the moving direction. Further, a value of the movement amount is obtained by correspondence with the angle of view.

  For example, in FIG. 11, it is assumed that the horizontal field angle is 30 degrees and the vertical field angle is 20 degrees. Further, the ratio of the movement amount “a” to the length of the side in the horizontal direction of the image frame is “0.30”, and the ratio of the movement amount “b” to the length of the side in the vertical direction of the image frame is “0. 25 ”. In this case, the movement amount corresponding to “a” is “9.00 degrees”, and the movement amount corresponding to “b” is “5.00 degrees”.

  Accordingly, the operation instruction transmission unit 212 of the photographing operation instruction terminal 21 notifies the operation instruction reception unit 114 of the photographing terminal 11 as “−9.00 degrees, minus 5.00 degrees” as operation instruction information.

  The operation instruction receiving unit 114 of the photographing terminal 11 that has received this operation instruction information displays a point at the same condition position in the finder image on the finder image display unit 112. As a result, the point can be displayed at the same position as the point indicated by the monitor display unit 211. That is, the coordinates of the point moved from the base point of the image frame of the finder image displayed on the finder image display unit 112 by “−9.00 degrees” in the horizontal direction and “−5.00 degrees” in the vertical direction.

  The azimuth angle and the vertical angle may be absolute values instead of relative values. For example, suppose that the azimuth angle detected by the geomagnetic sensor is “173.00 degrees” and the vertical angle detected by the gravity sensor is “plus 3.00 degrees” as the shooting direction of the displayed finder image. In the above example, the point-indicated position is “173.00−9.00 = 164.00” and “3.00−5.00 = −2.00”, and “164.00 degrees, minus “2.00 degrees” is the operation instruction information. Then, the operation instruction receiving unit 114 of the photographing terminal 11 displays a point at a coordinate position corresponding to “164.00 degrees, minus 2.00 degrees” with respect to the finder image on the finder image display unit 112.

  Then, the operation instruction receiving unit 114 of the photographing terminal 11 generates a composition frame centered on the above point and displays it on the finder image display unit 112 as the contents of the operation instruction.

  Returning to FIG.

  The operator who sees the contents of the operation instruction displayed on the finder image display unit 112 moves the camera to the left so that the finder image displayed on the finder image display unit 112 falls within the composition frame. The process of this movement operation is shown as (B) in FIG.

  When the operator moves the photographing terminal 11, the movement is detected by the sensor 118. That is, the movement in the left-right direction is detected by the geomagnetic sensor, and the movement in the vertical direction is detected by the gravity sensor. The detected information is notified to the operation instruction receiving unit 114. The detected information is also notified to the photographing operation instruction terminal 21 via the communication control device 117 together with the transmission of the corresponding finder image.

  The operation instruction receiving unit 114 identifies the difference between the detection value of the sensor indicating the shooting direction before movement and the detection value of the sensor indicating the shooting direction after movement as the movement direction and the movement amount. Then, the composition frame displayed on the finder image display unit 112 is moved to the coordinate position of the value corresponding to the movement amount in the direction opposite to the movement direction.

  The left side of FIG. 10B is a display example of the finder image display unit 112 displayed as described above, and shows a state in which the frame of the finder image is approaching the composition frame.

  On the other hand, information on the new shooting direction is also sent to the shooting operation instruction terminal 21. Therefore, when the point indication is displayed on the monitor display unit 211, the coordinate position on the monitor display unit 211 is the direction opposite to the movement direction and the value corresponding to the movement amount on the same principle as described above. The point indication display moves to. This control is performed by the monitor display control unit 214. The right side of FIG. 10B shows a state in which the position pointed by the operation instructor is approaching the center in the finder image displayed on the monitor display unit 211.

  FIG. 10C shows a state where the pointing operator moves the camera and the viewfinder image enters the composition frame (S406 in FIG. 8). The left side of FIG. 10C shows a state in which the finder image displayed on the finder image display unit 112 has entered the composition frame. Further, the diagram on the right side of FIG. 10C shows a state where the display pointed by the operation instructor has reached the center in the finder image displayed on the monitor display unit 211.

  When the intended composition is reached, the operation instructor issues a photo shooting operation instruction. Operation instruction information for requesting a photographing operation is sent to the photographing terminal 11 and received by the operation instruction receiving unit 114 (S407 in FIG. 8).

  The operation instruction receiving unit 114 displays a message instructing the photographing operation on the finder image display unit 112 as the content of the operation instruction based on the operation instruction information requesting the photographing operation (S408 in FIG. 8).

  The operator sees the message for instructing the photographing operation displayed on the finder image display unit 112, and presses the shutter button to perform the photographing operation. The captured image captured by the imaging unit 115 is compressed by the captured image output unit 116 and transmitted to the imaging operation instruction terminal 21. The captured image is received by the captured image receiving unit 213, the compression is released, and the image is displayed on the monitor display unit 211 via the monitor display control unit 214 (S409 in FIG. 8).

  By repeating the operations from S404 to S409 in FIG. 8 described above, the operation instructor can issue an operation instruction to the operator of the photographing terminal 11 so as to obtain a desired composition and remotely take a photograph. it can.

  When shooting is completed, a session disconnection request is issued from the shooting terminal 11 or the shooting operation instruction terminal 21, thereby disconnecting the communication between the shooting terminal 11 and the shooting operation instruction terminal 21 (S410 in FIG. 8).

  FIG. 12 is a flowchart showing the operation of the photographing terminal 11 described above.

  The photographing terminal 11 captures the image input from the optical input unit 111 as a finder image (S501). The photographing direction at this time is detected by the geomagnetic sensor and the gravity sensor, and the angle of view can also be identified from the focal length of the lens at that time (S502).

  Information on the shooting direction and angle of view is added to the finder image captured in this way, and the information is transmitted to the shooting operation instruction terminal 21 (S503).

  The photographing terminal 11 waits for operation instruction information sent from the photographing operation instruction terminal 21 (S504). When the operation instructor inputs an operation instruction at the imaging operation instruction terminal 21, the imaging terminal 11 receives operation instruction information based on the operation instruction (S504, YES). As described above, this operation instruction information includes the direction (moving direction of the photographing terminal 11) and the amount of movement corresponding to the point instruction of the operation instructor to display the finder image.

  Based on the moving direction and moving amount included in the operation instruction information, the composition frame intended by the operation instructor is displayed on the finder image display unit 112 as the contents of the operation instruction (S505).

  The operator who sees the contents of the operation instruction displayed on the finder image display unit 112 moves the photographing terminal 11 so that the finder image enters the instructed composition frame. That is, the camera moves left, right, up and down in the designated direction.

  This operation by the operator is detected as movement by the geomagnetic sensor and the gravity sensor (S506, YES), and the moving direction and moving amount are identified (S507).

  The composition frame displayed on the finder image display unit 112 is moved in accordance with the left and right, up and down movement directions and movement amounts detected by the geomagnetic sensor and the gravity sensor (S508). That is, the composition frame is moved by the detected movement amount in the direction opposite to the movement direction detected by the geomagnetic sensor and the gravity sensor.

  Thus, the composition frame displayed on the finder image display unit 112 enters the finder image frame displayed on the finder image display unit 112 by the moving operation performed by the operator (S509). When the composition frame approaches a predetermined position where it substantially overlaps the finder image frame (S509, YES), the photographing terminal 11 outputs an approach display that notifies the operator of that fact (S510).

  When the composition frame substantially matches the finder image frame displayed on the finder image display unit 112 (S511, YES), the photographing terminal 11 outputs a reaching display that notifies the operator of the fact (S512). ).

  The approach display and the arrival display are performed by, for example, vibration, sound, voice guide, and blinking.

  Next, an operation example on the monitor display unit 211 and a display example on the finder image display unit 112 corresponding to the operation will be described with reference to FIG.

  FIG. 13 is a diagram illustrating an operation example on the monitor display unit 211 and a display example on the finder image display unit 112 corresponding to the operation.

  FIG. 13A shows an operation in which the operation instructor designates a point desired to be set at the center of the composition as described above. At this time, “Move” is selected as the operation menu before pointing. In this case, as described above, the photographing terminal 11 is notified of the movement direction / movement amount corresponding to the coordinates at the center of the composition as the operation instruction information. As a result, the frame and the moving direction of the new composition are displayed on the finder image display unit 112. The movement amount may be displayed on the screen as shown in FIG. In this case, it means to move “0.5 screen”. The amount of movement to be displayed may be a distance or an angle. In the case of an angle, it may be a relative angle or an absolute angle.

FIG. 13B shows an operation when the operation instructor wants to move the composition. “Move” is selected as the operation menu, then a point is specified, the stylus pen is moved in the direction of movement, and the stylus pen is moved away from the screen at the end of movement. This means that the composition is moved so that the start point position becomes the end point position. In this case, the position (movement direction / movement amount) corresponding to the start point coordinate and the end point coordinate is notified to the photographing terminal 11 as operation instruction information. Thus, the frame, the moving direction, and the moving amount of the new composition are displayed on the finder image display unit 112.
FIG. 13C shows an operation when the operation instructor gives an instruction to zoom in. In this case, “zoom” is selected as the operation menu, and the range to be enlarged is surrounded by a continuous line. Accordingly, the position corresponding to the coordinates indicating the display range and the operation content are notified to the photographing terminal 11 as operation instruction information. In the finder image display unit 112, “Zoom in” is displayed on the screen as the composition frame of the part to be zoomed in and the operation content.

  Although not shown, a specific area may be specified in the same manner as described above, and an instruction to change the resolution of the area may be issued.

  As described above, in the second embodiment, the finder image captured in real time by the photographing terminal 11 can be monitored by the photographing operation instruction terminal 21. Then, the operation instructor inputs an operation instruction including an instruction to move the photographing terminal 11 so that the finder image displayed on the monitor becomes an image display in an intended direction or an intended composition, and the operation instructor enters the communication line via the communication line. The operation instruction information can be sent to the photographing terminal 11. The content of the operation instruction based on the operation instruction information is displayed as a composition frame on the finder image display unit 112 of the photographing terminal 11. Therefore, the operator may move the photographing terminal 11 so that the finder image enters the composition frame. The operation instructor who has confirmed that the viewfinder image has entered the composition frame instructs the operator to perform a photographing operation of the photographing terminal 11. As a result, the operation instructor can remotely take a photograph of a desired composition. In the second embodiment, the content of the operation instruction intended by the operation instructor can be transmitted intuitively and accurately to the operator.

  Next, a modification of the second embodiment will be described.

  The configuration and operation are the same as those shown in FIGS. However, the display on the monitor display unit 211 and the viewfinder image display unit 112 is different from that of the second embodiment.

  FIG. 14 is a schematic diagram illustrating an example of a display screen in the monitor display unit 211 and the finder image display unit 112 according to a modification of the second embodiment. The monitor display unit 211 and the finder image display unit 112 in the modification of the second embodiment have a two-screen configuration. It is divided into a normal display area where a finder image is displayed and a wide-angle display area.

  The wide-angle display area can display a viewing angle that is a multiple of the angle of view of the viewfinder image. The wide-angle display area displays a range of 90 degrees on each of the left and right sides, with the center of the angle of view at which the viewfinder image is currently projected being zero (0). The image frame shown in the center indicates the image display range that is projected at the current angle of view. That is, the center of the left side and the right side of the image frame is the direction in which the photographing terminal 11 is currently facing in the left-right direction.

  The center of the upper side and the lower side of the frame is the direction in which the photographing terminal 11 is currently facing in the vertical direction.

  In the second embodiment, the operation instructor instructs the operator to move within the display of the finder image. However, in the modification of the second embodiment, it is possible to instruct the operation intuitively and accurately so as to move the direction of the camera to an area not displayed in the finder image.

  FIG. 16 is a flowchart for explaining the point indication in the wide-angle display area of the monitor display unit 211 and the point display operation in the wide-angle display area of the finder image display unit 112 based on the modification in the second embodiment. It is.

  FIG. 16A is a flowchart for explaining the operation related to the point instruction in the wide-angle display area of the monitor display unit 211. When receiving the viewfinder image from the photographing terminal 11, the photographing operation instruction terminal 21 also receives information regarding the photographing direction and the angle of view (S601). Therefore, the similar frame corresponding to the angle of view is displayed in the wide-angle display area of the monitor display unit 211 with the shooting direction based on the information as a base point (S602). In addition, a wide-angle display region having a similar shape in the range of 90 degrees in the left and right direction and in the range of 10 degrees in the vertical direction can be easily generated from the field angle.

  The photographing operation instruction terminal 21 waits for an input of a point instruction from the operation instructor (S603). When the operation instruction person inputs a point instruction (S603, YES), the imaging operation instruction terminal 21 causes the operation instruction transmission unit 212 to move left and right, up and down, and move from the base point of the instructed point. Identify the quantity. The amount of movement is identified by an angle (S604).

  The imaging operation instruction terminal 21 transmits left and right, up and down movement directions and movement amounts as operation instruction information to the imaging terminal 11 (S605).

  FIG. 16B is a flowchart illustrating an operation of displaying a point in the wide-angle display area of the finder image display unit 112. The photographing terminal 11 detects information on the photographing direction of the camera that is displaying the current finder image by the geomagnetic sensor and the gravity sensor, and notifies the operation instruction receiving unit 114 of the information (S611). The operation instruction receiving unit 114 displays a similar image frame corresponding to the angle of view in the wide-angle display area of the finder image display unit 112 with the shooting direction based on the information as a base point (S612). A similar wide-angle display area in the range of 90 degrees in the left and right direction and in the range of 10 degrees in the vertical direction can be easily generated from the angle of view.

  The imaging terminal 11 waits for operation instruction information transmitted from the imaging operation instruction terminal 21 (S613). When receiving the operation instruction information from the imaging operation instruction terminal 21 (S613, YES), the imaging terminal 11 identifies the left and right, up and down movement directions and movement amounts included in the operation instruction information in the operation instruction reception unit 114 (S614). ). The amount of movement is identified by an angle. The operation instruction receiving unit 114 attaches a moving point display to a position corresponding to the identified moving direction and moving amount with the current shooting direction as a base point.

  As shown in FIG. 14, the position where the operation instructor inputs a point instruction in the wide-angle display area of the monitor display unit 211 is displayed as a point in the wide-angle display area of the finder image display unit 112.

  The operator sees this display and moves the photographing terminal 11 about 45 degrees to the left.

  As described with reference to FIG. 10B, this movement is detected by the sensor as the photographing terminal 11 moves, so that the wide angle of the finder image display unit 112 is detected by the detected movement amount in the opposite direction to the detected movement direction. Move the point display in the display area. Of course, the finder image in the normal display area displays an image in the moved direction.

  The moving direction and moving amount are also notified to the photographing operation instruction terminal 21 together with the finder image in the moving direction. Accordingly, in the wide-angle display area of the monitor display unit 211, the same processing is performed based on the notified information on the moving direction and moving amount, and the display of the pointed position is moved.

  FIG. 15 shows how the point display moves in the wide-angle display area of the finder image display unit 112 and the point instruction moves in the wide-angle display area of the monitor display unit 211 as the photographing terminal 11 moves. Then, when the photographing terminal 11 approaches the target direction, the composition frame is also displayed in the normal display area.

  As described above, the modification of the second embodiment includes a wide-angle display area in each of the finder image display unit and the monitor display unit, and facilitates an operation instruction to move the direction of the camera to an area not displayed in the finder image. Can be done. The operator can intuitively and accurately understand the content of the operation instruction intended by the operation instruction person.

  Next, a third embodiment will be described.

  FIG. 17 is a block diagram showing the configuration of the third exemplary embodiment of the present invention.

  The third embodiment differs from the photographing operation instruction terminal 21 of the second embodiment in that the photographing operation instruction terminal 22 further includes an image composition unit 226.

  The photographing terminal 12 of the third embodiment has substantially the same configuration as the photographing terminal 11 of the second embodiment. That is, the photographing terminal 12 includes an optical input unit 121, a finder image display unit 122, a finder image output unit 123, a photographing unit 125, a photographed image output unit 126, an operation instruction receiving unit 124, a sensor 128, and a communication control unit 127. Composed. The viewfinder image display unit 122 has a two-screen configuration as shown in FIGS. 14 and 15 described as a modification of the second embodiment.

  On the other hand, the imaging operation instruction terminal 22 includes a monitor display unit 221, an operation instruction transmission unit 222, a captured image reception unit 223, a monitor display control unit 224, an operation instruction input unit 225, an image composition unit 226, and a communication control unit 227. Composed.

  The image composition unit 226 composes a plurality of continuous photographs acquired from the photographing terminal 12 and generates a panoramic photograph. Then, the panoramic photograph generated by the image composition unit 226 is input to the monitor display control unit 224 and displayed in the wide-angle display area of the monitor display unit 221 under the control of the monitor display control unit 224. The wide-angle display area can display a viewing angle that is a multiple of the angle of view of the viewfinder image.

  In the modification of the second embodiment, the operation instructor can give an operation instruction to move the direction of the camera to a region other than the region currently displayed on the finder image. In the third embodiment, an operation instructor can intuitively grasp a desired composition position by displaying a panoramic photograph in a wide-angle display area.

  The operation of the third embodiment will be described with reference to FIG.

  FIG. 18 is a sequence diagram illustrating the operation of the third embodiment.

  A description will be given focusing on operations different from those of the second embodiment described with reference to FIG.

  The operations from the session establishment in S701 to the display of the viewfinder image in S703 on the monitor display unit 221 of the photographing operation instruction terminal 22 are the same as those in the second embodiment.

  An operation instructor who desires to display a panoramic photograph on the monitor display unit 221 and give a remote instruction inputs an operation instruction for specifying “panorama” in the operation menu of the photographing operation instruction terminal 22, for example. With this operation input, operation instruction information for instructing a panorama shooting operation is transmitted to the shooting terminal 12. Upon receiving the operation instruction information for the panorama shooting operation (S704), the shooting terminal 12 displays a message for instructing the panorama shooting operation on the finder image display unit 122 (S705).

  The operator who has seen the message for instructing the panorama shooting operation takes a plurality of surrounding photos while shifting the left and right.

  The plurality of photographed photographs are transmitted to the photographing operation instruction terminal 22, combined with the panoramic photograph by the image composition unit 226, input to the monitor display control unit 224, and controlled by the monitor display control unit 224 to the monitor display unit 221. It is displayed (S706).

  Here, panorama picture composition and display on the monitor display unit 221 will be described with reference to FIGS.

  FIG. 19 is a diagram for explaining a panoramic photo composition method performed by the image composition unit 226. FIG. 19 schematically shows how three images are sent and combined into a panoramic picture.

  As described above, the photographing terminal 12 includes sensors (a geomagnetic sensor and a gravity sensor), and sends information on the photographing direction at the time of photographing attached to the photographed image. Also, information on the angle of view is attached. For example, three photos (A), (B), and (C) shown in FIG. 19 will be described.

  A photograph (A) is a photograph taken with the camera facing in the direction of 327 degrees. The photograph (B) is a photograph taken with the camera in a horizontal state facing the direction of 350 degrees. Further, the photograph (C) is a photograph taken in a state where the camera is in a horizontal state facing the direction of 14 degrees. Here, “north” is set to “zero (0) degree”, and the angle increases clockwise. That is, “East” is displayed as “90 degrees”, “South” as “180 degrees”, and “West” as “270 degrees”. Therefore, these photographs are photographs from “northwest” to “northeast”. In addition, although the vertical direction of the camera is also shown, here, for the sake of simplicity, all the photos are taken with the camera being in a horizontal state.

  The angle of view is 30 degrees in the left-right direction and 20 degrees in the up-down direction. As described above, this is a value determined by the focal length of the lens and the image sensor size.

  Therefore, panoramic photographs as shown in the lower part of FIG. 19 are obtained by superimposing overlapping portions of the azimuth angles of the pictures, as shown in the middle part of FIG. Can be synthesized. Of course, if there is a vertical shift in each photo, the overlapping portions in the vertical direction may be overlapped.

  In this embodiment, the panoramic photograph is synthesized from the information on the photographing direction and the angle of view of the photograph. However, the present invention is not necessarily limited to this method, and the panoramic photograph may be synthesized by an arbitrary method. For example, there is a method of synthesizing a panoramic photograph by extracting feature points of images of each photograph and superimposing the feature points.

  The panoramic photograph synthesized as described above is sent from the image composition unit 226 to the monitor display control unit 224. The monitor display control unit 224 displays the finder image that has been subsequently sent from the photographing terminal 12 to the photo sent for panoramic photo composition and the panoramic photo on the monitor display unit 221.

  FIG. 20 is a diagram illustrating a display example of a finder image and a panoramic photograph on the monitor display unit 221.

  In this display example, the monitor display unit 221 has a two-screen configuration of a normal display area and a wide-angle display area. A finder image sent from the photographing terminal 12 is displayed in the normal display area, and a panoramic photograph is displayed in the wide-angle display area. This panoramic photograph is displayed in a positional relationship corresponding to the currently sent viewfinder image. Then, the image frame of the area where the current viewfinder image is displayed is displayed so as to be superimposed on the panoramic picture.

  Note that, in the display in the wide-angle display area, the current shooting direction is set to “zero (0) degree”, and the left and right areas are displayed in the same manner as described in the modification of the second embodiment. It is configured. Therefore, the azimuth angle displayed in the wide-angle display area is shown as a relative azimuth angle. As described with reference to FIG. 19, the azimuth angle detected by the photographing terminal 12 and notified to the photographing operation instruction terminal 22 is the absolute azimuth angle detected by the geomagnetic sensor. Of course, the display in the wide-angle display area may be displayed with an absolute azimuth angle. In that case, the azimuth angle at which the current viewfinder image is taken is displayed in the center.

  The operation instructor can intuitively grasp the desired composition by viewing the panoramic photograph of the wide-angle display area of the monitor display unit 221. Then, a point instruction is input on the panoramic photograph in the wide-angle display area so as to achieve the composition. That is, the center point of the desired composition is pointed (S707 in FIG. 18).

  As in the case of the operation of the modification of the second embodiment with reference to FIG. 16, the angle indicates how much the moving direction and the moving amount of the instructed point is from left to right and up and down from the base point. Identified. The base point is the center point of the current viewfinder image. For example, in the display example of FIG. 20, there is no movement in the vertical direction, and it is identified that the movement is “32 degrees to the left”. Then, the shooting operation instruction terminal 22 transmits left and right, up and down movement directions and movement amounts to the shooting terminal 12 as operation instruction information.

  Further, the display of the monitor display unit 221 may be as shown in FIG. 21 under the control of the monitor display control unit 224. In the case of this display example, the entire monitor display unit 221 is used as a wide-angle display area, not a two-screen configuration. In this case, since the panoramic picture can be displayed larger than in the case of the two-screen configuration, the operation instructor can determine a desired composition more intuitively.

  In this case, the image frame of the area where the finder image sent from the photographing terminal 12 is displayed is displayed on the panoramic picture. Alternatively, the viewfinder image may be processed into a transparent image and displayed on the panoramic photograph. Conversely, the panoramic photograph may be made a transparent image and overlapped with the viewfinder image.

  On the other hand, the imaging terminal 12 in the third embodiment performs the same operation as that of the modification of the second embodiment. FIG. 22 is a diagram illustrating a display example of the finder image display unit 122 of the photographing terminal 12 according to the third embodiment.

  The photographing terminal 12 detects information on the photographing direction of the camera that is displaying the current finder image by the geomagnetic sensor and the gravity sensor, and notifies the operation instruction receiving unit 124 of the information. The operation instruction receiving unit 124 displays a similar image frame corresponding to the angle of view of the finder image at the center of the wide angle display area of the finder image display unit 122 with the shooting direction based on the information as a base point. Note that the wide-angle display area displays, for example, a range of 90 degrees in the horizontal direction and 20 degrees in the vertical direction from the center of the image frame.

  When receiving the operation instruction information from the imaging operation instruction terminal 22, the operation instruction receiving unit 124 of the imaging terminal 12 identifies the left and right, upper and lower movement directions and movement amounts included in the operation instruction information. Then, the operation instruction receiving unit 124 attaches a movement point display to a position corresponding to the identified movement direction and movement amount with the current shooting direction as a base point (S708 in FIG. 18). FIG. 22A shows a display example of this state.

  The operator sees this display and moves the photographing terminal 12 32 degrees to the left.

  Since this movement is detected by the sensor as the photographing terminal 12 moves, the operation instruction receiving unit 124 points in the wide-angle display area of the finder image display unit 122 by the detected movement amount in the direction opposite to the detected movement direction. Move the display. Of course, the finder image in the normal display area displays an image in the moved direction.

  Further, the moving direction and the moving amount are notified to the photographing operation instruction terminal 22 together with the finder image showing the moving direction. Accordingly, the same processing is performed in the wide-angle display area of the monitor display unit 221 based on the notified information on the moving direction and moving amount, and the display of the pointed position is moved (S709 in FIG. 18).

  FIG. 22B shows how the point display moves in the wide-angle display area of the finder image display unit 122 as the photographing terminal 12 moves. Then, when the direction of the photographing terminal 12 approaches the target direction, the composition frame is also displayed in the normal display area. FIG. 23 shows how the point instruction moves together with the panoramic picture as the photographing terminal 12 moves in the wide-angle display area of the display example shown in FIG.

  In the third embodiment as well, an approach display is output when the composition frame displayed on the finder image display unit approaches a predetermined position almost overlapping with the display frame of the finder image display unit due to an operator's moving operation. To do. Further, when the composition frame substantially coincides with the display frame of the finder image display unit, an arrival display is output. These approach display and arrival display are performed by, for example, vibration, sound, voice guide, and blinking.

  With the configuration described above, the third embodiment can display a panoramic photograph on the photographing operation instruction terminal. The operation instructor can intuitively grasp a desired composition position in an area other than the area currently displayed on the finder image, and can issue an operation instruction to move the direction of the camera.

  A modification of the third embodiment will be described.

  In the modification of the third embodiment, a panoramic photograph synthesized by the photographing operation instruction terminal is also displayed in the wide angle display area of the finder image display unit of the photographing terminal.

  A modification of the third embodiment is the same as the configuration of the third embodiment shown in FIG. The panoramic photograph synthesized by the image synthesis unit 226 is sent to the monitor display control unit 224 and displayed on the monitor display unit 221 under the control of the monitor display control unit 224. At this time, the monitor display control unit 224 also sends the panoramic photograph to the operation instruction transmission unit 222 and instructs the photographing terminal 12 to transmit it.

  The operation instruction transmission unit 222 transmits the panoramic photograph to the photographing terminal 12 via the communication line. At this time, the operation instruction transmission unit 222 performs processing such as image compression as necessary. In addition, the transmitted panoramic photograph is attached with azimuth and vertical angle information corresponding to the image frame of the panoramic photograph.

  The photographing terminal 12 that has received the panoramic photo from the photographing operation instruction terminal 22 performs processing for displaying the panoramic photo in the wide-angle display area of the finder image display unit 122 in the operation instruction receiving unit 124. At this time, the operation instruction receiving unit 124 performs processing such as image decompression as necessary, and displays the panoramic photo on the wide angle display of the finder image display unit 122 based on the azimuth and vertical angle information attached to the panoramic photo. Display at the corresponding position in the region.

  The above-described operation is performed between the operations of S706 and S707 in the sequence diagram shown in FIG.

  By configuring and operating as described above, the modified example of the third embodiment can display a panoramic picture not only on the photographing operation instruction terminal but also on the photographing terminal. Then, even if the operator of the photographing terminal gives an operation instruction to move the direction of the camera to an area not displayed in the finder image, the instruction of the operator is intuitive and accurate. Can understand.

  A fourth embodiment will be described.

  In the fourth embodiment, a panoramic photograph is synthesized by a photographing terminal, sent to a photographing operation instruction terminal, and displayed on a wide-angle display area of a finder image display unit of the photographing terminal and a monitor display unit of the photographing operation instruction terminal.

  FIG. 24 is a block diagram showing the configuration of the fourth embodiment.

  In the fourth embodiment, the photographing terminal 13 includes an image composition unit 136. Further, the shooting operation instruction terminal 23 corresponds to a configuration in which the image composition unit 226 is removed from the shooting operation instruction terminal 22 of the third embodiment.

  The photographing terminal 13 includes an optical input unit 131, a finder image display unit 132, a finder image output unit 133, a photographing unit 135, an image composition unit 136, a photographed image output unit 133, an operation instruction receiving unit 134, a sensor 138, and a communication control unit 139. It is comprised including. The viewfinder image display unit 132 has a two-screen configuration as shown in FIGS. 14 and 15 described as a modification of the second embodiment and FIG. 22 described as the third embodiment.

  On the other hand, the imaging operation instruction terminal 23 includes a monitor display unit 231, an operation instruction transmission unit 232, a captured image reception unit 233, a monitor display control unit 234, an operation instruction input unit 235, and a communication control unit 236.

  FIG. 25 is a sequence diagram illustrating the operation of the fourth embodiment. The description will focus on the differences from the operation of the third embodiment described with reference to FIG.

  An operation instructor who desires to display a panoramic photograph on the monitor display unit 231 to give a remote instruction, for example, “panorama” displayed on the operation menu of the photographing operation instruction terminal 23, as in the third embodiment. Enter an operation instruction to specify. With this operation input, operation instruction information for instructing a panorama shooting operation is transmitted to the shooting terminal 13. Upon receiving the operation instruction information for the panorama shooting operation (S804), the shooting terminal 13 displays a message for instructing the panorama shooting operation on the finder image display unit 132 (S805).

  The operator who has seen the message instructing the panorama shooting operation shoots a plurality of surrounding photos while shifting the left and right, and selects and operates the operation menu for panorama photo composition.

  By this operation, the image composition unit 136 composes a plurality of taken continuous photographs to generate a panoramic photograph. Then, the panoramic photograph generated by the image composition unit 136 is input to the operation instruction receiving unit 134 and displayed in the wide-angle display area of the finder image display unit 132 under the control of the operation instruction receiving unit 134.

  Note that the composition of the panoramic photograph and the display in the wide-angle display area are controlled based on the azimuth and vertical angle information added to the photographed image as described in the third embodiment.

  At this time, the synthesized panoramic photograph is also input to the photographed image output unit 137, subjected to processing such as image compression by the photographed image output unit 137, and transmitted to the photographing operation instruction terminal 23 via the communication line. Is done.

  The photographing operation instruction terminal 23 receives the panoramic photograph by the photographed image receiving unit 233, cancels the image compression, and displays the panoramic photograph on the monitor display unit 231 under the control of the monitor display control unit 231 (S806).

  The display form of the monitor display unit 231 may be a display provided with a wide-angle display area as shown in FIG. 20 described in the third embodiment, or the normal display area is changed for wide-angle use as shown in FIG. You may make it do. The display of the panoramic photograph on the monitor display unit 231 is controlled based on the azimuth and vertical angle information added to the photographed image as described in the third embodiment.

  The operation instructor can intuitively grasp the desired composition by viewing the panoramic photograph of the wide-angle display area of the monitor display unit 231. Then, a point instruction is input on the panoramic photograph in the wide-angle display area so as to achieve the composition. That is, a point is designated at the center of the desired composition.

  The operation instruction input by the operation instructor is sent to the photographing terminal 13 as operation instruction information (S807), and as described in the modification of the second embodiment and the third embodiment, the content of the operation instruction is The image is displayed in the wide-angle display area of the finder image display unit 132.

  At this time, in the fourth embodiment, a panoramic photograph is displayed in the wide-angle display area of the finder image display unit 132. Then, the content of the operation instruction is displayed at the corresponding position of the panoramic photograph (S808).

  Subsequent operations are the same as those in the third embodiment, and a description thereof will be omitted.

  In the fourth embodiment as well, an approach display is output when the composition frame displayed on the finder image display unit approaches a predetermined position that substantially overlaps the display frame of the finder image display unit due to the movement operation of the operator. To do. Further, when the composition frame substantially coincides with the display frame of the finder image display unit, an arrival display is output. These approach display and arrival display are performed by, for example, vibration, sound, voice guide, and blinking.

  By configuring as described above, the fourth embodiment has the same effects as the modified example of the third embodiment. In other words, even if the operator of the photographing terminal gives an operation instruction to move the direction of the camera to an area not displayed in the viewfinder image, the instruction of the operation instruction person is intuitive and accurate. Can understand.

  Further, in the description of each of the above embodiments, it has been described that a message based on a request or operation instruction information sent from the imaging operation instruction terminal to the imaging terminal is displayed on the finder image display unit. In this case, the photographing terminal may be configured to emit the message content by synthesized speech. For example, in the case of a viewfinder image transmission request, “Please turn on the camera and send the viewfinder image” is issued. In the case of operation instruction information for instructing a panorama shooting operation, the message “Please take a panoramic photo of the surrounding area and send the image” is issued. Then, in the case of operation instruction information for instructing a shooting operation, “Please shoot with the current composition” is issued. Also, when instructing a zoom-in operation, “Please zoom in” is issued. With this configuration, the operator can more accurately grasp the contents designated by the operation instructor.

  Further, the description of each of the above embodiments has been made assuming that the photographing terminal does not have a camera remote control function. However, if the camera has a remote control function, the camera operator can remotely control the camera's shooting conditions such as aperture and shutter speed, change the resolution, zoom in / zoom out, and shutter operation from the shooting command terminal. Needless to say, you can.

DESCRIPTION OF SYMBOLS 10 Image acquisition means 11, 12, 13 Shooting terminal 31, 101, 111, 121, 131 Optical input part 32, 102, 112, 122, 132 Viewfinder image display part 33, 103, 113, 123, 133 Viewfinder image output part 34 104, 114, 124, 134 Operation instruction receiving unit 115, 125, 135 Shooting unit 116, 126, 137 Captured image output unit 117, 216, 127, 227, 139, 236 Communication control unit 118, 128, 138 Sensor 20 Image Display operation instruction means 21, 22, 23 Shooting operation instruction terminal 41, 201, 211, 221, 231 Monitor display unit 42, 202, 212, 222, 232 Operation instruction transmission unit 213, 223, 233 Captured image reception unit 214, 224 234 Monitor display control unit 215, 225, 23 Operation instruction input unit 136,226 image synthesizing unit 30 the image acquisition apparatus 40 image display operation instructing device

Claims (40)

An image acquisition means including a finder image display unit that displays an image input from the optical input unit as a finder image, a finder image output unit that outputs the finder image via a communication line, and via the communication line. A monitor display unit for displaying the input finder image on a monitor, and an operation for instructing an operation related to image acquisition including an input direction or composition of the finder image input to the finder image displayed on the monitor display unit An image display operation instruction unit including an operation instruction transmission unit that outputs an instruction as operation instruction information via the communication line, and the image acquisition unit is configured to output the operation instruction output by the image display operation instruction unit. An operation instruction for inputting information via the communication line and displaying the contents of the operation instruction on the finder image display unit Remote video display system comprising a signal unit. The image acquisition means further includes a sensor for detecting a shooting direction including an azimuth angle and a vertical angle of the finder image, and adds the shooting direction information and the view angle information of the finder image to the finder image. The operation instruction transmitting unit outputs the operation instruction input to the finder image displayed on the monitor display unit and is specified on the finder image of the monitor display unit. The operation instruction information including position information based on the direction information and the angle-of-view information is output, and the operation instruction receiving unit is configured to output the finder image display unit based on the position information included in the input operation instruction information. A position based on the shooting direction information and the angle-of-view information specified on the finder image is identified, and the operation instruction is displayed on the finder image display unit. Remote image display system according to claim 1, characterized in that subjecting the display to. The monitor display unit displays a first display area for displaying the finder image, an image frame corresponding to the angle of view of the finder image, and a second display for displaying a viewing angle that is a predetermined multiple of the angle of view. The viewfinder image display unit displays a first display area for displaying the viewfinder image and an image frame corresponding to the angle of view of the viewfinder image, and has a viewing angle that is a predetermined multiple of the angle of view. A second display area to be displayed, wherein the operation instruction transmission unit displays the operation instruction input to an area other than the image frame in the second display area of the monitor display unit. Output as the operation instruction information including position information based on the shooting direction information and the angle-of-view information specified on the second display area of the unit, and the operation instruction receiving unit receives the input operation instruction information Based on the position information included, the position based on the shooting direction information and the angle-of-view information specified on the second display area of the finder image display unit is identified, and the position of the finder image display unit is determined. The remote image display system according to claim 2, wherein a display corresponding to the operation instruction is attached to the display area of 2. The image acquisition means includes an imaging unit that captures an image input from the optical input unit, a captured image captured by the imaging unit, adds imaging direction information and angle-of-view information of the captured image, and connects the communication line. A captured image output unit that outputs the captured image output from the image acquisition unit via the communication line; and a captured image reception unit that receives the captured image output from the image acquisition unit via the communication line. The finder image input from the photographic image input unit and the photographic image input from the photographic image receiving unit are switched and displayed on the monitor display unit, and the operation is performed on the finder image displayed on the monitor display unit. The remote image display system according to claim 3, further comprising an operation instruction input unit for inputting an instruction. The image display operation instructing unit further includes an image combining unit that combines a plurality of the captured images output by the image acquisition unit acquired by the captured image receiving unit and outputs a panoramic photograph, and the monitor display control unit includes 5. The remote image display system according to claim 4, wherein the panoramic photograph is displayed in the second display area of the monitor display unit. The image display operation instructing unit further includes an image synthesis unit that synthesizes a plurality of the captured images output by the image acquisition unit acquired by the captured image reception unit and outputs as a panoramic photograph, and the monitor display unit includes: A display area that displays a viewing angle that is a predetermined angle of view of the viewfinder image, and the monitor display control unit corresponds to the shooting direction information and the view angle information of the panoramic photograph. The remote image display system according to claim 4, wherein the panoramic photograph is displayed at a position based on the shooting direction information and the angle-of-view information specified on the display area. The remote image display system according to claim 6, wherein the monitor display control unit displays the finder image so as to overlap the corresponding position of the panoramic photograph. The operation instruction receiving unit identifies a moving direction and a moving amount of the image acquisition unit based on the photographing direction detected by the sensor, and displays the finder image display unit corresponding to the moving direction and the moving amount. 8. The remote image display system according to claim 2, wherein a display corresponding to the displayed operation instruction is moved. The operation instruction receiving unit identifies a movement direction and a movement amount of the image acquisition unit based on the photographing direction detected by the sensor, and the movement direction and the movement amount correspond to a display corresponding to the operation instruction. 9. The remote image display system according to claim 8, wherein when the predetermined range is reached, a display notifying that is output. The present invention relates to a finder image display unit that displays an image input from an optical input unit as a finder image, a finder image output unit that outputs the finder image via a communication line, and image acquisition including an input direction or composition of the finder image. An image comprising: an operation instruction receiving unit that inputs operation instruction information related to an operation instruction for instructing an operation via the communication line and displays the contents of the operation instruction on the finder image display unit. Acquisition device. A sensor for detecting a shooting direction including an azimuth angle and a vertical angle of the viewfinder image; and adding the shooting direction information and the view angle information of the viewfinder image to the viewfinder image and outputting the information via the communication line, The operation instruction receiving unit is arranged on the finder image display unit of the finder image display unit based on the shooting direction information specified on the finder image included in the input operation instruction information and the position information based on the field angle information. The image acquisition apparatus according to claim 10, wherein a position based on the shooting direction information and the angle-of-view information specified in step (b) is identified, and a display corresponding to the operation instruction is attached to the finder image display unit. The finder image display unit displays a first display area for displaying the finder image and an image frame corresponding to an angle of view of the finder image, and displays a view angle of a predetermined multiple of the angle of view. A display area, wherein the operation instruction receiving unit is configured to display the second display of the viewfinder image display unit based on position information based on the shooting direction information and the angle of view information included in the input operation instruction information. The position based on the shooting direction information and the angle-of-view information specified on a region is identified, and a display corresponding to the operation instruction is attached to the second display region of the finder image display unit. Item 12. The image acquisition device according to Item 11. The operation instruction receiving unit identifies a moving direction and a moving amount of the image acquisition unit based on the photographing direction detected by the sensor, and displays the finder image display unit corresponding to the moving direction and the moving amount. The image acquisition apparatus according to claim 11, wherein a display corresponding to the displayed operation instruction is moved. The operation instruction receiving unit identifies a movement direction and a movement amount of the image acquisition unit based on the photographing direction detected by the sensor, and the movement direction and the movement amount correspond to a display corresponding to the operation instruction. The image acquisition apparatus according to claim 13, wherein when the predetermined range is reached, a display notifying that is output. A monitor display unit that displays an image input from the image acquisition device via a communication line as a finder image on a monitor, and an input direction or composition of the finder image input to the finder image displayed on the monitor display unit An operation instruction transmission unit that outputs an operation instruction for instructing an operation relating to image acquisition including the operation instruction information for displaying on the image acquisition apparatus via the communication line. Operation instruction device. The finder image is added with shooting direction information and field angle information including the azimuth and vertical angles of the finder image, and the operation instruction transmission unit is input to the finder image displayed on the monitor display unit. The operation instruction is output as the operation instruction information including the shooting direction information specified on the finder image of the monitor display unit and position information based on the angle-of-view information. The image display operation instruction device described. The monitor display unit displays a first display area for displaying the finder image, an image frame corresponding to the angle of view of the finder image, and a second display for displaying a viewing angle that is a predetermined multiple of the angle of view. And the operation instruction transmitting unit outputs the operation instruction input to an area other than the image frame in the second display area of the monitor display unit. 17. The image display operation instruction device according to claim 16, wherein the image display operation instruction device outputs the operation instruction information including position information based on the shooting direction information and the angle-of-view information specified on a display area. An image composition unit that synthesizes a plurality of captured images input from the image acquisition device via the communication line and outputs them as a panoramic photograph, and a monitor that displays the panoramic photograph in the second display area of the monitor display unit The image display operation instruction device according to claim 17, further comprising a display control unit. The monitor display unit includes a display area that displays a viewing angle that is a predetermined angle of view of the viewfinder image, and combines a plurality of captured images input from the image acquisition device via the communication line as a panoramic photograph. A position based on the shooting direction information and the angle-of-view information specified on the display area of the monitor display unit corresponding to the shooting direction information and the angle-of-view information of the panoramic photograph to be output. The image display operation instruction device according to claim 17, further comprising a monitor display control unit that displays the panoramic photograph. The image display operation instruction device according to claim 19, wherein the monitor display control unit displays the finder image so as to overlap the corresponding position of the panoramic photograph. An image acquisition unit displays an image input from the optical input unit on the finder image display unit as a finder image, outputs the finder image via a communication line, and an image display operation instruction unit passes the communication line. The input finder image is displayed on a monitor display unit, and an operation instruction is input to the finder image displayed on the monitor to instruct an operation related to image acquisition including an input direction or composition of the finder image. Output as operation instruction information via a communication line, and the image acquisition means inputs the operation instruction information via the communication line, and displays the contents of the operation instruction on the finder image display unit. Remote image display method. The sensor of the image acquisition unit detects a shooting direction including an azimuth angle and a vertical angle of the finder image, and the image acquisition unit adds the shooting direction information and the view angle information of the finder image to the finder image. And the image display operation instruction means outputs the operation instruction input to the finder image displayed on the monitor display unit on the finder image of the monitor display unit. The operation instruction information including position information based on the specified shooting direction information and the angle-of-view information is output, and the image acquisition unit performs the finder based on the position information included in the input operation instruction information. A position based on the shooting direction information and the angle-of-view information specified on the finder image of the image display unit is identified, and the position is displayed on the finder image display unit. Remote image display method according to claim 21, wherein subjecting the display corresponding to the operation instruction. The monitor display unit displays a first display area for displaying the finder image and an image frame corresponding to an angle of view of the finder image, and a second display for displaying a viewing angle that is a predetermined multiple of the angle of view. An image area corresponding to the angle of view of the viewfinder image, and a viewing angle that is a predetermined multiple of the angle of view. A second display area to be displayed, and the image display operation instruction means outputs the operation instruction input to an area other than the image frame in the second display area of the monitor display unit. The operation instruction information including position information based on the shooting direction information and the angle-of-view information specified on the second display area of the display unit is output and the operation instruction input by the image acquisition unit Identifying the position based on the shooting direction information and the angle-of-view information specified on the second display area of the finder image display unit based on the position information included in the report, and 23. The remote image display method according to claim 22, wherein a display corresponding to the operation instruction is attached to the second display area. The image acquisition means further captures an image input from the optical input unit, outputs the captured image, via the communication line, by adding imaging direction information and angle of view information of the captured image, The image display operation instruction means further receives the captured image output from the image acquisition means via the communication line, and switches between the finder image and the captured image input via the communication line to switch the monitor display unit. The remote image display method according to claim 23, wherein the operation instruction is input to the finder image displayed on the monitor display unit. The image display operation instruction unit combines a plurality of the captured images output from the image acquisition unit as a panoramic photograph, and displays the panoramic photograph in the second display area of the monitor display unit. The remote image display method according to claim 24. The monitor display unit includes a display area that displays a viewing angle that is a predetermined angle of view of the viewfinder image, and the image display operation instruction unit uses the plurality of captured images output by the image acquisition unit as panoramic photographs. The panorama is combined and positioned at the position based on the shooting direction information and the angle of view information specified on the display area of the monitor display unit corresponding to the shooting direction information and the angle of view information of the panoramic photograph. The remote image display method according to claim 24, wherein a photograph is displayed. 27. The remote image display method according to claim 26, wherein the image display operation instruction means displays the finder image so as to overlap the corresponding position of the panoramic photograph. The image display operation instruction means identifies the movement direction and movement amount of the image acquisition means based on the photographing direction detected by the sensor, and the viewfinder image display section corresponds to the movement direction and movement amount. The remote image display method according to any one of claims 22 to 27, wherein the display corresponding to the operation instruction displayed on the screen is moved. The image display operation instruction means identifies the movement direction and movement amount of the image acquisition means based on the photographing direction detected by the sensor, and the movement direction and movement amount are displayed on the display corresponding to the operation instruction. 29. The remote image display method according to claim 28, wherein when a corresponding predetermined range is reached, a display notifying that is output. An operation instruction related to an operation instruction that displays an image input from the optical input unit as a finder image, outputs the finder image via a communication line, and instructs an operation related to image acquisition including an input direction or composition of the finder image. An image acquisition method comprising: inputting information via the communication line and displaying the contents of the operation instruction on the finder image display unit. The shooting direction including the azimuth and vertical angle of the finder image is detected by a sensor, the shooting direction information and the view angle information of the finder image are added to the finder image and output via the communication line, and the input Based on the shooting direction information specified on the finder image included in the operation instruction information and position information based on the angle of view information, the shooting direction information specified on the finder image of the finder image display unit; The image acquisition method according to claim 30, wherein a position based on the angle-of-view information is identified, and a display corresponding to the operation instruction is attached to the finder image display unit. The finder image display unit displays a first display area for displaying the finder image and an image frame corresponding to the angle of view of the finder image, and displays a viewing angle that is a predetermined multiple of the angle of view. A display area, and specified on the second display area of the finder image display unit based on the shooting direction information and the position information based on the angle-of-view information included in the input operation instruction information 32. The image acquisition method according to claim 31, wherein a position based on the photographing direction information and the angle-of-view information is identified, and a display corresponding to the operation instruction is attached to the second display area of the finder image display unit. . A movement direction and a movement amount are identified based on the photographing direction detected by the sensor, and a display corresponding to the operation instruction displayed on the finder image display unit is moved in accordance with the movement direction and the movement amount. The image acquisition method according to claim 31 or 32. A movement direction and a movement amount are identified based on the photographing direction detected by the sensor, and when the movement direction and the movement amount reach a predetermined range corresponding to the display corresponding to the operation instruction, that fact 34. The image acquisition method according to claim 33, wherein a display for notifying is output. An image input from the image acquisition device via a communication line is displayed on a monitor as a finder image, and an operation related to image acquisition including an input direction or composition of the finder image input to the finder image displayed on the monitor is performed. An image display operation instruction method characterized by outputting an operation instruction to be instructed as operation instruction information for displaying on the image acquisition device via the communication line. The viewfinder image is added with shooting direction information and field angle information including the azimuth angle and vertical angle of the viewfinder image, and the operation instruction input to the viewfinder image displayed on the monitor display unit, 36. The image display operation instruction method according to claim 35, wherein the operation instruction information is output as the operation instruction information including the shooting direction information specified on the finder image of the monitor display unit and the position information based on the angle of view information. . The monitor display unit displays a first display area for displaying the finder image and an image frame corresponding to an angle of view of the finder image, and a second display for displaying a viewing angle that is a predetermined multiple of the angle of view. An operation instruction input to an area other than the image frame of the second display area of the monitor display unit is specified on the second display area of the monitor display unit 37. The image display operation instruction method according to claim 36, wherein the operation instruction information is output as the operation instruction information including position information based on the photographing direction information and the angle of view information. 38. A plurality of captured images input from the image acquisition device via the communication line are combined as a panoramic photograph, and the panoramic photograph is displayed in the second display area of the monitor display unit. The image display operation instruction method described in 1. The monitor display unit includes a display area that displays a viewing angle that is a predetermined angle of view of the viewfinder image, and combines a plurality of captured images input from the image acquisition device via the communication line as panoramic photographs, The panoramic photograph is displayed at a position based on the photographing direction information and the angle of view information specified on the display area of the monitor display unit corresponding to the photographing direction information and the angle of view information of the panoramic photograph. The image display operation instruction method according to claim 37, wherein: 40. The image display operation instruction method according to claim 39, wherein the finder image is displayed so as to overlap with a corresponding position of the panoramic photograph.

Images