JP2006222617A - Remote photography system, remote display controller, and remote photographic device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a suitable remote photographic device which significantly reduces the trouble for setting a zoom viewing angle. <P>SOLUTION: The remote photography system comprises a remote photographing terminal which is equipped with a view-angle controllable photographic means and a communication means, and performs view angle control according to a received control instruction and transmits a photographed image, and a display control terminal which is equipped with a means of inputting operation instructions and a communication means, and transmits view angle change request to the remote photographic device and displays a received image. Further, the system is equipped with a means of detecting the shape and the position of an object included in the photographed image and a means of making the instruction input means and the object correspond in each arrangement and varying the view angle, when there is an input to the instruction means so that the object made to correspond to the instruction input means can be included. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a network camera system that performs image display and control operations via communication means.

  2. Description of the Related Art Conventionally, devices with names such as surveillance cameras and network cameras are known as devices / systems for remotely displaying camera images and performing control operations. These connect a camera terminal and a display control terminal via a communication line. The user can browse the image of the camera from a remote place using the display control terminal, and can change the angle of view of the camera, the shooting parameters, and the like. The communication line to be connected is realized using a wired line such as ISDN or the Internet, a wireless line such as a wireless LAN, or a mobile phone network. Some display control terminals use a dedicated display device, PC, or mobile phone. There are also camera terminals corresponding to a plurality of communication lines and display control terminals.

  As a remote camera image display, a camera image being shot is displayed remotely. Some display control terminals have a recording function.

  Control operations for the remote camera include those relating to parameter setting, shooting control, and angle of view control. Parameter settings include initial conditions such as white balance, exposure settings, and trigger settings for abnormality notification. In the shooting control, the camera power is turned on / off and recording is started / stopped. The view angle control performs horizontal movement (panning), vertical movement (tilt), enlargement / reduction (zoom), and the like of the camera view angle.

The following methods have been proposed as methods for remotely controlling the angle of view.
(1) A remote camera system that performs pan / tilt / zoom operations by operating a slide bar displayed on a finder surface on a PC screen has been realized (for example, see Non-Patent Document 1).
(2) A method for controlling the angle of view of a camera using a portable terminal or a PDA has been proposed. The zoom control of the camera and the adjustment of the camera angle can be performed by operating a button or a finger control lever that can be moved up, down, left and right (see, for example, Patent Document 1).
(3) A method for controlling the angle of view of a camera using a mobile phone has been proposed. The mobile phone receives control data in which its numeric keypad is associated with camera operation, and transmits corresponding camera control data when the numeric keypad is operated. When the “2” key is pressed down, it is tilted up, and with the “8” key, it is tilted down (see, for example, Patent Document 2).
(4) A method of dividing the screen into areas corresponding to a plurality of directions and controlling the camera in the direction of the pointing area has been devised. When the right region is pointed on the screen, it operates to pan or zoom in the right direction (see, for example, Patent Document 3).
(5) A method of displaying an image on an image server on a mobile terminal has been proposed. A plurality of image data files with different resolutions divided on the matrix are stored on the image server, and when there is a request including the image size from the portable terminal, a desired size is obtained from the image data of one resolution. Image data is created and sent to the mobile terminal. The screen is divided and assigned to the numeric keypad, and operates to enlarge / reduce centering on the area corresponding to the pressed key (for example, see Patent Document 4).

Japanese Patent Laid-Open No. 2003-234938 JP 2002-057935 A Japanese Patent Laid-Open No. 10-200807 JP 2003-099357 A "Communication Camera VC-C4 Instruction Manual", Canon Inc.

  However, in the above conventional example, there is a problem that it takes much time to obtain a desired angle of view, and the usability is poor. In particular, in a mobile phone that is charged by the amount of communication, there is a problem in that many pieces of useless image data must be transmitted and received for adjusting the angle of view, resulting in a high communication fee.

  In the conventional examples (1) and (2), the user has to adjust each time by looking at the finder image, which is very troublesome. It was necessary to repeat the operation many times while watching the viewfinder image update. When the transmission delay of the communication line is significant, it takes time to update the viewfinder image, and thus adjustment may take a long time. Further, the following operation is performed before the viewfinder image is updated, and the operation is often overrun.

  The conventional examples (3) and (4) are different in that the screen position and the key are associated with each other. However, since the operation is required to be repeated, there is a drawback that the conventional examples (1) and (2) are bothersome. was there.

  In the conventional example (5), since the angle of view after correction is clear to the user, the angle of view may be determined by a single operation. However, since a predetermined angle of view is uniformly applied, there is a drawback that a desired angle of view may not be obtained. For example, when zooming in on a person, the upper half of the face may be cut off because the angle of view is set to a predetermined angle.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a suitable remote photographing apparatus that greatly reduces the trouble of setting a zoom angle of view by performing zoom control in accordance with the shape of an object in an image. It is another object of the present invention to provide a suitable remote photographing apparatus that greatly reduces the amount of communication data when setting the zoom angle of view.

  In order to achieve the above object, the remote imaging system of the present invention has the following configuration.

In other words, it includes an imaging unit and a communication unit capable of controlling an angle of view, and includes a remote imaging terminal that performs an angle of view control according to a received control instruction and transmits a captured image, a unit that inputs an operation instruction, and a communication unit. A remote imaging system comprising: a display control terminal that transmits a view angle change request to the remote imaging device and displays a received image;
Means for detecting the shape and position of an object included in the captured image;
Means for associating the instruction input means with the object in each arrangement and changing the angle of view so that the object associated with the instruction input means is included when there is an input to the instruction input means; .

  The remote display control device of the present invention has the following configuration.

That is, a remote display that includes means for inputting operation instructions and communication means, displays an image received from a photographing terminal capable of controlling the angle of view, and transmits a view angle change request input by the operation input means to the photographing terminal. A control device,
Means for detecting the shape and position of an object contained in the received image;
The instruction input means and the object are associated with each other in each arrangement, and when there is an input to the instruction input means, the angle of view is such that the object associated with the instruction input means is included. Means for transmitting a change request.

  The remote photographing apparatus of the present invention has the following configuration.

That is, a remote imaging device that includes an imaging unit and a communication unit capable of controlling an angle of view, performs an angle of view control according to an instruction command of a remote display control terminal, and transmits a captured image to the remote display control terminal,
Means for detecting the shape and position of an object included in the captured image;
Means for associating an instruction command of the remote display control terminal with an object, and changing the angle of view so that the object associated with the instruction command is included when the instruction command is received.

  In such a configuration of the present invention, the operation is performed in which the numeric keypad of the display terminal is assigned in accordance with the object shape and position in the finder screen and zoomed in accordance with the object corresponding to the arrangement of the pressed key.

  According to the present invention, by performing a zoom operation with the keyboard layout corresponding to the object in the image, it is possible to greatly reduce the time and effort for setting the zoom angle of view and to improve the usability. In addition, since it is not necessary to perform repetitive operations when setting the angle of view, the amount of communication data can be greatly reduced, and the communication fee can be reduced.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, exemplary embodiments of the invention will be described in detail with reference to the accompanying drawings.

[Embodiment 1]
The system according to the present embodiment performs an operation of assigning the numeric keypad of the mobile phone in accordance with the object shape and position in the photographed image, and zooming in on the object corresponding to the arrangement of the pressed key. .
<Operation Example of Angle of View Expansion Operation Corresponding to Object (FIGS. 2 and 5)>
First, using FIG. 2 and FIG. 5, an operation example of a zoom enlargement operation in which a numeric keypad is associated with an object will be described.

  FIG. 2 is an external view showing an example of a remote display terminal. In this embodiment, the remote display terminal is composed of a mobile phone. In the remote display terminal 10, 15 is a numeric keypad for inputting a telephone number and various mode setting information. Reference numeral 14 denotes a display screen. In the figure, an image of a remote camera connected by a communication line is displayed. Photographing is performed with an instruction by a key or every predetermined time, and the screen is updated. In this example, an image showing a house or other object is displayed. The display screen is divided into nine parts according to the shape of the main object, and each divided screen is associated with a numeric keypad. The key “6” is associated with the divided area 6 where the house object is located, the key “7” is associated with the area 7 where the stone object is located, and the key “1” is associated with the area 1.

  An example of the screen operation when the key is pressed will be described with reference to FIG.

  When the key is pressed, the angle of view is zoomed in accordance with the object at the position corresponding to the arrangement of the pressed key. FIG. 5A shows an initial screen. Here, when the key “6” is pressed, the angle of view is changed as shown in FIG. Since the key “6” is located at the right center on the numeric keypad, an object located at the right center in the screen is searched. In the example, since the house object 54 exists at the center position on the right side, the angle of view is changed to include the house object 54. If the screen is divided equally as in the prior art, the house object will be cut halfway, but if this is done, the target can be reliably captured with a single operation.

  Even after zooming in, zooming in can be repeated. When the key “5” is pressed again, the angle of view is zoomed in as shown in FIG. Since the key “5” is the center key, the object at the center of the screen is searched. In the figure, since the window object 59 exists at the center, the angle of view is changed to include the window object 59.

  If there are no objects to be split in the screen, the screen is uniformly divided and assigned. In FIG. 5C, since no new object exists in the window, the screen is divided equally. When the key is pressed further, the zoom is enlarged to the equally divided area.

It should be noted that by switching the angle-of-view change mode, it is possible to perform zooming and direction movement that do not correspond to the object. FIG. 5D shows an example of the operation screen after switching to the sequential direction movement mode. When the key “8” is pressed, the key “8” is located on the lower side of the center, so that the angle of view is moved downward by a specified value.
<Overall configuration of remote shooting system (FIG. 1)>
Next, the configuration of the remote photographing system of this embodiment will be described using the block diagram of FIG. The remote photographing system includes a remote camera terminal 1 and a remote display terminal 10. Both exchange image data and control data via communication means.

  The remote camera terminal 1 transmits an image captured by the camera over a communication line. Further, according to the command received through the communication line, execution of shooting, change of the angle of view, etc. are performed.

  In this terminal, reference numeral 2 denotes an imaging unit, which converts an optical mechanism unit such as a lens or a sensor, a pan / tilt / zoom mechanism unit that directs the optical system in a desired direction, and information acquired by the optical mechanism unit into digital image data. Development processing unit. An on-screen display control unit 3 superimposes various messages on the image. The boundary of the object angle of view described with reference to FIG. 5 and the superimposition of the numeric key numbers corresponding to each area are performed.

  Reference numeral 4 denotes a resizing / subtracting color conversion unit that converts an image captured by the image capturing unit 2 into a necessary size and number of colors on the remote display terminal 10. Reference numeral 5 denotes an image encoder, which converts a captured image into a compression format. In this embodiment, the image is converted to the JPEG format, but any other method can be used. For example, JPEG2000 can be used for still images, MotionJPEG, MPEG1, 2, 4, H263, H264, Microsoft WMV format, or the like can be used for moving images.

  A communication interface 6 outputs the compressed image data to a communication line. In this embodiment, the communication format of the mobile phone is used, but any other method can be used. Wireless communication such as an 802.11 wireless LAN, Bluetooth, and UWB, and wired communication such as a wired LAN or a fixed telephone public network can be used. Reference numeral 9 denotes an overall control unit that controls each block in the device, and includes a CPU, a memory, and various control circuits. Reference numeral 8 denotes an angle-of-view control unit that controls the imaging unit 2 so that the angle of view requested by the user is obtained. The zoom operation in which the numeric keypad is associated with the object according to the present embodiment is performed using the change request command received from the remote display terminal 10 and the information of the division boundary detection unit 7.

  Reference numeral 7 denotes a division boundary detection unit, which divides the screen area as shown in FIGS. 2 and 5 based on the shape and position of the object included in the screen. The same unit includes an object detection unit 21 and a screen division unit 22. The object detection unit 21 detects an object using image motion detection or contour extraction processing. In the motion detection process, a moving object is detected from a difference between a plurality of images shifted in time.

  In the contour extraction process, an edge component is detected by a filter process or the like, analyzed, and integrated to detect an object. Any known technique can be used as long as the object can be detected. A part of the function of the encoder can also be used. Since a motion detection process is performed in a compression method such as MPEG2, it may be shared with this functional block. The screen dividing unit 22 divides the screen area into nine based on the objects included in the screen. The main object is selected by evaluating the size and the degree of movement of the object, and the screen area is divided at the boundary of the main object. It is desirable to set a threshold for the size of an object so that an object that is too small is not targeted for division. This is to prevent the user from losing recognition of where the user is looking.

  In order to reduce the load of the encoder compression processing, it is desirable that the pixels of each divided screen match the processing unit of the encoder. Since MPEG and JPEG are processed in units of macroblocks of 8 × 8 or 16 × 16 pixels, the divided screen is divided by 8 or 16 pixels and divided into angles of view that include objects.

  The remote display terminal 10 displays the camera image received through the communication line on its display unit. Also, a command for operating the remote camera terminal is transmitted to the communication line. Although the present embodiment is composed of a mobile phone, it may be a PC, PDA, digital TV or the like. As described below, the remote display terminal according to the present embodiment does not require any special configuration, so that a general mobile phone can be widely used.

  In the same terminal, reference numeral 11 denotes a communication interface, which performs transmission and reception with the communication interface 6 of the remote camera terminal 1. The same type of configuration may be used, and a different type of configuration may be obtained by conversion on a communication line. For example, even when the remote camera terminal 1 performs communication in the Internet format, it is possible to connect to a public telephone network by performing conversion using an intermediate gateway server or the like.

An image decoder 12 decompresses the compressed image data received by the communication interface. A display control unit 13 converts the decompressed image data and various display data into a drive format of the display panel 14 and outputs the converted data. Reference numeral 14 denotes a display panel, which displays an expanded image. It also displays phone numbers, phone books, mail / web information, received images, etc. For example, it is composed of a liquid crystal display of QVGA size (240 × 320 pixels). Reference numeral 15 denotes a numeric keypad for inputting a telephone number and an angle of view change instruction, and reference numeral 16 denotes a key control unit of the numeric keypad 15. Reference numeral 17 denotes an overall control unit that controls each block in the device, and includes a CPU, a memory, and various control circuits.
<Explanation of processing flow of angle of view change operation (FIGS. 3, 4, 6 and 7)>
Next, the flow of processing for changing the angle of view will be described with reference to FIGS. 3, 4, 6, and 7.

  FIG. 3 is a flowchart showing the flow of view angle operation processing of the remote display terminal 10, which is realized by software in the overall control unit 17 of the remote display terminal 10. It is detected whether or not a key corresponding to the angle of view operation has been pressed, and the remote camera terminal 1 is notified that the key has been pressed.

  In the figure, in step s201, it is determined whether there is a key input. If there is an input, the process proceeds to step s202, and if not, step s201 is repeated. In step s202, it is determined whether the input key is a numeric keypad. If the keypad is a numeric keypad, the process proceeds to step s203. Otherwise, the process proceeds to step s204. In step s203, the numeric keypad code is transmitted to the camera terminal, and the process returns to step s201. Here, the transmission method may be arbitrary. When communicating via a data line such as 3G-324M, the key code may be sent as command data. When communicating via a voice call line, it can also be sent by a DTMF signal. On the other hand, in step s204, a mode setting process inside the device is performed according to the type of key, and the process returns to step s201. Through the above processing, information on the pressed numeric keypad can be transmitted to the camera terminal.

  FIG. 4 is a flowchart showing the flow of view angle operation processing of the remote camera terminal 1, which is realized by software in the overall control unit 9 of the remote camera terminal 1.

  FIG. 4A shows the flow of processing when a captured image is transmitted to the display terminal. A process is performed in which an object is detected from the photographed image, image division information corresponding to the numeric keypad is created, and then the image is transmitted. In the figure, in step s211, photographing is performed using the photographing unit 2, and the process proceeds to step s212. In step s212, object detection and screen division are performed using the division boundary detection unit 7, and the process proceeds to step s213. In step s213, an allocation table (described later) for associating the object with the numeric keypad is created, and the process proceeds to step s214. In step s214, the created allocation table is stored in the memory in the overall control unit 9, and the process proceeds to step s215. In step s215, the image is compressed by the encoder 5 and then transmitted to the display terminal 1, and the process ends.

  Here, FIG. 6 shows a configuration example of an object allocation table for associating a numeric keypad with an object.

  In FIG. 6, “Numeric keypad”, “Object”, “Upper left coordinates of rectangular area”, and “Lower right coordinates of rectangular area” are associated with each other. For example, in row 66, it is described that the key “6” is associated with “house object 54” and is in a rectangular area (140, 60)-(240, 260) in the screen. With the same table, a rectangular area including an object can be associated with a numeric keypad.

  FIG. 4B shows the flow of processing when there is a view angle change request from the display terminal.

  When a numeric key command is received, the coordinate information of the object corresponding to the key is searched, the camera angle of view is changed, and the image is captured and transmitted again. In the figure, in step s221, key code reception processing is performed, and the flow proceeds to step s222. In step S222, it is determined whether a numeric keypad command is received. If the numeric keypad command is received, the process proceeds to step s223. If not, the process returns to step s221.

  In step s223, the coordinate information of the object is retrieved from the object allocation table of FIG. 7, and the process proceeds to step s224. In step s224, the angle of view of the camera is changed to an angle of view including the object, and the process proceeds to step s225. In step s225, the captured image transmission process described in FIG. 4A is performed, and the process returns to step s221. By repeating the above processing, the angle of view can be changed to include the object corresponding to the key code.

  An example of a communication sequence when the above processing is performed will be described with reference to the timing chart of FIG.

  FIG. 7 is a communication sequence when the operation of the screen of FIG. 5 is performed. First, the camera terminal captures the initial screen 50 and transmits it as communication data 41. The display terminal decodes and displays the received image 50 and waits for a user operation input. When the key “6” is pressed, the display terminal transmits the communication data 42. The communication data 42 is a view angle change request, and includes a code indicating the key “6”. Upon receiving the view angle change request command, the camera terminal searches for an object corresponding to the key and changes the view angle. In this case, the angle of view is changed to area 6 and communication data 43 is transmitted. Communication data 43 is an image 51 of area 6.

  Similarly, the display terminal displays the image 51 and waits for an operation input. When the key “5” is pressed, the display terminal transmits communication data 44 indicating the key “5” as a view angle change request. The camera terminal receives the communication data 44, searches for an object, changes the angle of view to the area 5, and transmits the image as the communication data 45. As described above, even when the angle of view is significantly changed, the operation can be completed only by sending the image data and the angle-of-view change request only a few times.

  As described above, according to the present embodiment, it is possible to greatly reduce the trouble of setting the zoom angle of view by performing a zoom operation with the numeric keypad corresponding to an object in the image. In addition, the amount of communication data when setting the angle of view can be greatly reduced.

  The present invention is not limited to the above and can be widely applied.

  In this embodiment, an example of zooming in on the angle of view has been described, but the present invention can also be applied to reduction. This will be described with reference to the screen example of FIG.

  When reduction is instructed, an object including the current screen may be searched, and a new angle of view may be set according to the object. An object as shown in FIG. 8B is arranged in front of the camera. FIG. 8A shows an image obtained by matching the angle of view with the “window” object 59. When reduction is instructed, as shown in FIG. 8C, a “house” object 54 that includes the current screen is detected, and the angle of view is determined so that the entire object can be accommodated.

  Alternatively, the angle of view may be set so that the current object is positioned at the position of the pressed numeric keypad when reduction is instructed by the numeric keypad. When the reduced view angle is designated with the key “6” with respect to FIG. 8A, the view angle is changed as shown in FIG. Since the key “6” is positioned at the right center on the numeric keypad, the angle of view is set so that the current “window” object 49 is positioned at the right center of the screen.

  Screen dividing boundaries and corresponding key numbers may be displayed superimposed on the screen. It may be synthesized by the on-screen display control unit 3 of the camera terminal 1 or may be synthesized by the display control unit 13 of the display terminal 10.

  In this case, the positional relationship between the numeric keypad and the corresponding object need not necessarily match. Referring to the screen example of FIG. 9, the figure includes four objects “person” 81, “dog” 82, “stone” 83, and “tree” 84. Each object is displayed with numbers superimposed as shown in the figure. When the numeric key is pressed, the angle of view is expanded in accordance with the shape of the object corresponding to the numeric key number.

  You may make it combine the zoom operation of this Embodiment with pan and tilt control. When the object is at a position that protrudes from the current angle of view, panning and tilt control are performed together to control the angle of view so that the entire object is included.

  The image to be handled may be a moving image. After the angle of view of the object is enlarged, the angle of view may be maintained as it is. Also, once an object is enlarged and specified, the angle of view may be changed by tracking the object thereafter. This can be realized by continuously changing the angle of view according to the object detection unit 21. Since moving images are sent continuously as image frames, the effect of reducing the amount of data is reduced, but the effect of improving the usability of the user can be achieved.

  In a device that can change the position and angle of the display screen and the numeric keypad, the assignment of keys may be changed by detecting this. In some mobile phones, the display screen unit and the numeric keypad unit are connected via a hinge and can be used at any angle. If the zoom enlargement is performed in a state where the display screen portion and the numeric keypad are bent by 90 degrees, the arrangement of the numeric keys and the position of the object do not coincide with each other. In such a case, a means for detecting the position angle between the display screen and the numeric keypad may be provided to correct the allocation table.

  The view angle change request command may be a coordinate value instead of the numeric keypad number. If the allocation table is transmitted together with the transmission of the camera image, the coordinate value can be instructed directly from the display terminal side. By so doing, it is possible to absorb differences in resolution and parallax according to the model between display terminals.

  In the present embodiment, the screen division is determined in advance at the time of image transmission. However, the processing after the object detection may be performed after a view angle change request from the user.

[Embodiment 2]
In the first embodiment, a system is configured by combining a remote camera having an object detection function and a general mobile phone. However, there are cases where it is desired to construct a system with a general remote camera. In this embodiment, an example in which a system is configured by a general remote camera and a remote display terminal having an object detection function will be described.
<Overall configuration of remote shooting system (FIG. 10)>
The configuration of the remote photographing system of this embodiment will be described using the block diagram of FIG. In FIG. 10, the same components as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.

  The remote camera terminal 1 of the present embodiment uses a general remote camera. A function of compressing a photographed image and transmitting it on a communication line is provided. The imaging unit 2, the on-screen display control unit 3, the resize and color reduction conversion unit 4, the image encoder 5, the communication interface 6, the view angle control unit 8, and the overall control unit 9 are configured. The angle-of-view control unit 8 controls the imaging unit 2 in accordance with an angle-of-view control instruction coming from the remote display terminal 10.

The remote display terminal 10 according to the present embodiment uses a PC, for example. Compared to the first embodiment, a division boundary detection unit and an angle of view control unit are further provided. The communication interface 11, the image decoder 12, the display control unit 13, the display panel 14, the numeric keypad 15, the key control unit 16, the overall control unit 17, the division boundary detection unit 91, and the view angle control unit 92 are configured. The division boundary detection unit 91 is the same as the division boundary detection unit 7 and the angle-of-view control unit 92 of the above-described embodiment.
<Description of processing flow of angle of view change operation (FIG. 11)>
FIG. 11 is a flowchart showing the flow of the angle-of-view operation processing according to the present embodiment, which is realized by software in the overall control unit 17 of the display terminal 10. The operation of the display terminal 10 will be described with reference to FIG.

  First, FIG. 11A shows a flow of processing for receiving and displaying a captured image sent from a remote camera terminal. The received image is displayed, an object is detected, and screen division information corresponding to the numeric keypad is created and stored. In the figure, in step s251, the received image is displayed on the screen after storage, and the process proceeds to step s212. The image data is stored in a memory in the overall control unit 17 and the image is displayed on the display panel 14. In step s252, object detection and screen division are performed, and the flow proceeds to step s253. In step s253, an allocation table for associating the object with the numeric keypad is created, and the process proceeds to step s254. In step s254, the created allocation table is stored in the memory in the overall control unit 17, and the process ends.

  FIG. 11B shows a flow of processing for transmitting a view angle change request to the remote camera terminal when the user inputs a numeric keypad. When the key input is a numeric keypad, a process is performed in which field angle information of an object corresponding to the key is retrieved and a change request command for the field angle is transmitted.

  In the figure, in step s261, it is determined whether there is a key input. If there is an input, the process proceeds to step s262, and if not, step s261 is repeated. In step s262, it is determined whether or not the input key is a numeric keypad. If the key is a numeric keypad, the process proceeds to step s263. Otherwise, the process proceeds to step s265. In step s263, the view angle coordinates of the corresponding object are searched from the allocation table, and the process proceeds to step s264. In step s264, a command to change the field angle to the retrieved field angle coordinates is transmitted to the remote camera terminal, and the process returns to step s261. On the other hand, in step s265, a mode setting process inside the device is performed according to the type of key, and the process returns to step s261. When one of the remote camera terminals receives the angle of view change command, the remote camera terminal controls the imaging unit 2 so as to obtain a desired angle of view and performs a process of transmitting the updated image.

  With the above processing, when the numeric keypad is pressed, a view angle change request command corresponding to the object can be transmitted, and the view angle control according to the shape of the object can be performed.

  As described above, according to the present embodiment, the same effect as the above-described embodiment can be obtained. In this embodiment, a general remote camera can be used as the remote camera terminal.

  The present invention is not limited to the above and can be widely applied.

  The operation mode may be switched by detecting the pressing state of the numeric keypad. For example, the object unit zoom according to the present invention may be performed when the key is pressed and released for a short time, and continuously when the key is pressed for a predetermined time or longer. It may be switched by pressing or the number of times.

  An angle of view including a plurality of objects may be set. In a configuration that can detect simultaneous pressing of a plurality of keys, control may be performed so that the angle of view includes a plurality of objects corresponding to the simultaneously pressed keys. The same control may be performed when a plurality of keys are pressed within a certain time.

  Although the example of controlling with the numeric keypad has been described, various devices can be used as long as the key arrangement can be used. For example, a keyboard used in a PC or the like may be used. It is also possible to control with the channel key of the TV remote controller. In this case, the operation mode is switched on the TV main body, and in the camera angle of view control mode, the channel key number may be transmitted to the camera. It is also possible to use a fixed telephone numeric keypad. The remote display terminal is configured so as to be able to relay a fixed telephone line, and in the camera angle of view control mode, the tone or pulse signal of the fixed telephone may be converted and transmitted to the camera.

  The element described as hardware can be realized by software, and the element described as software can be realized by hardware. For example, the object detection process of the division boundary detection unit may be realized by software, and the control process of the overall control unit may be replaced with hardware logic.

It is a block diagram which shows schematic structure of the remote imaging | photography system in Embodiment 1 of this invention. It is an external view which shows the example of the remote display terminal in Embodiment 1 of this invention. It is a flowchart which shows the flow of a view angle operation process of the remote display terminal in Embodiment 1 of this invention. It is a flowchart which shows the flow of a view angle operation process of the remote camera terminal in Embodiment 1 of this invention. It is a figure which shows the example of the display screen at the time of the view angle expansion operation in Embodiment 1 of this invention. It is a table | surface which shows the example of the allocation table between a numeric keypad and an object in Embodiment 1 of this invention. It is a timing chart which shows the example of the communication sequence of a view angle operation process in Embodiment 1 of this invention. It is a figure which shows the example of the display screen at the time of the angle-of-view reduction operation in Embodiment 1 of this invention. It is a figure which shows the example of a response | compatibility of the object and ten key in Embodiment 1 of this invention. It is a block diagram which shows schematic structure of the remote imaging | photography system in Embodiment 2 of this invention. It is a flowchart which shows the flow of a view angle operation process of the remote display terminal in Embodiment 2 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Remote camera terminal 2 Image pick-up part 3 On-screen display control part 4 Resizing and color reduction conversion part 5 Image encoder 6 Communication interface 7 Division | segmentation boundary detection part 8 Angle of view control part 9 Overall control part of a remote camera terminal 10 Remote display terminal 11 Communication interface 12 image decoder 13 display control unit 14 display panel 15 numeric keypad 16 key control unit 17 overall control unit of remote display terminal 21 object detection unit 22 screen division unit

Claims (9)

A photographing unit and a communication unit capable of controlling the angle of view; a remote photographing terminal for performing angle of view control according to the received control instruction and transmitting a photographed image; a means for inputting an operation instruction; and a communication unit. A remote imaging system comprising: a display control terminal that transmits a view angle change request to a remote imaging device and displays a received image;
Means for detecting the shape and position of an object included in the captured image;
Means for associating the instruction input means with the object in each arrangement and changing the angle of view so that the object associated with the instruction input means is included when there is an input to the instruction input means; ,
A remote shooting system characterized by comprising:   The remote photographing system according to claim 1, wherein the instruction input means is a keyboard.   The remote photographing system according to claim 1, wherein the instruction input means is a numeric keypad.   The remote imaging system according to claim 1, wherein the display control terminal is a mobile phone. A remote display control device that includes means for inputting an operation instruction and communication means, displays an image received from an imaging terminal capable of controlling the angle of view, and transmits a view angle change request input by the operation input means to the imaging terminal Because
Means for detecting the shape and position of an object contained in the received image;
The instruction input means and the object are associated with each other in each arrangement, and when there is an input to the instruction input means, the angle of view is such that the object associated with the instruction input means is included. Means for sending a change request;
A remote display control device comprising:   6. The remote display control apparatus according to claim 5, wherein the instruction input means is a keyboard.   6. The remote display control apparatus according to claim 5, wherein the instruction input means is a numeric keypad.   The remote display control device according to claim 5, wherein the display control terminal is a mobile phone. A remote photographing device comprising a photographing means and a communication means capable of controlling a field angle, performing a field angle control according to an instruction command of a remote display control terminal, and transmitting a photographed image to the remote display control terminal,
Means for detecting the shape and position of an object included in the captured image;
Means for associating an instruction command of the remote display control terminal with an object, and changing the angle of view so that the object associated with the instruction command is included when the instruction command is received;
A remote photographing device comprising:

Images