JP2012049781A - Remote control system, remote control method, bidirectional communication system and bidirectional communication method for imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To speedily, easily, and intuitively control the imaging direction of an imaging apparatus 10 connected communicably.SOLUTION: A remote control system comprises: an angle detection unit (a horizontal angle sensor 23, a vertical angle sensor 24) which, when a user rotates the direction of the display screen of a display device 20, detects the rotation angle of the rotation; a rotation angle calculation unit (a horizontal rotation angle calculation unit 29, a vertical rotation angle calculation unit 30) which calculates the rotation angle of the imaging direction of an imaging unit 11 equipped to the imaging apparatus 10, in accordance with the rotation angle detected by the angle detection unit; a rotation unit (a horizontal rotation unit 12, a vertical rotation unit 13) which rotates the imaging direction of the imaging unit 11; and an imaging control unit 16 which controls the operation of the rotation unit so as to rotate the imaging direction of the imaging unit 11 in accordance with the rotation angle calculated by the rotation angle calculation unit.

Description

  The present invention relates to a remote operation system and a remote operation for performing an operation in the imaging direction of an imaging device from the display device side in a communication system in which an imaging device and a display device that displays an image captured by the imaging device are connected via a network. The present invention relates to a method, a bidirectional communication system that performs bidirectional communication using the remote control system, and a bidirectional communication method.

  Conventionally, there has been known a communication system in which a display device and an imaging device are connected via a communication network, and an image captured by the imaging device is displayed on the display device. Examples of such a system include a video conference system and a video phone system.

  By the way, in this type of communication system, when an observer of the display device wants to see something outside the imaging range of the imaging device, he contacts a person in the vicinity of the remote imaging device and moves the imaging device. It is necessary to have you. However, in a video conference system or a video phone system, for example, if the imaging device is moved by contacting a person in the other party's conference room, the conference or conversation is frequently interrupted.

  As a technique for solving such a problem, for example, Patent Literature 1 uses a multi-window display function for an image captured by an imaging unit and a control menu for inputting an instruction regarding an imaging operation of the imaging unit. And a technique for controlling an imaging operation of an imaging unit in response to an input from a user to a control menu using a pointing device.

  Japanese Patent Laid-Open No. 2004-26883 discloses a configuration in which video captured by a remote camera is transmitted to the mobile terminal via the remote video control device and displayed on the mobile terminal, and the temporal image of the video captured by the mobile terminal camera is displayed. A technique is disclosed in which movement or rotation of a mobile terminal is detected based on a change, and a photographing operation of a remote camera is controlled according to a detection result.

JP 7-135594 A (published May 23, 1995) JP 2004-128997 A (published on April 22, 2004)

  However, in the technique of the above-mentioned Patent Document 1, since the user needs to operate the pointing device when operating the imaging unit, a troublesome operation is necessary for the user and it is difficult to perform an intuitive operation. There is a problem that.

  Further, in the technique of Patent Document 2, since it is necessary to detect a temporal change in an image captured by a camera of a mobile terminal, (i) a complicated configuration for performing detection processing is necessary, and the device configuration is complicated. (Ii) It takes time for the detection process, and it is difficult to control the imaging operation of the remote camera in real time. (Iii) It is difficult to perform the detection process with high accuracy. For this reason, there is a problem that it is difficult to cause the remote camera to perform an imaging operation intended by the user.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to remotely control an imaging apparatus that can quickly, easily, and intuitively operate an imaging direction of an imaging apparatus that is communicably connected. An operation system and a remote operation method, and a bidirectional communication system and a bidirectional communication method using the remote operation system are provided.

  The remote operation system according to the present invention includes an imaging device that includes an imaging unit that captures an image in a predetermined direction and generates image data, a rotation unit that rotates the imaging direction of the imaging unit, and the imaging unit that is generated by the imaging unit. An imaging device that operates in the imaging direction of the imaging unit via the display device in a display system that is communicably connected via a communication network to a display device having a display unit having a display screen for displaying image data The display device includes an angle detection sensor that detects a rotation angle of the rotation when the user rotates the direction of the display screen, and the imaging device or the display device includes: A rotation angle calculation unit that calculates a rotation angle in the imaging direction of the imaging unit according to the rotation angle detected by the angle detection sensor is provided, and the rotation unit includes the rotation angle. Calculator is calculated in accordance with the rotation angle is characterized by rotating the imaging direction of the imaging unit.

  According to another aspect of the present invention, a remote operation method includes: an imaging device including an imaging unit that captures an image in a predetermined direction to generate image data; a rotation unit that rotates an imaging direction of the imaging unit; Remote operation of an imaging device that operates in the imaging direction of the imaging unit via the display device in a display system that is communicably connected via a communication network to a display device that has a display screen that displays the image data that has been displayed An angle detection step of detecting a rotation angle of the rotation when the user rotates the direction of the display screen, and an imaging direction of the imaging unit according to the rotation angle detected in the angle detection step A rotation angle calculation step of calculating a rotation angle of the image sensor, and an imaging control unit provided in the imaging apparatus controls the operation of the rotation unit, and the rotation angle calculated in the rotation angle calculation step Flip and is characterized by comprising an imaging direction rotation step of rotating the imaging direction of the imaging unit.

  According to the remote operation system and the remote operation method described above, when the user rotates the direction of the display screen, the rotation angle of the rotation is detected, and the rotation angle in the imaging direction of the imaging unit is detected according to the detected rotation angle. And the imaging direction of the imaging unit is rotated according to the calculated rotation angle. As a result, the user can operate the imaging direction of the imaging unit according to the rotation angle by rotating the display screen, so that the imaging direction of the imaging unit can be operated quickly, easily, and intuitively. Can do. Further, since the image displayed on the display screen is an image corresponding to the image data captured by the imaging unit, the moving direction of the imaging direction of the imaging unit matches the moving direction of the image displayed on the display screen. For this reason, since the user can operate the imaging direction of the imaging unit while viewing the image displayed on the display screen, the user can more intuitively operate the imaging direction of the imaging unit.

  In addition, the display device includes a pedestal for placing the display device on a placement surface, and a support unit that supports the display unit so as to be relatively rotatable with respect to the pedestal. The detection sensor may be configured to detect a rotation angle of the display screen with respect to the pedestal.

  According to said structure, the rotation angle of a display screen can be detected easily.

  The rotating unit can rotate the imaging direction of the imaging unit in two directions perpendicular to each other, and the support unit can cause the display unit to rotate in a first direction and a second direction perpendicular to the pedestal. The angle detection sensor detects the rotation angles of the first direction and the second direction with respect to the pedestal of the display unit, and the rotation angle calculation unit is configured to detect each of the angle detection sensors. The rotation angle for the two directions of the imaging direction of the imaging unit is calculated according to the detection result of the rotation angle of the direction, and the rotation unit calculates the rotation angle for the two directions calculated by the rotation angle calculation unit. Accordingly, the imaging direction of the imaging unit may be rotated.

  According to said structure, the rotation angle of the 1st direction of a display screen and a 2nd direction (for example, a direction parallel to a mounting surface and a perpendicular | vertical direction) is detected, and according to these both rotation angles, an imaging part is detected. The rotation angle in two directions can be calculated. Therefore, the user can control the imaging direction of the imaging unit in two directions orthogonal to each other (for example, the horizontal direction and the vertical direction).

  In addition, a rail having an arc-shaped track surface centered on an observation position that is assumed as a position at which the user observes the display screen, and supports the display unit so as to be movable in parallel along the track surface A member may be provided, and the angle detection sensor may detect a rotation angle of the display unit along the track surface with the observation position as a center.

  According to said structure, the rotation angle of the display screen centering on the user who observes a display screen can be detected, and the imaging direction of an imaging part can be operated according to it. Therefore, the user can more intuitively control the imaging direction of the imaging unit.

  The rotating unit can rotate the imaging direction of the imaging unit in two directions perpendicular to each other, and the display device allows the rail member to be perpendicular to the track surface with a straight line passing through the observation position as an axis. The angle detection sensor includes a rotation angle of the display unit along the track surface centered on the observation position and the axis of the rail member. A rotation angle is detected, and the rotation angle calculation unit is configured to detect a rotation angle of the display unit along the track surface by the angle detection sensor and a detection result of the rotation angle about the axis of the rail member. A configuration in which rotation angles in the two directions of the imaging direction of the imaging unit are calculated, and the rotation unit rotates the imaging direction of the imaging unit in accordance with the rotation angles calculated by the rotation angle calculation unit. It may be.

  According to said structure, the rotation angle along the track surface of the rail member centering on an observation position and the rotation angle of the rail member centering on the straight line which passes along an observation position are detected, and according to these both rotation angles Thus, the rotation angle in two directions for the imaging unit can be calculated. Therefore, the user can control the imaging direction of the imaging unit in two directions orthogonal to each other.

  In addition, an imaging direction control mode in which the imaging direction of the imaging unit is rotated in accordance with a rotation operation of the display screen by a user, and an imaging direction in which the imaging direction of the imaging unit is not rotated in accordance with the rotation operation. An imaging control switching means for allowing the user to arbitrarily switch between control modes is provided, and only when the imaging direction control mode is selected, the imaging unit is controlled according to the rotation angle detected by the angle detection sensor. It is good also as a structure which rotates an imaging direction.

  According to said structure, a user can arbitrarily set whether the imaging direction of an imaging part is rotated according to rotation of a display screen. Thereby, for example, only the orientation of the display screen can be changed without changing the imaging direction of the imaging unit.

  In addition, a rotation ratio adjusting unit is provided for a user to adjust a ratio of a rotation angle of the imaging unit to the rotation angle detected by the angle detection sensor, and the rotation angle calculation unit is configured to detect the rotation angle detected by the angle detection sensor. The rotation angle of the imaging unit may be calculated based on the rotation angle and the ratio indicated by the user via the rotation ratio adjusting unit.

  According to said structure, the user can set arbitrarily the ratio of the rotation angle of the imaging direction of the imaging part with respect to the rotation angle of a display screen.

  The two-way communication system of the present invention uses two sets of the imaging device and the display device provided in any one of the remote control systems described above, and images captured by the first imaging device arranged at the first venue. The data is displayed on the first display device arranged at the second venue, and the image data captured by the second imaging device arranged at the second venue is displayed at the second venue. An interactive communication system for displaying on an apparatus, wherein the imaging unit of the first imaging device is provided in accordance with a rotation angle of the display screen detected by the angle detection sensor of the first display device. The imaging direction is rotated, and the imaging direction of the imaging unit provided in the second imaging device is rotated according to the rotation angle of the display screen detected by the angle detection sensor provided in the second display device. It is characterized in.

  Further, the two-way communication method of the present invention uses two sets of the imaging device and the display device provided in any one of the remote control systems described above, and captures an image with the first imaging device arranged at the first venue. The image data obtained is displayed on the first display device arranged at the second venue, and the image data captured by the second imaging device arranged at the second venue is second arranged at the first venue. A two-way communication method for displaying on the display device, wherein a user at a second venue detects a rotation angle of the rotation when the orientation of a display screen provided in the first display device is rotated. An angle detection step; a first angle calculation step of calculating a rotation angle in the imaging direction of the imaging unit provided in the first imaging device according to the rotation angle detected in the first angle detection step; Imaging provided in the above imaging device A first imaging direction rotation step in which the control unit controls the operation of the rotation unit provided in the imaging device and rotates the imaging direction of the imaging unit according to the rotation angle calculated in the first angle calculation step; When the user at the first venue rotates the direction of the display screen provided in the second display device, the second angle detection step of detecting the rotation angle of the rotation and the second angle detection step detect the rotation angle. A second angle calculation step of calculating a rotation angle in the imaging direction of the imaging unit provided in the second imaging device according to the rotation angle, and an imaging control unit provided in the second imaging device includes the imaging device. And a rotation second imaging direction rotation step that controls the operation of the rotation unit included in the imaging unit and rotates the imaging direction of the imaging unit according to the rotation angle calculated in the second angle calculation step.

  According to the bidirectional communication system and the bidirectional communication system described above, an image captured by the imaging device at the first venue is displayed on the display device at the second venue, and an image captured by the imaging device at the second venue is displayed on the first venue. In a two-way communication system (for example, a video conference system or a videophone system) displayed on one display device, the imaging direction of the imaging device at the other venue can be operated by rotating the display device at one venue. Therefore, it is possible to realize a two-way communication system that can quickly, easily, and intuitively operate the imaging direction of the counterpart imaging apparatus.

  As described above, in the remote operation system of the present invention, the display device includes the angle detection sensor that detects the rotation angle of the display screen when the user rotates the direction of the display screen. A rotation angle calculation unit that calculates a rotation angle in the imaging direction of the imaging unit according to the rotation angle detected by the angle detection sensor, and the rotation unit is configured to calculate the rotation angle calculated by the rotation angle calculation unit. The imaging direction is rotated.

  The remote operation method of the present invention includes an angle detection step of detecting a rotation angle of the rotation when the user rotates the direction of the display screen, and imaging of the imaging unit according to the rotation angle detected in the angle detection step. A rotation angle calculation step for calculating a rotation angle of the direction, and an imaging control unit provided in the imaging apparatus controls the operation of the rotation unit, and rotates the imaging direction of the imaging unit according to the rotation angle calculated in the rotation angle calculation step Imaging direction rotation step.

  Therefore, according to the remote operation system and the remote operation method of the present invention, the imaging direction of the imaging unit can be operated quickly, easily, and intuitively.

It is a block diagram which shows the structure of the remote control system concerning one Embodiment of this invention. It is a perspective view which shows the external appearance of the display apparatus with which the remote control system of FIG. 1 is equipped. It is a schematic diagram of the display panel with which the display apparatus of FIG. 2 is equipped. It is a flowchart which shows the flow of a process in the remote control system shown in FIG. It is explanatory drawing which shows operation | movement of the remote control system shown in FIG. It is explanatory drawing which shows operation | movement of the remote control system shown in FIG. It is explanatory drawing which shows the bidirectional | two-way communication system using the remote control system shown in FIG. It is explanatory drawing which shows the modification of the display apparatus with which the remote control system of FIG. 1 is equipped. It is explanatory drawing which shows operation | movement of the remote control system using the display apparatus shown in FIG. It is explanatory drawing which shows operation | movement of the remote control system using the display apparatus shown in FIG.

  An embodiment of the present invention will be described.

(1-1. Configuration of Remote Operation System 1)
FIG. 1 is a block diagram showing a configuration of a remote control system 1 according to the present embodiment. As shown in this figure, the remote operation system 1 has a configuration in which an imaging device 10 and a display device 20 are connected via a communication network 2.

  The configuration of the communication network 2 is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, A satellite communication network or the like can be used. Also, the transmission medium constituting the communication network 2 is not particularly limited. For example, the transmission medium may be wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, infrared light such as IrDA or remote control, Bluetooth, and the like. (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, or the like may be used.

  The imaging device 10 includes an imaging unit 11, a horizontal rotation unit 12, a vertical rotation unit 13, a communication unit 14, a storage unit 15, and an imaging control unit 16.

  The imaging unit 11 captures an image in a predetermined direction and generates image data corresponding to the imaging result. For example, various conventionally known imaging units such as those using a CCD element can be used.

  The horizontal rotation unit 12 rotates the imaging unit 11 in the horizontal direction by a rotation driving unit (not shown) including a motor, a gear, and the like, thereby moving the imaging direction of the imaging unit 11 in the horizontal direction.

  The vertical rotation unit 13 rotates the imaging unit 11 in the vertical direction (in-plane direction perpendicular to the horizontal direction) by a rotation driving unit (not shown) including a motor, a gear, and the like, thereby imaging the imaging unit 11. The direction is moved in the vertical direction.

  The communication unit 14 communicates with the display device 20 via the communication network 2. The communication unit 14 transmits image data captured by the imaging unit 11 to the display device 20, and from the display device 20 to the imaging unit 11. Control information related to the imaging process is received.

  The storage unit 15 stores various setting values, a data table, a program, and the like for controlling the operation of each unit of the imaging apparatus 10. As the storage unit 15, various conventionally known storage means such as a read only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), and the like can be used.

  The imaging control unit 16 controls the operation of each unit provided in the imaging device 10, and is, for example, a processing circuit realized by a microcomputer, a microprocessor, or the like that includes a central processing unit (CPU). is there. The imaging control unit 16 extracts various information stored in the storage unit 15 and a program for performing various controls, performs arithmetic processing and determination processing, and controls each unit of the imaging device 10 based on the processing results. Signals are sent to control the operation of each part.

  Although details will be described later, in the present embodiment, the communication unit 14 controls the operations of the horizontal rotation unit 12 and the vertical rotation unit 13 based on the control information received from the display device 20 via the communication network, and the imaging unit. 11 imaging directions are rotated.

  The display device 20 includes a display panel (display unit) 21, a display control unit 22, a horizontal angle sensor (angle detection sensor) 23, a vertical angle sensor (angle detection sensor) 24, an imaging control switch (imaging control switching means) 25, Rotation ratio adjustment knob (rotation ratio adjustment means) 26, instruction input unit 27, storage unit 28, horizontal rotation angle calculation unit (rotation angle calculation unit) 29, vertical rotation angle calculation unit (rotation angle calculation unit) 30, and communication unit 31 And a control unit 32.

  The display panel 21 is a display unit that displays an image corresponding to the image data. The configuration of the display panel 21 is not particularly limited. For example, a liquid crystal display, a plasma display, an organic EL display, a CRT (cathode ray tube), or the like can be used.

  The display control unit 22 controls the display panel 21 according to the image data, and causes the display panel 21 to display an image according to the image data. For example, the display control unit 22 displays an image corresponding to image data (image data captured by the imaging unit 11 of the imaging device 10) received by the communication unit 31 from the imaging device 10 via the communication network 2 on the display panel 21. Display.

  The horizontal angle sensor 23 has a rotation angle x ° in a horizontal direction (a direction parallel to the mounting surface of the display device 20) with respect to a reference position of the display panel 21 (a position where the normal direction of the display screen faces the viewer). That is, it is a sensor that detects the rotation angle in the horizontal direction (first direction) of the display surface normal direction of the display panel 21.

  The vertical angle sensor 24 is a rotation angle y ° in the vertical direction with respect to the reference position of the display panel 21 (rotation angle in the in-plane direction perpendicular to the horizontal direction), that is, the vertical direction in the normal direction of the display surface of the display panel 21 ( It is a sensor that detects a rotation angle in the second direction. The horizontal angle sensor 23 and the vertical angle sensor 24 are not particularly limited as long as the rotation angle of the display panel 21 can be detected. For example, a rotary potentiometer or the like can be used.

  The imaging control changeover switch 25 is an imaging direction control mode in which the imaging direction of the imaging unit 11 is controlled based on the detection result of the rotation angle of the display panel 21 and an imaging direction non-control mode in which the imaging direction of the imaging unit 11 is not controlled. This is for the user to arbitrarily switch between. Thereby, for example, when it is desired to rotate the display panel 21 without changing the imaging direction of the imaging device 10, the imaging unit 11 is imaged by selecting the imaging direction non-control mode and rotating the display panel 21. It is possible to prevent the direction from being changed against the user's intention.

  The rotation ratio adjusting knob 26 is a ratio α of a rotation angle in the imaging direction of the imaging unit 11 to a rotation angle of the display panel 21 detected by the horizontal angle sensor 23 and the vertical angle sensor 24 (a horizontal rotation ratio α1 and a vertical rotation). This is for the user to arbitrarily adjust the ratio α2). Note that the rotation ratio adjustment knob 26 may adjust the rotation ratio α1 in the horizontal direction and the rotation ratio α2 in the vertical direction separately, and adjust both in common by setting α = α1 = α2. You may do.

  The instruction input unit 27 is for receiving various instruction inputs from the user to the display device 20. For example, the instruction input unit 27 may be a remote controller provided in a non-contact manner with respect to the display device 20, or may be various key operation buttons provided in a part of the display device 20. Further, the imaging control changeover switch 25 and the rotation ratio adjustment knob 26 described above may be provided as a part of the instruction input unit 27.

  The storage unit 28 stores various setting values, a data table, a program, and the like for controlling the operation of each unit of the display device 20. As the storage unit 28, various conventionally known storage means such as a read only memory (ROM), a random access memory (RAM), a hard disk drive (HDD), and the like can be used.

  The horizontal rotation angle calculation unit 29 is based on the rotation angle x ° in the horizontal direction of the display panel 21 detected by the horizontal angle sensor 23 and the horizontal rotation ratio α1 set by using the rotation ratio adjustment knob 26. A rotation angle X ° = α1 · x ° in the horizontal direction of the imaging unit 11 is calculated.

  The vertical rotation angle calculation unit 30 is based on the rotation angle y ° in the vertical direction of the display panel 21 detected by the vertical angle sensor 24 and the vertical rotation ratio α2 set using the rotation ratio adjustment knob 26. A rotation angle Y ° = α1 · y ° in the vertical direction of the imaging unit 11 is calculated.

  The communication unit 31 communicates with the imaging device 10 via the communication network 2, receives image data captured by the imaging unit 11 from the imaging device 10, and calculates the rotation calculated by the horizontal rotation angle calculation unit 29. Control information indicating the angle X ° and the rotation angle Y ° calculated by the vertical rotation angle calculation unit 30 is transmitted to the imaging device 10.

  In the present embodiment, the horizontal rotation angle calculation unit 29 and the vertical rotation angle calculation unit 30 of the display device 20 calculate the rotation angles X ° and Y ° of the imaging unit 11, but the present invention is not limited to this. For example, the horizontal rotation angle calculation unit 29 and the vertical rotation angle calculation unit 30 are provided in the imaging device 10, and the rotation angle x °, the rotation angle y °, the ratio α1, and the ratio α2 are changed from the display device 20 to the imaging device 10. And the rotation angle X ° and the rotation angle Y ° may be calculated in the imaging device 10 based on these values.

  The control unit 32 controls the operation of each unit provided in the display device 20, and is, for example, a processing circuit realized by a microcomputer, a microprocessor, or the like that includes a central processing unit (CPU). . The control unit 32 extracts various information stored in the storage unit 28 and a program for performing various controls, performs arithmetic processing and determination processing, and controls the control signal to each unit of the display device 20 based on these processing results. To control the operation of each part.

  FIG. 2 is a perspective view showing the appearance of the display device 20. As shown in this figure, the display device 20 includes a pedestal 41, a first support arm 42, a first rotation support portion 43, a second support arm 44, and a second rotation support portion 45. The display panel 21 is supported.

  The pedestal 41 is for mounting the display device 20 on a mounting surface such as a desk. One end of the first support arm 42 is attached to the pedestal 41 so as to be rotatable in the horizontal direction by a first rotation support portion 43. In addition, a second rotation support portion 45 is provided at the other end of the first support arm 42, and one end of the second support arm 44 is perpendicular to the first support arm 42 by the second rotation support portion 45. It is supported so as to be rotatable in the in-plane direction perpendicular to the rotatable direction with respect to the base 41 of the first point support portion 43. The display panel 21 is attached to the other end of the second support arm 44.

  Thereby, the display panel 21 is supported so as to be rotatable in the horizontal direction and the vertical direction with respect to the base 41 (the placement surface of the display device 20). When the display panel 21 is rotated with respect to the pedestal 41, the user touches a part of the display panel 21 and manually rotates the display panel 21 in a desired direction.

  A horizontal angle sensor 23 is provided inside the first rotation support portion 43, and a vertical angle sensor 24 is provided inside the second rotation support portion 45.

  In the present embodiment, the first rotation support portion 43 and the second rotation support portion 45 are provided separately. However, the rotation is not limited to this, and the rotation is performed in multiple directions including the horizontal direction and the vertical direction with respect to the pedestal 41. You may make it support the display panel 21 through the possible support part. In the present embodiment, the display panel 21 is rotatable in the horizontal direction and the vertical direction with respect to the pedestal 41. However, the present invention is not limited to this, and it is sufficient that the display panel 21 can be rotated in at least one direction.

  FIG. 3 is a schematic diagram showing the appearance of the display panel 21. As shown in this figure, the display panel 21 includes a display screen 46 and a frame portion 47 provided so as to surround the display screen 46. The imaging control changeover switch 25 and the rotation ratio adjustment knob described above. 26 is provided in the frame portion 47. Various switches constituting the instruction input unit 27, a power switch, and the like may be provided in the frame portion 47 (none is shown). When the instruction input unit 27 is a remote control, an infrared light receiving unit (not shown) for performing communication with the remote control may be provided in the frame portion 47.

  Also, some or all of the display control unit 22, storage unit 28, horizontal rotation angle calculation unit 29, vertical rotation angle calculation unit 30, communication unit 31, and control unit 32 shown in FIG. Or you may provide in the inside of the base 41. FIG.

(1-2. Operation of Remote Operation System 1)
FIG. 4 is a flowchart showing the flow of processing in the remote operation system 1.

  First, the imaging control unit 16 of the imaging device 10 controls the imaging unit 11 to perform imaging and generate image data (S11). And the imaging control part 16 controls the communication part 14, and transmits the image data produced | generated by the imaging of the imaging part 11 to the display apparatus 20 (S12).

  When receiving the image data from the imaging device 10 via the communication unit 31 (S21), the control unit 32 of the display device 20 controls the display control unit 22 to display an image according to the received image data on the display panel 21. (S22). Thereby, the image imaged with the imaging device 10 is displayed on the display panel 21 in real time.

  Next, the control unit 32 determines whether or not the imaging direction control mode is selected (S23). That is, it is determined whether the imaging control changeover switch 25 is ON (imaging direction control mode) or OFF (imaging direction non-control mode).

  If it is determined that the imaging direction control mode is selected, the control unit 32 causes the horizontal angle sensor 23 to detect the rotation angle x ° in the horizontal direction of the display panel 21 (S24), and causes the vertical angle sensor 24 to detect it. The rotation angle y ° in the vertical direction of the display panel 21 is detected (S25). Further, the control unit 32 determines whether or not the detected rotation angles x ° and y ° are 0, that is, whether x ° = y ° = 0 (S26).

  When it is determined that x ° = y ° = 0 is not satisfied, that is, when it is determined that at least one of x ° and y ° is not 0, the control unit 32 determines the rotation ratio α1 in the horizontal direction, and The rotation ratio α2 in the vertical direction is acquired (S27, S28). For example, the control unit 32 acquires the rotation ratios α1 and α2 by detecting the set value of the rotation ratio adjustment knob 26.

  Next, the control unit 32 causes the horizontal rotation angle calculation unit 29 to calculate the rotation angle X ° = α1 · x ° in the imaging direction (S29), and causes the vertical rotation angle calculation unit 30 to rotate the rotation angle Y ° = α2 in the imaging direction. Y is calculated (S30). Then, the control unit 32 generates an imaging control signal for rotating the imaging direction of the imaging device 10 by X ° in the horizontal direction and Y ° by the vertical direction, and controls the communication unit 31 to send the imaging control signal to the imaging device. 10 (S31).

  On the other hand, when it is determined that the imaging direction control mode is not selected in S23, and when it is determined that both x ° and y ° are 0 ° in S26, the control unit 32 is imaged by the imaging device 10. It is determined whether or not to end the display of the image data (S32). This determination may be made, for example, depending on whether or not an instruction input indicating the end of display is made via the instruction input unit 27.

  If it is determined in S32 that display is to be ended, the control unit 32 generates an imaging control signal for ending imaging, and controls the communication unit 31 to transmit the imaging control signal to the imaging device 10 (S32). ), The process is terminated.

  When receiving the imaging control signal from the display device 20 (S13), the imaging control unit 16 of the imaging device 10 determines whether the imaging control signal indicates the end of imaging (S14).

  If it is determined in S14 that the imaging control signal does not indicate the end of imaging, the imaging control unit 16 controls the horizontal rotation unit 12 to indicate the imaging direction of the imaging unit 11 in the horizontal indicated by the imaging control signal. Rotate in the horizontal direction by the rotation angle X ° in the direction (S15), and control the vertical rotation unit 13 to rotate the imaging direction of the imaging unit 11 in the vertical direction by the rotation angle Y ° in the vertical direction indicated by the imaging control signal. (S16). Then, the process returns to S11.

  On the other hand, if it indicates the end of imaging, the imaging control unit 16 ends imaging by the imaging unit 11 (S17), and ends the process.

  As described above, in the remote operation system 1 according to this embodiment, the rotation angle x °, y ° of the display panel 21 by the observer (user) of the display device 20 is detected, and the detected rotation angle x of the display panel 21 is detected. Based on ° and y °, rotation angles X ° and Y ° in the imaging direction of the imaging unit 11 are calculated, and the imaging control unit 16 performs the horizontal rotation unit 12 and the vertical rotation unit according to the calculated rotation angles X ° and Y °. 14 is controlled to rotate the imaging direction of the imaging unit 11. For example, as shown in FIG. 5, when the observer of the display panel 21 rotates the display panel 21 in the horizontal direction by x °, the imaging direction of the imaging device 10 rotates in the horizontal direction by X ° = α1 · x °.

  Thereby, since the observer who observes the display panel 21 can operate the imaging direction of the imaging part 11 by rotating the display panel 21, the imaging direction of the imaging part 11 can be quickly, easily and intuitively. Can be operated.

  In addition, since the image displayed on the display panel 21 is an image captured by the imaging device 10, the moving direction of the imaging direction of the imaging device 10 matches the moving direction of the image displayed on the display panel 21. For this reason, the observer can more intuitively operate the imaging direction of the imaging unit 11 while viewing the image displayed on the display panel 21.

  For example, as shown in FIG. 6, when the entire subject A that the observer wants to view is not included in the image captured by the imaging device 10 and displayed on the display panel 21, the observer rotates the display panel 21. Thus, the imaging direction of the imaging device 10 can be rotated, and the entire subject A can be imaged and displayed.

  In addition, by using two sets of remote control systems 1 according to the present embodiment, it can be used for a bidirectional communication system that transmits captured image data bidirectionally, such as a video conference system or a video phone.

  FIG. 7 is a schematic diagram showing a state in which the remote control system 1 is applied to a video conference system. As shown in this figure, in the example shown in FIG. 7, the display device 20a and the imaging device 10b are arranged in the first conference room (first venue), and the display device 20b and the imaging device 10a are in the second conference room ( (Second venue). The configuration of the imaging devices 10a and 10b is the same as that of the imaging device 10 described above, and the configuration of the display devices 20a and 20b is the same as that of the display device 20 described above.

  In the example of FIG. 7, an image captured by the imaging device 10a disposed in the second conference room is transmitted to the display device 20a disposed in the first conference room and displayed on the display device 20a. When the display device 20a is rotated by x °, the imaging direction of the imaging device 10a is rotated by α1 · x °. In addition, an image captured by the imaging device 10b disposed in the first conference room is transmitted to the display device 20b disposed in the second conference room and displayed on the display device 20b. When the display device 20b is rotated by x2 °, the imaging direction of the imaging device 10b is rotated by α1 · x2 °.

  Thereby, for example, as shown in FIG. 7, when D is not reflected on the display screen of the display device 20a among the attendees A, B, C, and D in the second meeting room, the observer can display the display device. By rotating the display panel 21 of 20a in the direction in which D is supposed to exist, the imaging direction of the imaging device 10a can be rotated to capture D, and D can be displayed on the display device 20a.

  In the present embodiment, the configuration in which the rotation angles x ° and y ° with respect to the pedestal 41 of the display panel 21 are detected and the imaging direction of the imaging device 10 is rotated according to the detection result has been described. It is not limited to.

  For example, the horizontal rotation angle m ° and the vertical rotation angle n ° of the display panel 21 centering on the observer are detected, and the imaging direction of the imaging device 10 is set to X ° = horizontal direction according to the detection result. It may be configured to rotate α1 · m ° and Y ° = α2 · n ° in the vertical direction. FIG. 8 is an explanatory diagram showing a configuration example of the display device 20 in that case.

  The display device 20 shown in FIG. 8 replaces the base 41, the first support arm 42, the first rotation support portion 43, the second support arm 44, and the second rotation support portion 45 in the configuration shown in FIG. 51 and rail support parts 52a and 52b.

  The rail 51 is provided in an arc shape centered on the observer's observation position (position where the observer observes the display panel 21), and the display panel is arranged on the rail 51 by the user's manual operation. 21 can be moved in parallel. Thereby, the display panel 21 can be moved along an arc-shaped trajectory centered on the observer. In this movement, the normal direction of the display surface of the display panel 21 is always directed to the viewer.

  The radius of the arc shape of the rail 51 is not particularly limited. For example, in the case of a system that assumes that there is only one observer of the display panel 21, the display panel is formed by the observer reaching out. You may set within the range (for example, 70 cm or less) which can move the display panel 21 by touching 21. Further, in the case of a system that assumes that a plurality of observers observe the display panel 21 at the same time, the number of observers to observe at the same time, the installation space of the display device 20, and the like may be set as appropriate.

  The rail support portions 52a and 52b are provided at both ends of the rail 51. When the user manually operates the rail 51 to move the display panel 21 in the vertical direction, the track surface of the rail 51 (the arc formed by the rail 51). It is supported so that it can be rotated in a vertical direction (in-plane direction perpendicular to the track surface) with respect to a plane parallel to the shape. That is, the rail support portions 52a and 52b support the rail member 51 so as to be rotatable in a direction perpendicular to the track surface of the rail member 51 with a straight line passing through the observer's observation position as an axis.

  Further, the display panel 21 or the rail 51 is provided with a displacement sensor (not shown) such as a linear potentiometer for detecting the amount of movement of the display panel 21 along the rail 51. Further, the display device 20 has a horizontal rotation angle m ° of the display panel 21 around the observer based on the detection result of the displacement sensor, that is, a horizontal position relative to a reference position in the normal direction of the display surface of the display panel 21. A calculation unit (not shown) for calculating a rotation angle with respect to the direction is provided, and a horizontal angle sensor 23 is configured by the displacement sensor and the calculation unit.

  Further, at least one of the rail support portion 52a and the rail support portion 52b has a rotation angle n ° with respect to the reference position of the rail 51, that is, a rotation angle with respect to the reference position in the normal direction of the display surface of the display panel 21 with respect to the vertical direction. A vertical angle sensor 24, such as a rotary potentiometer, is provided.

  As a result, as shown in FIG. 9, when the observer rotates the display panel 21 in the horizontal direction by m ° around itself, the imaging direction of the imaging unit 11 is rotated by α1 · m ° in the horizontal direction accordingly. Can be done.

  In addition, for example, as shown in FIG. 10, when the subject A moves out of the imaging range of the imaging device 10 and captures and displays a moving subject, the observer uses the display panel 21. The imaging direction of the imaging device 10 can be manipulated by moving it intuitively, and the imaging direction of the imaging unit 11 can be rotated so as to track the subject A. When the subject is tracked and imaged, the moving direction of the subject displayed on the display panel 21 matches the rotation direction of the display panel 21 for moving the imaging direction to the moving direction of the subject. Can intuitively operate the display panel 21 to operate the imaging direction of the imaging apparatus 10.

  In the present embodiment, the imaging direction of the imaging unit 11 can be rotated in two directions, the horizontal direction and the vertical direction, but is not necessarily limited thereto. For example, it may be configured to rotate in two directions perpendicular to each other (a non-horizontal direction and a non-vertical direction), or may be configured to be rotatable only in one direction.

  In the present embodiment, the display panel 21 can be rotated in two directions, the horizontal direction and the vertical direction. However, the present invention is not limited to this. For example, it may be configured to be rotatable in two directions perpendicular to each other (non-horizontal direction and non-vertical direction), may be configured to be rotatable in multiple directions including the horizontal direction and the vertical direction, and may be rotated only in one direction. It is good also as a structure. In the case of a configuration that can rotate in multiple directions, an angle sensor that detects the rotation direction and the rotation angle of the display panel 21 is provided, and the rotation direction and the rotation angle of the imaging unit 11 are calculated according to the detection result of the angle sensor. That's fine.

  Further, when the coordinate system of the rotation direction of the display device 20 and the coordinate system of the rotation direction of the imaging direction by the imaging unit 11 are non-parallel, the horizontal rotation angle calculation unit 29 and the vertical rotation angle calculation unit 30 perform the coordinates. The rotation direction and the rotation angle of the imaging unit 11 may be calculated in consideration of the difference between the systems, and the rotation of the imaging unit 11 may be controlled accordingly.

  Further, the control unit 22, the display control unit 22, the horizontal rotation angle calculation unit 29, the vertical rotation angle calculation unit 30, and the imaging control unit 16 included in the imaging device 10 provided in the display device 20 in the above embodiment are included in the CPU. It may be realized by software using a processor such as. In this case, the display device 20 and the imaging device 10 include a CPU (central processing unit) that executes instructions of a control program for realizing each function, a ROM (read only memory) that stores the program, and a RAM ( random access memory), a storage device (recording medium) such as a memory for storing the program and various data. The object of the present invention is to record the program code (execution format program, intermediate code program, source program) of the control program of the display device 20 or the imaging device 10 which is software for realizing the above-described functions so as to be readable by a computer. This is achieved by supplying the recording medium to the display device 20 or the imaging device 10 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the display device 20 or the display device 10 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The blocks of the display device 20 and the imaging device 10 are not limited to those realized using software, but may be configured by hardware logic, and may be hardware that performs a part of processing. It may be a combination of calculation means for executing software for controlling the hardware and the remaining processing.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  The present invention

DESCRIPTION OF SYMBOLS 1 Remote operation system 2 Communication network 10, 10a, 10b Imaging device 11 Imaging part 12 Horizontal rotation part (rotation part)
13 Vertical rotating part (rotating part)
14 Communication unit 15 Storage unit 16 Imaging control unit 20, 20a, 20b Display device 21 Display panel (display unit)
22 Display control unit 23 Horizontal angle sensor (angle detection sensor)
24 Vertical angle sensor (angle detection sensor)
25. Imaging control switch (imaging control switching means)
26 Rotation ratio adjustment knob (Rotation ratio adjustment means)
27 Instruction input unit 28 Storage unit 29 Horizontal rotation angle calculation unit (rotation angle calculation unit)
30 Vertical rotation angle calculation unit (rotation angle calculation unit)
31 communication unit 32 control unit 41 pedestal 42 first support arm (support unit)
43 1st rotation support part (support part)
44 2nd support arm (support part)
45 Second rotation support part (support part)
46 Display screen 47 Frame portion 51 Rail 52a, 52b Rail support portion

Claims (10)

An imaging apparatus including an imaging unit that captures an image in a predetermined direction and generates image data, and a rotation unit that rotates the imaging direction of the imaging unit, and a display screen that displays image data generated by the imaging unit A remote control system for an imaging device that performs an operation in the imaging direction of the imaging unit via the display device in a display system that is communicably connected via a communication network to a display device having a display unit having
The display device includes an angle detection sensor that detects a rotation angle of the rotation when the user rotates the display screen.
The imaging device or the display device includes a rotation angle calculation unit that calculates a rotation angle in the imaging direction of the imaging unit according to the rotation angle detected by the angle detection sensor,
The remote operation system, wherein the rotation unit rotates an imaging direction of the imaging unit according to the rotation angle calculated by the rotation angle calculation unit. The display device includes a pedestal for mounting the display device on a mounting surface, and a support unit that supports the display unit so as to be rotatable relative to the pedestal.
The remote operation system according to claim 1, wherein the angle detection sensor detects a rotation angle of the display screen with respect to the pedestal. The rotating unit can rotate the imaging direction of the imaging unit in two directions perpendicular to each other,
The support unit supports the display unit so as to be rotatable in a first direction and a second direction perpendicular to the pedestal,
The angle detection sensor detects rotation angles in the first direction and the second direction with respect to the pedestal of the display unit,
The rotation angle calculation unit calculates a rotation angle in the two directions of the imaging direction of the imaging unit according to the detection result of the rotation angle in each direction by the angle detection sensor,
The remote operation system according to claim 2, wherein the rotation unit rotates the imaging direction of the imaging unit according to the rotation angle in the two directions calculated by the rotation angle calculation unit. A rail member having an arc-shaped track surface centered on an observation position that is a position assumed as a position at which the user observes the display screen, and supporting the display unit so as to be capable of translation along the track surface. Prepared,
The remote control system according to claim 1, wherein the angle detection sensor detects a rotation angle of the display unit along the track surface with the observation position as a center. The rotating unit can rotate the imaging direction of the imaging unit in two directions perpendicular to each other,
The display device includes a rail support portion that supports the rail member so as to be rotatable in a direction perpendicular to the track surface with a straight line passing through the observation position as an axis.
The angle detection sensor detects a rotation angle of the display unit along the track surface centered on the observation position and a rotation angle centered on the axis of the rail member,
The rotation angle calculation unit is configured to change an imaging direction of the imaging unit according to a detection result of a rotation angle of the display unit along the track surface by the angle detection sensor and a rotation angle about the axis of the rail member. Calculate the rotation angle for each of the two directions,
The remote control system according to claim 4, wherein the rotation unit rotates the imaging direction of the imaging unit according to the rotation angles calculated by the rotation angle calculation unit.   An imaging direction control mode in which the imaging direction of the imaging unit is rotated according to a rotation operation of the display screen by a user, and an imaging direction non-control mode in which the imaging direction of the imaging unit is not rotated in accordance with the rotation operation Imaging control switching means for the user to arbitrarily switch the imaging direction of the imaging unit according to the rotation angle detected by the angle detection sensor only when the imaging direction control mode is selected. The remote control system according to claim 1, wherein the remote control system is rotated. A rotation ratio adjusting means for a user to adjust a ratio of a rotation angle of the imaging unit to the rotation angle detected by the angle detection sensor;
The rotation angle calculation unit calculates a rotation angle of the imaging unit based on the rotation angle detected by the angle detection sensor and the ratio instructed by a user via the rotation ratio adjusting unit. The remote control system according to any one of claims 1 to 6. An imaging apparatus including an imaging unit that captures an image in a predetermined direction and generates image data, and a rotation unit that rotates the imaging direction of the imaging unit, and a display screen that displays image data generated by the imaging unit A remote operation method of an imaging device for performing an operation in an imaging direction of the imaging unit via the display device in a display system that is communicably connected to a display device having a communication network,
An angle detection step of detecting a rotation angle of the rotation when the user rotates the direction of the display screen;
A rotation angle calculation step of calculating a rotation angle in the imaging direction of the imaging unit according to the rotation angle detected in the angle detection step;
An imaging control unit included in the imaging apparatus includes an imaging direction rotation step of controlling the operation of the rotation unit and rotating the imaging direction of the imaging unit according to the rotation angle calculated in the rotation angle calculation step. Remote operation method characterized by. Image data captured by the first imaging device arranged at the first venue using two sets of the imaging device and the display device provided in the remote control system according to any one of claims 1 to 7. Is displayed on the first display device disposed at the second venue, and the second display device is disposed at the first venue with the image data captured by the second imaging device disposed at the second venue. A two-way communication system for display on
Rotating the imaging direction of the imaging unit provided in the first imaging device according to the rotation angle of the display screen detected by the angle detection sensor provided in the first display device;
Bidirectionally rotating the imaging direction of the imaging unit provided in the second imaging device according to the rotation angle of the display screen detected by the angle detection sensor provided in the second display device Communications system. Image data captured by the first imaging device arranged at the first venue using two sets of the imaging device and the display device provided in the remote control system according to any one of claims 1 to 7. Is displayed on the first display device disposed at the second venue, and the second display device is disposed at the first venue with the image data captured by the second imaging device disposed at the second venue. A two-way communication method for displaying on
A first angle detection step of detecting a rotation angle of the rotation when the user of the second venue rotates the orientation of the display screen provided in the first display device;
A first angle calculation step of calculating a rotation angle in the imaging direction of the imaging unit provided in the first imaging device according to the rotation angle detected in the first angle detection step;
An imaging control unit provided in the first imaging device controls the operation of the rotation unit provided in the imaging device, and sets an imaging direction of the imaging unit according to the rotation angle calculated in the first angle calculation step. A first imaging direction rotation step to rotate;
A second angle detection step of detecting a rotation angle of the rotation when the user of the first venue rotates the orientation of the display screen provided in the second display device;
A second angle calculation step of calculating a rotation angle in the imaging direction of the imaging unit provided in the second imaging device according to the rotation angle detected in the second angle detection step;
An imaging control unit provided in the second imaging device controls the operation of the rotation unit provided in the imaging device, and sets the imaging direction of the imaging unit according to the rotation angle calculated in the second angle calculation step. And a rotation second imaging direction rotation step.

Images