KR20130123679A - Video confenrece apparatus, and method for operating the same - Google Patents

Abstract

The present invention relates to a video reference apparatus and an operation method for the same. The operation method of the video reference apparatus according to the embodiment of the present invention comprises the steps of: receiving a photographed image; performing signal processing such that received share content is included in the photographed image; performing signal processing such that a control object capable of controlling the share content is included in the photographed image; and performing a corresponding operation for the share content on the basis of the selection input of a predetermined item within the control object. Thus, use convenience can be improved. [Reference numerals] (AA) Start;(BB) No;(CC) Yes;(DD) End;(S710) Transmit photographed image including sharing object outside;(S720) Register sharing object?;(S730) Signal process predetermined object in photographed image to sharing object;(S740) Transmit photographed image including sharing object outside;(S750) Receive sharing contents;(S760) Signal process for received sharing contents to be included in photographed image;(S770) Transmit photographed image including sharing object outside;(S780) Signal process for control object controlling sharing contents to be included in photographed image;(S790) Perform the given motion based on selection input of the predetermined item in control object

Description

Video conferencing apparatus, and method for operating the same

TECHNICAL FIELD The present invention relates to a videoconferencing apparatus and a method of operating the same, and more particularly, to a videoconferencing apparatus capable of improving user convenience and a method of operating the same.

A videoconferencing apparatus is a device which performs signal processing so that videoconferencing can be performed. That is, the captured video and audio are transmitted to the counterpart video conference apparatus, and the video and audio captured from the counterpart conference apparatus are received.

On the other hand, during video conferencing, there are cases where various data other than the captured video and audio are shared. For this purpose, the video conferencing apparatus separately transmits data to be shared to the counterpart conference apparatus.

SUMMARY OF THE INVENTION An object of the present invention is to provide a video conference apparatus and a method of operating the same, which can improve user convenience.

Another object of the present invention is to provide a videoconferencing apparatus capable of including and transmitting content to be shared in a captured image, and an operation method thereof.

According to an aspect of the present invention, there is provided a method of operating a videoconferencing apparatus, the method including receiving a captured image, signal processing the received shared content to be included in the captured image, and controlling the shared content. And processing a signal so that the control object may be included in the captured image, and performing a corresponding operation on the shared content based on a selection input of a predetermined item in the control object.

In addition, an operation method of a videoconferencing apparatus according to an embodiment of the present invention for achieving the above object, the step of receiving a captured image, the signal processing to include the received shared content in the captured image, and the shared object The method may include transmitting a captured image to an external device, signal processing a control object capable of controlling shared content to be included in the captured image, and transmitting the captured image including the shared content to the outside.

In addition, a video conferencing apparatus according to an embodiment of the present invention for achieving the above object, the photographing unit, and a user input interface unit for receiving a user input; The received shared content is signaled to be included in the captured image, the control object capable of controlling the shared content is signaled to be included in the captured image, and based on a selection input of a predetermined item in the control object, the corresponding to the shared content. It includes a control unit for controlling to perform the operation.

According to an embodiment of the present invention, the videoconferencing apparatus may perform signal processing so that the shared content is included in the captured video, and transmit the captured video including the shared content to the videoconferencing device on the other side via the network. . Accordingly, compared with the conventional method of separately transmitting the captured image and the shared content, the data transmission amount can be significantly reduced, and the transmission speed can be significantly improved.

On the other hand, according to an embodiment of the present invention, the video conferencing device generates a control object capable of controlling shared content, performs signal processing to be included in the captured image, and captures a captured image including the control object in a network. Through the video conferencing device on the other side, transmission can be performed. Accordingly, compared with the conventional method of separately transmitting the captured image and the control object, the data transmission amount can be considerably reduced.

On the other hand, according to an embodiment of the present invention, the video conferencing apparatus can increase the user's convenience by performing a corresponding operation on the shared content based on the selection input of a predetermined item in the control object.

1 is a diagram illustrating a videoconferencing system according to an embodiment of the present invention.
2A to 2B are internal block diagrams of a videoconferencing apparatus according to an embodiment of the present invention.
3 is an internal block diagram of a videoconferencing apparatus according to another embodiment of the present invention.
4 is an internal block diagram of the control unit of FIG.
5 is a diagram showing a control method of the remote control apparatus of FIG.
Fig. 6 is an internal block diagram of the remote control device of Fig. 3; Fig.
7 is a flowchart illustrating a method of operating a videoconferencing apparatus according to an embodiment of the present invention.
8 to 14E are views referred to for describing various examples of the operation method of FIG. 7 or 9.
15 is a flowchart illustrating a method of operating a videoconferencing apparatus according to another embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is a diagram illustrating a videoconferencing system according to an embodiment of the present invention.

Referring to FIG. 1, the videoconferencing system 10 according to an embodiment of the present invention includes a first videoconferencing device 50a and a second videoconferencing device 50b capable of exchanging image data with each other. It may include. In addition, the first video display device 100a capable of displaying an image processed by the first video conferencing device 50a and the second video conference device 50b may display an image processed by the second video conferencing device 50b. 2 may further include an image display device (100b).

According to an embodiment of the present invention, the first video conferencing device 50a may include a photographing unit 195a, and may process an image photographed by the photographing unit 195a and transmit the signal to the outside. In detail, the captured image may be transmitted to the second video conference apparatus 50b on the opposite side through the network 500. On the contrary, the second video conferencing device 50b may also include a capturing unit 195b, and processes the image captured by the capturing unit 195b to process the first video conferencing device (via the network 500). 50a).

On the other hand, the first video conferencing device 50a can receive content from an external device such as the laptop computer 600. When the received content is shared content that can be shared with the video conference counterpart, the first video conference apparatus 50a transfers the shared content to the second video conference apparatus 50b on the other side via the network 500. Can transmit

In this case, according to an embodiment of the present invention, the first video conference apparatus 50a performs signal processing so that the shared content is included in the captured image, and captures the captured image including the shared content through the network 500. It is possible to transmit to the second video conference apparatus 50b on the other side. Accordingly, compared with the conventional method of separately transmitting the captured image and the shared content, the data transmission amount can be significantly reduced, and the transmission speed can be significantly improved.

Meanwhile, according to an exemplary embodiment of the present invention, the first video conferencing device 50a generates a control object capable of controlling the shared content, performs signal processing to be included in the captured image, and captures the image including the control object. Video. The second video conferencing device 50b on the other side can be transmitted via the network 500. Accordingly, as compared with the conventional method of separately transmitting the captured image and the control object, the data transmission amount can be significantly reduced, and the transmission speed can be significantly improved.

In addition, according to an embodiment of the present invention, the first video conferencing device 50a may increase user convenience by performing a corresponding operation on the shared content based on a selection input of a predetermined item in the control object. Will be.

On the other hand, the video conferencing devices 50a and 50b under the video conferencing system 10 as shown in FIG. 1 are provided separately from the video display devices 100a and 100b. It is possible to perform the processing and the audio signal processing, and to transmit the signal-processed video signal and audio signal to the respective video display devices 100a and 100b.

The image display apparatuses 100a and 100b may perform image output and audio output through the received image signal and the audio signal, respectively, through the display and the audio output unit in the image display apparatus.

 Meanwhile, the image display apparatuses 100a and 100b may include a TV (TV), a monitor, a computer, and the like, which can be broadcast-displayed.

On the other hand, although the video conference between the 1st video conference apparatus 50a and the 2nd video conference apparatus 50b is illustrated in figure, multi-party video conference is also possible. That is, in addition to the first and second video conferencing devices, it is also possible for more video conferencing devices to be used in the video conferencing system.

Meanwhile, unlike FIG. 1, in the videoconferencing apparatus according to another embodiment of the present invention, the videoconferencing apparatus 50a and the first image display apparatus 100a of FIG. 1 may be combined. That is, it is possible for the first video conferencing device 50a to be provided in the first video display device 100a. Accordingly, transmission of the captured image may be performed through the network 500 between the image display apparatuses 100a and 100b.

2A to 2B are internal block diagrams of a videoconferencing apparatus according to an embodiment of the present invention.

First, referring to FIG. 2A, the video conference apparatus 50 includes a photographing unit 195, a microphone 198, a network interface unit 255, a storage unit 258, a control unit 260, and a user input interface unit ( 263, and an external device interface unit 265.

The photographing unit 195 photographs an image. In particular, for video conferencing, a speaker can be photographed. The image information photographed by the photographing unit 195 may be input to the controller 260.

The photographing unit 195 may be implemented by one camera, but is not limited thereto and may be implemented by a plurality of cameras. On the other hand, the photographing unit 195 may be embedded in the upper portion of the video conferencing device 50 or disposed separately. The image information photographed by the photographing unit 195 may be input to the controller 260.

The microphone 198 collects an audio signal. In particular, for video conferencing, a speaker audio signal may be collected. In this case, the collected audio signal may be an audio signal of a multi channel mode. The audio signal collected by the microphone 198 may be input to the controller 260.

On the other hand, the microphone 198 may be embedded in the upper portion of the video conferencing device 50 or disposed separately. The microphone 198 may be provided separately from the photographing unit 195. Alternatively, the microphone 198 may be provided integrally with the photographing unit 195.

The network interface unit 255 provides an interface for connecting to a wired / wireless network including an internet network. In addition, via the connected network or another network 500 linked to the connected network, it is possible to transmit or receive data with the counterpart video conference apparatus.

In particular, in accordance with an embodiment of the present invention, the network interface unit 255 transmits or receives a captured image, transmits or receives a captured image including shared content, or transmits a captured image including a control object. Or can be received.

The storage unit 258 may store a program for processing and controlling signals in the controller 260, and may include an image, audio, or data signal input from the external device interface unit 265 or the network interface unit 255. You can also perform a function for temporary storage of.

The user input interface unit 263 transmits a signal input by the user to the controller 260 or transmits a signal from the controller 260 to the user. For example, various control signals, such as power on / off, operation input, setting input, etc. input through a local key (not shown) or a remote control device (not shown) may be received and transmitted to the controller 260.

The user input interface unit 263 may be a concept including the photographing unit 195 and the microphone 198. For example, the captured image from the photographing unit 195 may be used to detect a user input signal by a gesture such as a speaker's hand gesture, and the audio collected from the microphone 198 may be input by a speaker's voice recognition. Can be used for signal detection.

The external device interface unit 265 provides an interface for data transmission or reception with an external device connected by wire or wirelessly. In particular, when the image display apparatus 50 is provided separately from the image display apparatus 100, an interface for transmitting or receiving data with the image display apparatus 100 is provided. It is also possible to provide an interface for data transmission or reception with an external device such as a game device, a camera, a camcorder, a computer (notebook computer) or the like.

The controller 260 performs signal processing on the input signal.

For example, the controller 260 may multiplex or encode the video signal photographed by the photographing unit 195 or the audio signal collected by the microphone 198. In addition, the controller 260 may control to transmit the multiplexed or encoded video signal and audio signal to the counterpart video conference apparatus through the network interface unit 255 for the video conference.

As another example, the controller 260 may demultiplex or decode a video signal or an audio signal received from a counterpart video conference apparatus through the network interface unit 255.

The controller 260 may synthesize a video signal photographed by the photographing unit 195 and a video signal from a counterpart video conference apparatus received through the network interface unit 255. The synthesized video signal may be transmitted to the videoconferencing apparatus 100 through the external device interface unit 265.

In addition, the controller 260 may synthesize the audio signal collected by the microphone 198 and the audio signal from the counterpart video conference apparatus received through the network interface unit 255. The synthesized audio signal may be transmitted to the video conference apparatus 100 through the external device interface unit 265.

The video conferencing device 50 may further include a media input unit (not shown) for playing a separate media. An example of such a media input unit is a Blu-ray input unit (not shown) or the like. That is, the video conference apparatus 50 can be equipped with a Blu-ray player or the like. The input media such as a Blu-ray disc may be transmitted to the videoconferencing apparatus 100 through the external device interface 265 for display after signal processing such as demultiplexing or decoding in the controller 260. .

Next, referring to FIG. 2B, the videoconferencing device 50 is similar to the videoconferencing device 50 of FIG. 2A, but unlike FIG. 2A, the video conferencing device 50 further includes a broadcast receiving unit 272.

The broadcast receiving unit 272 may include a tuner unit 270 and a demodulation unit 275. In particular, it can receive a broadcast signal, which is received via the antenna 50. The received broadcast signal may be input to the controller 260.

In addition, operation | movement of the control part 260 etc. is abbreviate | omitted with reference to FIG. 2A.

3 is an internal block diagram of an image display apparatus according to another embodiment of the present invention.

Referring to FIG. 3, the video conferencing device 100 according to another embodiment of the present invention may be a video conferencing device and a video display device, unlike FIG. 1. In the following description, it will be described.

According to another embodiment of the present invention, the video conferencing device 100 of FIG. 3 includes a broadcast receiving unit 105, an external device interface unit 130, a storage unit 140, a user input interface unit 150, and a sensor unit. (Not shown), the controller 170, the display 180, the audio output unit 185, the microphone 198, and the photographing unit 195 may be included.

The broadcast receiving unit 105 may include a tuner unit 110, a demodulation unit 120, and a network interface unit 130. Of course, it is possible to design the network interface unit 130 not to include the tuner unit 110 and the demodulation unit 120 as necessary, and to provide the network interface unit 130 with the tuner unit 110 And the demodulation unit 120 are not included.

Meanwhile, unlike the figure, the broadcast receiving unit 105 may include an external device interface unit 135 of FIG. 3.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by the user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through the antenna 50. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner unit 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit 110 can be directly input to the controller 170.

The tuner unit 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among the RF broadcast signals received through the antenna in the present invention, and sequentially selects RF broadcast signals of the intermediate frequency signal, baseband image, . ≪ / RTI >

On the other hand, the tuner unit 110 may be provided with a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. In this case, the stream signal may be a signal multiplexed with a video signal, an audio signal, or a data signal.

The stream signal output from the demodulator 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 may be connected to an external device such as a DVD (Digital Versatile Disk), a Blu-ray, a game device, a camera, a camcorder, a computer (laptop), or a wired / wireless connection. You can also perform input and output operations.

The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the video conference apparatus 100 with a wired / wireless network including an internet network. For example, the network interface unit 135 can receive, via the network, content or data provided by the Internet or a content provider or a network operator.

In addition, the network interface unit 135 may transmit or receive data with the counterpart videoconferencing apparatus via the connected network or another network 500 linked to the connected network.

In particular, in accordance with an embodiment of the present invention, the network interface unit 135 transmits or receives a captured image, transmits or receives a captured image including shared content, or transmits a captured image including a control object. Or can be received.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

In addition, the storage 140 may perform a function for temporarily storing an input image, audio, or data signal from the external device interface 130 or the network interface 135. In addition, the storage unit 140 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

Although the storage unit 140 of FIG. 3 is separately provided from the controller 170, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

(Not shown), such as a power key, a channel key, a volume key, and a set value, from the remote control apparatus 200, (Not shown) that senses a user's gesture to the control unit 170 or transmits a signal from the control unit 170 to the control unit 170 It is possible to transmit it to the sensor unit (not shown).

The controller 170 performs signal processing on the input signal.

For example, the controller 170 may multiplex or encode the video signal captured by the photographing unit 195 or the audio signal collected by the microphone 198. The controller 170 may control the multiplexed or encoded video signal and audio signal to be transmitted to the counterpart video conference apparatus through the network interface 135 for the video conference.

As another example, the controller 170 may demultiplex or decode the video signal or the audio signal received from the counterpart video conference apparatus through the network interface unit 135.

The controller 170 may synthesize the video signal photographed by the photographing unit 195 and the video signal from the counterpart video conference apparatus received through the network interface unit 135. In addition, the synthesized video signal may be controlled to be displayed on the display 180.

In addition, the controller 170 may synthesize the audio signal collected by the microphone 198 and the audio signal from the counterpart video conference apparatus received through the network interface unit 135. The synthesized audio signal may be controlled to be output through the audio output unit 185.

In addition, the control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner unit 110, the demodulator 120, or the external device interface unit 130 to process an image or an audio signal. Signals for output can be generated and output.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. Also, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The audio signal processed by the control unit 170 may be output to the audio output unit 185 as an audio signal. The audio signal processed by the controller 170 may be input to the external output device through the external device interface unit 130. [

Although not shown in FIG. 3, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to FIG. 4.

In addition, the controller 170 may control overall operations in the video conference apparatus 100.

In addition, the controller 170 may control the video conference apparatus 100 by a user command or an internal program input through the user input interface unit 150.

Meanwhile, the control unit 170 may control the display 180 to display an image. In this case, the image displayed on the display 180 may be a still image or a video, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate a 3D object for a predetermined 2D object among the images displayed on the display 180, and display the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

Such a 3D object may be processed to have a different depth than the image displayed on the display 180. [ Preferably, the 3D object may be processed to appear protruding from the image displayed on the display 180.

The controller 170 may recognize a location of the user based on the image photographed by the photographing unit 195. For example, the distance (z-axis coordinate) between the user and the videoconferencing device 100 may be determined. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 130 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be stream-decoded together with a decoded image and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display 180 using the input thumbnail image.

At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 180, or in a full viewing mode displayed in most areas of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts an image signal, a data signal, an OSD signal, a control signal, or an image signal, a data signal, a control signal received from the external device interface unit 130 processed by the controller 170, and generates a driving signal. Create

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like, and may also be capable of a 3D display.

Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives the signal processed by the control unit 170 and outputs it as a voice.

The photographing unit 195 photographs an image. In particular, for video conferencing, a speaker can be photographed. The image information photographed by the photographing unit 195 may be input to the controller 170.

The photographing unit 195 may be implemented by one camera, but is not limited thereto and may be implemented by a plurality of cameras. Meanwhile, the photographing unit 195 may be embedded in the video conferencing device 100 on the display 180 or may be separately disposed. The image information photographed by the photographing unit 195 may be input to the controller 170.

The controller 170 may detect a gesture of the user based on each of the images captured by the photographing unit 195 or the detected signals from the sensor unit (not shown) or a combination thereof.

The microphone 198 collects an audio signal. In particular, for video conferencing, a speaker audio signal may be collected. In this case, the collected audio signal may be an audio signal of a multi channel mode. The audio signal collected by the microphone 198 may be input to the controller 170.

On the other hand, the microphone 198 may be embedded in the upper portion of the video conferencing device 50 or disposed separately. The microphone 198 may be provided separately from the photographing unit 195. Alternatively, the microphone 198 may be provided integrally with the photographing unit 195.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control apparatus 200 can use Bluetooth, RF (radio frequency) communication, infrared (IR) communication, UWB (Ultra Wideband), ZigBee, or the like. Also, the remote control apparatus 200 can receive the video, audio, or data signal output from the user input interface unit 150 and display it or output it by the remote control apparatus 200.

Meanwhile, the video conferencing device 100 described above may be a digital broadcast receiver capable of receiving fixed or mobile digital broadcasting.

On the other hand, a block diagram of the video conferencing device 100 shown in Figure 3 is a block diagram for one embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the video conferencing apparatus 100 that is actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

On the other hand, the video conferencing device 100 does not include the tuner 110 and the demodulator 120 shown in FIG. 3, unlike the illustrated in FIG. 3, but the network interface 130 or the external device interface unit ( Through 130, broadcast content may be received and reproduced.

Meanwhile, the video conference apparatus 100 of FIG. 3 may include a portable terminal such as a TV (TV), a monitor, a computer, a mobile phone, a tablet PC, and the like that can be broadcasted.

4 is an internal block diagram of the control unit of FIG.

Referring to the drawings, the controller 260 of the videoconferencing apparatus of FIGS. 1 and 2 according to one embodiment of the present invention, or the control unit of the videoconferencing apparatus of FIG. 3 according to another embodiment of the present invention ( 170 may include a demultiplexer 310, an image processor 320, a processor 330, an OSD generator 340, a mixer 345, and an image encoder 370. An audio processing unit (not shown), and a data processing unit (not shown).

Hereinafter, the control unit 170 of the video conference apparatus of FIG. 3 will be described.

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120, the external device interface 130, or the network interface 135.

The image processor 320 may perform image processing of an input image signal. To this end, the image processing unit 320 may include a video decoder 225 and a scaler 235. [

The video decoder 225 decodes the demultiplexed video signal and the scaler 235 performs scaling so that the resolution of the decoded video signal can be output from the display 180. The video decoder 225 may include a decoder of various standards.

 The image processor 320 may receive an image signal photographed by the photographing unit 195 and perform signal processing. If the captured image signal is an encoded image signal, it may be decoded. In addition, when the photographed video signal is not encoded, separate decoding may not be performed. On the other hand, for the decoded video signal or the like, resolution adjustment may be performed in the scaler.

For example, when the captured video signal received from the counterpart videoconferencing apparatus is input to the image processor 320, since the captured video signal is an encoded signal, the image decoder 225 decodes it and the scaler 235. May perform scaling on the decoded video signal.

As another example, when the photographed video signal received from the photographing unit 195 attached to the video conferencing device 100 is input to the image processor 320, since the photographed video signal is an uncoded signal, the video decoder 225 is used. ) May not perform a separate encoding. The scaler 235 may perform scaling on the captured image signal.

The scaler 235 determines the size of the captured image received from the counterpart video conferencing apparatus and the size of the captured image received from the image capturing unit 195 attached to the video conferencing apparatus 100 by user setting during video conferencing. Can be variable. Preferably, the size of the captured image received from the photographing unit 195 attached to the apparatus 100 may be larger.

The processor 330 may control overall operations in the video conferencing device 100 or the controller 170. For example, the processor 320 may perform control of signal processing for video conferencing. As another example, the processor 320 may control the tuner 110 to select an RF broadcast corresponding to a channel selected by a user or a pre-stored channel for viewing the received broadcast.

In addition, the processor 330 may control the video conference apparatus 100 by a user command or an internal program input through the user input interface unit 150.

In addition, the processor 330 may perform data transfer control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generator 340 generates an OSD signal according to a user input or itself. For example, based on a user input signal, a signal for displaying various information in a graphic or text form on the screen of the display 180 can be generated. The generated OSD signal may include various data such as a user interface screen, various menu screens, widgets, and icons of the video conference apparatus 100. In addition, the generated OSD signal may include a 2D object or a 3D object.

The OSD generating unit 340 can generate a pointer that can be displayed on the display based on the pointing signal input from the remote control device 200. [ In particular, such a pointer may be generated by the pointing signal processor, and the OSD generator 240 may include such a pointing signal processor (not shown). Of course, a pointing signal processing unit (not shown) may be provided separately from the OSD generating unit 240.

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the image signal processed by the image processor 320.

The mixed signal at mixer 345 may be passed to display 180 for output at display 180. In this case, the mixed signal may be converted into a signal for transmission such as a low voltage differential signaling (LVDS) signal or a mini LVDS signal, and transmitted to the display 180.

On the other hand, the signal mixed in the mixer 345 can be used to be transmitted to the counterpart videoconferencing apparatus for videoconferencing. To this end, the mixed signal from the mixer 345 may be input to the image encoder 370.

The video encoder 370 may encode a video signal from the mixer 345. To this end, the encoder 370 may be provided with encoders of various standards.

Although not shown in the figure, it is preferable that a multiplexer (not shown) is further provided after the encoder 370. The multiplexer (not shown) may multiplex the video signal encoded by the video encoder 370 and the audio signal encoded by the audio encoder (not shown), and change the signal into a signal suitable for transmission to the counterpart videoconferencing apparatus.

The encoded video signal or audio signal or multiplexed signal may be transmitted to the counterpart video conference apparatus through the network interface unit 135.

Meanwhile, the audio processor (not shown) in the controller 170 may perform voice processing of the demultiplexed voice signal by the demultiplexer 310. To this end, the audio processing unit (not shown) may include various decoders.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

Meanwhile, the block diagram of the controller 170 shown in FIG. 4 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

5 is a diagram showing a control method of the remote control apparatus of FIG.

5A illustrates that the pointer 180 corresponding to the remote control device 200 is displayed on the display 180. In this case,

The user can move or rotate the remote control device 200 up and down, left and right (Figure 5 (b)), and back and forth (Figure 5 (c)). The pointer 205 displayed on the display 180 of the video display device corresponds to the movement of the remote control device 200. [ As shown in the figure, the remote controller 200 can be referred to as a space remote controller or a 3D pointing device because the pointer 205 is moved and displayed according to the movement in the 3D space.

5B illustrates that when the user moves the remote control apparatus 200 to the left, the pointer 205 displayed on the display 180 of the image display apparatus also shifts to the left correspondingly.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The image display apparatus can calculate the coordinates of the pointer 205 from the information on the motion of the remote control apparatus 200. [ The image display apparatus can display the pointer 205 so as to correspond to the calculated coordinates.

5C illustrates a case in which the user moves the remote control device 200 away from the display 180 while pressing a specific button in the remote control device 200. FIG. Thereby, the selected area in the display 180 corresponding to the pointer 205 can be zoomed in and displayed. Conversely, when the user moves the remote control device 200 close to the display 180, the selection area within the display 180 corresponding to the pointer 205 may be zoomed out and zoomed out. On the other hand, when the remote control device 200 moves away from the display 180, the selection area is zoomed out, and when the remote control device 200 approaches the display 180, the selection area may be zoomed in.

On the other hand, when the specific button in the remote control device 200 is pressed, it is possible to exclude recognizing the up, down, left, and right movement. That is, when the remote control device 200 moves away from or near the display 180, the up, down, left and right movements are not recognized, and only the front and back movements can be recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

Fig. 6 is an internal block diagram of the remote control device of Fig. 3; Fig.

The remote control device 200 includes a wireless communication unit 425, a user input unit 435, a sensor unit 440, an output unit 450, a power supply unit 460, a storage unit 470, And a control unit 480.

The wireless communication unit 425 transmits / receives a signal to / from any one of the video display devices according to the embodiments of the present invention described above. Among the image display apparatuses according to the exemplary embodiments of the present invention, one video conferencing apparatus 100 will be described as an example.

In the present embodiment, the remote control apparatus 200 may include an RF module 421 capable of transmitting and receiving a signal with the videoconferencing apparatus 100 according to the RF communication standard. In addition, the remote control apparatus 200 may include an IR module 423 capable of transmitting and receiving a signal with the videoconferencing apparatus 100 according to the IR communication standard.

In the present embodiment, the remote control apparatus 200 transmits a signal containing information on the movement of the remote control apparatus 200 to the videoconferencing apparatus 100 through the RF module 421.

In addition, the remote control apparatus 200 may receive a signal transmitted from the video conference apparatus 100 through the RF module 421. In addition, the remote control apparatus 200 may transmit a command regarding power on / off, channel change, volume change, etc. to the video conference apparatus 100 through the IR module 423 as necessary.

The user input unit 435 may include a keypad, a button, a touch pad, or a touch screen. The user may input a command related to the video conference apparatus 100 to the remote control apparatus 200 by manipulating the user input unit 435. When the user input unit 435 includes a hard key button, the user may input a command related to the video conferencing device 100 to the remote control apparatus 200 through a push operation of the hard key button. When the user input unit 435 includes a touch screen, the user may input a command related to the video conferencing device 100 to the remote controller 200 by touching a soft key of the touch screen. In addition, the user input unit 435 may include various types of input means such as a scroll key, a jog key, etc., which can be operated by the user, and the present invention is not limited to the scope of the present invention.

The sensor unit 440 may include a gyro sensor 441 or an acceleration sensor 443. The gyro sensor 441 may sense information about the movement of the remote controller 200.

For example, the gyro sensor 441 can sense information about the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 443 may sense information about a moving speed of the remote controller 200. On the other hand, a distance measuring sensor can be further provided, whereby the distance to the display 180 can be sensed.

The output unit 450 may output a video or audio signal corresponding to an operation of the user input unit 435 or corresponding to a signal transmitted from the video conference apparatus 100. Through the output unit 450, the user may recognize whether the user input unit 435 is manipulated or whether the video conference apparatus 100 is controlled.

For example, the output unit 450 may include a LED module 451 which is turned on when the user input unit 435 is manipulated or a signal is transmitted / received through the wireless communication unit 425, and a vibration module generating vibration. 453), a sound output module 455 for outputting sound, or a display module 457 for outputting an image.

The power supply unit 460 supplies power to the remote control device 200. The power supply unit 460 may reduce power waste by stopping the power supply when the remote controller 200 does not move for a predetermined time. The power supply unit 460 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 470 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control apparatus 200 transmits and receives a signal wirelessly through the video conference apparatus 100 and the RF module 421, the remote control apparatus 200 and the video conference apparatus 100 transmit signals through a predetermined frequency band. Send and receive The control unit 480 of the remote control apparatus 200 stores information on a frequency band or the like for transmitting and receiving a signal wirelessly with the video conferencing apparatus 100 paired with the remote control apparatus 200 in the storage unit 470. Reference may be made.

The control unit 480 controls various items related to the control of the remote control device 200. The control unit 480 is a video conferencing device through a wireless communication unit 425 a signal corresponding to a predetermined key operation of the user input unit 435 or a signal corresponding to the movement of the remote control device 200 sensed by the sensor unit 440. 100 can be sent.

The user input interface unit 150 of the video conference apparatus 100 includes a wireless communication unit 151 capable of transmitting and receiving a signal wirelessly with the remote control apparatus 200, and a pointer corresponding to the operation of the remote control apparatus 200. It may be provided with a coordinate value calculation unit 415 that can calculate the coordinate value of.

The user input interface unit 150 can wirelessly transmit and receive signals to and from the remote control device 200 through the RF module 412. Also, the remote control device 200 can receive a signal transmitted through the IR module 413 according to the IR communication standard.

The coordinate value calculator 415 corrects the camera shake or error from the signal corresponding to the operation of the remote controller 200 received via the wireless communication unit 151 and outputs the coordinate value of the pointer 202 to be displayed on the display 170 (x, y) can be calculated.

The remote control device 200 transmission signal input to the videoconferencing device 100 through the user input interface unit 150 is transmitted to the controller 180 of the videoconferencing device 100. The controller 180 may determine the information on the operation and the key operation of the remote controller 200 from the signal transmitted from the remote controller 200 and control the video conference apparatus 100 correspondingly.

As another example, the remote controller 200 may calculate a pointer coordinate value corresponding to the operation and output the pointer coordinate value to the user input interface unit 150 of the video conference apparatus 100. In this case, the user input interface unit 150 of the videoconferencing apparatus 100 may transmit the information about the received pointer coordinate value to the controller 180 without a separate hand shake or error correction process.

As another example, the coordinate value calculating unit 415 may be provided in the control unit 170 instead of the user input interface unit 150, unlike the drawing.

FIG. 7 is a flowchart illustrating a method of operating a videoconferencing apparatus according to an embodiment of the present invention, and FIGS. 8 to 14E are views for explaining various examples of the method of FIG. 7 or 9.

The operation method of the videoconferencing device of FIGS. 7 to 14E is described on the premise that the videoconferencing device 50 under the videoconferencing system 10 is provided separately from the video display device 100 as shown in FIG. 1.

First, the video conference apparatus 50 receives a captured video (S710). Meanwhile, step 710 of FIG. 7 corresponds to step 810 of FIG. 8.

The photographing unit 195 photographs an image. In particular, for video conferencing, a speaker can be photographed. The image information photographed by the photographing unit 195 may be input to the controller 260.

On the other hand, the microphone 198 collects audio signals. In particular, for video conferencing, a speaker audio signal may be collected. The audio signal collected by the microphone 198 may be input to the controller 260.

On the other hand, the imaging apparatus 100 can receive the captured video and audio signal from the counterpart videoconferencing apparatus via the network interface unit 255. The received captured image and audio signal may be input to the controller 260. Accordingly, the controller 260 may demultiplex, decode, scale, or the like the photographed video signal and the audio signal received from the counterpart video conference apparatus.

The controller 260 may mix the video signal photographed by the videoconferencing apparatus with the photographed video signal received from the counterpart videoconferencing apparatus. The mixed image signal may be transmitted to the image display apparatus 100.

Accordingly, as shown in FIG. 9A, the self-captured image 910 photographed by the photographing unit 195a of the first image display apparatus 100a and the photographing unit 195b of the second image display apparatus 100b are photographed. The conference image 900 including the opposite side captured image 920 may be output from the first video conference apparatus 50a and displayed on the first image display apparatus 100a.

On the other hand, on the contrary, the self-captured image 925 captured by the capturing unit 195b of the second image display apparatus 100b and the counterpart photographed image captured by the capturing unit 195a of the first image display apparatus 100a. The conference video 905 including 915 may be output from the second video conference device 50b and displayed on the second video display device 100b.

The controller 260 may mix the audio signal collected by the videoconferencing apparatus and the audio signal collected from the counterpart videoconferencing apparatus. The mixed audio signal may be transmitted to the image display apparatus 100.

Next, it is determined whether the shared object is registered (S720). When the shared object is registered, the predetermined object in the captured image is signal processed as the shared object (S730). In operation S740, the captured image including the shared object is transmitted to the outside. Meanwhile, steps 720 to 740 (S740) of FIG. 7 correspond to steps 820 to 840 (S840) of FIG. 8.

The control unit 260 of the video conference apparatus 50 can determine whether a shared object that can be shared with the counterpart video conference apparatus is registered.

The shared object may be determined as a predetermined object in the image photographed by the image capturing unit of the video conference apparatus 50. For example, when a plurality of speakers and grid pattern sheets are included in the captured image, the grid pattern sheet may be set as a shared object by user registration.

In FIG. 9A, the grid pattern sheet 930 in the self-captured image 910 captured by the capturing unit 195a of the first image display apparatus 100a is set as a shared object.

Such a shared object is an object in the photographed video image, and is preferably highlighted to be distinguishable from other objects.

The controller 260 controls to transmit the captured video signal including the shared object to the video display device 100.

9A, the shared object 930 received from the first video conference device 50a is highlighted by the first video display device 100b connected to the first video conference device 50a, and the shared object 930 is highlighted. For example, the captured image 900 including 930 is displayed. Specifically, the box processing 935 is illustrated around the grid pattern sheet 930. This makes it possible for users who use themselves and their counterpart videoconferencing apparatus to easily recognize the existence of the shared object.

 The signal processing for the shared object is performed by the controller 260 of the video conferencing device 50. In particular, the OSD generator 340 may perform highlight display of the shared object. The mixer 345 mixes the photographed video and the shared object subjected to highlight display processing, and outputs a photographed video signal including the highlighted shared object.

On the other hand, when the shared object is set, the controller 260 may control the controller 260 to transmit a captured video signal including the shared object to the counterpart video conference apparatus through the network 500. .

FIG. 9A illustrates a second video display device 100b connected to a second video conference device 50b to receive a captured video signal including a shared object received from the first video conference device 50a. For example, the display device 100b displays a captured image 915 including a shared object.

9B is similar to FIG. 9A except that the types of shared objects are different.

FIG. 9B illustrates that an augmented shared object 940 is displayed instead of the grid pattern sheet 930 in the captured image of FIG. 9A as the shared object. To this end, the controller 260, in particular, the OSD generator 340 generates a virtual shared object and outputs it. The mixer 345 synthesizes the captured image and the generated caustic shared object, and outputs a captured image in which the virtual shared object 940 is positioned at the grid pattern sheet 930 as shown in the figure. .

Accordingly, as shown in FIG. 9B, the captured image 900 including the highlighted shared object 940 may be displayed on the first image display apparatus 100b connected to the first video conference apparatus 50a.

In the meantime, the above-described shared object may provide a criterion for a location where content to be shared is displayed in a video conference, between two parties or between parties. That is, in the video conference, the shared content included in the captured image may be disposed in the captured image corresponding to the position of the shared object. This will be described with reference to the following.

Next, the shared content is received (S750). In operation S760, the received shared content is signaled to be included in the captured image. In operation S770, the captured image including the shared content is transmitted to the outside. Meanwhile, steps 750 to 770 (S770) of FIG. 7 correspond to steps 850 to 870 (S870) of FIG. 8.

The controller 260 of the video conference apparatus 50 may receive the shared content from the outside or from the storage. The shared content may be content to be shared in a video conference, and may be content that may be transmitted to a counterpart video conference apparatus. For example, it may be an electronic document file such as a web document, a presentation document, or a multimedia file material such as a music file or an image file.

According to an embodiment of the present invention, when shared content is input to the control unit 260 of the video conference apparatus 50, signal processing is performed so that the shared content is included in the captured image transmitted to the counterpart video conference apparatus. do.

That is, it is assumed that only the captured image is transmitted when the content to be shared is combined in the captured image and transmitted to the counterpart video conference apparatus. Compared with the conventional method of separately transmitting the captured image and the shared content, the data transmission amount can be significantly reduced, and the transmission speed can be significantly improved.

For example, when the content to be shared is an electronic document file, the control unit 260 of the video conferencing device 50 selects the electronic document file in the vicinity of the shared object 940 or overlaps with the shared object 940. Can be controlled to place

Specifically, as shown in FIG. 9C, when the notebook 600 displaying a web document is connected to the first video conferencing device 50a, the first video conferencing device 50a is shared content in the captured image 910. Signal the web document 950 to be included. In particular, the image processor 320 in the controller 260 may mix the received captured image 910 with the shared content to scale the shared content so that the shared content is included in the captured image.

Accordingly, as shown in FIG. 9C, the self-captured image 910 and the second image display apparatus 100b captured by the capturing unit 195a of the first image display apparatus 100a including the shared content 950. ), The conference image 900 including the counterpart captured image 920 captured by the image capturing unit 195b is outputted from the first video conference apparatus 50a, and displayed on the first image display apparatus 100a. Can be.

On the other hand, the controller 260 may control to transmit the captured video signal including the shared content to the counterpart video conference apparatus through the network 500.

FIG. 9C illustrates a second video display device 100b connected to the second video conference device 50b to receive a captured video signal including shared content received from the first video conference device 50a. For example, the display device 100b displays a captured image 915 including shared content.

In operation S780, a control object capable of controlling shared content is included in the captured image. Meanwhile, step 780 of FIG. 7 corresponds to step 870 of FIG. 8.

The controller 260 of the video conference apparatus 50 may perform signal processing so that a control object capable of controlling shared content is included in the captured image according to a user input.

For example, a control object capable of controlling shared content displayed on the image display apparatus 100 may be displayed by a user's local key input, a remote controller input, or a touch input or a user's gesture input. Do.

As described above, the gesture input of the user may be recognized based on the recognized user's motion through the photographing unit 195 having one or more cameras.

Meanwhile, the control object may have a variable item according to the type of shared content, the data size of the shared content, the speaker's preference, and the like.

For example, if the shared content is an electronic document file, the control object may include a print item, email send item, mobile terminal send item, social network server send item, zoom item, previous / next page, for the electronic document file. It may include at least one of the moving items.

As another example, when the shared content is a music file, the control object may include at least one of an email transmission item, a mobile terminal transmission item, a social network server transmission item, and a volume control item for the music file.

As another example, when the shared content is a video file, the control object may include at least one of an email transmission item, a mobile terminal transmission item, a social network server transmission item, a zoom item, a channel adjustment item, and a volume control item for the image file. It may include one.

In addition, when the size of the shared content file is large and the control object is difficult to share with other users, the control object may include only a channel adjustment item, a volume adjustment item, and the like.

The signal processing for the control object is performed by the controller 260 of the video conferencing device 50. In particular, in the OSD generator 340, a control object may be generated. The mixer 345 may mix the photographed video with the generated control object and output a photographed video signal including the control object.

The control unit 260 of the videoconferencing apparatus 50 can control the transmission of the captured video including the control object to the videoconferencing apparatus on the other side via the network. Accordingly, compared with the conventional method of separately transmitting the captured image and the control object, the data transmission amount can be considerably reduced.

FIG. 9D illustrates a web document 950 as shared content in the captured image 910, and also includes an e-mail sending item 962 and a print item 964 for controlling the web document 950. Example control object. Such a control object may be displayed on both the first video display device 100a connected to the first video conferencing device 50a and the second video display device 100b connected to the second video conferencing device 50b. .

Next, based on the selection input of the predetermined item in the control object, a corresponding operation on the shared content is performed (S790). Meanwhile, step 790 of FIG. 7 corresponds to step 890 of FIG. 8.

The control unit 260 of the video conferencing device 50 controls to perform a corresponding operation on the shared content based on a selection input of a predetermined item in the control object by a user input.

For example, based on a selection input of a predetermined item in a control object, which is displayed on the video display device 100 by a user's local key input, a remote controller input, or a touch input or a user's gesture input. Control to perform a corresponding operation on the content.

That is, corresponding to any one of a print item, an email transmission item, a mobile terminal transmission item, a social network server transmission item, a zoom item, a previous / next page moving item, a channel adjustment item, and a volume control item for the shared content. Control to perform an operation.

9E illustrates that an email sending item 962 is selected from an email sending item 962 and a print item 964. Accordingly, the control unit 260 of the first video conferencing device 50a can control the shared content 950 to be sent by e-mail. The e-mail receiving target may be a preset target or the second video conferencing device 50b.

In FIG. 9E, the shared object 930 is dragged and dropped to the email transmission item 962. The drag and drop operation may be performed by using a gesture of a user and a pointer of a pointing device.

In addition to drag and drop, the e-mail transmission item 962 may be selected as shown in FIG. 9E by the selection input of the shared object 930 and the selection input of the e-mail transmission item 962. Alternatively, the email transmission item 962 may be selected directly by the selection input of the email transmission item 962 without the selection input of the shared object 930.

As described above, when the video conference is performed, the user's ease of use can be increased by performing the corresponding operation on the shared content based on the selection input of the predetermined item in the control object.

On the other hand, the screen for the selection operation, as shown in Fig. 9d, the first video display device 100a connected to the first video conferencing device 50a, the second video display device connected to the second video conferencing device 50b ( 100b) may be indicated in both.

9D and 9E illustrate an example in which an e-mail transmission item 962 and a print item 964, which are items in a control object, are displayed in a separate area from the shared content 950, but various modifications may be made. It is possible.

That is, as shown in FIGS. 9F and 9G, the email transmission item 962 and the print item 964, which are items in the control object, may be disposed in the shared content 950. That is, it is also possible to overlay the email transmission item 962 and the print item 964 on the shared content input from the outside. As a result, the captured video region can be further secured, thereby increasing the concentration in the video conference.

10A-10B illustrate various examples of control objects.

First, FIG. 10A illustrates a circular control object 970 as a 2D control object. As shown in the drawing, a control object 970 including an e-mail transmission item 972, a print item 974, and a data transmission item 976 may be disposed in a circular shape on a shared area 950. .

By the user input, the circular control object 970 may be rotated to select a specific item, or a specific item may be selected by selecting a specific region without additional rotation.

Next, FIG. 10B illustrates a three-dimensional control object 980. As shown in the drawing, a control object 980 including an email transmission item 982, a print item 984, and a data transmission item 986 may be disposed in a hexahedral shape in a separate area on the shared content 950. .

By the user input, the hexahedral control object 980 may be rotated to select a specific item, or a specific item may be selected by selecting a specific region without additional rotation.

10A illustrates a 2D control object 970 and FIG. 10B illustrates a three-dimensional control object 980, but the shape of the control object can be changed by user setting. Do. For example, it is possible to determine the shape of the control object using the setting menu before or during video conference.

On the other hand, the control object can be displayed by a predetermined user input. For example, when a user or a speaker performs a specific pattern of actions such as lifting and lowering the grid pattern sheet 930 during a video conference, the user recognizes this as a control object display input, and the control object You can control the display. Such a specific pattern of behavior can be determined using a setting menu before or during a video conference.

In the following, using an augmented control object having a hexahedron shape, selecting an item in the control object desired by the user during a video conference will be described.

11A illustrates rotating and selecting a virtual control object 980 using a first finger 1010 of the user.

The video conference apparatus 50 may detect the movement of the first finger 1010 of the user through the photographing unit 195.

When the e-mail sending item 982, the print item 984, and the data sending item 986 are disposed and displayed on three sides of the virtual control object 980, respectively, the first finger 1010 of the user is left. In the case of rotation, the virtual control object 980 of FIG. 11A (a) is rotated to the left so that the virtual control object 980, as shown in FIG. 11A (b), may be displayed. Then, when the user's first finger 1010 is bent to indicate a click, the printer item 986 located on the uppermost surface of the cube may be selected as shown in FIG. 11A (c). This allows the user to intuitively select an item in the desired virtual control object 980.

11B illustrates that the photographing unit 195 photographs the actual grid pattern sheet 930 and the first finger 1010 of the user.

The control unit 260 of the video conferencing device 50 controls the left rotation of the first finger 1010 in consideration of the distance between the grid pattern sheet 930 and the first finger 1010 of the user, the rotation direction, and the like. May detect that there is a left input of rotation of the virtual control object 980, or a selection input of the virtual control object 980 by bending the first finger 1010.

In the drawing, the photographing unit 195 includes one camera lens, but the distance between the grating pattern sheet 930 and the first finger 1010 of the user, the photographing unit 195 and the grating pattern sheet ( At least two camera lenses may be provided to measure the distance between the camera 930 and the distance between the photographing unit 195 and the user's first finger 1010. Alternatively, a plurality of photographing units arranged to be spaced apart from each other may be used.

The controller 260 of the videoconferencing apparatus 50 may recognize the first finger 1010 itself of the user or the thimble worn on the first finger 1010.

In contrast, the photographing unit 195 may photograph two fingers of the user and detect a rotational input, a selection input, or the like of the user input in consideration of the distance between the two fingers and the rotation.

FIG. 11C illustrates sensing the left rotational input in consideration of a distance, a position, and the like between two fingers of the user, specifically, the thumb 1020 and the index finger 1010.

When two finger positions 1010 and 1020 are parallel as shown in FIG. 11C, as shown in FIG. 11C, the control unit 260 has coordinates of (4,0.8) and ( 1, 1).

Next, as shown in (b) of FIG. 11C, when the thumb 1020 is positioned below the index finger 1010, as shown in (d) of FIG. 11C, the control unit 260 has respective coordinates (1). , 1), and (-1, -2). Accordingly, the virtual control object 980 may be detected to rotate left. 11C (b) illustrates the virtual control object 980 rotated leftward. Accordingly, unlike FIG. 11C (a), in FIG. 11C (b), the print item appears to be located on the uppermost surface of the hexahedron.

In this manner, by moving, rotating, and selecting the virtual control object 980, the user can easily select a desired item among the control items related to the shared content, so that the user's ease of use Can be increased.

12A illustrates an example of an operation for printing shared content 1250.

As shown in FIG. 12A, the shared object 940 is brought close to the control object 980. 12A and 12B, the control object 980 is rotated, and as shown in FIG. 12AC, when the print item in the control object 980 is located on the uppermost surface of the hexahedron, the control object ( A print item of 980 may be selected. Accordingly, an operation of printing the shared content 1250 may be performed. In this case, as shown in (c) of FIG. 12A, the object 1210 indicating that the printer is printing may be displayed together. As a result, the user can intuitively know that the print operation is in progress.

On the other hand, unlike FIG. 12A, it is also possible to access the shared object 1940 to the shared content 1250, rotate the control object 980, and select a desired item from the control object 980.

Next, FIG. 12B illustrates an example of an operation of e-mailing the shared content 1250.

As shown in FIG. 12B, the shared object 940 is approached to the shared content 1250. 12B, when the shared object 940 is moved again to access the email item 962 of the control object, the email item 962 of the control object may be selected. Accordingly, an operation of sending an email of the shared content 1250 may be performed. As a result, the user can easily perform an email transmission of the shared content 1250.

The approach of FIG. 12B eventually corresponds to that performed by the selection input of the shared object 940, the selection input of the shared content 1250, and the selection input of the email item 962.

Next, FIG. 12C illustrates another example of an operation of printing the shared content 1250.

As shown in FIG. 12C, the shared object 940 is approached to the shared content 1250. 12C, when the shared object 940 is moved again to access the print item 964 of the control object, the print item 964 of the control object may be selected. Accordingly, an operation of printing the shared content 1250 may be performed. As a result, the user may easily perform a print operation of the shared content 1250.

13A to 13C illustrate that an enlargement / reduction item is selected among the items of the control object.

The video display device 100 connected to the video conferencing device 50 may capture a captured image including a control object including a shared object 1340, shared content 1350, a reduced item 1342, and an enlarged item 1344. I can display it.

13B, when the shared object 1340 is selected and moved to the reduced item 1322 by the user input, the reduced item 1136 is selected among the control objects, and the video conferencing device 50 is selected. The connected image display apparatus 100 may reduce the shared content 1350 and display the reduced shared content 1355.

On the other hand, when the shared object 1340 is selected and moved to the enlarged item 1164 by the user input, the enlarged item 1164 is selected among the control objects, and thus the video conferencing device 50 is selected. The image display apparatus 100 connected to FIG. 1) may enlarge the reduced shared content 1355 to display the enlarged shared content 1360. Accordingly, the user can easily perform the desired operation.

14A-14E illustrate setting shared content as a speaker.

First, FIG. 14A illustrates a self-captured image 1410 captured by the capturing unit 195a of the first image display apparatus 100a and a counterpart photographed captured by the capturing unit 195b of the second image display apparatus 100b. The conference image 1400 including the image 1420 is output from the first video conference apparatus 50a and is displayed on the first image display apparatus 100a.

On the other hand, on the contrary, the self-captured image 1425 captured by the capturing unit 195b of the second image display apparatus 100b and the counterpart photographed image captured by the capturing unit 195a of the first image display apparatus 100a. The conference image 1405 including the 1415 may be output from the second video conference apparatus 50b and displayed on the second image display apparatus 100b.

The shared object may be determined as a predetermined object in the image photographed by the photographing unit of the videoconferencing apparatus. 14A to 14E illustrate setting at least one of a plurality of speakers in a captured image as a shared object.

FIG. 14A illustrates an image corresponding to the first speaker, the second speaker, and the third speaker in the self-captured image 1410 captured by the capturing unit 195a of the first image display apparatus 100a as a shared object. Illustrate that. These shared objects may be highlighted so as to be distinguished from other objects as previously registered in a video conference. In FIG. 14A, box processing 1432, 1434, and 1436 are illustrated around each shared object.

Next, in FIG. 14B, unlike FIG. 14A, shared objects 1442, 1444, and 1446 corresponding to the first speaker, the second speaker, and the third speaker are separately generated, and thus, the first speaker, the second speaker, and the third speaker are separately generated. In the vicinity of the corresponding image, it is illustrated separately. It is preferable to be displayed as different shared objects so as to be distinguishable for each speaker.

At this time, in order to grasp the priority shared object, priority may be given to any one shared object. In FIG. 14B, the box processing 1443 is illustrated around the first shared object 1442 having the priority.

On the other hand, as shown in FIG. 14C, when the notebook 600 for displaying a web document is connected to the first video conference apparatus 50a, the first video conference apparatus 50a shares a first share in the captured image 1410. Signal processing is performed so that the shared content 1450 is arranged near the object 1442.

Next, when there is a user input, as shown in FIG. 14D, a web document 1450 is included as the shared content in the captured image 1410, and an email transmission item 1462 for controlling the web document 1450 is also included. And a control object including the print item 1464 may be displayed on the first image display apparatus 100a.

Next, as illustrated in FIG. 14E, when an email transmission item 1462 is selected among control objects by user input, an email transmission may be performed on the shared content. In particular, since the shared object is a shared object for the first speaker, an operation of emailing the shared content to the first speaker may be performed. Accordingly, the usability of the user can be increased.

On the other hand, when the second speaker, the third speaker, the other party's speaker, or a shared object corresponding thereto is selected in addition to the first speaker, the corresponding speaker can easily operate selection items of shared content such as e-mail transmission or mobile phone transmission. Can be done.

15 is a flowchart illustrating a method of operating a videoconferencing apparatus according to another embodiment of the present invention.

The operating method of the apparatus of the imaging of FIG. 15 is described on the premise that, as in FIG. 3, the videoconferencing apparatus and the video display apparatus under the videoconferencing system 10 are combined as one apparatus. Accordingly, the signal processing steps S730, S760, and S780 of the captured image in the operating method of FIG. 7 may correspond to display steps S1530, S1560, S1580, and the like of the captured image of FIG. 15, respectively.

 Meanwhile, unlike FIG. 7, an operation (S1515) of displaying the captured image may be further performed.

That is, as shown in 9a, the first image display apparatus 100a including the display includes a self-captured image 1410 photographed by the photographing unit 195a and a photographing unit 195b of the second image display apparatus 100b. The conference image 1400 including the counterpart photographed image 1420 captured at may be displayed.

On the other hand, on the contrary, the self-captured image 1425 captured by the capturing unit 195b of the second image display apparatus 100b and the counterpart photographed image captured by the capturing unit 195a of the first image display apparatus 100a. The conference image 1405 including the 1415 may be displayed on the second image display apparatus 100b having a display.

Other operation matters correspond to the description contents of FIGS. 7 to 14E.

The videoconferencing apparatus and its operation method according to the present invention are not limited to the configuration and method of the embodiments described as described above, but the embodiments are all or all of the embodiments so that various modifications can be made. Some may be optionally combined.

On the other hand, the operating method of the videoconferencing apparatus of the present invention can be embodied as processor-readable codes on a processor-readable recording medium provided in the videoconferencing apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

Receiving a captured image;
Signal processing the received shared content to be included in the captured image;
Signal processing such that a control object capable of controlling the shared content is included in the captured image; And
And performing a corresponding operation on the shared content on the basis of a selection input of a predetermined item in the control object. The method of claim 1,
And processing a predetermined object in the captured image as a shared object.
And the shared content is disposed in the captured image corresponding to the position of the shared object. The method of claim 1,
Transmitting a captured image including the shared object to the outside; And
And transmitting the captured image including the shared content to the outside. The method of claim 1,
The control object includes an operable item for the shared content, and the operable item is variable according to the type or data size of the shared content. The method of claim 1,
The predetermined item in the control object may include a print item, an email transmission item, a mobile terminal transmission item, a social network server transmission item, a zoom item, a previous / next page moving item, a channel adjustment item, and a volume control on the shared content. And at least one of the items. 3. The method of claim 2,
Performing a corresponding operation on the shared content,
And based on at least one of a selection input of the shared object or a selection input of the shared content, in addition to a selection input of a predetermined item in the control object. The method of claim 1,
Performing a corresponding operation on the shared content,
And a selection input of a predetermined item in the control object and a selection input of the shared content. The method of claim 1,
Displaying a captured image including the shared content; And
And displaying a captured image including the control object. The method of claim 1,
Displaying a shared object related to a predetermined object in the captured image;
And the shared content is disposed in the captured image corresponding to the position of the shared object. The method of claim 1,
Displaying a shared object related to a speaker in the captured image;
Performing a corresponding operation on the shared content,
And when there is a selection input of the shared object and a selection input of a predetermined item in the control object, corresponding operation on the shared content is performed corresponding to the speaker. Receiving a captured image;
Signal processing the received shared content to be included in the captured image;
Transmitting a captured image including the shared object to the outside;
Signal processing such that a control object capable of controlling the shared content is included in the captured image; And
And transmitting the captured image including the shared content to the outside. A photographing unit;
A user input interface unit for receiving a user input; And
And processing the received shared content to be included in the captured image, and processing a control object capable of controlling the shared content to be included in the captured image, based on a selection input of a predetermined item in the control object. And a controller which controls to perform a corresponding operation on the shared content. The method of claim 12,
The control unit,
Processing a predetermined object in the captured image as a shared object,
And the shared content is disposed in the captured image corresponding to the location of the shared object. The method of claim 12,
Further comprising a; network interface unit for exchanging data with the network,
The control unit,
And transmitting the captured image including the shared object and the captured image including the shared content to the network. The method of claim 12,
The control object includes an operable item for the shared content,
The control unit,
And the operable item is changed according to the type or data size of the shared content. The method of claim 13,
The control unit,
And controlling to perform a corresponding operation on the shared content based on at least one of a selection input of the shared object or a selection input of the shared content, in addition to a selection input of a predetermined item in the control object. Conference unit. The method of claim 12,
The control unit,
And performing a corresponding operation on the shared content based on a selection input of a predetermined item in the control object and a selection input of the shared content. The method of claim 12,
The display further includes;
The control unit,
And control to display a captured image including the shared content, and display the captured image including the control object. The method of claim 12,
The display further includes;
The control unit,
Controls to display a shared object related to a predetermined object in the captured image,
And the shared content is disposed in the captured image corresponding to the location of the shared object. The method of claim 12,
The display further includes;
The control unit,
Controls to display a shared object related to the speaker in the captured image,
And when there is a selection input of the shared object and a selection input of a predetermined item in the control object, controlling to perform a corresponding operation on the shared content in response to the speaker.

Images