KR20140052739A - Video conference system providing data sharing function based on meta data and method thereof - Google Patents

Abstract

The specification discloses a video conference system having a data sharing function based on meta data, a video conference terminal and a method thereof. According to an embodiment of the present invention, the video conference terminal comprises an interface unit connected to an external device; a communications unit connected to the external video conference terminal through network; and a control unit for controlling the communications unit to receive data which is used for video conference from the external device, controlling the interface unit, displaying the data on a first screen, acquiring properties information on a user work on the first screen, producing meta data corresponding to the user work based on the properties information, and transmitting the produced meta data to the external video conference terminal.

Description

TECHNICAL FIELD [0001] The present invention relates to a video conferencing system and a video conferencing system having a data sharing function based on meta data,

The present specification relates to a video conference system (VCS) and a video conference method capable of sharing data during a video conference without a PC using metadata.

Generally, VCS used in video conference uses two A / V channels because TV and PC are connected per VCS terminal.

The problem with this method is that data to be shared by a user is transmitted through a video channel, which may increase the amount of data to be transmitted.

It is an object of the present invention to provide a video conference system, a video conference terminal and a video conference method having a data sharing function based on metadata.

According to an aspect of the present invention, there is provided a video conferencing terminal comprising: an interface unit connected to an external device; A communication unit connected to an external video conferencing terminal through a network; And controlling the interface unit to receive data used for video conferencing from the external device, displaying the data on a first screen, acquiring characteristic information on a user task on the first screen, And a control unit for controlling the communication unit to transmit the generated metadata to the external video conferencing terminal.

As an example related to the present specification, the first screen may be a screen of a display device provided inside or connected to the video conference terminal.

As one example related to the present specification, the characteristic information may be detected and obtained by the display device.

As an example related to the present specification, the user operation may be performed by an electronic pen that detects the characteristic information, and the control unit may obtain the characteristic information from the electronic pen.

In one embodiment of the present invention, the characteristic information may include at least one of position information on the first screen corresponding to the user job, a type of the user job, and attributes of the user job.

As an example related to the present specification, the position information on the first screen may be pixel coordinate information on the first screen corresponding to the user task.

As one example related to the present specification, the type of the user's job may be a line-drawing operation, a drawing operation, a writing operation, a selection operation on a specific object displayed on the first screen, And an operation of adding a new object on the screen.

In one embodiment of the present invention, the attributes of the user task include at least one of a size, a color, a shape corresponding to the line, a figure or a letter, a display mode of the selected specific object, Lt; / RTI >

In one embodiment of the present invention, the external videoconference terminal receives the data and the meta data from the communication unit, and displays an effect corresponding to the data and the user operation on a second screen based on the meta data .

As an example related to the present specification, the second screen may be a screen of a display device provided inside or connected to the external video conferencing terminal.

As an example related to the present specification, the control unit may control the communication unit to receive external data used for the video conference from the external videoconference terminal and external metadata related to external user operation on the screen displaying the external data And displaying an effect corresponding to the external data and the external user operation on the first screen based on the external metadata.

According to an embodiment of the present invention, the plurality of external videoconference terminals may share the metadata corresponding to a specific time point or a specific time period.

As an example related to the present specification, the metadata corresponding to the specific time point or the specific time period may be shared with each other when the communication state of the network is unstable.

As an example related to the present specification, the metadata may include first time stamp information for synchronization with the external videoconference terminal.

In one embodiment of the present invention, the control unit may display an image of the user of the video conference terminal on the first screen, and the metadata may include a second image for synchronization with the photographed image and the meta data, And may include timestamp information.

In order to achieve the above objects, a video conference system according to the present invention displays data used for a video conference on a first screen, detects characteristic information on a user task on the first screen, A first video conference terminal for generating metadata corresponding to the user task; And a second video conference terminal for receiving the data and the metadata via a network and displaying the metadata and the effect corresponding to the user work on a second screen based on the metadata .

According to another aspect of the present invention, there is provided a video conference method comprising: displaying data used for a video conference on a first screen; Detecting characteristic information on a user task on the first screen; Generating metadata corresponding to the user task based on the characteristic information; And transmitting the data and the metadata to an external videoconference terminal through a network.

According to an embodiment disclosed herein, a video conference system, a video conference terminal, and a video conference method having a data sharing function based on metadata are disclosed.

Particularly, according to the video conferencing system, video conferencing terminal or video conferencing method disclosed in this specification, data required for video conferencing is shared between video conferencing terminals based on metadata, so that a small network bandwidth is used, There is an advantage that you can see the same data and instantly share your modifications.

1 is an exemplary diagram showing a general video conferencing system.
2 is a block diagram illustrating a video conferencing terminal according to an embodiment disclosed herein.
3 is an exemplary diagram illustrating a video conferencing system in accordance with one embodiment disclosed herein.
4 is a flowchart illustrating a video conferencing method in accordance with one embodiment disclosed herein.

The techniques disclosed in this specification can be applied to a video conference system, a video conference terminal, or a video conference method. However, the technology disclosed in this specification is not limited thereto, and can be applied to all data sharing systems and data sharing methods to which the technical idea of the above-described technology can be applied.

It is noted that the technical terms used herein are used only to describe specific embodiments and are not intended to limit the scope of the technology disclosed herein. Also, the technical terms used herein should be interpreted as being generally understood by those skilled in the art to which the presently disclosed subject matter belongs, unless the context clearly dictates otherwise in this specification, Should not be construed in a broader sense, or interpreted in an oversimplified sense. In addition, when a technical term used in this specification is an erroneous technical term that does not accurately express the concept of the technology disclosed in this specification, it should be understood that technical terms which can be understood by a person skilled in the art are replaced. Also, the general terms used in the present specification should be interpreted in accordance with the predefined or prior context, and should not be construed as being excessively reduced in meaning.

Also, the singular forms "as used herein include plural referents unless the context clearly dictates otherwise. In this specification, the terms "comprising ", or" comprising "and the like should not be construed as necessarily including the various elements or steps described in the specification, Or may be further comprised of additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in this specification can be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted.

Further, in the description of the technology disclosed in this specification, a detailed description of related arts will be omitted if it is determined that the gist of the technology disclosed in this specification may be obscured. It is to be noted that the attached drawings are only for the purpose of easily understanding the concept of the technology disclosed in the present specification, and should not be construed as limiting the spirit of the technology by the attached drawings.

Hereinafter, a video conference system, a video conference terminal, and a video conference method having a data sharing function based on metadata will be described with reference to FIGS. 1 to 4. FIG.

Description of the video conferencing system

1 is an exemplary diagram showing a general video conferencing system.

Referring to FIG. 1, a typical video conference system (VCS) 10 may include a video conference terminal 10, a display device 20, an external terminal 30, and an A / V device 40 have.

The video conferencing terminal 10 is connected to at least one or more external video conferencing terminals 50 connected to the video conferencing system VCS10 via a communication network (or network N10) and an image (or video) And / or audio data and control signals.

The video conferencing terminal 10 and the external video conferencing terminal 50 may be terminals using a homogeneous protocol or terminals using a heterogeneous protocol.

According to one embodiment, the video conferencing terminal 10 and the external video conferencing terminal 50 are connected to the ITU Telecommunication Standardization Sector (ITU-T) multi-party video conference recommendation (including H.323) (Including MEGACO (Media Gateway Control), H.248, etc.) proposed by the ITU-T and IETF, or MGCP (Media Gateway Control Protocol) So that video conferencing is possible regardless of the terminal type.

According to an embodiment, the video conferencing terminal 10 and the video conferencing terminal 50 may be a video conferencing terminal, a smart phone, a portable terminal, a mobile terminal A PDA (Personal Digital Assistant), a Wibro terminal, an IPTV (Internet Protocol Television) terminal, a television, a 3D television, a digital broadcasting receiver, A portable multimedia player (PMP), an AVN (Audio Video Navigation) terminal, a navigation terminal (vehicle navigation device), an A / V (Audio / Video) .

The videoconference terminal 10 may include one or more components (for example, a communication unit) for performing wired / wireless communication between the external videoconference terminals 50.

The video conference terminal 10 also communicates with the external video conference terminal through the communication network N10 based on a predetermined (or randomly set) unique IP address in the video conference terminal 10 .

The video conference terminal 10 can transmit and receive a wireless signal to at least one of a base station, an external terminal (including a video conference terminal, a mobile terminal, etc.) and a server (not shown) on the communication network N10.

Here, the wireless signal may include various types of data related to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

In addition, the video conferencing terminal 10 may include a module for wireless Internet access or a module for short range communication. Here, the wireless Internet technology includes a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), a WiMAX, a high speed downlink packet access (HSDPA) (Bluetooth), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as the short distance communication technology .

The display device 20 can display image information processed by the video conferencing terminal 10.

The display device 20 may display information on a communication connection state between the video conferencing terminal 10 and the video conferencing terminal 50 and an operation state of the video conferencing system VCS10.

In addition, when displaying the information, the display device 20 may display various contents such as various menu screens using the pre-stored user interface and / or graphical user interface.

Here, the content displayed by the display device 20 may include various text or image data and a menu screen including data such as an icon, a list menu, and a combo box.

The external terminal 30 may provide information (AV2) on data used for video conferencing to the video conferencing terminal 10.

For example, the information (AV2) on the data used in the video conference may be provided in a variety of formats such as a spreadsheet (e.g., Excel data), presentation data (e.g., PowerPoint data) May be information about other multimedia data that can be used in < RTI ID = 0.0 > a < / RTI >

The external terminal 30 may provide (or transmit) the data AV2 to the video conferencing terminal 10 through an A / V (Audio / Video, video or audio channel) channel.

Accordingly, the external terminal 30 can transmit an image or an image of a screen displaying data used for the video conference to the video conference terminal 10 through the channel.

Therefore, the video conference terminal 10 is provided with a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog ), A DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

The external terminal 30 may be various electronic devices. For example, the external terminal 30 may be a smart phone, a portable terminal, a mobile terminal, a telematics terminal, a notebook computer, a digital broadcasting terminal A Personal Digital Assistant (PDA), a Wibro terminal, a Portable Multimedia Player (PMP), an AVN (Audio Video Navigation) terminal, a navigation terminal (Vehicle Navigation Device) / V (Audio / Video) system, and the like.

The A / V device 40 provides information (AV1) about the users of the video conferencing terminal 10 or the subjects present in the area where the video conferencing terminal 10 is located to the video conferencing terminal 10 Can play a role.

The information (AV1) on the user or the subjects may mean various information on the user or the subjects.

For example, the information AV1 on the user or the subjects may be image or image information of the user or the subjects.

In this case, the A / V device 40 may be a digital / analog camera, a digital / analog camcorder, an electronic device capable of photographing other images or images, or a photographing device.

In addition, the A / V device 40 provides information (AV1) about the user or the subjects to the video conference terminal 10 through an A / V (Audio / Video, video or audio channel) Transmission).

The videoconference terminal 10 can acquire image or image information AV3 corresponding to an external user from the external videoconference terminal 50 through the communication network N10. For example, the image or image information AV3 corresponding to the external user may be an image or image data of the external user.

The video conference terminal 10 receives the first A / V data AV1 obtained from the A / V device 40, the second A / V data AV2 received from the external terminal 30, V data AV3 acquired from the external videoconference terminal 50 to the display device 20 and the display device 20 can transmit the first A / V data AV1 to the display device 20, (Or an external user) of the video conferencing terminal 10 and the user of the external video conferencing terminal 50 by displaying the second A / V data AV2 or the third A / V data AV3 on the screen, So that the video conference can be smoothly performed.

The work disclosed herein In the embodiment  Video conferencing terminal

The video conferencing terminal according to an embodiment disclosed herein may include an interface unit connected to an external device, a communication unit connected to an external video conferencing terminal through a network, and a communication unit connected to the interface unit to receive data used for video conferencing from the external device. Displaying the data on a first screen, acquiring characteristic information on a user task on the first screen, generating metadata corresponding to the user task based on the characteristic information, And a control unit for controlling the communication unit to transmit the data to the external videoconference terminal.

According to one embodiment, the first screen may be a screen of a display device provided inside or connected to the video conference terminal.

Further, according to one embodiment, the characteristic information may be detected and obtained by the display device.

Further, according to an embodiment, the user operation may be performed by an electronic pen that detects the characteristic information, and the control unit may obtain the characteristic information from the electronic pen.

According to an embodiment, the characteristic information may include at least one of position information on the first screen corresponding to the user job, a type of the user job, and attributes of the user job.

According to an embodiment, the position information on the first screen may be pixel coordinate information on the first screen corresponding to the user task.

According to an embodiment of the present invention, the type of the user task may include at least one of a line drawing operation, a drawing operation, a writing operation, a selection operation on a specific object displayed on the first screen, And an operation of adding a new object on the screen.

According to an embodiment of the present invention, the attributes of the user task include at least one of a size, a color, a shape corresponding to the line, a figure or a letter, a display mode of the selected specific object, Lt; / RTI >

According to an embodiment of the present invention, the external videoconference terminal receives the data and the meta data from the communication unit, and displays an effect corresponding to the data and the user operation on the second screen based on the meta data .

In addition, according to an embodiment, the second screen may be a screen of a display device provided in or connected to the external video conferencing terminal.

According to an embodiment of the present invention, the control unit controls the communication unit to receive external data used for the video conference from the external videoconference terminal and external metadata related to external user operation on the screen displaying the external data And displaying an effect corresponding to the external data and the external user operation on the first screen based on the external metadata.

According to an embodiment of the present invention, the plurality of external video conference terminals may share the metadata corresponding to a specific time point or a specific time interval.

According to an embodiment, the metadata corresponding to the specific time point or the specific time period may be shared with each other when the communication state of the network is unstable.

According to an embodiment of the present invention, the metadata may include first time stamp information for synchronization with the external videoconference terminal.

According to an embodiment of the present invention, the control unit may display an image of the user of the video conference terminal on the first screen, and the metadata may include a second time for synchronization with the photographed video and the meta data, And may include stamp information.

Hereinafter, a video conference terminal according to an embodiment disclosed herein will be described with reference to FIG.

2 is a block diagram illustrating a video conferencing terminal according to an embodiment disclosed herein.

2, the video conferencing terminal 100 according to one embodiment of the present invention includes a communication unit 110, an A / V input unit 120, a user input unit 130, an output unit 140, a storage unit 150, an interface unit 160, a control unit 170, and a power supply unit 180.

The communication unit 110 may perform the operations of demodulating, demodulating, and encoding / decoding signals transmitted / received to / from another (or external) video conferencing terminal (not shown) connected to the video conferencing terminal 100 through a communication network.

The signals that the videoconference terminal 100 exchanges with the other videoconference terminals may include control signals, audio, video, and / or data.

The A / V input unit 120 is for inputting an audio signal or a video signal. The A / V input unit 120 may include a camera 121 and a microphone 122.

According to another embodiment, the A / V input unit 120 receives the audio signal or the video signal from an A / V device such as a separate camera and a microphone connected to the video conferencing terminal 100 in a wired or wireless manner To the control unit 170 or the like.

The camera 121 can process an image frame such as a still image or a moving image obtained by the image sensor in a video conference mode. The processed image frame can be displayed on the display unit 142 and stored in the storage unit 150 or transmitted to the outside through the communication unit 110. [

The microphone 122 can receive an external sound signal by a microphone in a conference mode, a recording mode, a voice recognition mode, and the like, and process it as electrical voice data.

In the conference mode, the processed voice data can be converted into a form that can be transmitted to the video conferencing service network (or communication network) through the communication unit 110 and output.

The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 130 accepts an input command that the user inputs for controlling the operation of the video conferencing terminal 100 and transmits the received command to the controller 170 so that the controller 170 .

The user input unit 130 may include a mouse, a keyboard, a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

Particularly, when the touch pad has a mutual layer structure with the display unit 142, it can be called a touch screen.

The output unit 140 is for outputting an audio signal or a video signal. The output unit 140 may include a display unit 142 and an audio output module 144.

The display unit 142 may display and output information processed in the video conferencing terminal 100. For example, when the video conferencing terminal 100 is in a conference mode, a UI (User Interface) or a GUI (Graphic User Interface) related to video conferencing can be displayed.

When the video conferencing terminal 100 is in the video conferencing mode, the captured and / or received video or UI and GUI can be displayed.

According to one embodiment, the videoconference terminal 100 may receive data (e.g., document data related to a videoconference topic) associated with (or used in) a videoconference from an external terminal .

In this case, the control unit 170 executes an application related to the data (for example, when the data is a spreadsheet, corresponds to Excel), and displays the data processed by the application on the screen. (142).

Also, according to one embodiment, the display unit 142 can display a video conference image obtained by the A / V input unit 120 on the screen.

In addition, according to one embodiment, the display unit 142 may display a video conference image of an external user obtained from the external video conference terminal through the communication unit 110 on the screen.

The display unit 142 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, And a three-dimensional display (3D display).

Also, there may be two or more display units 142 according to the implementation mode of the video conferencing terminal 100. For example, the video conferencing terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The external display unit may be a display device connected to the video conference terminal 100 by wire or wirelessly. For example, the external display unit may be an Internet Protocol Television (IPTV), a digital / analog television, a 3D television, a smart TV, or a portable multimedia player.

(Hereinafter, referred to as 'touch screen') having a mutual layer structure with the display unit 142 and a sensor (hereinafter, referred to as 'touch sensor' It can also be used as an input device in addition to the device.

The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display portion 142 or a capacitance generated in a specific portion of the display portion 242 into an electrical input signal.

The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller may process the signal (s) and then transmit corresponding data to the controller 170.

Thus, the control unit 170 can know which area of the display unit 142 is touched or the like.

The audio output module 144 outputs audio data received from the communication unit 110 or stored in the storage unit 150 in a call signal reception mode, a conference mode or a recording mode, a voice recognition mode, and a broadcast reception mode.

The sound output module 144 may output sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the videoconference terminal 100.

The sound output module 144 may include a speaker, a buzzer, and the like.

The storage unit 150 may include a read only memory (ROM), for example, a flash memory for storing a program for the operation of the controller 170, a RAM (not shown) for temporarily storing data to be processed for transmission, Random Access Memory).

The storage unit 150 may store various application programs related to the video conferencing service including an operating system and a program for receiving a video conferencing service.

The storage unit 150 may include various CODECs for processing video and / or audio data transmitted and received through the communication unit 110, the A / V input unit 120, and the interface unit 160. [ As shown in FIG.

The interface unit 160 serves as an interface with all external devices (or external terminals) connected to the video conferencing terminal 100.

For example, the interface unit 160 may include a headset port, an external charger port, a wired / wireless data port (such as a USB port), a memory card port, an audio I / O (input / output) port, a video I / O (input / output) port, and an earphone port.

The interface unit 160 receives data from an external device or receives power from the external device and transmits the received data to each component in the video conferencing terminal 100 or data in the video conferencing terminal 100 is transmitted to an external device .

According to one embodiment, the interface unit 160 may receive data related to a video conference from the external device (or external terminal). For example, when the external device is a USB memory module, the interface unit 160 may acquire presentation data (e.g., PowerPoint data) used for video conferencing from the USB memory module.

In this case, the control unit 170 may execute an application (e.g., a power point program) related to the presentation data, and may be configured to process user work, etc., with the presentation data. In addition, the controller 170 may control the display unit 142 to display the obtained presentation data or the processing result of the user task on the screen.

The interface unit 160 may be a path through which the power from the cradle is supplied to the video conferencing terminal 100 when the video conferencing terminal 100 is connected to an external cradle, A command signal may be transmitted to the video conferencing terminal 100.

Various command signals or power from the cradle may be operated as a signal for recognizing that the video conference terminal 100 is correctly mounted on the cradle.

The control unit 270 can generally control the overall operation of the video conferencing terminal 100.

For example, the control unit 170 may perform related control and processing for voice call, data communication, video call, and the like.

According to one embodiment disclosed herein, the interface unit 160 can be controlled to receive data (or related) used for video conferencing from an external device (or external terminal).

As described above, the data used for the video conference may be various multimedia data related to the video conference theme (e.g., a word document, a spreadsheet or a presentation running on PowerPoint, etc.).

According to one embodiment, unlike in a typical video conferencing system, data related to the video conferencing is not communicated to the video conferencing terminal 100 in the form of A / V data (audio / video signals) (Or a file having an executable executable in the application)

Therefore, there is an advantage that the transmission amount is reduced as compared with the transmission in the A / V data format.

In addition, the control unit 170 may display the data on the first screen and acquire the characteristic information on the user task on the first screen.

According to one embodiment, the first screen may be a screen of a display device provided in the video conferencing terminal 100 or connected to the video conferencing terminal 100.

Further, according to one embodiment, the characteristic information may be detected and obtained by the display device.

According to another embodiment, the user operation may be performed by an electronic pen that detects the characteristic information, and the control unit may obtain the characteristic information from the electronic pen.

Here, the characteristic information may include at least one of position information on the first screen corresponding to the user job, a type of the user job, and attributes of the user job.

The position information on the first screen may be pixel coordinate information on the first screen corresponding to the user task.

In addition, the types of the user tasks may include a line drawing operation, a drawing operation, a writing operation, a selection operation for a specific object displayed on the first screen, and a selection operation for a new object on the first screen And an additional operation.

In addition, the attribute of the user task may be at least one of a size, a color, a shape corresponding to the line, a figure or a letter, a display mode of the selected specific object, and a type of the added new object.

The electronic pen is capable of performing a user operation (e.g., a drawing operation) on a screen on which a specific object, image or image is displayed by using an electrical response (or reaction) device or an optical response It may mean an electronic device capable of detecting characteristic information on the screen on which a user operation is performed.

A concrete example of the case where the characteristic information is on the screen is as follows.

For example, when an electronic device is used, when the electronic pen is moved on the screen (for example, the first screen), a metal line arranged at the bottom of the screen reacts to an electromagnetic field emitted from the pen, And the device reads the position of the electronic pen and inputs it to the system. Therefore, it can be used for computer graphics work because it can input characters or draw pictures while watching the screen without a keyboard.

According to another embodiment, the electronic pen can directly detect a position on the screen of the electronic pen in response to an electromagnetic field emitted from the screen.

Also, for example, when an optical sensing device is used, the electronic pen may be an electronic device that is made to sense motion by light using optical technology using an optical sensor and DSP technology or a super-precision lens.

For example, light reflected from the electronic pen may be input to the sensor. In this case, when the electronic pen is moved, light is emitted from the light emitting part (for example, a small diode LED) emitting red light, and the light reflected from the bottom in contact with the electronic pen is again transmitted to the optical sensor of the electronic pen Can be input.

The optical sensor functions as a CCD screen of a video camera, recognizes a subtle difference in the floor, analyzes it in a digital signal processing (DSP) chip, calculates a moving distance, and sends coordinates to the video conference terminal 100 .

The cursor on the screen can be moved on the basis of coordinates received from the electronic pen of the videoconference terminal 100. This repeats hundreds of times per second, so the cursor on the screen can move very smoothly.

In addition, according to the one-sided printing, the controller 170 can generate the metadata corresponding to the user job based on the characteristic information.

The metadata may be data representing contents of the user task. To this end, the metadata may include information on the property information, for example, the type of the user operation or the attributes of the user operation.

For example, when the user operation is a line-drawing operation on the screen (for example, the first screen), the metadata includes pixel coordinates (1,1) to (10,20) " In this case, the metadata includes information that the user has performed a red line from pixel coordinates (1, 1) to (10, 20) on the screen.

Therefore, according to the technology disclosed in the present specification, it is possible to transmit information related to the video conference in the form of A / V to the external video conferencing terminal, And can transmit the effect of the operation corresponding to the user of the video conference terminal to the external video conference terminal.

That is, the external videoconference terminal receives the data related to the videoconference and the meta data, and displays the screen corresponding to the user's operation in the same manner as the display So that it can be displayed on the screen of the device.

Therefore, according to the technique disclosed in this specification, it is possible to have an effect of preventing an increase in transmission amount due to A / V type data transmission.

According to an exemplary embodiment, the controller 170 may be configured to receive, from the external videoconference terminal, external data used for the video conference and external metadata related to external user operations on a screen displaying the external data, And controls the communication unit 110 to display an effect corresponding to the external data and the external user operation on the first screen based on the external metadata.

The power supply unit 180 may receive external power and internal power under the control of the controller 170 to supply power required for operation of the respective components.

The work disclosed herein In the embodiment  Video conferencing system

A summary of the techniques disclosed herein is as follows.

By integrating Pentouch TV into VCS, users can view video and video conferences while sharing the data, sharing data through the data channel, and transferring the objects drawn thereon to metadata to reduce the amount of data transferred.

At this time, the TV can output the position information using a dedicated pen like the pentouch ready model.

In addition, the VCS incorporates a pentouch position information receiving unit to receive coordinates detected from the pen.

In addition, VCS can open and view files connected via USB using the application.

In addition, the data to be displayed on the user's screen (files stored in the USB) can be shared with other users via a data channel if necessary.

In addition, when the user modifies data displayed on the screen, metadata (eg Draw line from point 1 to point 2) rather than video information is transmitted so that the same output is generated on another user's screen.

In addition, when a method of synchronizing the screen between the users is required during the use of the product, the user can share the data file (presentation data) to be used for the conference at the start of the conference and share the entire screen as an image file Or sharing drawing data, or if the network is unstable during a meeting, the entire screen can be shared as an image file or shared with the demonstration data.

Also, a time stamp can be included in the drawing information to match the sync of the video input video with the input of the pen.

A video conference system according to an embodiment disclosed herein displays data used in a video conference on a first screen, detects characteristic information about a user task on the first screen, Receiving the data and the meta data through a first video conference terminal and a network for generating metadata corresponding to a user task, and displaying an effect corresponding to the meta data and the user operation based on the meta data on a second screen And a second videoconference terminal that displays the first videoconference terminal.

Here, the characteristic information may include at least one of position information on the first screen corresponding to the user job, a type of the user job, and an attribute of the user job, A drawing operation, a writing operation, a selection operation for a specific object displayed on the first screen, and an operation for adding a new object on the first screen, The attribute may be at least one of a size, a color, a shape corresponding to the line, a figure or a letter, a display mode of the selected specific object, and a type of the added new object.

3 is an exemplary diagram illustrating a video conferencing system in accordance with one embodiment disclosed herein.

Referring to FIG. 3, the video conference system (VCS 100) according to an exemplary embodiment of the present invention includes a video conference terminal 100, a display device 200, an external terminal 300, and an A / V Device 400 shown in FIG.

The roles and functions of the components of the video conferencing system (VCS100) are the same as or similar to those described above, and thus will not be described.

According to an embodiment disclosed herein, the video conferencing terminal 100 may receive data related to video conferencing from the external terminal 300. [

The video conference terminal 100 acquires information (e.g., a user photographed image, AV1) about the user (may be plural) of the video conferencing terminal 100 from the A / V device 400 can do.

The video conferencing terminal 100 may acquire information about an external user (e.g., an external user imaged video, AV3) from the external video conferencing terminal 500 connected through the communication network N110.

Also, the video conferencing terminal 100 may transmit the data file, the information about the user AV1 or the information about the external user AV3 to the display device 200. [

The display device 200 may display the data file, information on the user AV1, or information on the external user AV3 on the first screen.

The data file may be executed through an application related to the data, and the execution result may be displayed on the first screen.

The first screen may be a screen of a display device provided inside or connected to the video conference terminal.

When the user of the video conferencing terminal 100 performs a specific user operation on the first screen (for example, a drawing operation as shown in FIG. 3), the video conferencing terminal 100 displays the first screen It is possible to obtain the characteristic information on the user operation on the display device.

The user task may be performed in various manners. For example, it may be performed by touching a finger or the like on the first screen, or may be performed based on (or using) the electronic pen P100.

As described above, the characteristic information may include at least one of position information on the first screen corresponding to the user job, a type of the user job, and attributes of the user job.

Here, the position information on the first screen may be pixel coordinate information on the first screen corresponding to the user task.

In addition, the types of the user tasks may include a line drawing operation, a drawing operation, a writing operation, a selection operation for a specific object displayed on the first screen, and a selection operation for a new object on the first screen And may include at least one of additional operations.

In addition, the attribute of the user task may be at least one of a size, a color, a shape corresponding to the line, a figure or a letter, a display mode of the selected specific object, and a type of the added new object.

According to one embodiment, the characteristic information may be detected and obtained by the display device 200. [

According to another embodiment, the characteristic information may be to obtain the characteristic information from the electronic pen.

The external videoconference terminal (500) can receive the data and the metadata from the communication unit.

In addition, the external videoconference terminal 500 may display an effect corresponding to the data and the user operation on the second screen based on the meta data.

Here, the second screen may be a screen of the display device 600 provided in or connected to the external video conferencing terminal.

According to a specific embodiment of the present invention, when the user task is a line drawing, the video conference terminal 100 can acquire the pixel coordinates on the first screen with respect to the line drawing from the electronic pen P100.

To this end, the video conferencing terminal 100 may obtain the pixel coordinates through the communication unit 110 and the interface unit 160, or may acquire the pixel coordinates through a separate communication module (not shown) can do.

The video conference terminal 100 may generate metadata based on the pixel coordinates. For example, the metadata may be "pixel coordinates (1,1) to (10,20): polar coordinates: red ".

In this case, the video conference terminal 100 can acquire the information that the line drawing or the line is red through an application corresponding to data related to the video conference.

For example, when the data related to the video conference is presentation data (e.g., PowerPoint data) and the user performs a line drawing operation on the first screen on which the presentation data is displayed, the video conference terminal 100 The metadata for the line-drawing operation and the presentation data may be transmitted to the external videoconference terminal 500.

In this case, the external videoconference terminal 500 may have an effect on the user task on the second screen based on the metadata and the presentation data (for example, the result of the user operation performed on the first screen : Presentation materials and lines on the above presentation materials).

In addition, according to one embodiment, the videoconference terminal 100 may receive external data used for the videoconference from the external videoconference terminal 500 and external metadata related to external user operations on the screen in which the external data is displayed Lt; / RTI >

In this case, the videoconference terminal 100 can display the effect corresponding to the external data and the external user operation on the first screen based on the external metadata.

Hereinafter, a synchronization method according to an embodiment disclosed herein will be described.

According to one embodiment disclosed herein, the number of the external videoconference terminals may be plural.

In this case, the plurality of external videoconference terminals share the metadata corresponding to a specific time point or a specific time period to generate data related to the videoconference and a synchronization operation for displaying an effect on a user operation performed on the data Can be performed.

According to an embodiment, the metadata corresponding to the specific time point or the specific time period may be shared with each other when the communication state of the network is unstable.

In addition, according to one embodiment, the metadata may include first time stamp information for synchronization with the external videoconference terminal 500.

In this case, the video conferencing terminal 100 and the external video conferencing terminal 500 (including all of the plurality of video conferencing terminals 500) can perform a synchronization operation at a specific time or a specific time interval using the first time stamp information.

According to an embodiment of the present invention, an image captured by the video conference terminal 100 or the control unit 170 and a user of the video conference terminal 100 is displayed on the first screen, And a second timestamp information for synchronizing with the meta data.

The video conferencing terminal 100 or the external video conferencing terminal 50 may perform a synchronization operation with the photographed video and the meta data based on the second timestamp information.

The work disclosed herein In the embodiment  Video conferencing method

A video conference method according to an embodiment disclosed herein includes displaying data used in a video conference on a first screen, detecting characteristic information about a user task on the first screen, Generating metadata corresponding to the user task, and transmitting the data and the metadata to an external videoconference terminal through a network.

According to an exemplary embodiment, the external videoconference terminal may display an effect corresponding to the data and the user operation on the second screen based on the metadata.

According to an embodiment, the characteristic information may include at least one of position information on the first screen corresponding to the user job, a type of the user job, and attributes of the user job, Includes at least one of a line drawing operation on the first screen, a drawing operation, a writing operation, a selection operation on a specific object displayed on the first screen, and a new object addition operation on the first screen And the attributes of the user task may be at least one of a size, a color, a shape corresponding to the line, a figure or a letter, a display mode of the selected specific object, and a type of the added new object.

4 is a flowchart illustrating a video conferencing method in accordance with one embodiment disclosed herein.

Referring to FIG. 4, a video conferencing method according to an embodiment disclosed herein may include the following steps.

First, the data used in the video conference can be displayed on the first screen (S110).

Next, characteristic information on the user task on the first screen can be detected (S120).

Next, metadata corresponding to the user task may be generated based on the characteristic information (S130).

Next, the data and the metadata may be transmitted to an external video conferencing terminal through a network (S140).

As described above, a general VCS is a method of transmitting two A / V channels together by connecting a TV and a PC to each VCS terminal at the time of a video conference, so that data that users want to share is transmitted through a video channel, This can be a problem because each user has to find the necessary parts when meeting with the same data (file).

However, as described above, according to the video conferencing system or the video conferencing method disclosed in the present specification, since the data necessary for video conferencing is shared among the video conferencing terminals based on the metadata, a small network bandwidth is used, And can immediately share the corrections with the same data.

The scope of the present invention is not limited to the embodiments disclosed herein, and the present invention can be modified, changed, or improved in various forms within the scope of the present invention and the claims.

100: video conference terminal 200: display device
300: external terminal 400: A / V device
500: External video conference terminal

Claims (20)

An interface unit connected to an external device;
A communication unit connected to an external video conferencing terminal through a network; And
Controls the interface unit to receive data used for video conferencing from the external device,
Displaying the data on a first screen,
Acquiring characteristic information on a user task on the first screen,
Generating metadata corresponding to the user task based on the characteristic information,
And controlling the communication unit to transmit the generated metadata to the external video conferencing terminal. The method according to claim 1,
Wherein the video conference terminal is a screen of a display device provided inside or connected to the video conference terminal. 3. The method according to claim 2,
And is detected and obtained by the display device. 2. The method of claim 1,
And an electronic pen for detecting the characteristic information,
Wherein,
And obtains the characteristic information from the electronic pen. The information processing apparatus according to claim 1,
Wherein the information includes at least one of position information on the first screen corresponding to the user job, a type of the user job, and attributes of the user job. 6. The method according to claim 5,
Is pixel coordinate information on a first screen corresponding to the user operation. 6. The method according to claim 5,
A drawing operation on a first screen, a drawing operation, a writing operation, a selection operation on a specific object displayed on the first screen, and a new object addition operation on the first screen In video conferencing terminal. 8. The method of claim 7,
Wherein the display mode is at least one of a size, a color, a shape, a display mode of the selected specific object, and a type of the added new object corresponding to the line, picture or text. The terminal according to claim 1,
Receiving the data and the metadata from the communication unit,
And displays an effect corresponding to the data and the user operation on a second screen based on the metadata. The method according to claim 9,
Wherein the video conference terminal is a screen of a display device provided inside or connected to the external video conference terminal. The apparatus of claim 1,
Controlling the communication unit to receive external data used for the video conference from the external video conference terminal and external metadata related to an external user operation on a screen displaying the external data,
And displays an effect corresponding to the external data and the external user operation on the first screen based on the external metadata. The terminal according to claim 1,
Plural,
Wherein the plurality of external video conferencing terminals comprises:
And sharing metadata corresponding to a specific time point or a specific time interval with each other. 13. The method of claim 12,
The metadata corresponding to the specific time point or the specific time period may be,
And is shared when the communication state of the network is unstable. The method of claim 1,
And a first time stamp information for synchronization with the external videoconference terminal. The apparatus of claim 1,
Displaying a video image of a user of the video conference terminal on the first screen,
The metadata
And a second time stamp information for synchronizing with the photographed image and the meta data. The data used in the video conference is displayed on the first screen,
Detecting characteristic information on a user task on the first screen,
A first video conference terminal for generating metadata corresponding to the user task based on the characteristic information; And
Receiving the data and the metadata via a network,
And a second video conference terminal for displaying an effect corresponding to the metadata and the user operation on a second screen based on the metadata. The information processing apparatus according to claim 16,
A type of the user task, and attributes of the user task, the position information on the first screen corresponding to the user task, the type of the user task,
The type of the user task is,
A drawing operation on a first screen, a drawing operation, a writing operation, a selection operation on a specific object displayed on the first screen, and a new object addition operation on the first screen,
Wherein the attributes of the user task include:
Wherein the display mode is at least one of a size, a color, a shape, a display mode of the selected specific object, and a type of the added new object corresponding to the line, picture, or text. Displaying data used in a video conference on a first screen;
Detecting characteristic information on a user task on the first screen;
Generating metadata corresponding to the user task based on the characteristic information; And
And transmitting the data and the metadata to an external videoconference terminal through a network. 19. The video conferencing terminal of claim 18,
And displaying an effect corresponding to the data and the user operation on a second screen based on the metadata. 19. The method according to claim 18,
A type of the user task, and attributes of the user task, the position information on the first screen corresponding to the user task, the type of the user task,
The type of the user task is,
A drawing operation on a first screen, a drawing operation, a writing operation, a selection operation on a specific object displayed on the first screen, and a new object addition operation on the first screen,
Wherein the attributes of the user task include:
Wherein the display mode is at least one of a size, a color, a shape, a display mode of the selected specific object, and a type of the added new object corresponding to the line, picture or text.

Images