KR101692909B1 - Method and system for providing video conference using screen mirroring - Google Patents

Abstract

The present invention provides a video conference providing method and apparatus using screen mirroring. A method of providing a video conference in a mobile device in cooperation with a sink terminal through a wireless network according to an embodiment of the present invention includes the steps of setting a wireless transmission channel with the sink terminal when NFC tagging with the sink terminal is detected, A step of loading and reproducing presentation data to be used for a video conference according to a user selection, a step of driving a camera and a microphone provided in the mobile device, an image frame corresponding to the camera photographing, and a voice corresponding to a voice input through the microphone And multiplexing the audio frame and the reproduced frame to form a video conference frame, and transmitting the configured video conference frame to the sink terminal through the wireless transmission channel. Accordingly, the present invention is advantageous in that it can provide a video conferencing service through smart phone mirroring more effectively.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and system for providing video conference using screen mirroring,

The present invention relates to a video conference providing method, and more particularly, to a video conference using screen mirroring capable of displaying a mirroring screen on a remote terminal through a wireless network, ≪ / RTI >

As the smartphone's data processing capabilities and storage capacity are improved and the number of applications supported increases, many people store most of their personal data directly on their smartphones or on cloud servers.

In addition, many office workers have recently been able to view and change necessary data anytime and anywhere by storing report data and other important data necessary for business in a storage medium, a mail box or a cloud storage medium provided inside the smart phone.

In addition, as various social networking service (SNS) applications and messenger applications are installed on smartphones, work styles through existing mail are changing to faster real time interactive work styles that enable quicker information exchange and faster decision making.

 As a result, there may be cases where urgent decision-making and reporting / presentation are required in addition to pre-planned meetings or reports in actual business situations.

In such a case, it is inconvenient for the conference attendee to call an emergency meeting and prepare a notebook and a beam project for the conference proceeding. In addition, if there are multiple people presenting at the meeting, they can collect the materials and output the meeting materials through the beam project through a single notebook, or the conference presenter can individually prepare the notebooks and connect to the beam project each time the presenter changes It has a disadvantage that it takes a lot of time.

SKT recently launched a smart mirroring service using mirror cast dongles.

Smart Mirroring service using mirror casting dongle can connect the smart mirroring dongle to the HDMI terminal of TV, monitor, beam projector, etc., and the screen of smart phone or tablet PC is transmitted to smart mirroring dongle through WiFi communication, , A beam projector, and so on. In other words, Smart Mirroring is a kind of projector that simply moves the screen of a smartphone to a TV screen.

In addition, SKT recently introduced a smart beam service that connects a smart phone with a small beam project through a predetermined data transmission cable and outputs a screen reproduced from a smart phone through a beam project.

However, the above-described related arts have a disadvantage in that they are not suitable for video conferencing because they merely provide a function of displaying a display screen or a playback screen on a smart phone through a large output screen such as a TV.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a video conference providing method and system using screen mirroring.

It is another object of the present invention to provide a video conference providing method and system using screen mirroring capable of providing remote video conference via a mobile communication network.

It is still another object of the present invention to provide a video conferencing system capable of real-time multiplexing of a voice of a user of a mobile device and a user image photographed by a camera with a playback screen on a mobile device in a video conference mode and transmitting the multiplexed video image to a remote sink terminal And to provide a system and method for providing the same.

It is another object of the present invention to provide a video conference providing method and system using screen mirroring capable of switching a presenter through transferring a mirroring token between presenters when a plurality of presenters are present through a mobile device in a video conference mode.

It is another object of the present invention to provide a video conference providing method and system using screen mirroring capable of forming a video conference group through NFC tagging of a mobile device of a conference attendee in a video conference mode.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

The present invention provides a video conference providing method and apparatus using screen mirroring.

A method of providing a video conference in a mobile device in cooperation with a sink terminal through a wireless network according to an embodiment of the present invention includes the steps of setting a wireless transmission channel with the sink terminal when NFC tagging with the sink terminal is detected, A step of loading and reproducing presentation data to be used for a video conference according to a user selection, a step of driving a camera and a microphone provided in the mobile device, an image frame corresponding to the camera photographing, and a voice corresponding to a voice input through the microphone And multiplexing the audio frame and the reproduced frame to form a video conference frame, and transmitting the configured video conference frame to the sink terminal through the wireless transmission channel.

Further, the method may further include activating a video conference mode according to a predetermined menu selection, wherein when the NFC tagging is detected while the video conference mode is activated, the wireless transmission channel with the sink terminal can be set.

Here, the wireless transmission channel may be a Wi-Fi communication channel.

In addition, the presentation data may be selected by connecting to a cloud server connected to a mobile communication network.

A method of providing a video conference in a mobile device interlocked with a sink terminal through a mobile communication network according to another embodiment of the present invention includes the steps of selecting a connected sink terminal and setting a wireless communication channel with the selected connected sink terminal The method comprising the steps of: loading and reproducing presentation data to be used for a video conference according to a user's selection; driving a camera and a microphone provided in the mobile device; A corresponding video frame and a reproduced frame to form a video conference frame, and transmitting the composed video conference frame to the sink terminal through the wireless communication channel.

The method may further include activating a video conference mode according to a predetermined menu selection before receiving the connection target sink terminal.

The method may further include generating a video conference group with another mobile device connected to the mobile communication network, wherein the video conference frame is configured to be transmitted to another mobile device included in the video conference group.

The method may further include receiving a video conference presenter token request message from any of the other mobile devices,

If the video conference presenter token request is accepted, the video conference frame may be configured by the mobile device that requested the video conference presenter token and sent to the sink terminal.

The mobile communication network may include at least one of a Wideband Code Division Multiple Access (WCDMA) network, a High Speed Packet Access (HSPA) network, and an LTE (Long Term Evolution) / LTE-Advanced network.

In another aspect of the present invention, there is provided a method for providing a video conference in a sink terminal interworking with a mobile device through a wireless network, the method comprising: setting a wireless transmission channel with the mobile device when NFC tagging with the mobile device is detected; Receiving a video conference frame multiplexed through the wireless transmission channel, demultiplexing the received video conference frame to extract an image frame and a voice frame, and extracting the extracted video frame and voice frame to an image display device And transmitting the data.

Here, the video display device may be any one of a beam projector, a smart TV, a notebook, and a desktop.

In addition, the video conference frame may be configured by multiplexing at least one of an image photographed by a camera of the mobile device, a voice input through a microphone of the mobile device, and a presentation image displayed on a screen of the mobile device.

Also, the image display apparatus can be connected to the image display apparatus through wireless Internet communication.

Also, the video display device can be connected to the video display device through a cable.

According to another embodiment of the present invention, there is provided a computer-readable recording medium having recorded thereon a program for executing any one of the video conference providing methods.

The mobile device that provides the video conference in cooperation with the sink terminal through the wireless network according to another embodiment of the present invention may include means for setting a wireless transmission channel with the sink terminal when NFC tagging with the sink terminal is detected Means for driving a camera and a microphone provided in the mobile device, means for driving an image frame corresponding to the camera photographing, means for inputting the image data input through the microphone, Means for multiplexing a voice frame corresponding to a voice and a reproduced frame to form a video conference frame, and means for transmitting the composed video conference frame to the sink terminal through the wireless transmission channel.

A mobile device that provides a video conference in cooperation with a sink terminal through a mobile communication network according to another embodiment of the present invention includes means for receiving a destination sink terminal and means for setting a wireless communication channel with the selected destination sink terminal Means for driving a camera and a microphone provided in the mobile device, means for driving an image frame corresponding to the camera photographing, means for inputting the image data input through the microphone, Means for multiplexing a voice frame corresponding to a voice and a reproduced frame to form a video conference frame, and means for transmitting the composed video conference frame to the sink terminal through the wireless communication channel.

A sink terminal for providing a video conference in cooperation with a mobile device through a wireless network according to another embodiment of the present invention includes means for setting a wireless transmission channel with the mobile device when NFC tagging with the mobile device is detected, Means for receiving a video conference frame multiplexed through the wireless transmission channel; means for extracting an image frame and a voice frame by demultiplexing the received video conference frame; and means for transmitting the extracted video frame and voice frame to a video display device And the like.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. And can be understood and understood.

Effects of the method according to the present invention and the apparatus and system supporting the method will be described as follows.

First, the present invention has an advantage of providing a video conference providing method and system using screen mirroring.

Second, the present invention has an advantage of providing a method and system for providing video conference using screen mirroring capable of providing a remote conference video conference over a mobile communication network.

Third, the present invention provides a video conference providing method using screen mirroring capable of multiplexing the voice of the user of the mobile device and the user image captured by the camera in real time with the playback screen on the mobile device and transmitting the voice to the remote sink terminal And a system.

Fourth, the present invention has an advantage of providing a method and system for providing video conference using screen mirroring capable of switching a presenter through transferring a mirroring token between presenters when a plurality of presenters are present in a video conference mode through a mobile device.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. It is to be understood, however, that the technical features of the present invention are not limited to the specific drawings, and the features disclosed in the drawings may be combined with each other to constitute a new embodiment.
1 is a block diagram illustrating an internal configuration of a mobile device providing a video conference function according to an embodiment of the present invention.
2 is a configuration diagram of a video conference providing system using screen mirroring according to an embodiment of the present invention.
3 is an example of a video conference providing service using screen mirroring according to an embodiment of the present invention.
4 is an example of a video conference providing service using screen mirroring according to another embodiment of the present invention.
5 is an example of a video conference providing service using screen mirroring according to another embodiment of the present invention.
6 is a flowchart illustrating a method for providing a video conference using screen mirroring in a mobile device according to an exemplary embodiment of the present invention.
7 is a flowchart illustrating a method of providing a video conference using screen mirroring in a mobile device according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an apparatus and various methods to which embodiments of the present invention are applied will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. That is, within the scope of the present invention, all of the components may be selectively coupled to one or more of them. In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. The codes and code segments constituting the computer program may be easily deduced by those skilled in the art. Such a computer program can be stored in a computer-readable storage medium, readable and executed by a computer, thereby realizing an embodiment of the present invention. As the storage medium of the computer program, a magnetic recording medium, an optical recording medium, or the like can be included.

It is also to be understood that the terms such as " comprises, "" comprising," or "having ", as used herein, mean that a component can be implanted unless specifically stated to the contrary. But should be construed as including other elements. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

In describing the components of the present invention, terms such as first, second, A, B, (a), and (b) may be used. These terms are intended to distinguish the constituent elements from other constituent elements, and the terms do not limit the nature, order or order of the constituent elements. When a component is described as being "connected", "coupled", or "connected" to another component, the component may be directly connected to or connected to the other component, It should be understood that an element may be "connected," "coupled," or "connected."

A mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a personal digital assistant Navigation and the like can be used. It should be noted, however, that the configuration according to the embodiments described herein can be applied to fixed terminals such as digital TVs, desktop computers, and the like, except when applicable only to mobile terminals.

In addition, the video display device interlocked with the sink terminal described in this specification may include a beam project, a smart TV, a notebook, a desktop, and the like.

Hereinafter, a cloud environment applied to the present invention will be briefly described.

Cloud computing environment refers to a computer environment in which information is temporarily stored in a client such as a desktop, tablet computer, notebook computer, netbook, smart phone, etc., by storing or processing data through a server on the Internet . That is, all the information of the user is stored in a server on the Internet, and the information can be used anytime and anywhere through various IT devices.

When cloud computing is introduced, businesses or individuals can reduce the cost of maintaining and maintaining computer systems, purchasing and installing servers, updating and purchasing software, and saving energy. .

Cloud browsing is a method for processing a web page and transmitting it to an end user, which means handling things that are difficult for user devices to utilize external computing resources.

1 is a block diagram illustrating an internal configuration of a mobile device providing a video conference function according to an embodiment of the present invention.

1, the mobile device 100 includes a wireless communication unit 110, an output unit 130, an A / V input unit 140, a memory unit 150, an input key module 160, An external interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, and a mobile device having more or fewer components may be implemented.

Hereinafter, the components will be described in detail.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile device 100 and the mobile communication system or between the mobile device 100 and the wireless network in which the mobile device 100 is located. For example, the wireless communication unit 110 includes a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS (Global Positioning System) . ≪ / RTI >

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated in advance and transmitting the broadcast signals and / or broadcast- related information to the mobile device 100. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, or a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The mobile communication module 113 performs a function of transmitting / receiving a radio signal with a base station, a repeater, a repeater, a femtocell, and the like through a wireless interface of a mobile communication network. Here, the wireless signal may include various types of data signals in response to voice and video call signals or text / multimedia message transmission / reception.

The mobile communication network applicable to the video conference providing system using the screen mirroring according to the present invention is a 3.5-generation communication network such as a 3-generation communication network such as a WCDMA network, a High Speed Packet Access (HSPA) Term Evolution) / LTE-Advanced network as well as next-generation mobile communication networks that evolve later.

The wireless Internet module 115 refers to a transmission / reception module for wireless Internet access, and the wireless Internet module 115 may be embedded in the mobile device 100 or may be externally connected through a predetermined interface terminal. WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (World Interoperability for Microwave Access) and the like can be used as wireless Internet technologies.

The short-range communication module 117 refers to a module for short-range communication. Near Field Communication (NFC), Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), UltraWideband (UWB), ZigBee, and the like can be used as a short distance communication technology.

The GPS receiving module 119 is a module for confirming or acquiring positional information of the mobile device 100 using a signal received through a positioning satellite.

The output unit 130 may include a display module 131, an audio output module 133, an alarm unit 135, a haptic module 137, and the like, for generating output related to visual, auditory,

The display module 131 displays and outputs information processed by the mobile device 100. For example, when the mobile device 100 is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with the call is displayed. When the mobile device 100 is in the video communication mode or the photographing mode, the photographed and / or received image, UI, or GUI is displayed. In particular, the display module 131 may display a UI or a GUI related to a video conference in accordance with a control signal of the controller 180.

The display module 131 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display).

The audio output module 133 may output audio data received from the wireless communication unit 110 or stored in the memory unit 150 in a call signal reception mode, a communication mode or a recording mode, a voice recognition mode, a broadcast reception mode, have. The sound output module 133 may output an acoustic signal related to a function performed in the mobile device 100 (e.g., a call signal reception tone, a message reception tone, etc.). The sound output module 133 may include a receiver, a speaker, a buzzer, and the like. In addition, the sound output module 133 can output sound through the earphone jack provided at one side of the mobile device 100. [

The alarm module 135 outputs a signal for notifying the occurrence of an event of the mobile device 100. Examples of events that occur in the mobile device 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm module 135 may output a signal for informing occurrence of an event in a form other than a video signal or an audio signal, for example, a vibration. The video signal or the audio signal can also be output through the display module 131 or the sound output module 133.

The haptic module 137 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 137 is vibration. The intensity and pattern of the vibration generated by the hit module 137 can be set through a predetermined user interface. For example, the haptic module 137 may combine and output different vibrations or sequentially output the vibrations.

Referring to FIG. 1, an A / V (Audio / Video) input unit 140 is for inputting an audio signal or a video signal, and may include a camera 141 and a microphone 143.

The camera 141 processes image frames such as still images or moving images obtained by the image sensor in a video conference mode, a video communication mode, or a shooting mode. The processed image frame can be displayed on the screen through the display module 131. [

The image frame processed by the camera 141 may be stored in the memory unit 150 or may be transmitted to the outside through the wireless communication unit 110. [

The microphone 143 receives an external sound signal by a microphone in a video conference mode, a communication mode, a recording mode, a voice recognition mode, or the like, and converts it into electrical voice data. The converted voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode.

The memory unit 150 may store a program for the operation of the controller 180 and may store input / output data (for example, various presentation materials used for video conferencing, address book, Certificate information, security card information, application programs, etc.). Here, the application program may include applications related to video conferencing, maps, games, chat, web surfing scheduling, finance, dictionaries, and the like.

The memory unit 150 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk.

The input key module 160 generates input data for controlling the operation of the mobile device 100 by a user. The input key module 160 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The external interface unit 170 provides an interface with all external devices connected to the mobile device 100. The external interface unit 170 receives data from an external device or receives power from the external device, transfers the data to each component in the mobile device 100, or transmits data in the mobile device 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video I / O (Input / Output) port, an earphone port, etc. are included in the mobile device 100

.

Here, the identification module is a chip that stores various information for authenticating the usage right of the mobile device 100, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format.

Accordingly, the identification device can be connected to the mobile device 100 through a predetermined port.

The control unit 180 typically controls the overall operation of the mobile device 100.

For example, the control unit 180 can control the installation and operation of various application programs and widgets, as well as a call function including a voice call, a data communication, a video call, and the like.

In addition, the control unit 180 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

In addition, the control unit 180 may control the input and the output according to various control signals received from the lower module, and configure and provide a user interface screen accordingly. Here, the lower module includes the wireless communication unit 110, the sensing unit 120, the output unit 130, the A / V input unit 140, the memory unit 150, the input key module 160, 170 and a power supply 190.

Particularly, the control unit 180 according to the present invention can drive the camera 141 and the microphone 143 in the video conference mode, and can display the mirroring screen displayed by the display module 131, the video shot by the camera 141 Frame, and microphone 143, and supplies the multiplexed user voice to the wireless communication unit 110.

In the conventional smart mirroring system, only the image displayed on the screen and the sound output through the sound output module 133 are mirrored.

However, the mobile device 100 according to the present invention is not limited to the conventional mirrored information such as a display screen and output (or playback) voice, as well as the appearance of a conference presenter photographed by the camera 141, The voice of the conference presenter input through the Internet can be multiplexed in real time and transmitted to the sink terminal.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory unit 150 and executed by the control unit 180. [

2 is a configuration diagram of a video conference providing system using screen mirroring according to an embodiment of the present invention.

2, the video conference providing system includes first to Nth mobile devices 100, a sink terminal, a beam projector 220, a large screen 230, a cloud server 240, (250), a mobile communication network (260), and an Internet network (270). The components shown in Fig. 2 are not essential, so that a videoconference provisioning system having components with more components or fewer components may be implemented.

For example, the sink terminal 210 may be interworked with a TV through a wireless Internet communication. In another example, the sink terminal 210 may be interworked with a notebook computer, a desktop, or the like through a wireless Internet communication or a predetermined communication cable (including an HDMI cable, for example).

The first to Nth mobile devices 100 may be interworked with the cloud server 240, the video conferencing server 250, the sink terminal 210, and the like through the mobile communication network 260.

The first to Nth mobile devices 100 may be interworked with the cloud server 240 and the sink terminal 210 through the mobile communication network 260 and the Internet network 270. [

At this time, the sink terminal 210 may be connected to the Internet network 270 through a wireless Internet AP-not shown or a dedicated Internet cable.

The first to Nth mobile devices 100 may generate a video conference group through a predetermined control procedure with the video conferencing server 250. The first to Nth mobile devices 100 included in the video conference group can acquire a video conference presenter token through interlocking with the video conference server 250. The mobile device that has acquired the video conference presenter token can acquire the video conference presenter token, To obtain the authority of.

After acquiring the video conference presenter token, the mobile device can transmit the video conference screen configured on the sink terminal 210 and / or the remaining mobile devices included in the video conference group after configuring the video conference screen.

In one example, the second mobile device may send a video conference presenter token request message to the video conferencing server 250 with the first mobile device having a video conference presenter token. The video conferencing server 250 may send a video conference changer change request message informing the first mobile device that the second mobile device has requested the video conference presenter rights. Subsequently, when the video conference presenter change request is accepted by the first mobile device, the video conferencing server 250 allocates the video conference presenter token to the second mobile device through a predetermined control procedure. Thereafter, the second mobile device acquires the videoconference presenter authority to configure a video conference screen and transmit it to the sink terminal 210 and other mobile devices included in the video conference group.

In addition, the first to Nth mobile devices 100 may access the cloud server 240 to acquire video conference data (e.g., presentation data, etc.) .

Also, the first to Nth mobile devices 100 according to the present invention can establish a wireless transmission channel through NFC tagging of the sink terminal 210, and transmit a video conference screen to the sink terminal 210 through the set wireless transmission channel. As shown in FIG. Accordingly, the first to Nth mobile devices 100 can transmit a video conference screen to the sink terminal 210 wirelessly without a separate cable connection.

3 is an example of a video conference providing service using screen mirroring according to an embodiment of the present invention.

Referring to FIG. 3, a user can activate a video conference mode by selecting a predetermined menu on the mobile device 100. The mobile device 100 can request a wireless communication channel with the sink terminal 210 designated in the mobile communication network 260 when the sink terminal 210 to which the video conference through the screen mirroring is to be performed is designated by the user. When the wireless communication channel with the sink terminal 210 is established, the mobile device 100 can select the presentation data to be used for the video conference from the user and display the selected presentation data on the screen. Here, the presentation data may be selected by selecting data stored in the internal memory of the mobile device 100 or by selecting data stored in the cloud server 240.

Subsequently, the mobile device 100 can drive the camera 141 and the microphone 143 provided therein.

The mobile device 100 can form a video conference frame by multiplexing the video information displayed on the screen, the video frame processed by the camera 141, and the voice frame input through the microphone 143. [

The mobile device 100 may transmit the configured video conference frame to the sink terminal 210 through a preset wireless communication channel.

The sink terminal 210 can demultiplex the received video conference frames to extract a voice frame and a still picture frame. At this time, the extracted image frame and voice frame are transmitted to the connected beam projector 220, and the beam projector 200 outputs the image frame to the large screen 230, reproduces the voice frame, and outputs the voice frame through the speaker .

Therefore, the screen displayed on the mobile device 100 and the screen displayed on the large screen 230 according to the present invention may be different from each other.

In another example, when the mobile device 100 synthesizes an image captured by a camera with presentation data and outputs the synthesized image to a screen, the screen displayed on the mobile device 100 may be the same as the screen displayed on the large screen 230 have.

4 is an example of a video conference providing service using screen mirroring according to another embodiment of the present invention.

4 illustrates a procedure for performing a video conference by performing a screen mirroring by NFC-tagging a specific conference attendee to the sink terminal 210 of the mobile terminal 100 in a meeting room.

4, a video conference presenter can set a video conference channel for screen mirroring by simply NFC tagging his or her mobile device 100 to the sink terminal 210. [

Then, the video information displayed on the screen of the mobile device 100 and the audio information output through the speaker of the mobile device 100 (hereinafter simply referred to as the mirroring information) are transmitted to the sink terminal 210 through the set video conference channel .

The sink terminal 210 transmits the mirroring information to the beam projector 220 via the HDMI cable. The beam projector 200 projects the image information of the mirroring information on the large screen 230, reproduces the audio information, It can be output through a speaker.

The sink terminal 210 according to another embodiment of the present invention may communicate with the smart TV through a local communication connection, for example, a Bluetooth connection, or a wireless Internet connection, for example, a Wi-Fi connection. In this case, the sink terminal 210 may transmit the ring information to the smart TV in advance, and the smart TV may display the video information of the received mirroring information on the TV screen, reproduce the voice information, have.

Another embodiment of the present invention is a method for video surveillance in which when a video conference presenter simply NFC tags his or her mobile device 100 to the sink terminal 210, The camera 141 and the microphone 143 provided in the mobile device 100 may be driven at the same time the conference channel is automatically set. Subsequently, the mobile device 100 may construct a video conference frame and transmit it to the sink terminal 210 as in the description of FIG.

5 is an example of a video conference providing service using screen mirroring according to another embodiment of the present invention.

5, when the video conferencing mode is activated, the mobile device 500 transmits playback information (i.e., mirroring information) on the mobile device 500 to the first sink terminal 510, 510 may transmit the mirroring information to the smart TV 520. Subsequently, the smart TV 520 reproduces the received mirroring information. At this time, the mobile device 500 may be mounted on the cradle 501 for capturing a video conference presenter.

Then, the video conference presenter visually watches the screen displayed on the smart TV 520, and the mobile device 500 captures a real-time presentation image through the camera 141 and generates an image frame . In addition, the mobile device 500 may also operate the microphone 143 to generate a voice frame by processing voice of a video conference presenter in real time.

The mobile device 500 can multiplex the generated video frame and voice frame to form a video conference frame and transmit the composed video conference frame to the second sync terminal 540 through the mobile communication network 530. [ The second sync terminal 540 demultiplexes the received video conference frames, separates the video frames and the audio frames, and transmits the separated video frames and audio frames to the HDMI projector 550 through the HDMI communication cable.

The beam projector 550 reproduces the received image frame and projects it to the large screen 560, and the received voice frame is reproduced and output through the provided speaker.

6 is a flowchart illustrating a method for providing a video conference using screen mirroring in a mobile device according to an exemplary embodiment of the present invention.

Referring to FIG. 6, the mobile device 100 may be switched to a video conference mode according to a user's selection of a predetermined menu (S601).

When NFC tagging with the sink terminal 210 is detected in the video conference mode, the mobile device 100 can set a radio transmission channel for transmitting the ring information to the sink terminal 210 in advance (S603).

Thereafter, a presentation file to be used for a video conference (hereinafter referred to as a presentation target file) is selected through a predetermined menu selection of the user of the mobile device 100, and the selected presentation target file can be loaded and executed (S605 ). At this time, the executed presentation file is reproduced through the screen of the mobile device 100 and the speaker. As an example, some presentation files may include video and / or audio clips as well as text images, so that audio may be output through the speakers during the presentation.

In addition, when the wireless transmission channel is set, the mobile device 100 can drive the camera 141 and the microphone 143 (S607).

The mobile device 100 multiplexes a video frame through the camera 141, a voice frame corresponding to the voice input through the microphone 143, and a reproduction frame corresponding to the reproduced presentation file to form a video conference frame , And transmit the composed video conference frame to the sink terminal 210 through the wireless transmission channel (S609).

7 is a flowchart illustrating a method of providing a video conference using screen mirroring in a mobile device according to another embodiment of the present invention.

Referring to FIG. 7, the mobile device 100 may be switched to a video conference mode according to a user's selection of a predetermined menu (S701).

After that, the user of the mobile device 100 can select a sink terminal 210 (hereinafter, simply referred to as a connected sink terminal) to be connected for a video conference through a predetermined menu selection (S703).

The mobile device 100 establishes a wireless communication channel with the selected connected destination sink terminal 210, loads the presentation target file through selection of a predetermined menu of the user, and executes the loaded file (S707).

In addition, when the wireless communication channel is set, the mobile device 100 can drive the camera 141 and the microphone 143 (S709).

The mobile device 100 multiplexes a video frame through the camera 141, a voice frame corresponding to the voice input through the microphone 143, and a reproduction frame corresponding to the reproduced presentation file to form a video conference frame , And transmits the composed video conference frame to the sink terminal 210 through the wireless transmission channel (S711).

The mobile device 100 according to an exemplary embodiment of the present invention may set a wireless communication channel with another mobile device set as a video conference group and transmit a video conference frame through a set wireless communication channel, May be performed.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Mobile devices: 100 Outputs: 130
A / V input unit: 140 Sync terminal: 210
Beam projector: 220 Cloud server: 230
Video conference server: 240 Mobile communication network: 260
Internet: 270 Smart TV: 520
Output: 130 Access detection module: 145
Speech recognition module: 160 Face recognition module: 170

Claims (18)

A method for providing video conferencing in a mobile device in cooperation with a sink terminal via a wireless network,
Activating a video conference mode according to a predetermined menu selection;
Setting a wireless transmission channel with the sink terminal when NFC tagging with the sink terminal is detected in a state that the video conference mode is activated;
Loading and reproducing presentation data to be used for a video conference according to user selection;
Driving a camera and a microphone provided in the mobile device;
Constructing a video conference frame by real-time multiplexing a video frame photographed by the camera, a voice frame corresponding to a voice input through the microphone, and a reproduction frame of the presentation data;
Transmitting the configured video conference frame to the sink terminal via the wireless transmission channel; And
Receiving a video conference presenter token request message from another mobile device associated with the sink terminal during the video conference frame transmission
Wherein, when the video conference presenter token request is accepted, the video conference frame is formed by the other mobile device that has requested the video conference presenter token and is transmitted to the sink terminal. delete The method according to claim 1,
Wherein the wireless transport channel is a Wi-Fi communication channel. The method according to claim 1,
Wherein the presentation data is selected by being connected to a cloud server connected to a mobile communication network. A method for providing a video conference in a mobile device that is interlocked with a sink terminal through a mobile communication network,
Selecting a connection target sink terminal;
Setting a wireless communication channel with the selected connected sink terminal
Loading and reproducing presentation data to be used for a video conference according to user selection;
Driving a camera and a microphone provided in the mobile device;
Constructing a video conference frame by real-time multiplexing a video frame photographed by the camera, a voice frame corresponding to a voice input through the microphone, and a reproduction frame of the presentation data;
Transmitting the configured video conference frame to the sink terminal via the wireless communication channel; And
Receiving a video conference presenter token request message from another mobile device associated with the sink terminal during the video conference frame transmission
Wherein, when the video conference presenter token request is accepted, the video conference frame is formed by the other mobile device that has requested the video conference presenter token and is transmitted to the sink terminal. delete 6. The method of claim 5,
Further comprising generating a video conference group with another mobile device connected to the mobile communication network, wherein the video conference frame is configured to be transmitted to another mobile device included in the video conference group. delete 6. The method of claim 5,
Wherein the mobile communication network includes at least one of a Wideband Code Division Multiple Access (WCDMA) network, a High Speed Packet Access (HSPA) network, and an LTE (Long Term Evolution) / LTE-Advanced network. A method for providing a video conference in a sync terminal interlocked with a mobile device via a wireless network,
Setting a wireless transmission channel with the mobile device when NFC tagging with the mobile device in which the video conference mode is activated is detected;
Receiving a multiplexed video conference frame over the wireless transmission channel;
Demultiplexing the received video conference frames to extract video frames and audio frames; And
Transmitting the extracted image frame and voice frame to an image display device
Wherein the video conference frame includes at least one of an image frame photographed through a camera provided in the mobile device, a voice frame corresponding to a voice input through the microphone of the mobile device, and presentation data displayed on the screen of the mobile device Wherein at least one of the corresponding playback frames is multiplexed, a video conference group is formed through the NFC tagging, and a video conference presenter token request and acceptance procedure between a mobile device included in the video conference group, Is switched. 11. The method of claim 10,
Wherein the video display device is any one of a beam projector, a smart TV, a notebook, and a desktop. delete 11. The method of claim 10,
Wherein the video display device is connected to the video display device via wireless Internet communication. 11. The method of claim 10,
Wherein the video display device is connected to the video display device via a cable. A computer readable recording medium storing a program for executing the method according to any one of claims 1, 3, 4, 5, 7, 9, 11, 13, Lt; / RTI > 1. A mobile device for providing a video conference in cooperation with a sink terminal through a wireless network,
Means for activating a video conference mode in accordance with a predetermined menu selection;
Means for setting a wireless transmission channel with the sink terminal when NFC tagging with the sink terminal is detected in a state that the video conference mode is activated;
Means for loading and reproducing and displaying presentation data to be used for a video conference according to user selection;
Means for driving a camera and a microphone provided in the mobile device;
Means for multiplexing a video frame photographed by the camera, a voice frame corresponding to a voice input through the microphone, and a reproduction frame of the presentation data to form a video conference frame;
Means for transmitting the configured video conference frame to the sink terminal via the wireless transport channel;
Means for receiving a video conference presenter token request message from another mobile device associated with the sink terminal during the video conference frame transmission;
Wherein, when the video conference presenter token request is accepted, the video conference frame is configured by the other mobile device that has requested the video conference presenter token and is transmitted to the sink terminal. A mobile device for providing a video conference in cooperation with a sink terminal through a mobile communication network,
Means for selecting a connection target sink terminal;
Means for setting a wireless communication channel with the selected connected sink terminal;
Means for loading and reproducing and displaying presentation data to be used for a video conference according to user selection;
Means for driving a camera and a microphone provided in the mobile device;
Means for multiplexing a video frame photographed by the camera, a voice frame corresponding to a voice input through the microphone, and a reproduction frame of the presentation data to form a video conference frame;
Means for transmitting the composed video conference frame to the sink terminal via the wireless communication channel; And
Means for receiving a video conference presenter token request message from another mobile device associated with the sink terminal during the video conference frame transmission;
Wherein, when the video conference presenter token request is accepted, the video conference frame is configured by the other mobile device that has requested the video conference presenter token and is transmitted to the sink terminal. A sync terminal for providing a video conference in cooperation with a mobile device via a wireless network,
Means for establishing a wireless transport channel with the mobile device when NFC tagging with the mobile device activated with the video conference mode is detected;
Means for receiving a multiplexed video conference frame over the wireless transmission channel;
Means for demultiplexing the received video conference frames to extract video frames and audio frames; And
Means for transmitting the extracted image frame and voice frame to the image display device
Wherein the video conference frame includes an image frame corresponding to the image photographed by the camera of the mobile device, a voice frame corresponding to the voice input through the microphone of the mobile device, and a presentation A video conference group is formed through the NFC tagging, and a video conference presenter token request and acceptance procedure between mobile devices included in the video conference group is performed through a video conference A sink terminal where the presenter is switched.

Images