KR101670815B1 - Method for providing real-time contents sharing service based on virtual reality and augment reality - Google Patents

Method for providing real-time contents sharing service based on virtual reality and augment reality Download PDF

Info

Publication number
KR101670815B1
KR101670815B1 KR1020160015789A KR20160015789A KR101670815B1 KR 101670815 B1 KR101670815 B1 KR 101670815B1 KR 1020160015789 A KR1020160015789 A KR 1020160015789A KR 20160015789 A KR20160015789 A KR 20160015789A KR 101670815 B1 KR101670815 B1 KR 101670815B1
Authority
KR
South Korea
Prior art keywords
content
terminal
real
time
supply
Prior art date
Application number
KR1020160015789A
Other languages
Korean (ko)
Inventor
진종원
Original Assignee
(주)건우애듀
진종원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)건우애듀, 진종원 filed Critical (주)건우애듀
Priority to KR1020160015789A priority Critical patent/KR101670815B1/en
Application granted granted Critical
Publication of KR101670815B1 publication Critical patent/KR101670815B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • H04N13/0203—
    • H04N13/0271—
    • H04N13/0429—
    • H04N13/044—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs

Abstract

Provided is a method for providing a real-time content sharing service comprising: a step of receiving generated content to be photographed in a content supply terminal in real time; a step of transmitting the received content to at least one content consumer terminal interworking with the content supply terminal; and a step of controlling the content so as to play the content generated from a head mounted display (HMD) connected to at least one content consumer terminal in real time.

Description

TECHNICAL FIELD [0001] The present invention relates to a VR and AR-based real-time knowledge sharing service,

The present invention relates to a method of providing VR and AR-based real-time knowledge sharing services, and a method of sharing virtual and augmented reality contents generated by a content generation terminal with content consumption terminals in real time.

In recent years, as the spread of smart terminals has become popular and various developed applications are commercialized, studies for real-time streaming of contents of virtual reality and augmented reality are being conducted, and video lectures are generated not only in 2D but also in 3D, Efforts are being made.

At this time, a realistic lecture is a method of generating contents using a virtual reality. In this connection, Korean Unexamined Patent Publication No. 2001-0067612 (published on July 13, 2001) discloses a configuration for storing VR content and allowing VR content to be browsed on a multicast channel desired by a client.

However, even if VR content is created, it is not a real-time streaming like 2D or 3D, but only reproducing existing content by browsing. Therefore, the learner can not communicate with the lecturer in real time, The person does not shoot with his / her own gaze, but the photographer shoots the lecturer, and can not automatically follow the object described in the lecturer's gaze.

In an embodiment of the present invention, the lecturer and the learner are connected in real time to deliver the content. The lecturer receives the learner's feedback in real time. The learner can transmit the unknown part to the lecturer in real time. By receiving content photographed by the lecturer's gaze, the learner can directly participate in the lecture room and add the same sense of presence as being with the lecturer, while realizing the concentration through AR. Which can provide a real-time knowledge sharing service providing method. It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

As a technical means for achieving the above technical object, an embodiment of the present invention is a method for providing a content providing system, comprising the steps of: receiving a content photographed and generated in real time from a content providing terminal; To the consuming terminal, and controlling the content generated in real time in the HMD (Head Mounted Display) connected to at least one content consumption terminal to be reproduced.

According to any one of the above-mentioned objects of the present invention, the lecturer and the learner are connected in real time to deliver the content, the lecturer receives the learner's feedback in real time, and the learner learns the lecture in real time By receiving contents photographed by the lecturer's gaze while increasing the concentration through VR and AR, the learner can participate directly in the lecture room and add the same sense of presence as being with the lecturer, The same sense of presence can be obtained.

1 is a block diagram illustrating a system for providing a real-time knowledge sharing service according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a real-time knowledge sharing service providing server shown in FIG. 1. FIG.
FIG. 3 is a block diagram illustrating an embodiment in which the real-time knowledge sharing service shown in FIG. 1 is implemented.
FIG. 4 is a configuration diagram for explaining an embodiment of photographing by the photographing terminal shown in FIG. 1. FIG.
FIG. 5 is a diagram illustrating a process in which data is transmitted and received between the respective components included in FIG. 1 according to an embodiment of the present invention.
6 is a flowchart illustrating a method for providing a real-time knowledge sharing service according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

The terms "about "," substantially ", etc. used to the extent that they are used throughout the specification are used in their numerical values or in close proximity to their numerical values when the manufacturing and material tolerances inherent in the stated meanings are presented, Accurate or absolute numbers are used to help prevent unauthorized exploitation by unauthorized intruders of the referenced disclosure. The word " step (or step) "or" step "does not mean" step for. &Quot;

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by a terminal, a device, or a device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, device or device connected to the server.

In this specification, some of the operations or functions described in the mapping or matching with the terminal are mapping or matching the unique number of the terminal, which is the identification data of the terminal, or the identification information of the individual . ≪ / RTI >

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating a system for providing a real-time knowledge sharing service according to an embodiment of the present invention. 1, a real-time knowledge sharing service providing system 1 includes a content providing terminal 100, a real-time knowledge sharing service providing server 300, at least one content consuming terminal 400, a shooting terminal 500, And an HMD (Head Mounted Display). However, since the real-time knowledge sharing system 1 of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to FIG.

At this time, the respective components of FIG. 1 are generally connected through a network 200. For example, as shown in FIG. 1, the content providing terminal 100 may be connected to the shooting terminal 500 through the network 200. Also, the content providing terminal 100 can be connected to the real-time knowledge sharing service providing server 300 through the network 200. [ The content providing terminal 100 may be connected to at least one content consuming terminal 400 through the network 200. [ Here, the real-time knowledge sharing service providing server 300 may be connected to the content providing terminal 100 and at least one content consuming terminal 400 through the network 200. [ In addition, at least one content consumption terminal 400 may be connected to the HMD 600 through the network 200. At least one content consumption terminal 400 may be connected to the content providing terminal 100 via the network 200 via the real-time knowledge sharing service providing server 300.

Here, the network 200 refers to a connection structure capable of exchanging information between nodes such as a plurality of terminals and servers. One example of such a network 200 is a 3rd Generation Partnership Project (3GPP) network, A 5th Generation Partnership Project (5GPP) network, a World Interoperability for Microwave Access (WIMAX) network, an Internet, a LAN (Local Area Network), a Wireless LAN (Local Area Network) But are not limited to, a wide area network (PAN), a personal area network (PAN), a Bluetooth network, a satellite broadcast network, an analog broadcast network, and a digital multimedia broadcasting network. The content providing terminal 100, the real-time knowledge sharing service providing server 300, the at least one content consuming terminal 400, the photographing terminal 500 and the HMD 600 shown in FIG. 1 are the same as those shown in FIG. 1 But is not limited to.

The content providing terminal 100 may be a terminal that transmits the content to the real-time knowledge sharing service providing server 300 in real time using the photographing terminal 500. The content providing terminal 100 may be a terminal that receives feedback from at least one content consuming terminal 400 and generates a response to the feedback to the real-time knowledge sharing service providing server 300 Terminal. Also, the content providing terminal 100 may be a terminal accessing at least one site provided by the real-time knowledge sharing service providing server 300. At this time, the provider of the content providing terminal 100 may be a student or a lecturer. That is, the lecturer and the lecturer are not set separately, but may be a lecturer if there is a subject that they want to learn, and a lecturer if there is a subject that they want to teach at the same time. However, when the content providing terminal 100 generates the content, the content providing terminal 100 may be a terminal that is linked with the shooting terminal 500 to generate the content. At this time, the content providing terminal 100 may be implemented as a computer capable of connecting to a remote server or terminal through the network 200. Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like on which a WEB browser is installed. The content providing terminal 100 may be implemented as a terminal capable of connecting to a remote server or terminal through the network 200. [ The content supply terminal 100 is a wireless communication device that is guaranteed to be portable and mobility, for example, a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular), a PHS System, a PDA (Personal Digital Assistant), an IMT (International Mobile Telecommunication) -2000, a Code Division Multiple Access (CDMA) -2000, a W-CDMA (W-CDMA) A handheld based wireless communication device such as a smartphone, a smartpad, a tablet PC, and the like.

The real-time knowledge sharing service providing server 300 may be a server that transmits contents received in real time from the contents providing terminal 100 to at least one contents consuming terminal 400. [ The real-time knowledge sharing service providing server 300 is a server that controls the shooting terminal 500 at the content providing terminal 100 and controls the HMD 600 at the at least one content consuming terminal 400. [ Lt; / RTI > The real-time knowledge sharing service providing server 300 may be a server that authenticates and distinguishes a user who uses real-time knowledge sharing using user information. For example, the real-time knowledge sharing service providing server 300 defines a terminal satisfying a predetermined condition as at least one content consuming terminal 400 and transmits a terminal that does not satisfy the predetermined condition to the content providing terminal 100 ). ≪ / RTI > Also, the real-time knowledge sharing service providing server 300 may be a server that mediates at least one content consuming terminal 400 and the content providing terminal 100. That is, the real-time knowledge sharing service providing server 300 receives and classifies the supply data for the supply contents from the contents supply terminal 100, and when the search event is received from the at least one contents consumption terminal 400, It is possible to match the list of lectures according to the learning level and the degree of difficulty of at least one content consumption terminal 400. In addition, the real-time knowledge sharing service providing server 300 provides a list of matched lectures to at least one content consuming terminal 400, and an event for selecting any one of the provided lectures is transmitted to at least one content consuming terminal 400 , It is possible to connect the content providing terminal 100 and the at least one content consuming terminal 400, which are in progress of the selected lecture, so that the lecture can proceed. At this time, at least one content consumption terminal 400 can use the gift certificate as the payment means for paying the lecture fee to the real-time knowledge sharing service providing server 300. Here, the gift certificate may be a transaction means provided to be able to charge a certain amount of money and use real-time information and contents through a unique information value. At this time, the real-time knowledge sharing service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through the network 200. [ Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like on which a WEB browser is installed.

At least one content consumption terminal 400 may be a terminal accessing at least one site provided by the real-time knowledge sharing service providing server 300. At this time, the user of at least one content consumption terminal 400 may be a student or an instructor. That is, the lecturer and the lecturer are not set separately but can be a lecturer if there is a subject that they want to learn, and a lecturer if there is a subject that they want to teach at the same time. When at least one content consumption terminal 400 is a consumer, it can output the content generated by the content supply terminal 100 in cooperation with the HMD 600. [ At this time, at least one content-consuming terminal 400 may be implemented as a computer capable of accessing a remote server or terminal through the network 200. [ Here, the computer may include, for example, a notebook, a desktop, a laptop, and the like on which a WEB browser is installed. In addition, at least one content-consuming terminal 400 may be implemented as a terminal capable of connecting to a remote server or terminal through the network 200. [ At least one content consumption terminal 400 is a wireless communication device that is guaranteed to be portable and mobility, for example, a PCS (Personal Communication System), a GSM (Global System for Mobile communications), a PDC (Personal Digital Cellular) Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W-CDMA (W- A handheld based wireless communication device such as a smart phone, a smartphone, a smartpad, a tablet PC, and the like.

The shooting terminal 500 may be a terminal that interlocks with the content providing terminal 100 and transmits the photographed content to the real-time knowledge sharing service providing server 300 via the content providing terminal 100. [ Here, the shooting terminal 500 may be provided to photograph a line of sight of the contents provider. The shooting terminal 500 may be a terminal that transmits data to the contents providing terminal 100 wirelessly or by wire.

The HMD 600 may be a terminal for outputting the image of the content supply terminal 100 received from the real-time knowledge sharing service providing server 300. [ At this time, the HMD 600 can be used to view a video on a large screen while being portable, and the virtual reality contents or the augmented reality contents can be output from the HMD 600. [

FIG. 2 is a configuration diagram for explaining a real-time knowledge sharing service server shown in FIG. 1, FIG. 3 is a configuration diagram for explaining an embodiment in which real time knowledge sharing service shown in FIG. 1 is implemented, Is a configuration diagram for explaining an embodiment of photographing by the photographing terminal shown in Fig.

2, a real-time knowledge sharing service providing server 300 according to an exemplary embodiment of the present invention includes a receiving unit 310, a transmitting unit 320, a control unit 330, a view obtaining unit 340, A customized portion 360, a management portion 370, and a representation portion 380. [0100]

(Not shown) operating in conjunction with the real-time knowledge sharing service providing server 300 or the real-time knowledge sharing service providing server 300 according to an embodiment of the present invention may be provided to the content providing terminal 100 or at least one content A content providing terminal 100 or at least one content consuming terminal 400 may be a real-time knowledge sharing providing application, a program, an application page, a web page, , An app page, a web page, and the like. In addition, the service program may be executed in the content providing terminal 100 or at least one content consuming terminal 400 using a script executed in the web browser. Here, a web browser is a program that enables a WWW (World Wide Web) service, and is a program for receiving and displaying hypertext described in hypertext mark-up language (HTML), for example, Netscape (Netscape) An Explorer, chrome, and the like. Further, the application refers to an application on the terminal, for example, an app (app) running on a mobile terminal (smart phone).

The content providing terminal 100 and the real-time knowledge sharing service providing server 30), the at least one content consuming terminal 400, the photographing terminal 500 and the HMD 600 are connected to the network 200, Means creating a communication object at a communication contact for communication with a terminal connected to the network 200. The real-time knowledge sharing service providing server 300 can exchange data with each other through a communication object.

The receiving unit 310 can receive the content photographed and generated in real time from the content providing terminal 100. [ Here, the content supply terminal 100 may be interlocked with the shooting terminal 500. The content providing terminal 100 is linked to the shooting terminal 500 to generate content and the shooting terminal 500 is installed in proximity to the eye of the content provider to capture a line of sight of the content provider. And a microphone module positioned proximate the mouth of the content provider to extract the voice of the content provider. At this time, the camera of the dual shooting module of the content supply terminal 100 is a virtual reality camera, and the generated content may be a virtual reality or augmented reality content.

The transmitting unit 320 may transmit the received content to at least one content consuming terminal 400 associated with the content providing terminal 100. Here, the transmitting unit 320 may identify the computing resources and the networking resources of the content providing terminal 100 and the at least one content consuming terminal 400, determine the content quality corresponding to the computing resources and the networking resources, And may be executed by connecting the content providing terminal 100 and the selected at least one content consuming terminal 400 so as to be transcoded based on the content quality. The computing resources may be hardware resources such as an operating system (OS), a memory availability, a CPU, and a screen size of the content providing terminal 100 and the at least one content consuming terminal 400. The networking resources may be network resources such as network bandwidth and congestion of the content providing terminal 100 and the at least one content consuming terminal 400. [ Accordingly, transmitting the screen of the same pixel to the content providing terminal 100 and the at least one content consuming terminal 400 at the same time can make networking resources and computing resources difficult to transcode in other terminals, The transmission unit 320 can grasp the amount of each resource and transmit the screen according to the resource amount.

In summary, the transmitting unit 320 can grasp the resources required to drive the received content, and can grasp the resources of the at least one content consuming terminal 400. If the network resource or the computing resource of the at least one content consuming terminal 400 identified does not satisfy the requested resource, the transmitting unit 320 may transmit at least one content consuming terminal 400 having the network resource or the computing resource 400 to enable real-time streaming, and to transcode the received content in response to the determined content quality. In addition, the transmitting unit 320 may transmit the transcoded contents to the at least one content consuming terminal 400.

The control unit 330 can control the content generated in real time in the HMD 600 connected to at least one content consumption terminal 400 to be reproduced.

On the other hand, the camera of the dual photographing module includes a camera of a first system for photographing a photographing object in a horizontal focus mode, and a camera of a second system for photographing an angle and a focus automatically set according to the movement of the photographing object, The two-way camera may use at least one of a depth camera, an ultrasonic distance measuring camera, and a sonar sensor camera. Accordingly, the viewpoint and the image in the content supply terminal 100 can be output from at least one content consumption terminal 400. [

Here, the HMD 600 may include a photographing module that photographs the field of view of the content consumer. In other words, the HMD 600 may include a module for taking a front view so that a view can be secured without removing the HMD 600 while consuming a content. Accordingly, the view securing unit 340 controls the controller 330 to reproduce the content generated in real time in the HMD 600 (Head Mounted Display) connected to at least one content consumption terminal 400, When receiving the stop signal of the HMD 600 from one content consumption terminal 400, it is possible to stop the reproduction of the content in the HMD 600 via the at least one content consumption terminal 400. [ When the reproduction of the content is stopped in the HMD 600, the view securing unit 340 can control the imaging module of the HMD 600 to be driven. When the HMD 600 captures the view of the content consumer So that the screen can be controlled to be reproduced.

The alarm unit 350 controls the control unit 330 to reproduce the screen of the HMD 600 that reproduces the view of the content consumer and then displays the screen reproduced from the view of the content consumer on the at least one content consuming terminal 400. [ And analyzes the time and image at which the content corresponding to the streamed screen is reproduced. The alarm unit 350 may transmit a warning message to the at least one content consuming terminal 400 when the analyzed time and the image coincide with the predetermined time and image.

The customizing unit 360 controls the controller 330 to reproduce the content generated in real time in the HMD 600 (Head Mounted Display) connected to at least one content consuming terminal 400, Monitors whether an input signal for inputting a user interface or data corresponding to predetermined condition data is inputted from the terminal 400 and outputs the input of the user interface or the predetermined condition When the data corresponding to the data is inputted, it is possible to transmit to the contents supply terminal 100 that the input data exists. The customized unit 360 transmits the frame of the content to be supplied from the content supply terminal 100 when the input data exists to the content supply terminal 100, When generating the descriptive content, it may transmit the selectively generated descriptive content to at least one content consuming terminal 400 that has entered the user interface or the condition data.

The control unit 370 controls the control unit 330 to reproduce the content generated in real time in the HMD 600 (Head Mounted Display) connected to at least one content consumption terminal 400, The mobile terminal 400 may receive at least one terminal or account information registered to the content consumer and monitor whether there is a signal for accessing the received at least one terminal or the account information. If there is a signal for accessing the received at least one terminal or the account information as a result of the monitoring, the management unit 370 intercepts the access signal and controls so that signals for accessing at least one terminal or account are not transmitted .

 The at least one content-consuming terminal 400 may include a module for photographing a content consumer that consumes the content. At this time, the reproducing unit 380 controls the controller 330 to reproduce the content generated in real time in the HMD 600 (Head Mounted Display) connected to at least one content consuming terminal 400, It is possible to receive self-photographing data from at least one content-consuming terminal 400 and to control the received self-photographing data to be displayed in at least one content-consuming terminal 400. [

The at least one content-consuming terminal 400 may provide the content of the content-supplying terminal 100 to the at least one content-consuming terminal 300 400), and control the bidders who bid for the first time to select a price.

In addition, the real-time knowledge sharing service providing server 300 receives the supply data for the supply contents from the contents supply terminal 100. [ At this time, for example, the supplied content may be knowledge content to be provided by the provider, and the supplied data may be metadata describing the knowledge content. Here, the classification may be established in at least one site provided by the real-time knowledge sharing service providing server 300.

The real-time knowledge sharing service providing server 300 registers and classifies the supplied contents using the metadata included in the supplied data. At this time, the classifying unit 320 may classify the content providing terminal 100 based on the supply data describing the supplied content, instead of registering the content itself.

The real-time knowledge sharing service providing server 300 receives a search event for the supply data from at least one content consuming terminal 400. At this time, the search event may be an event for searching for a subject to be taken by a user of at least one content consumption terminal 400. The search event may be, for example, data received from at least one content consuming terminal 400 by transmitting survey data or question type data to a user of the at least one content consuming terminal 400. For example, the search event may be data that includes an understanding of the subject, a desired degree of difficulty, and an exact part to be learned by the user.

The real-time knowledge sharing service providing server 300 searches and arranges the supply data based on the matching algorithm so as to correspond to the search event. At this time, the search event may include at least one of a learning subject, a learning motive, a learning level, and a concern of a user of at least one content consumption terminal 400, and the supply data may be provided by a provider of the content supply terminal 100 A supply of supply content, a supply motive, a supply level, and a concern. In this case, the matching algorithm of the matching unit 330 may match at least one of the content providing terminals 100 with one of the content providing terminals 100, if the matching rate of the search event and the supplied data exceeds a preset matching rate. The content consumption terminal 400 can be matched.

In addition, the matching algorithm of the real-time knowledge sharing service providing server 300 is a condition in which the state of accessing at least one site provided by the real-time knowledge sharing service providing server 300 is a mandatory condition, Whether or not the match rate exceeds the predetermined match rate or whether the match rate of the learning difficulty and the supply difficulty included in the search event and the supply data exceeds the predetermined match rate can be matched with a sufficient condition. That is, in the former case, even if the user and the supplier match all the conditions, the knowledge can not be shared if the two are not connected in real time, so that it can be set as a necessary condition whether or not the user is currently accessing the site. In the latter case, it is possible to set the degree of difficulty to a sufficient condition so that matching is performed by setting the degree of difficulty among the conditions of the two as the highest priority. At this time, the case where any of the remaining conditions other than the difficulty level can be set as the highest priority condition is not excluded.

In addition, the matching algorithm of the real-time knowledge sharing service providing server 300 is performed by the real-time knowledge sharing service providing server 300 when the matching rate of the search event exceeds the preset matching rate, A message may be sent to the content providing terminal 100 so as to recognize the supply necessary event of the user terminal 300 when the at least one providing site is not connected. That is, in order to share knowledge in real time, a precondition that both parties 100 and 400 must be connected in real time is required. When the provider is not connected, a message is transmitted to the content providing terminal 100, So that it can be recognized. Here, the message may be transmitted to a web-to-web or a web-to-phone by the real-time knowledge sharing service providing server 300.

Then, the real-time knowledge sharing service providing server 300 transmits the supply data searched and arranged to the user terminal to at least one content consuming terminal 400.

The at least one content consuming terminal 400 and the selected content providing terminal 100 may be connected to the real-time knowledge sharing service providing server 300 when the selection event for selecting the supply data from the at least one content consuming terminal 400 occurs. In real time. The connection of at least one content consumption terminal 400 and the selected content supply terminals 100 in the connection unit 350 in real time means that a selection event for selecting supply data from at least one content consumption terminal 400 occurs The Multi-point Control Unit provides a multi-party video conferencing service, grasps the operating systems of at least one content consuming terminal 400 and the selected content providing terminal 100, and generates a real-time image corresponding to the operating system And can be executed by controlling the multiparty recall conference service to be driven by at least one content consumption terminal 400 and the selected content supply terminal 100 by using the transmitted application.

A method for providing a real-time knowledge sharing service according to an embodiment of the present invention having the above-described configuration will be described with reference to FIGS. 3 and 4. FIG.

Referring to FIG. 3, a method for providing a real-time knowledge sharing service according to the present invention can be implemented such that a learner and a teacher through VR or AR (Virtual Reality or Augmented Reality) share VR or AR contents in real time. For example, the real-time knowledge sharing service providing method of the present invention can be applied to any place where contents are shared in real time. For example, the present invention can be applied to various fields such as communication, remote interview test, remote medical consultation, and the like, so that it is not limited to the above embodiments.

Referring to FIG. 3, (a) the provider of the content providing terminal 100 that generates the content can wear the shooting terminal 500 and generate the content when creating the content. For example, suppose you create content about how to cook. In such a case, the photographer and the lecturer must be separate, and the photographer should focus on the object to be photographed. In this case, when the photographing terminal 500 is worn by the supplier of the contents supply terminal 100 according to the embodiment of the present invention, a separate photographer is not required. In addition, in the content providing terminal 100 according to the embodiment of the present invention, the shooting terminal 500 is interlocked with the shooting terminal 500. The shooting terminal 500 can be configured to be worn by the content creator have. The content consumer terminal 400, which is a terminal of the learner, that is, the content consumer, can output the content in the HMD 600 in cooperation with the HMD 600. [ At this time, (b) the screen output from the HMD 600 may be added to the augmented reality in addition to the virtual reality, and the user interface corresponding to the augmented reality may include an overlay If there is an input for touching or selecting a user interface for the augmented reality, the menu or the content corresponding to the input may be output. In this case, since the content consumer may not concentrate on the content, a sensor for detecting the biorhythm of the content consumer may be further included. If the biorhythm is similar or identical to the rhythm at the time of sleep, the content consumption terminal 400 The user can wake up all of the terminals associated with the wake-up device so that the wakefulness state can be maintained. In this case, the sensor for sensing the biorhythm may be provided in the content consumption terminal 400 or in the HMD 600. However, if the sensor is installed in the HMD 600, (Not shown).

Referring to FIG. 4, the photographing terminal 500 can use both a horizontal focusing method and a subject focusing method. (A) The horizontal focusing method captures an object according to the angle of the camera regardless of the subject. On the other hand, (b) the auto-focusing method is a function of tracking a subject by measuring the distance between the camera and the shooting object, adjusting the angle of the camera to a specific position, and setting the focus. Even if the angle of bowing or the like changes from object to object, the object can be tracked and photographed.

1 to 4 can be easily deduced from the same or similar contents as those of the method of providing a real-time knowledge sharing service, as described above with reference to FIG. 1, The description will be omitted.

FIG. 5 is a diagram illustrating a process in which data is transmitted and received between the respective components included in FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process of transmitting and receiving a signal according to an embodiment of the present invention will be described with reference to FIG. 5. However, the present invention is not limited to such an embodiment, and according to various embodiments described above, It is apparent to those skilled in the art that the process of transmitting and receiving the shown data can be changed.

5, the photographing terminal 500 can photograph (S5100) to generate a content, and the photographed content is transmitted to the content providing terminal 100 (S5200) (Step S5300).

Then, the real-time knowledge sharing service providing server 300 grasps the resources of the contents consumption terminal 400 (S5400), determines the quality that can be transmitted to the contents consumption terminal 400 without delay (S5500 ), And starts transcoding the content according to the determined quality (S5600).

Then, the real-time knowledge sharing service providing server 300 transmits the contents to the contents consuming terminal 400 (S5700), and the contents consuming terminal 400 transmits the contents to the HMD 600 to be displayed S5800).

Here, the HMD 600 starts outputting the content of the content provider (S5900). When the HMD 600 is stopped in the content consuming terminal 400 (S5910), the HMD 600 secures the view without removing the HMD 600 , The HMD 600 starts shooting (S5920).

Then, the photographed contents are reproduced without removing the HMD 600 so that a view can be secured (S5930).

On the other hand, the content consumption terminal 400 transmits feedback (S5940), causes the shooting terminal 500 to generate a content responding to the feedback (S5950), and when the content is generated in the shooting terminal 500 And transmits it to the real-time knowledge sharing service providing server 300 through the HMD 600 at the content consuming terminal 400 at step S5970.

The order between the above-described steps S5100 to S5980 is merely an example, but is not limited thereto. That is, the order between the above-described steps (S5100 to S5980) may be mutually varied, and some of the steps may be executed or deleted at the same time.

Since the method of providing the real-time knowledge sharing service shown in FIG. 5 can be easily derived from the same or described contents of the real-time knowledge sharing service providing method described above with reference to FIGS. 1 to 4, The description will be omitted.

6 is a flowchart illustrating a method for providing a real-time knowledge sharing service according to an embodiment of the present invention. Referring to FIG. 6, the real-time knowledge sharing service providing server receives the content photographed and generated in real time from the content providing terminal (S6100).

Then, the real-time knowledge sharing service providing server transmits the received contents to at least one content consuming terminal interlocked with the contents providing terminal (S6200).

Here, the real-time knowledge sharing service providing server controls the content generated in real time in an HMD (Head Mounted Display) connected to at least one content consumption terminal to be played back in operation S6300.

Since the method of providing the real-time knowledge sharing service shown in FIG. 6 can be easily derived from the same or explained contents of the real-time knowledge sharing service providing method as described above with reference to FIGS. 1 to 5, The description will be omitted.

The method of providing a real-time knowledge sharing service according to the embodiment described with reference to FIG. 6 can also be implemented in the form of a recording medium including instructions executable by a computer such as an application or a program module executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium can include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

The above-described method of providing a real-time knowledge sharing service according to an embodiment of the present invention can be executed by an application installed in a terminal (which may include a program included in a platform or an operating system basically installed in the terminal) (I.e., a program) installed directly on the master terminal through an application providing server such as a user, an application store server, an application, or a web server related to the service. In this regard, the above-described method of providing a real-time knowledge sharing service according to an embodiment of the present invention may be implemented as an application (i.e., a program) installed basically in a terminal or directly installed by a user, And recorded on a recording medium.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

Claims (10)

A real-time knowledge sharing service providing method executed by a real-time knowledge sharing service providing server,
Receiving content photographed and generated in real time from a content supply terminal;
Transmitting the received content to at least one content consuming terminal associated with the content providing terminal;
Controlling to reproduce the content generated in real time in an HMD (Head Mounted Display) connected to the at least one content consumption terminal;
Lt; / RTI >
Wherein the content providing terminal is interfaced with a photographing terminal to create a content, the photographing terminal being installed so as to be close to an eye of the contents provider and photographing a line of sight of the contents provider, And a microphone module for extracting a voice of the contents provider,
Wherein the camera of the dual shooting module of the content supply terminal is a virtual reality camera,
Wherein the generated content is a virtual reality or augmented reality content,
Wherein the step of transmitting the received content to at least one content consuming terminal interlocked with the content providing terminal comprises:
Determining a resource required to drive the received content;
Identifying a resource of the at least one content-consuming terminal;
Wherein the at least one content-consuming terminal having the network resource or the computing resource is capable of real-time streaming if the network resource or the computing resource of the at least one content-consuming terminal does not satisfy the requested resource Determining;
Transcoding the received content in response to the determined content quality; And
Further comprising transmitting the transcoded content to the at least one content consuming terminal,
Wherein the at least one content consumption terminal comprises a module for photographing a content consumer consuming the content,
After the step of controlling to reproduce the content generated in real time in an HMD (Head Mounted Display) connected to the at least one content consumption terminal,
Receiving photographed data from the at least one content consuming terminal;
Controlling the received self-imaging data to be displayed at the at least one content-consuming terminal
Further comprising:
Selecting a price having a higher frequency of at least one content consumption terminal that has presented the lowest price to the highest price when the content of the content supply terminal is desired by the at least one content consumption terminal;
Controlling the bidders who have presented the selected price for the first time to receive bids;
Receiving supply data for the supply content from the content supply terminal;
Registering and classifying the supply contents using the metadata included in the supply data;
Receiving a search event for the supply data from at least one content consuming terminal;
Searching and sorting the supply data based on the matching algorithm so as to correspond to the search event
Further comprising:
The matching algorithm may be a method of matching any one content providing terminal and at least one content consuming terminal among the content providing terminals or matching the search event with the supplied data if the matching rate of the search event and the supplied data exceeds a predetermined matching rate Whether or not the rate of matching of the learning difficulty and the supply difficulty included in the search event exceeds the preset matching rate, or whether the matching rate of the learning difficulty and the supply difficulty included in the search event exceeds the preset matching rate. Service delivery method. delete delete delete delete delete delete delete delete delete
KR1020160015789A 2016-02-11 2016-02-11 Method for providing real-time contents sharing service based on virtual reality and augment reality KR101670815B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160015789A KR101670815B1 (en) 2016-02-11 2016-02-11 Method for providing real-time contents sharing service based on virtual reality and augment reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160015789A KR101670815B1 (en) 2016-02-11 2016-02-11 Method for providing real-time contents sharing service based on virtual reality and augment reality

Publications (1)

Publication Number Publication Date
KR101670815B1 true KR101670815B1 (en) 2016-10-31

Family

ID=57445999

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160015789A KR101670815B1 (en) 2016-02-11 2016-02-11 Method for providing real-time contents sharing service based on virtual reality and augment reality

Country Status (1)

Country Link
KR (1) KR101670815B1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101771583B1 (en) 2016-08-05 2017-08-25 (주)건우애듀 Method for providing real-time experience sharing service using avatar based on augment reality and virtual reality
CN107465670A (en) * 2017-07-24 2017-12-12 终极（北京）科技有限公司 One mobile terminal synchronization controls the control method and system of multiple VR all-in-ones
KR20180076730A (en) * 2016-12-28 2018-07-06 주식회사 글로브포인트 System and method for providing learning contents
CN108389249A (en) * 2018-03-06 2018-08-10 深圳职业技术学院 A kind of spaces the VR/AR classroom of multiple compatibility and its construction method
CN108965857A (en) * 2018-08-09 2018-12-07 张家港康得新光电材料有限公司 A kind of stereo display method and device, wearable stereoscopic display
KR101960815B1 (en) * 2017-11-28 2019-03-21 유엔젤주식회사 Learning Support System And Method Using Augmented Reality And Virtual reality
WO2019151793A1 (en) * 2018-02-02 2019-08-08 Samsung Electronics Co., Ltd. Apparatus and method for sharing a virtual reality environment
KR102109968B1 (en) * 2019-07-15 2020-05-12 안정훈 System for providing virtual reality based self-hypnosis counseling and psychotherapy service
KR20200092595A (en) * 2019-01-25 2020-08-04 김진태 Virtual reality display system
KR102245166B1 (en) * 2021-01-11 2021-04-27 (주)코믹스브이 Virtual reality contents trading platform
KR102420576B1 (en) * 2021-08-25 2022-07-15 주식회사 아이스크림미디어 Systems that provide textbook-based responsive digital textbooks service and method for controlling the same

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012173476A (en) * 2011-02-21 2012-09-10 Nec Casio Mobile Communications Ltd Display system, terminal device, method for controlling the device, and program
KR101295976B1 (en) * 2012-06-04 2013-08-13 충북대학교 산학협력단 3d video conference system
KR101409396B1 (en) * 2013-07-04 2014-06-20 진종원 Method for providing real-time knowledge sharing service

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012173476A (en) * 2011-02-21 2012-09-10 Nec Casio Mobile Communications Ltd Display system, terminal device, method for controlling the device, and program
KR101295976B1 (en) * 2012-06-04 2013-08-13 충북대학교 산학협력단 3d video conference system
KR101409396B1 (en) * 2013-07-04 2014-06-20 진종원 Method for providing real-time knowledge sharing service

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101771583B1 (en) 2016-08-05 2017-08-25 (주)건우애듀 Method for providing real-time experience sharing service using avatar based on augment reality and virtual reality
KR20180076730A (en) * 2016-12-28 2018-07-06 주식회사 글로브포인트 System and method for providing learning contents
CN107465670A (en) * 2017-07-24 2017-12-12 终极（北京）科技有限公司 One mobile terminal synchronization controls the control method and system of multiple VR all-in-ones
KR101960815B1 (en) * 2017-11-28 2019-03-21 유엔젤주식회사 Learning Support System And Method Using Augmented Reality And Virtual reality
WO2019151793A1 (en) * 2018-02-02 2019-08-08 Samsung Electronics Co., Ltd. Apparatus and method for sharing a virtual reality environment
US10976982B2 (en) 2018-02-02 2021-04-13 Samsung Electronics Co., Ltd. Guided view mode for virtual reality
CN108389249A (en) * 2018-03-06 2018-08-10 深圳职业技术学院 A kind of spaces the VR/AR classroom of multiple compatibility and its construction method
CN108965857A (en) * 2018-08-09 2018-12-07 张家港康得新光电材料有限公司 A kind of stereo display method and device, wearable stereoscopic display
KR20200092595A (en) * 2019-01-25 2020-08-04 김진태 Virtual reality display system
KR102185632B1 (en) 2019-01-25 2020-12-02 김진태 Virtual reality display system
KR102109968B1 (en) * 2019-07-15 2020-05-12 안정훈 System for providing virtual reality based self-hypnosis counseling and psychotherapy service
KR102245166B1 (en) * 2021-01-11 2021-04-27 (주)코믹스브이 Virtual reality contents trading platform
KR102420576B1 (en) * 2021-08-25 2022-07-15 주식회사 아이스크림미디어 Systems that provide textbook-based responsive digital textbooks service and method for controlling the same
KR102447488B1 (en) * 2021-08-25 2022-09-28 주식회사 아이스크림미디어 A responsive digital textbook service providing system that maximizes learners' five senses
KR102447485B1 (en) * 2021-08-25 2022-09-28 주식회사 아이스크림미디어 A System for Using Realistic AR/VR Video Content Based on Textbooks as Educational Content
KR102447484B1 (en) * 2021-08-25 2022-09-28 주식회사 아이스크림미디어 A system that collects multimedia information in advance and provides customized digital textbooks
KR102447486B1 (en) * 2021-08-25 2022-09-28 주식회사 아이스크림미디어 A service providing system that enables indirect contact and virtual manipulation of learners with target learning materials
KR102447487B1 (en) * 2021-08-25 2022-09-28 주식회사 아이스크림미디어 A system that allows learners to easily recognize their own learning attitude, achievement, and concentration

Similar Documents

Publication Publication Date Title
KR101670815B1 (en) Method for providing real-time contents sharing service based on virtual reality and augment reality
US10679676B2 (en) Automatic generation of video and directional audio from spherical content
US8204299B2 (en) 3D content aggregation built into devices
US8676925B1 (en) Method and apparatus for peer-to-peer capturing and sharing of visual information based on incentives
US10938725B2 (en) Load balancing multimedia conferencing system, device, and methods
US11670055B1 (en) Facial expression tracking during augmented and virtual reality sessions
WO2021000708A1 (en) Fitness teaching method and apparatus, electronic device and storage medium
CN110809175B (en) Video recommendation method and device
US20120188345A1 (en) Apparatus and method for streaming live images, audio and meta-data
JP2017507557A (en) Process for improving the quality of experience for users who view high-definition video streams on their devices
US20190174069A1 (en) System and Method for Autonomously Recording a Visual Media
CN117043719A (en) Mirror device with hands-free mode
US11568615B2 (en) Collaborative on-demand experiences
US11272140B2 (en) Dynamic shared experience recommendations
JP6922012B2 (en) How to provide a mosaic image based on the tag of the image, a mosaic image providing device, and a program
EP3272127B1 (en) Video-based social interaction system
CN114463470A (en) Virtual space browsing method and device, electronic equipment and readable storage medium
CN114501064B (en) Video generation method, device, equipment, medium and product
US20150341541A1 (en) Methods and systems of remote acquisition of digital images or models
KR20180131687A (en) Live performance baseContent Delivery base system
US10701462B2 (en) Generating video montage of an event
US10593222B1 (en) Video filming and discovery system
KR101409396B1 (en) Method for providing real-time knowledge sharing service
US20140178035A1 (en) Communicating with digital media interaction bundles
JP2021077131A (en) Composition advice system, composition advice method, user terminal, and program

Legal Events

Date Code Title Description
AMND Amendment
AMND Amendment
X701 Decision to grant (after re-examination)
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20190812

Year of fee payment: 4