KR101165375B1 - Method for providing an education information using a virtual reality - Google Patents

Abstract

PURPOSE: A learning information supplying method using virtual reality is provided to extract motion of a performer in virtual reality through movement path of a light and to output virtual reality information to a virtual reality output screen. CONSTITUTION: A server extracts indication information from optical motion information(200). If the indication information is extracted, a controlling unit determines information which indication information indicates(300). The server performs a function related to the first indication information(400). The server changes a virtual icon according to second indication information(500). The server outputs new virtual information(600).

Description

METHOD FOR PROVIDING AN EDUCATION INFORMATION USING A VIRTUAL REALITY}

The present invention relates to an information providing method using virtual reality that provides various information by tracking a user's movement in virtual reality.

With the development of science and technology, various information providing media have been used.

Among them, televisions (TVs) or the Internet provide various image information that can be perceived by the user's vision. The image information may be a simple text, various kinds of still images, or may be a continuously changing video.

The video as described above may be simple information such as a movie or a drama, but may be a video for educational purposes of various examinees, a video providing a voting status of the president or a member of the National Assembly, or a graphic such as a weather forecast. This may be a required video. In addition, the video as described above may be a video produced by a general company for meetings or sales.

On the other hand, recently, after extracting the operator's motion in a studio without a separate background, various services using virtual reality in the form of combining the virtual reality and the host's motion have been provided.

For example, in the case of virtual reality that announces the voting status, the presenter monitors his / her appearance and images output through a separate monitor in a studio where a blue screen and a camera are used as backgrounds, and various buttons in the image. Various operations are provided through selecting operations.

As another example, in the case of a video produced for learning a foreign language, the presenter delivers a variety of situations, such as virtual reality, in a variety of places output in virtual reality, so that learners learn a foreign language while feeling more real. It provides an educational environment that makes it possible.

However, in the virtual reality as described above, the presenter can simply provide a variety of information to the user by simply expressing his or her intention by voice or selecting or dragging images such as buttons output on a video. For example, the presenter himself cannot generate information such as a character that he / she wants to provide information to users.

On the other hand, in order to overcome the above problems, recently, a technique for extracting the finger movement of the presenter operating in the virtual studio and outputting the information shaped by the finger has been developed. There is a problem that it is difficult to be widely used because it falls.

The present invention is to solve the above-described problems, using the virtual reality, which can extract the motion of the host of the virtual reality through the movement path of the light, and output the virtual information intended by the host on the screen on which the virtual reality is output It is a technical task to provide a method of providing learning information.

Learning information providing method using the virtual reality according to the present invention for achieving the above technical problem, extracting the host image from the image signal received from the camera, by combining the presenter image to the virtual reality background image to the virtual image Generating; Determining an operator's operation using optical motion information extracted from the video signal and extracting indication information using the motion information; Extracting virtual information corresponding to the first indication information if the indication information is first indication information for outputting previously stored virtual information; And generating and outputting learning information combining the virtual information extracted by the first indication information to the virtual image.

According to the above solution, the present invention provides the following effects.

That is, the present invention extracts the movement of the host of the virtual reality through the movement path of the light, and outputs the virtual information intended by the host on the screen where the virtual reality is output, thereby providing the desired virtual information to the user immediately Can provide the effect.

1 is a block diagram of a virtual reality system to which the present invention is applied.
Figure 2 is a flow diagram of an embodiment of a learning information providing method using a virtual reality according to the present invention.
Figure 3 is a flow diagram illustrating an embodiment of the indication information extraction process in detail of the learning information providing method using the virtual reality according to the present invention.
4 and 5 are exemplary diagrams for providing learning information according to the first instruction information for outputting previously stored virtual information in the method for providing learning information using virtual reality according to the present invention.
6 and 7 are exemplary diagrams for providing learning information according to the second instruction information for changing the virtual icon of the learning information providing method using the virtual reality according to the present invention.
8 and 9 are exemplary views of providing learning information according to the third instruction information for generating and outputting new virtual information in the method of providing learning information using virtual reality according to the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a virtual reality system to which the present invention is applied.

In the virtual reality system to which the present invention is applied, as shown in FIG. 1, an image of a presenter carrying a virtual pen 13 (hereinafter, simply referred to as an 'advanced image') and motion information of light output from the virtual pen ( Hereinafter, the virtual studio 10 and the virtual reality background image collected through the virtual studio 10 and the virtual studio for collecting the 'photo motion information' are simply generated to generate a virtual image, and extracted from the photo motion information. The virtual information is generated using the indication information, and the server 20 for generating the learning information by matching the generated virtual information with the virtual image, so that the user can monitor the learning information generated by the server and transmitted through the network. And a user terminal 30 for outputting.

The virtual studio 10 is a space for collecting light motion information and a host image generated by a host having a virtual pen 13 that outputs light such as an LED. A screen 12, a camera 11 for collecting the presenter image and light motion information, and a monitor 14 for allowing the presenter to monitor his / her movement are provided.

The virtual pen 13 is a device that generates light, such as a light emitting diode (LED), and may be configured to be used by the presenter while being placed at the tip of his or her finger, or may be configured to be used by the presenter.

In addition, the virtual pen may be provided with a switch for turning the light output on and off. Therefore, the facilitator may keep the optical output of the virtual pen ON when only the virtual information is to be generated.

In other words, the virtual pen is a device that outputs light, and may be configured to be used by a presenter while holding it in a hand or attached to a finger, and the like, and is preferably made small so that it can be turned on and off by the movement of a finger. . Such a virtual pen may be manufactured using all currently available light sources, and may be configured to be turned on and off using a general switching function currently used, and thus, a detailed description of the virtual pen will be omitted.

The blue screen 12, the camera 11, and the monitor 14 may be applied to those which are generally used, and thus detailed description thereof will be omitted.

The server 20 combines the presenter image transmitted from the camera 14 installed in the virtual studio with the virtual reality background image generated in advance to generate a virtual image. In other words, the virtual image refers to an image combining the host image and the virtual reality background image.

In addition, the server analyzes the optical motion information output from the virtual pen possessed by the host, extracts the instruction information intended by the host, generates virtual information corresponding to the instruction information, and generates the virtual image as a virtual image. And matching function.

That is, the motion of the light output by the virtual pen forms the light motion information, and the server analyzes the light motion information transmitted through the camera and extracts the indication information intended by the light motion information. Here, the indication information is extracted by the light motion information, but the light motion information is generated by the facilitator. Consequently, the indication information refers to information including the intention of the facilitator.

Meanwhile, the server generates virtual information matched with the indication information by using the extracted indication information, and generates learning information by matching the generated virtual information with the virtual image.

That is, the learning information is a virtual image combined with a facilitator image and a virtual reality background image, and virtual information generated by optical motion information is matched. The server transmits the learning information to a user terminal through a network. do.

Here, the indication information is information extracted from the optical motion information output from the virtual pen, and can be referred to as the purpose or function substantially intended by the facilitator as described above, and the indication information is divided into three main categories as follows. Can be distinguished.

The first indication information may be information for outputting virtual information already stored in the server. For example, if a button (virtual icon) that matches specific virtual information is displayed on the virtual image output through the monitor installed in the virtual studio, the presenter places the position of his virtual pen on the button through the monitor. Afterwards, a button may be selected as a preset operation. At this time, the server analyzes the operation (glow information) to determine that the operation (glow information) is the first indication information, and then matches the button. The virtual information can be displayed together with the virtual image currently being output.

The second indication information may be information for transforming a specific medium (hereinafter, simply referred to as a 'virtual icon') currently output in the virtual image into various forms. For example, if a virtual icon such as a book is displayed on the virtual image output through the monitor installed in the virtual studio, the presenter places the position of his virtual pen on the book through the monitor and then virtualizes it to the desired position. The operation of moving the pen may be performed. In this case, the server analyzes the operation (motion information) to determine that the operation is the second indication information, and then the presenter finally displays the virtual icon (book) currently being output. You can move it to the position of the virtual pen you are pointing to. At this time, the virtual information may be the movement of the virtual icon itself. Therefore, the learning information generated by the second instruction information may be a movement of the position of the virtual icon already output on the virtual image on the virtual image currently output.

The third indication information may be information for newly generating new virtual information not stored in the server. For example, a chart that can display a bar graph on a virtual image output through a monitor installed in a virtual studio (for example, a chart formed to display the number of male students on the X axis and the number of male students on the Y axis). ) Is displayed, the host can place his virtual pen on the chart at the point where the grade he wants and the number of male students he wants to select in the chart match, and then take a preset action. After analyzing the operation to determine that the operation is the third instruction information, a bar graph corresponding to the number of male students of the grade selected by the facilitator may be generated and output on the currently output chart. In this case, the virtual information may be a newly output bar graph. Accordingly, the learning information generated by the third instruction information includes a chart (which may be a virtual reality background image or a virtual icon) already output on the virtual image, and a bar graph (virtual information) newly generated by the user. It can be combined information.

Meanwhile, in the above description and the following description, the information finally output through the server, that is, the information output from the user terminal will be described using the term learning information, but the term learning information is merely used for convenience of description. As the present invention is not limited to the field corresponding to the dictionary term learning. That is, the present invention may be widely used for education in kindergarten, elementary and junior high school, university or various institutes, but may also be used for election broadcasting to inform various election results, and for broadcasting to provide various information such as weather and securities. It can also be used as.

However, hereinafter, the present invention will be described with reference to embodiments that can be applied to fields related to learning for convenience of description.

The user terminal 30 performs a function of outputting the user to check the learning information transmitted from the server. Such a user terminal may be a device used by an individual such as a personal computer (PC), an iPhone, an iPad, a PDA, and the like, which are commonly used today, and a device that many users can watch together such as a TV or a monitor. It may be.

2 is a flowchart illustrating a method for providing learning information using virtual reality according to the present invention. In addition, Figure 3 is a flow chart illustrating in detail the process of extracting the indication information of the learning information providing method using the virtual reality according to the present invention.

In order to implement the learning information providing method using the virtual reality according to the present invention, the server is required for the implementation of the optical recognition program and virtual reality that can extract the indication information by analyzing the information on the virtual reality background image, optical motion information Various applications are stored (100). Meanwhile, the virtual reality referred to in the present invention refers to a virtual reality that is output from a user terminal by mixing a virtual reality background image and a host image, and may be referred to simply as a virtual image. That is, the present invention outputs virtual information on a virtual image (virtual reality), and the information transmitted to the user by the virtual image and the virtual information is learning information.

In the virtual studio, as described above, the blue screen 12, the camera 11, and the monitor 14 are basically provided. When the host takes an operation with the virtual pen 13 in the virtual studio, the server Extracts only the facilitator image from the image collected from the camera 11 and combines the extracted facilitator image with the virtual reality background image to generate and store a virtual image or transmit the image to the user terminal 30, while transmitting the light from the camera. Instruction information is extracted from the motion information (200).

That is, the facilitator selects a button of the virtual pen 13 held in the hand and outputs light when a special virtual information is to be provided to the user watching the learning information transmitted from the server through the user terminal. In the state of being present, the characters, symbols, images and the like are imaged in the real space of the virtual studio. At this time, the facilitator checks his position or the position of the virtual pen in the virtual image output through the monitor 14, places the virtual pen at a desired position among the virtual images, takes a preset operation, and provides optical motion information. You can send it to the server.

At this time, the server determines whether the light is being received from the image transmitted through the camera, and if it is determined that the light is being received, the optical recognition program is driven to analyze the light motion information and extract the instruction information intended by the facilitator. .

Here, a specific method of extracting a movement path of light using the light recognition program may be variously set, and an example thereof is illustrated in FIG. 3. That is, the server extracts a movement path of light output through the virtual pen (hereinafter, simply referred to as 'operator motion') by using the optical motion information generated by the operator's motion of moving the virtual pen. The operation is stored in advance and compared with the indication information for determination. As a result of the comparison, when there is determination instruction information that matches the presenter's operation, the server extracts instruction information that matches the determination support information.

To this end, first, the server detects a pixel corresponding to a color range emitted from the virtual pen 13 in the original image, that is, the facilitator image (202). This detection is detected from the light motion information transmitted from the camera.

Next, the server generates a mask image from the detected pixels (204).

Next, the server calculates 206 a masked pixel range region.

Next, the server determines whether the size of the masking area is equal to or less than a predetermined range (208).

As a result of the determination, if it is not below the predetermined range, the outer boundary removing filter for the masking region is applied to make the masking region within a predetermined range (210). In other words, if the masking area is too large, the presenter may not be able to correct the position indicated by the virtual pen, thereby reducing the masking area. In addition, even in the case of light generated from a light source other than the virtual pen or light reflected from an object having the same color as the light generated by the virtual pen, the masking area exceeds a predetermined range, in which case the detected masking area is excluded. Can be.

As a result of the determination, if less than a predetermined range, the server determines the center point of the masking area as the position of the virtual pen (212).

When the location of the virtual pen, ie, the location indicated by the facilitator through the virtual pen, is determined through the above processes, the server continuously tracks the location of the virtual pen through the above processes to extract the facilitator motion and extracts the extracted facilitator motion. In operation 214, the instruction information to be instructed by the presenter is extracted by comparing with the predetermined determination indication information. Here, the determination instruction information refers to information that may correspond to a facilitator operation indicating a movement path of the virtual pen, and each determination instruction information is matched with any one of the first indication information and the third indication information. Accordingly, when the determination instruction information having the information that matches the operator operation is extracted by analyzing the presenter operation and the determination instruction information, the server extracts the indication information matching the extracted determination instruction information.

When the indication information is extracted according to the above-described process, the controller determines in detail what information the indication information indicates (300). That is, when the indication information is classified into three types as described above, the server determines what function the indication information extracted in the indication information extraction process 200 performs in detail.

For example, whether the instruction information is to output predetermined virtual information (first instruction information) or to change a virtual icon (second instruction information) or to generate and output new virtual information ( Third indication information).

Subsequently, according to the determined content, the server performs a function related to the first indication information (400), performs a function related to the second indication information (500), or performs a function related to the third indication information (600). After generating the virtual information, the generated virtual information is combined with the virtual image and finally outputs the learning information (700).

On the other hand, the indication information is divided into three, but may be classified more variously, and in addition to the large classification, can be divided into the middle classification, small classification bar, the server performs the function required finally the indication information. .

Hereinafter, an example corresponding to the three pieces of indication information as described above will be described with reference to FIGS. 4 to 9.

4 and 5 are exemplary views in which learning information is provided according to first instruction information for outputting previously stored virtual information in a method of providing learning information using virtual reality according to the present invention. It is shown. Meanwhile, in the following description, the virtual icon may be a virtual reality background image, but if the virtual reality background image is composed of several blocks, it may be any one of the blocks constituting the virtual reality background image. If the virtual reality background image is composed of one object, the virtual reality background image may be a virtual icon.

For example, when the virtual reality background image 910 is a screen composed of various buttons as shown in FIG. 4, the virtual icon 911 may be any one of the buttons constituting the virtual reality background image. . Meanwhile, the entire screen including the virtual reality background image, the virtual icon, and the host image may be a virtual image as described above. That is, in the case of the virtual reality in which the presenter image 920 is displayed on the virtual image (or the virtual reality background image) as described above, the server may detect the movement of the virtual pen 13 attached to the presenter's finger or hand. The tracking information is extracted as described above (200). Here, the virtual reality background image 910 is configured in the form of a plurality of buttons, and among these buttons, the button 911 selected by the user may be referred to as a virtual icon.

At this time, as described above, the operation of the presenter who moves the virtual pen, that is, the presenter's motion that refers to the movement path of the light output through the virtual pen, is analyzed in the form of 'V', and the instruction information on the shape is displayed. In the case of the first instruction information for outputting the pre-stored virtual information matched with the virtual icon placed at the position (300), the server extracts the virtual icon 911 outputted at the coordinates at which the moderator's operation was made. Meanwhile, the virtual information matched with the extracted virtual icon is output to a predetermined position on the virtual image as shown in FIG. 4.

For example, in the virtual reality illustrated in FIG. 4, when the moderator performs the moderator action in the form of 'V' on the virtual icon 911 marked as 'graph', the server is matched with the corresponding virtual icon 911. You can output the graph on the virtual image.

In addition, as illustrated in FIG. 5, when the globe 910 is output as a virtual reality background image (or a virtual icon), the presenter may perform the process as described above on a specific location of the globe, for example, a map of Korea. If the moderator action is taken, the server may output the map of Korea by judging the moderator action as the instruction information to enlarge and output the map of Korea as shown in FIG. 5.

In this case, the output virtual information may be a map as described above, but may be a three-dimensional model that is lifted up in a form of digging out the corresponding area on the globe, and may also be provided with a table of the population, resources, etc. of the corresponding area.

Meanwhile, in the case where the moderator operation is performed in FIG. 4 and FIG. 5, the virtual icon does not match the preset virtual information as described above, the server may not take a separate reaction.

However, in this case, the presenter's operation may correspond to the second instruction information. Therefore, the server may output figures, letters, numbers, etc. according to the presenter's operation on the virtual image.

In addition, in FIG. 5, when the presenter motion (the movement path of the light of the virtual pen) is moved from the left end of the globe to the right end, the presenter motion does not match any indication information for outputting preset virtual information. If it matches the presenter's action corresponding to the second indication information, the server may determine the presenter's action as the second indication information. In this case, the globe displayed as the virtual reality background image (or a virtual icon) is displayed on the left side. It may be rotated to the right, ie counterclockwise.

That is, the server determines the first indication information, the second indication information, and the third indication information for one virtual icon 910 or 911 in combination, and outputs the respective virtual information accordingly.

In detail, the virtual information according to the first indication information according to the present invention is virtual information (graph or an enlarged map of Korea) that is previously stored in the server by matching with the virtual icon 910, as described above. The virtual information by the second indication information refers to information for rotating or moving the virtual icon according to the operator's operation.

6 and 7 are exemplary diagrams of providing learning information according to second instruction information for changing a virtual icon in a method of providing learning information using virtual reality according to the present invention, and showing a screen output through a user terminal. will be.

As described above, the second instruction information refers to information for rotating or moving the virtual icon according to the operator's operation. When the instruction information extraction result is the second instruction information, the server outputs various kinds of information output on the virtual image. The virtual icon can be moved or rotated according to the moderator's motion.

For example, as shown in FIG. 6, on the virtual image in which the mobile phone 910 is output as a virtual icon, the moderator operation starts from the first coordinate where the mobile phone is located and ends at another second coordinate. In this case, the server may grasp the operator's operation as the second instruction information and output virtual information for moving the mobile phone from the first coordinate to the second coordinate.

Also, as shown in FIG. 7, on the virtual image in which the book 910 is output as a virtual icon, the presenter's motion is the first coordinate at one end of the first page, and the second coordinate at one end of the second page. When moving to, the server may grasp the host's operation as the second instruction information and output virtual information for turning over the bookshelf of the book.

At this time, the present invention may be provided with a separate e-book server having the e-book information, in order to show the contents of the book as described above, may be linked to the e-book server and the server applied to the present invention. In addition, the present invention may allow the server to read the text of the book directly by using a technology such as TTS, in which case, the presenter performs the presenter's operation such as handing over the bookcase as described above according to the contents read by the server. By doing this, more realistic virtual reality can be provided.

Meanwhile, even in the virtual reality illustrated in FIGS. 6 and 7, when the presenter's motion identified as the first instruction information is extracted, the server may extract the virtual information corresponding to the first instruction information, for example, the animal in the book page. An enlarged picture or the like can be output on the virtual image.

8 and 9 are exemplary views of providing learning information according to the third instruction information for generating and outputting new virtual information in the learning information providing method using the virtual reality according to the present invention. The screen is displayed.

As described above, the third indication information refers to information for generating new virtual information that is not stored and outputting the same on the virtual image. The server indicates that the indication information extracted in the process of extracting the indication information is the third indication information. In this case, various new virtual information required by the third indication information may be generated and output.

For example, as shown in FIG. 8, a moderator operation of sequentially inputting the characters '1 + 1 =' at a position corresponding to a blackboard that is a virtual icon (or a virtual reality background image) 910. , The server recognizes the characters '1', '+', '1' and '=' independently, and before and after the symbol '+', it outputs the characters judged as numbers and the result Since there is a symbol '=' to be recognized, it can be recognized as adding, and the numbers 1 and 2 plus 2 can be output to the virtual icon (blackboard) 910 of the virtual reality, so that the learners input the presenter. In addition to one piece of information, you can see the number '2'.

That is, when a moderator action of 'l' is input, if there is no first instruction information or second instruction information matching the operator action of 'l' in the corresponding coordinates, the third instruction to output it as it is is input. It grabs the information and prints 'l' on the virtual icon blackboard.

Subsequently, the server outputs the '+' and 'l' to the virtual image according to the same principle.

On the other hand, after outputting the character '=', the server may determine '1 + 1 =' as a whole equation and automatically output the number '2' after '='.

However, when the new moderator action is input after '=', the sum value may not be automatically output when the sum value is set to be automatically output. That is, in this case, when another moderator operation such as 'V' is entered after '=', the server determines that the moderator operation is the sum value output instruction, and the server outputs the sum value.

In this case, the facilitator may ask a question to the students who are monitoring the corresponding contents through their respective user terminals 30, and thus the students may input answers to the calculation through their respective user terminals. . The input answer is transmitted to the server, and the server knowing the user information or the terminal information of each user terminal outputs the answer transmitted by each user on the virtual image as shown in FIG. The answer may be output on the virtual image by comparing with the sum value or the value input by the moderator. At this time, in the latter case, that is, in order to compare the values input by the facilitator with the values input by the students, the server recognizes the number input by the facilitator as a number '1' instead of simply a character. It should be equipped with the bar, such a character recognition technology can be applied to the techniques currently used in general.

That is, the present invention does not unilaterally transmit the learning information output of the virtual information on the virtual image to the user terminal, but also output the information received from each user terminal on the virtual image through a separate operation or processing. You can also

Therefore, when the virtual reality is a virtual reality for foreign language learning, the presenter can write various words or conversations required in the virtual reality to the virtual space of the virtual studio through the virtual pen, and the server moves the path of the light output from the virtual pen. Analyze the characters, numbers or images written by the facilitator can be inserted into the virtual image as letters, numbers or images. In addition, users (learners) monitoring the virtual reality through the user terminal can not only check the letters, numbers or images written on the virtual image by the host in the virtual reality is output through the user terminal, and accordingly various characters Alternatively, the number may be transmitted to the server, and the server may output the information transmitted from the user terminal on the virtual image.

In addition, FIG. 9 illustrates a virtual image in which the table 910 is output as a virtual icon (or a virtual reality background image). For example, the virtual table may be A, B, C, D, E, and F items, respectively. In the case of a chart for displaying a graph that matches any one of numbers from 10 to 100 (in Fig. 9, a graph in which numbers are matched from A to C is already output). If you select the intersection point of the desired item (the presenter indicates the top of item D in FIG. 9) and the desired value (the presenter indicates the position corresponding to approximately 60 in FIG. 9), the server selects the intersection. 3 may be identified as the third instruction information, and a graph (referring to a graph indicated by a dotted line) may be output at a corresponding intersection as shown in FIG. 9. That is, in FIG. 9, the graph is output as virtual information.

In detail, it can be seen that the graph output as virtual information in FIG. 9 is not pre-stored or set in value, but newly generated by coordinates arbitrarily selected by the facilitator on the chart board.

Accordingly, the embodiment as illustrated in FIG. 9 may be applied to a method for allowing a host to modify in real time the turnout rate of each candidate that is changed in real time in various election broadcasts.

On the other hand, the present invention can be implemented in various ways as well as the embodiments as described above.

For example, according to the first indication information, the present invention may output virtual information such as marking a character, a figure, an underline or a road on a map according to the first indication information.

In addition, the present invention can move, rotate, enlarge or reduce the virtual icon on the virtual image according to the second instruction information.

In addition, the present invention may perform an operation of spreading or turning over a document output as a virtual icon according to the second indication information. That is, according to the present invention, when the presenter selects a book that the children want to read as a virtual pen, the presenter takes out the selected book and spreads it in the center of the screen, and the presenter turns the page of the book according to the second instruction information. You can also read to students.

In addition, the present invention using the field where the dinosaurs play virtual reality background image, the host (teacher) to go to the dinosaurs that students want to see close up the dinosaur (virtual icon) with a virtual pen and explain about the related specifications You can do that. In this case, the present invention performs a combination of the virtual information (the specification table in which the relevant specification appears) and the virtual information according to the second instruction information (showing while turning the dinosaur three-dimensionally) according to the first instruction information.

As the same concept as above, the present invention allows the host to select, move, rotate, and enlarge the exhibits (virtual icons) that the children want to see using the virtual reality background image as a virtual pen to observe the exhibits in detail. You may want to expand the table or graph to explain the specifications.

In addition, according to the third indication information, various graphs such as a line graph, a bar graph, a pie graph, and the like may be output as virtual information on a table output as a virtual icon or a virtual reality background image.

On the other hand, as a moderator operation for generating the indication information as described above, not only 'V' as described above, but also various gestures, for example, various shapes such as 'O, X, triangle, square', and the like may be applied.

It will be understood by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

10: virtual studio 11: camera
12: blue screen 13: virtual pen
14: monitor
910: virtual reality background image or virtual icon
911: virtual icon 920: host video

Claims (10)

The presenter image is extracted from a video signal including a facilitator image received from a camera and a facilitator image of a facilitator carrying a virtual pen and light motion information, which is motion information of light output from the virtual pen, and extracted into the virtual reality background image. Generating a virtual image by combining the presenter image;
Extracting the optical motion information from the image signal, determining the facilitator motion by using the extracted optical motion information, and extracting the indication information using the optical motion information;
Extracting virtual information corresponding to the first indication information if the indication information is first indication information for outputting previously stored virtual information; And
Generating and outputting learning information combining the virtual information extracted by the first indication information with the virtual image,
Extracting the virtual information corresponding to the first indication information,
If the indication information is the first indication information, determining whether a virtual icon that can be matched with the first indication information is output on a coordinate at which the facilitator motion is performed on the virtual image;
Not performing a separate operation on the first indication information when it is not output as a result of the determination; And
And if it is outputted, extracting the virtual information matched with the virtual icon. delete The method of claim 1,
Extracting the indication information,
Detecting pixels corresponding to a color range of light emitted from the virtual pen using the light motion information;
Generating mask images corresponding to each of the detected pixels;
Calculating a range of a masking area formed by the mask images;
Determining whether the size of the masking area is less than or equal to a preset range;
If the determination result is not less than the preset range, applying an outer boundary elimination filter for the masking region so that the masking region is within a predetermined range, and determining the center point of the masking region as the position of the virtual pen. ;
Determining the center point of the masking area as the position of the virtual pen when the determination result is less than or equal to a preset range;
Determining the presenter's operation through a continuous movement path of the virtual pen, and extracting the indication information matched with the determining indication information corresponding to the presenter's operation from preset determination indication information. How to provide learning information. delete The method of claim 1,
The facilitator operation, learning information providing method using a virtual reality, characterized in that any one of the lines, figures, letters, numbers. delete The method of claim 1,
If the instruction information is not the first instruction information and is second instruction information for changing the virtual icon output on the virtual image, the virtual information for which the virtual icon is changed according to the second instruction information is extracted. Learning information providing method using a virtual reality further comprising the step of. The method of claim 7, wherein
Extracting the virtual information in which the virtual icon is changed according to the second indication information,
Determining whether the indication information is the second indication information if the indication information is not the first indication information;
If it is not determined that the second indication information is determined, not performing a separate operation on the indication information;
Determining, if the second indication information, on the virtual image, determining whether a virtual icon that can be matched with the second indication information is output on a coordinate at which the facilitator operation is performed;
If the virtual icon is not output, not performing a separate operation; And
And if the virtual icon is output, extracting virtual information in which at least one of a position, a size, and a rotation direction of the virtual icon is changed according to the second indication information. The method of claim 1,
If the indication information is not the first indication information and is third indication information for generating and outputting new virtual information, generating and extracting new virtual information according to the third indication information. Learning information providing method using. The method of claim 9,
The virtual information extracted according to the third indication information,
Learning information providing method, characterized in that at least one of letters, figures, numbers, graphs, pictures.

Images