KR102359253B1 - Method of providing non-face-to-face English education contents using 360 degree digital XR images - Google Patents

Abstract

The present invention relates to a non-face-to-face English educational content providing method using XR images which comprises the following steps of: receiving, by a processor, a request of first educational content from an eXtended reality (XR) device through a communication unit; receiving, by the processor, a first VR image associated with the first educational content from a virtual reality (VR) image providing device; and providing, by a processor, the first educational content using a first XR image generated based on the first VR image to the XR device through the communication unit.

Description

Method of providing non-face-to-face English education contents using 360 degree digital XR images

The present invention relates to a method of providing non-face-to-face English education contents using a 360 degree XR digital image.

Demand for non-face-to-face and non-contact education is growing with the epidemic of infectious diseases such as Corona 19. Online education is being used in public education and private education as a way to meet this demand. Such online education is performed by the student playing the previously created and provided educational content using his/her own terminal, or the lecture is conducted through video while the instructor and the student are connected at the same time.

However, in the case of students with relatively low concentration, such as infants and children, the online education according to the prior art is inevitably less efficient than the offline education due to the lack of concentration. Since it is difficult to communicate with each other in the online environment, it is necessary to develop an education system to induce the interest of students with relatively low concentration.

Published Patent 10-2003-0017850

An object of the present invention is to provide a method for providing non-face-to-face English educational content using XR images so that even students with relatively low concentration, such as infants and children, can immerse themselves in the lecture in order to solve the above problems.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, in the non-face-to-face English educational content providing method using an XR image according to an embodiment of the present invention, an XR image is generated based on a VR image and provided to the XR device.

A method of providing non-face-to-face English educational content using an XR image, the method comprising: receiving, by a processor, a request for first educational content from an XR (eXtended Reality) device through a communication unit; receiving, by the processor, a first VR image associated with a first educational content from a virtual reality (VR) image providing device; and providing, by a processor, the first educational content using a first XR image generated based on the first VR image to the XR device through a communication unit.

The providing of the first educational content may include, by a processor, outputting the first VR image to a display; obtaining, by the processor, a first instructor image through a camera; generating, by a processor, a first XR image by synthesizing the first VR image and the first instructor image; and providing, by a processor, the first XR image to the XR device through a communication unit.

The first instructor image is an image explaining the first object displayed in the first VR image.

The generating of the first XR image may include: generating, by a processor, a 3D virtual space based on the first VR image; extracting, by the processor, a second object for the instructor from the first instructor image; and inserting, by a processor, the second object into the virtual space, wherein the inserting includes inserting the second object into an area in the virtual space except for an area in which the first object is located. .

The providing of the first educational content may include: receiving, by a processor, voice data of a learner from the XR device through a communication unit; obtaining, by the processor, a second instructor image associated with the student's voice data; and generating, by the processor, a second XR image by synthesizing the first VR image and the second instructor image.

The details of other embodiments are included in the detailed description and drawings.

According to the present invention, there are one or more of the following effects.

First, there is an effect of improving immersion in non-face-to-face English learning by students such as infants and children using XR images.

Second, by using XR, there is an effect of effective communication between the instructor and the students.

Effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description of the claims.

1 is a block diagram of a system according to an embodiment of the present invention.
2 is a control block diagram of an apparatus for providing educational content according to an embodiment of the present invention.
3 is a control block diagram of an XR apparatus according to an embodiment of the present invention.
4 is a signal flow diagram of a system according to an embodiment of the present invention.
5 is a flowchart of an apparatus for providing educational content according to an embodiment of the present invention.
6 is a diagram referenced for explaining the operation of a system according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

1 is a block diagram of a system according to an embodiment of the present invention.

Referring to FIG. 1 , an education system 1 is a system for performing non-face-to-face education using eXtended Reality (XR) technology. The education system 1 may be used for non-face-to-face English education. The education system 1 may be used for teaching subjects other than English.

The education system 1 may be utilized in the public education field that provides educational contents to students in kindergartens, elementary schools, middle schools, and high schools. In addition, the education system 1 may be utilized in private education fields such as private institutes and online education platforms.

A learner with relatively low concentration, such as infants or children, may be a target for providing English education contents using the education system 1 .

When generating XR images, an instructor image is required, where the instructor is preferably a native speaker. According to an embodiment, the instructor may be a Korean instructor.

The education system 1 includes a VR image providing device 20 , an educational content providing device 100 , and an eXtended Reality (XR) device 300 . The educational content providing apparatus 100 and the XR apparatus 300 may communicate through a wired or wireless network. In the wired or wireless network, an infrastructure provided by a third party may be utilized.

On the other hand, although the education performed through the education system 1 is described as an example of English education, the education system 1 is not limited thereto, and it is also used in education of various subjects such as music, history, science, mathematics, Korean, and social studies. can be used

2 is a control block diagram of an apparatus for providing educational content according to an embodiment of the present invention.

Referring to FIG. 2 , the educational content providing apparatus 100 generates an XR image based on the VR image received from the VR image providing apparatus 20 , and provides the generated XR image to the XR apparatus 300 . can

Educational content providing apparatus 100, communication unit 110, camera 120, microphone 130, display 150, speaker 160, memory 140, processor 170, interface 180 and power supply A supply unit 190 may be included. According to an embodiment, the camera 120 and the microphone 130 may be implemented to be physically separated from the remaining components of the educational content providing apparatus 100 .

The communication unit 110 may exchange signals with an electronic device (eg, the XR device 300 ) external to the educational content providing device 100 .

The communication unit 110 may include at least one of a transmit antenna, a receive antenna, a radio frequency (RF) circuit capable of implementing various communication protocols, and an RF element to perform communication.

The communication unit 110 may exchange signals with an electronic device (eg, the XR device 300 ) external to the educational content providing device 100 using a mobile communication network (eg, 3G, 4G, 5G). can

The camera 120 may photograph the instructor. The camera 120 may include at least one lens, at least one image sensor, and a processing unit electrically connected to the image sensor to process a received signal. The camera 120 may be at least one of a mono camera and a stereo camera.

A plurality of cameras 120 may be disposed with the instructor at the center, and in a form that surrounds the instructor by 360 degrees. In this case, the position of the camera 120 may be arranged based on the VR image. The focal length of the camera 120 may be set based on a distance relationship between the VR image and the instructor.

The microphone 130 may convert an acoustic signal into an electrical signal.

The display 150 may display graphic objects corresponding to various pieces of information.

The display 150 is a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (flexible display). ), a three-dimensional display (3D display), and may include at least one of an e-ink display (e-ink display).

The display 150 may implement a touch screen by forming a layer structure with the touch sensor or being integrally formed.

The display 150 may output a VR image provided by the VR image providing apparatus 20 .

The display 150 may be paired with the camera 120 and disposed around the camera 120 . The instructor can recognize the distance between the object in the VR image and himself while looking at the display 150 .

The speaker 160 may convert an electrical signal into an audio signal and output it.

The memory 140 is electrically connected to the processor 170 . The memory 140 may store basic data for the unit, control data for operation control of the unit, and input/output data. The memory 140 may store data processed by the processor 170 . The memory 140 may be configured as at least one of ROM, RAM, EPROM, flash drive, and hard drive in terms of hardware. The memory 140 may store various data for the overall operation of the electronic device 100 , such as a program for processing or controlling the processor 170 . The memory 140 may be implemented integrally with the processor 170 . According to an embodiment, the memory 140 may be classified into a sub-configuration of the processor 170 .

Processor 170, ASICs (application specific integrated circuits), DSPs (digital signal processors), DSPDs (digital signal processing devices), PLDs (programmable logic devices), FPGAs (field programmable gate arrays), processors (processors), controller It may be implemented using at least one of controllers, micro-controllers as microphones, microprocessors as microphones, and electrical units for performing other functions.

The processor 170 is electrically connected to the communication unit 110 , the camera 120 , the microphone 130 , the display 150 , the memory 140 , the interface 180 , and the power supply unit 190 to exchange signals. can

The interface 180 may exchange signals with an external electronic device by wire or wirelessly. The interface 180 may be configured of at least one of a communication module, a terminal, a pin, a cable, a port, a circuit, an element, and a device.

The power supply unit 190 may supply power to the educational content providing apparatus 100 . The power supply unit 190 may receive power from the battery and supply power to each unit of the educational content providing apparatus 100 .

3 is a control block diagram of an XR apparatus according to an embodiment of the present invention.

Referring to FIG. 3 , the XR apparatus 300 may be implemented as a head-mount display (HMD), a wearable device, or the like.

The XR device 300 analyzes 3D point cloud data or image data acquired through various sensors or from an external device to generate location data and attribute data for 3D points, thereby providing information on surrounding space or real objects. It can be obtained and output by rendering the XR object to be output. For example, the XR apparatus 300 may output an XR object including additional information on the recognized object to correspond to the recognized object.

The XR apparatus 300 may perform the above operations by using a learning model composed of at least one or more artificial neural networks. For example, the XR device 300 may recognize a real object from 3D point cloud data or image data using a learning model, and may provide information corresponding to the recognized real object. Here, the learning model may be directly learned from the XR device 300 or learned from an external device such as an AI server.

In this case, the XR device 300 may perform an operation by generating a result using the direct learning model, but may also perform an operation by transmitting sensor information to an external device such as an AI server and receiving the result generated accordingly. there is.

The XR device 300 includes a camera 310 , a display 320 , a sensor 330 , a processor 340 , a memory 350 , and a communication module 360 .

The communication module 360 performs wired/wireless communication with an external device or server, for example, Wi-Fi, Bluetooth, etc. may be used as short-distance wireless communication, and for example, LTE, LTE-A as long-distance wireless communication. , 5G, etc. may be used.

The camera 310 may capture an environment around the XR device 300 and convert it into an electrical signal. The image captured by the camera 310 and converted into an electrical signal may be stored in the memory 350 and then displayed on the display 320 through the processor 340 . In addition, the image may be directly displayed through the display 320 using the processor 340 without being stored in the memory 350 . Also, the camera 310 may have an angle of view. In this case, the angle of view means, for example, an area capable of detecting a real object positioned around the camera 310 . The camera 310 may detect only real objects located within the angle of view. When the real object is located within the angle of view of the camera 310 , the XR apparatus 300 may display the augmented reality object corresponding to the real object. Also, the camera 310 may detect the angle between the camera 310 and the real object.

The sensor 330 may include at least one sensor, for example, a gravity sensor, a geomagnetic sensor, a motion sensor, a gyro sensor, an acceleration sensor, an inclination sensor, a brightness sensor, an altitude sensor, and an olfactory sense. and sensing means such as a sensor, a temperature sensor, a depth sensor, a pressure sensor, a bending sensor, an audio sensor, a video sensor, a global positioning system (GPS) sensor, and a touch sensor. Furthermore, although the display 320 may be of a fixed type, a liquid crystal display (LCD), an organic light emitting diode (OLED), an electro luminescent display (ELD), a micro LED (M-LED) to have high flexibility can be implemented with At this time, the sensor 330 is designed to detect the degree of bending and bending of the display 320 implemented with the aforementioned LCD, OLED, ELD, M-LED (LED as a microphone), and the like.

The memory 350 not only has a function of storing an image captured by the camera 310, but also has a function of storing all or part of a result value obtained by performing wired/wireless communication with an external device or server. .

The XR device 300 may further include a learning processor. The learning processor may be configured separately from the processor 340 or may be classified as a sub-concept of the processor 340 .

The XR device 300 may be equipped with a learning model. The learning model may be implemented in hardware, software, or a combination of hardware and software. When a part or all of the learning model is implemented in software, one or more instructions constituting the learning model may be stored in the memory 350 .

The learning processor according to embodiments of the present invention may be communicatively connected to the processor 340, and may repeatedly learn a model composed of an artificial neural network using training data. An artificial neural network is an information processing system in which a number of neurons called nodes or processing elements are connected in the form of a layer structure by modeling the operating principle of biological neurons and the connection relationship between neurons. Artificial neural network is a model used in machine learning, and it is a statistical learning algorithm inspired by neural networks in biology (especially the brain in the central nervous system of animals) in machine learning and cognitive science. Machine learning can be used interchangeably with machine learning. Machine learning is a branch of artificial intelligence (AI), a technology that gives computers the ability to learn without an explicit program. Machine learning is a technology that studies and builds algorithms and systems that learn based on empirical data, make predictions, and improve their own performance. Accordingly, the learning processor according to embodiments of the present invention may determine the optimized model parameters of the artificial neural network by iteratively learning the artificial neural network, and infer a result value with respect to new input data. Accordingly, the learning processor may analyze the user's device usage pattern based on the user's device usage history information. Additionally, the learning processor may be configured to receive, classify, store, and output information to be used for data mining, data analysis, intelligent decision-making, and machine learning algorithms and techniques.

The processor 340 according to embodiments of the present invention may determine or predict at least one executable operation of the device based on data analyzed or generated by the learning processor. In addition, the processor 340 may request, search, receive, or utilize the data of the learning processor, and may control the XR device 300 to execute a predicted operation or an operation determined to be desirable among at least one executable operation. there is. The processor 340 according to embodiments of the present invention may perform various functions for implementing intelligent emulation (ie, a knowledge-based system, an inference system, and a knowledge acquisition system). It can be applied to various types of systems (eg, fuzzy logic systems), including adaptive systems, machine learning systems, artificial neural networks, and the like. That is, the processor 340 predicts a future user device usage pattern based on data analyzed by the user's device usage pattern in the learning processor, so that the XR apparatus 300 can be controlled to provide a more suitable XR service to the user. there is.

4 is a signal flow diagram of a system according to an embodiment of the present invention.

5 is a flowchart of an apparatus for providing educational content according to an embodiment of the present invention.

6 is a diagram referenced for explaining the operation of a system according to an embodiment of the present invention.

Referring to the drawings, the operation of the XR device 300 is performed under the control of the processor 340 , and the operation of the educational content providing device 100 is performed by the processor 170 unless otherwise specified in the following description. done under control.

The XR device 300 may drive a non-face-to-face education application using the XR image (S401). The XR device 300 may receive a user input through the sensor 330 to drive an application. For example, the XR device 300 may drive an application based on a signal generated through a motion sensor. The XR device 300 may drive an application based on a signal received from the user's mobile terminal paired with the XR device 300 through the communication module 360 .

The XR device 300 may select the first educational content (S404). The XR device 300 may receive a user input through a sensor and select the first educational content. The XR device 300 may receive a user input through the communication module 360 to select the first educational content.

The XR device 300 may request the first education content from the education content providing apparatus 100 through the communication module 360 (S407). The educational content providing apparatus 100 may receive a request for the first educational content from the XR device 300 through the communication unit 110 (S407).

When the first educational content is requested from the XR device 300 , the processor 170 may request the VR image providing device 20 for a first VR image associated with the first educational content ( S411 ).

The processor 170 may receive a first VR image associated with the first educational content from the VR image providing apparatus 20 ( S413 ).

A virtual reality (VR) image may be defined as an image for providing a virtual space. The VR image may be a 360-degree VR image captured by a 360-degree camera. The VR image may be described as an image captured to recognize virtual reality from the user's point of view of the XR device 300 .

The VR image may be an image of a space related to educational content. For example, if the English education content relates to a specific situation, the VR image may be an image of a space suitable for the corresponding situation. For example, if the English education content relates to a specific country, the VR image may be an image of a landmark of the corresponding country. For example, if the English education content relates to a specific place (eg, sea, mountain, river, beach, etc.), the VR image may be an image of the corresponding place.

The processor 170 may provide the first educational content using the first XR image generated based on the first VR image to the XR device 300 through the communication unit 110 ( S420 ).

Extended reality (eXtended Reality, XR) may refer to a form of electronically based reality that has been manipulated in any way prior to presentation to a user, including virtual reality (VR), augmented reality (AR), and mixed reality. Extended reality may consist of hybrid reality, simulated reality, immersive reality, holography, or a combination thereof. For example, “extended reality” content may include fully computer-generated content or partially computer-generated content combined with captured content (eg, real-world images).

An eXtended Reality (XR) image may be defined as an image in which interaction between reality and virtual reality is further enhanced as compared to a VR image. A VR image may be an image providing a virtual space related to educational content, and an XR image may be described as an image reflecting an image of an instructor existing in the virtual space.

Step S420 may include steps S421, S424, S427, S431, S434, S437, S441, S444, S447, and S451.

The processor 170 may output the first VR image to the display 150 (S421).

The processor 170 may acquire the first instructor image through the camera 120 (S424). The first instructor image may be an image of the instructor giving a lecture while viewing the first VR image displayed on the display 150 . The first instructor image may be an image explaining the first object 610 displayed in the first VR image.

The first instructor image is a concept including the instructor's voice acquired through the microphone 130 .

The camera 120 may be configured in plurality to photograph the instructor from various angles. The plurality of cameras 120 may be disposed so that at least a portion of the respective angles of view overlaps each other. The processor 170 may synthesize the images obtained from the plurality of cameras 120 to generate an image viewing the instructor from 360 degrees.

According to an embodiment, the plurality of cameras 120 may be configured as a stereo camera. The processor 170 may synthesize the stereo images obtained from the plurality of cameras 120 to generate an image viewing the instructor from 360 degrees while expressing the depth of the instructor.

The processor 170 may generate a first XR image by synthesizing the first VR image and the first instructor image (S427).

Step S427 may include steps S510, S520, and S530.

The processor 170 may generate the 3D virtual space 600 based on the first VR image (S510).

The processor 170 may extract the second object 620 of the instructor from the first instructor image (S520).

The processor 170 may insert the second object 620 into the virtual space 600 ( S530 ). The processor 170, in the inserting step (S530), the first object 610 in the virtual space 600 based on the viewpoint viewed by the user (eg, a student) of the XR device 300 is located The second object 620 may be inserted in an area other than the area.

The camera 120 may be configured in plurality to photograph the instructor from various angles. The plurality of cameras 120 may be disposed so that at least a portion of the respective angles of view overlaps each other. The processor 170 may synthesize the images obtained from the plurality of cameras 120 to generate an image viewing the instructor from 360 degrees.

According to an embodiment, the plurality of cameras 120 may be configured as a stereo camera. The processor 170 may synthesize the stereo images obtained from the plurality of cameras 120 to generate an image viewing the instructor from 360 degrees while expressing the depth of the instructor.

The processor 170 may insert the second object 620 into the virtual space 600 by reflecting the depth data for the instructor. For example, the processor 170 may receive the instructor's depth data obtained from the stereo camera 120 of the educational content providing apparatus 100 . When the second object 620 is inserted into the virtual space 600 , the processor 170 reflects the depth data of the second object 620 to determine the size of the second object 620 in the virtual space; At least one of a shape and a position may be determined.

The processor 170 may adjust the depth of the second object 620 in the virtual space 600 based on the user of the XR apparatus 300 . The processor 170 may adjust the depth of the second object 620 to have the same depth as the object in the VR image described by the instructor.

When the instructor explains the object 1a, the processor 170 may analyze the lecturer's utterance to specify the object 1a in the VR image. The processor 170 may adjust the depth of the second object 620 to the first value so that the second object 620 has the same depth as the object 1a.

When the instructor switches from the description of the object 1a to the description of the object 1b, the processor 170 may analyze the lecturer's utterance and specify the object 1b in the VR image. The processor 170 may convert the depth of the second object 620 from the first value to the second value so that the second object has the same depth as the first object 1b.

The processor 170 may provide the first XR image to the XR device 300 through the communication unit 110 ( S431 ). The XR device 300 may receive the first XR image from the education content providing device 100 through the communication module 360 ( S431 ).

The XR apparatus 300 may output the first XR image to the display 320 (S434).

The XR device 300 may acquire the user's voice through the audio sensor (S437). Here, the user's voice may be a voice generated as the user utters in association with the first XR image.

The XR device 300 may transmit voice data to the education content providing device 100 through the communication module 360 (S441). The educational content providing apparatus 100 may receive the student's voice data through the communication unit 110 (S441).

The processor 170 may acquire a second instructor image related to the student's voice data (S447). The second instructor video may be a video of the instructor listening to the student's voice and reacting.

The second instructor image is a concept including the instructor's voice acquired through the microphone 130 .

The processor 170 may generate a second XR image by synthesizing the first VR image and the second instructor image (S447).

Step S447 may include steps S510, S520, and S530.

The processor 170 may generate the 3D virtual space 600 based on the first VR image (S510).

The processor 170 may extract the second object 620 of the instructor from the second instructor image (S520).

The processor 170 may insert the second object 620 into the virtual space 600 ( S530 ).

The processor 170 may provide the second XR image to the XR device 300 through the communication unit 110 (S451). The XR device 300 may receive the second XR image from the education content providing device 100 through the communication module 360 ( S451 ).

Thereafter, the XR apparatus 300 may output a second XR image to the display 320 and obtain a user's voice through an audio sensor.

Step S420 may be repeated until the XR device 300 changes the content according to the user input ( S454 ).

As described above, although the learner and the instructor are physically in different spaces, by performing non-face-to-face training through the XR image, the student can feel that they are having a conversation with the instructor in a virtual space related to the educational content. Through this, more immersion in education is increased. In addition, since the instructor conducts the class in a virtual space related to the students and the educational content, it is possible to enjoy the same effect as performing a visiting education.

When the content is changed to the second content through the XR device 300 (S454), a process related to the second educational content may be performed (S460).

Through the XR device 300 , when termination is input, the process may be terminated.

Meanwhile, the XR image described in this specification creates a virtual space by providing an image of the omnidirectional view centered on the wearer of the XR device 300 . The image may be referred to as a 360 degree XR digital image.

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that is implemented in the form of. In addition, the computer may include a processor or a control unit. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

1: Education system
20: VR image providing device
100: educational content providing device
110: communication department
120: camera
170: processor
300: XR unit

Claims (5)

receiving, by the processor, a request for first educational content from an eXtended Reality (XR) device through a communication unit;
receiving, by the processor, a first VR image for providing a virtual space as an image of a space associated with a specific situation of the first educational content from a VR (Virtual Reality) image providing device; and
providing, by a processor, the first educational content using a first XR image reflected up to an instructor image existing in the virtual space through a communication unit to the XR device;
The step of providing the first educational content,
outputting, by the processor, the first VR image to a display;
The processor acquires a first instructor image, which is an image describing a first object displayed in the first VR image, through a plurality of stereo cameras having an angle of view arranged at least partially overlapping each other, and from the plurality of stereo cameras synthesizing the obtained stereo images to generate an image viewing the instructor from 360 degrees while expressing the depth of the instructor;
generating, by a processor, a first XR image by synthesizing the first VR image and the first instructor image; and
providing, by a processor, the first XR image to the XR device through a communication unit;
The generating of the first XR image comprises:
generating, by the processor, a three-dimensional virtual space based on the first VR image;
extracting, by the processor, a second object for the instructor from the first instructor image; and
Including, by the processor, inserting the second object into the virtual space;
The inserting step is
The processor determines the size, shape, and position of the second object according to the depth data for the instructor, inserts it into the virtual space, and adjusts the depth of the second object to have the same depth as the first object,
When the lecturer's description relates to the 1a object, the lecturer's speech is analyzed to specify the 1a object in the VR image, and the second object has the same depth as the 1a object. Adjust the depth of the second object to the first value,
When the lecturer's explanation is switched from object 1a to object 1b, the lecturer's speech is analyzed to specify the 1b object in the VR image, and the second object has the same depth as the 1b object. A method of providing non-face-to-face English educational content using an XR image for converting a depth of the second object from the first value to a second value so as to have the delete delete The method of claim 1,
The inserting step is
A method of providing non-face-to-face English educational content using an XR image in which the second object is inserted in an area in the virtual space except for an area in which the first object is located. The method of claim 1,
The step of providing the first educational content,
receiving, by the processor, voice data of a learner from the XR device through a communication unit;
obtaining, by the processor, a second instructor image associated with the student's voice data; and
A method of providing non-face-to-face English education content using an XR image, comprising: a processor, generating a second XR image by synthesizing the first VR image and the second instructor image.

Images