KR102495597B1 - Method for providing online lecture content for visually-impaired person and user terminal thereof - Google Patents

Abstract

Disclosed is a method of providing online lecture contents for the visually impaired, which is performed in a user terminal. A method for providing online lecture contents according to an embodiment of the present invention includes a process of outputting text included in lecture materials as audio for a first hour, a process of outputting a lecturer's voice included in online lecture contents for a second hour, and the above. When an instructor's motion event occurs, a process of outputting a description of the instructor's motion event in voice for a third time corresponding to the occurrence time of the motion event may be included.

Description

Method for providing online lecture contents for the visually impaired and its user terminal

The present invention relates to a method of providing online lecture contents for the visually impaired and a user terminal thereof, and more particularly, to a method of providing online lecture contents for improving accessibility of the visually impaired persons to online lectures and a user terminal thereof.

Due to the spread of Corona, our daily life is rapidly changing to non-face-to-face. For example, the existing work environment is being replaced by telecommuting or video conferencing, and face-to-face lectures are rapidly being replaced by online lectures.

However, the transition from the face-to-face society to the non-face-to-face is causing the isolation of the disabled more seriously.

For example, since non-face-to-face online lecture contents are based on an image information delivery method, it is difficult for visually impaired people to properly utilize online lecture contents.

Accordingly, the development of online information providing services that can be used by the visually impaired is active.

As an example of the technology behind the present invention, Republic of Korea Patent Registration No. 10-1944187 (2019.02.07.) provides voice service to the visually impaired through an application and server for voice service using an open API for voice synthesis and an RSS feed. A method of providing is disclosed.

Specifically, the visually impaired will be able to hear lecture audio provided from online lecture contents, but it is almost impossible to grasp lecture materials appearing on the screen, or the lecturer's writing motion or writing contents.

The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a method of converting visual information included in an online lecture screen into audio and effectively conveying it to the visually impaired.

A method for providing online lecture contents for the visually impaired according to various embodiments of the present invention includes a process of outputting text included in lecture materials as audio for a first hour, and outputting a lecturer's voice included in online lecture contents for a second hour. and, when the instructor's motion event occurs, outputting a description of the instructor's motion event in audio during a third time corresponding to the occurrence time of the motion event.

The user terminal according to various embodiments of the present invention outputs the text included in the storage unit and the lecture material for the first time as voice, outputs the instructor's voice included in the online lecture content for the second time, and outputs the instructor's voice. When a motion event occurs, a processor outputting a description of the instructor's motion event as a voice during a third time period corresponding to the occurrence time of the motion event may be included.

The server according to various embodiments of the present invention outputs the text included in the storage unit and the lecture material for the first time as voice, outputs the lecturer's voice included in the online lecture content for the second time, and outputs the lecturer's motion When an event occurs, it may include a processor outputting a description of the instructor's motion event as a voice during a third time corresponding to the occurrence time of the motion event.

In a non-transitory computer readable medium storing a computer command for causing the user terminal to perform an operation when executed by a processor of a user terminal according to various embodiments of the present disclosure, the operation is performed on lecture materials for a first time. The process of outputting the included text as voice, the process of outputting the instructor's voice included in the online lecture content during the second time, and the third time corresponding to the occurrence time of the motion event when the instructor's motion event occurs. A process of outputting a description of the instructor's motion event by voice may be included.

According to various embodiments of the present invention, visual information included in the online lecture screen can be converted into audio and effectively delivered to the visually impaired. Through this, the visually impaired can effectively learn online lectures.

1 shows an online lecture system for the visually impaired according to an embodiment of the present invention.
2 is a block diagram of a user terminal according to an embodiment of the present invention.
3 is a block diagram of a server according to an embodiment of the present invention.
4 illustrates components of online lecture content according to an embodiment of the present invention.
5 illustrates audio sync of online lecture contents according to an embodiment of the present invention.
6 shows one slide of lecture materials according to an embodiment of the present invention.
7 shows one slide of lecture materials according to another embodiment of the present invention.
8 illustrates audio sync of online lecture contents according to another embodiment of the present invention.
9 is a block diagram of a method for providing online lecture contents according to an embodiment of the present invention.
10 is a detailed block diagram of a method for providing online lecture contents according to an embodiment of the present invention.
11 is a block diagram of a detailed configuration of a user terminal or server according to an embodiment of the present invention.
12 is a flowchart of a method for providing online lecture contents according to an embodiment of the present invention.

Hereinafter, the operating principle of a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings. In addition, when it is determined that a detailed description of a related known function or configuration may obscure the gist of the present disclosure in describing an embodiment of the present invention, the detailed description will be omitted. In addition, terms 7 used below are terms defined in consideration of functions in the present invention, which may vary according to the intention or custom of a user or operator. Therefore, the definitions of the terms used should be interpreted based on the content throughout this specification and the corresponding function.

1 illustrates an online lecture content providing system for the visually impaired according to an embodiment of the present invention.

Referring to FIG. 1 , a system 1 for providing online lecture contents for the visually impaired may include a server 11 and a user terminal 12 .

The server 11 may generate and provide online lecture content.

For example, the server 11 may provide a platform for creating online lecture contents.

In this case, the online lecture content creator may connect to the server 11 and produce online lecture content by producing lecture materials, filming lectures, editing lectures, and the like.

Meanwhile, the server 11 may perform deep learning on properties of online lecture files through big data including a large amount of online lecture files.

Through this, the server 11 may perform deep learning on the properties of slides included in lecture materials, the instructor's voice, and the instructor's motion included in online lecture files.

In addition, the server 11 may generate online lecture content for online lecture files through artificial intelligence (AI). Here, online lecture content may be defined as content created for the visually impaired.

The aforementioned online lecture content may include video files and audio files or only audio files.

For example, online lecture content may include audio for text included in lecture materials. In addition, online lecture content may include a lecturer's voice. In addition, the online lecture content may include a voice describing the instructor's motion event.

Each of the voices for the text included in the above-described lecture materials, the lecturer's voice included in the online lecture contents, and the voice describing the motion events may be placed in the predefined synchronized online lecture contents. This will be described in detail in FIGS. 5 to 8 to be described later.

The server 11 may structure and store the produced online lecture content. In this case, the server 11 may provide an address for online lecture content.

In addition, when a request for provision of specific online lecture contents is received from the user terminal 12 , the server 11 may transmit the corresponding online lecture contents to the user terminal 12 .

In this case, the corresponding online lecture content may be provided through streaming.

The user terminal 12 may receive online lecture contents from the server 11 and provide the contents to the visually impaired. Here, the user terminal 12 may be a variety of electronic devices such as smart phones, tablet PCs, PCs, TVs, and laptops. It is not limited thereto, and the user terminal 12 may be implemented as an acoustic device such as a radio capable of reproducing only audio.

For example, the user terminal 12 may output text included in online lecture content as voice for a predefined time period.

In addition, the user terminal 12 may output the lecturer's voice included in the online lecture content for a predefined time.

In addition, the user terminal 12 may output a description of the instructor's motion event as a voice for a predefined time period corresponding to the motion event.

According to various embodiments of the present invention described above, visual information included in the online lecture screen can be converted into audio and effectively delivered to the visually impaired. Through this, the visually impaired can effectively learn online lectures.

2 is a block diagram of a user terminal according to an embodiment of the present invention.

Referring to FIG. 2 , the user terminal 100 may include a storage unit 110 and a processor 120 .

The storage unit 110 is input/output signals or data according to operation processes of, for example, a communication module, a multimedia module, a camera module, an input/output module, a sensor module, and a touch screen under the control of the processor 120. can be saved.

Also, the storage unit 110 may store control programs and applications for controlling the user terminal 100 .

For example, the storage unit 110 may be included in the processor 120 .

For example, the storage unit 110 may be any data storage device such as ROM, RAM, or a memory card (eg, SD card or memory stick).

Also, the storage unit 110 may include a non-volatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

According to various embodiments of the present disclosure, the storage unit 110 may store online lecture content.

For example, the storage unit 110 may store audio data for text included in lecture materials, audio data for instructors included in online lecture content, and audio data for explanations of motion events by the instructor.

Here, the lecture material may be included in the online lecture content and provided as a video, or may be provided as a separate file.

The processor 120 may control overall operations and components of the user terminal 100 . Here, the processor 120 may be singular or plural.

The processor 120 may receive online lecture content from the server 11 . Here, the online lecture content may include the aforementioned online lecture content for the visually impaired.

The processor 120 may output the text included in the lecture material as a voice for the first time based on the online lecture content.

Also, the processor 120 may output the instructor's voice included in the online lecture content for a second time.

For example, the processor 120 may output the text included in the first slide of the lecture material as a voice for a first time.

Here, the processor 120 outputs the text included in the lecture material for the first time as a voice, and when the first time ends, the processor 120 starts outputting the instructor's voice included in the online lecture content after a predetermined time for the second time. The instructor's voice may be output.

Also, in the above example, the processor 120 may output an instructor's motion event.

Specifically, when an instructor's motion event occurs, the processor 120 may output a description of the instructor's motion event in voice for a third time corresponding to the occurrence time of the motion event.

Here, the fact that the third time corresponds to the occurrence time of the motion event may be interpreted as that the time of the third time corresponds to the occurrence time of the motion event. For example, the third hour may start when the instructor's motion event occurs.

The aforementioned third time may be included in the second time.

Specifically, the instructor's motion event may occur during a lecture. Accordingly, the second time, which is the time when the instructor's voice is output, may include a third time when the instructor's description of the motion event is output as a voice.

The motion events described above include an underlining motion for underlining at least some of the text included in the slide, a highlighter motion for writing a highlighter on at least some of the text included in the slide, a checking motion for one area included in the slide, and adding text to the slide. It may include at least one of a text adding motion for adding text and a text deleting motion for deleting text included in the slide.

Meanwhile, for example, the processor 120 may output the number of a slide including text among lecture slides as a voice. Through this, the visually impaired can recognize the location of the lecture they are currently listening to.

For example, the processor 120 may output a voice saying “Slide No. 1”.

In addition, the processor 120 may output a guide for the animation effect as a voice when the text included in the lecture slide includes the animation effect. Through this, a visually impaired person can recognize an animation effect.

For example, the processor 120 may output a voice of “an animation effect in which text shakes from side to side”.

Alternatively, the processor 120 may output a voice saying "an animation effect in which 'I am going to fly' is shaking from side to side" when the text is 'I am going to fly'.

Also, a tone of a voice output as a description of a motion event may be set to be different from that of an instructor.

For example, a tone of a voice output as a description of a motion event may be lower than that of an instructor.

As described above, by differentiating the tone of the voice output as a description of the motion event and the tone of the instructor's voice (tone differentiation), the visually impaired can hear the voice output as a description of the motion event while the instructor's voice is output. Even if it is output, it can be clearly recognized by distinguishing the two.

According to various embodiments of the present invention described above, a visually impaired person can effectively obtain information about text included in lecture materials, information delivered by a lecturer through voice, and information delivered by a lecturer through motion.

The operation of the user terminal 100 in FIG. 2 described above may also be performed by a server. In this case, the server may transmit and receive related data to and from the user terminal 100 so that the operation of the user terminal 100 in FIG. 2 may be performed in the user terminal 100 .

Hereinafter, the operation of the server performing the online lecture content providing method will be described in detail with reference to FIG. 3 .

3 is a block diagram of a server according to an embodiment of the present invention.

Referring to FIG. 3 , the server 200 may include a storage unit 210 and a processor 220 .

For example, the storage unit 210 may store online lecture content.

The storage unit 210 may store audio data for text included in lecture materials, audio data for instructors included in online lecture content, and audio data for explanations of motion events by the instructor.

Here, the lecture material may be included in the online lecture content and provided as a video, or may be provided as a separate file.

The processor 220 may control overall operations and components of the server 200 . Here, the processor 220 may be singular or plural.

The processor 220 may create online lecture contents from lecture videos and lecture audio through deep learning and artificial intelligence.

For example, the processor 220 may control the user terminal 100 to output the text included in the lecture materials as audio for a first time based on the online lecture contents.

In addition, the processor 220 may control the user terminal 100 to output the instructor's voice included in the online lecture content for a second time.

For example, the processor 220 may control the user terminal 100 to output the text included in the first slide of the lecture material as a voice for a first time.

Here, the processor 120 controls the user terminal 100 to output the text included in the lecture material as voice for the first time, and when the first time ends, the instructor's voice included in the online lecture content after a predetermined time The user terminal 100 may be controlled to start outputting.

In addition, the processor 220 may control the user terminal 100 to output the instructor's voice during the second time therefrom.

Also, in the above example, the processor 220 may control the user terminal 200 to output an instructor's motion event.

Specifically, when the instructor's motion event occurs, the processor 220 may control the user terminal 200 to output a description of the instructor's motion event as a voice during the third time corresponding to the occurrence time of the motion event. .

Here, the fact that the third time corresponds to the occurrence time of the motion event may be interpreted as that the time of the third time corresponds to the occurrence time of the motion event. For example, the third hour may start when the instructor's motion event occurs.

The aforementioned third time may be included in the second time.

Specifically, the instructor's motion event may occur during a lecture. Accordingly, the second time when the instructor's voice is output from the user terminal 200 may include a third time when the instructor's description of the motion event is output from the user terminal 200 as a voice.

The motion events described above include an underlining motion for underlining at least some of the text included in the slide, a highlighter motion for writing a highlighter on at least some of the text included in the slide, a checking motion for one area included in the slide, and adding text to the slide. It may include at least one of a text adding motion for adding text and a text deleting motion for deleting text included in the slide.

Meanwhile, for example, the processor 220 may output the number of a slide including text among lecture slides as a voice. Through this, the visually impaired can recognize the location of the lecture they are currently listening to.

For example, the processor 220 may output a voice saying “Slide No. 1” through the user terminal 200 .

In addition, when the text included in the lecture slide includes an animation effect, the processor 220 may output a guide for the animation effect through the user terminal 200 as a voice. Through this, a visually impaired person can recognize an animation effect.

For example, the processor 220 may output a voice of “an animation effect in which text shakes left and right” through the user terminal 200 .

Alternatively, the processor 220 may control the user terminal 200 to output a voice saying “an animation effect of 'I am going to fly' shaking left and right” when the text is 'I am going to fly'.

Also, a tone of a voice output as a description of a motion event may be set to be different from that of an instructor.

For example, a tone of a voice output as a description of a motion event may be lower than that of an instructor.

As described above, by differentiating the tone of the voice output from the user terminal 200 and the tone of the instructor's voice as a description of the motion event (tone differentiation), the visually impaired can output the instructor's voice from the user terminal 200. Even if a voice output as a description of a motion event is output during operation, the two can be distinguished and clearly recognized.

According to various embodiments of the present invention described above, a visually impaired person can effectively obtain information about text included in lecture materials, information delivered by a lecturer through voice, and information delivered by a lecturer through motion.

4 illustrates components of online lecture content according to an embodiment of the present invention.

Referring to FIG. 4 , for example, online lecture content may include lecture materials (background display), lecture commentary (audio), and writing (animation display).

Here, the lecture material is a visual element, the lecture commentary is an auditory element, and the writing is a visual element. In the case of the visually impaired, it is difficult to obtain information about lecture materials and writings that are visually delivered.

Therefore, information on lecture materials and information on writings need to be provided as audio to the visually impaired.

As a method for effectively delivering audio for lecture materials, audio for lecture commentary (or lecturer's voice), and audio for writing explanations to the visually impaired, the present invention proposes a time slicing method and a tone differentiation method.

Hereinafter, a time slicing method and a tone differentiation method will be described in detail with reference to FIG. 5 .

Hereinafter, for convenience of description, the online lecture content providing method will be described as being performed in the user terminal 100, but it can be interpreted as being performed in the server 200, of course.

5 illustrates audio sync of online lecture contents according to an embodiment of the present invention.

Referring to FIG. 5 , online lecture content may include a lecturer's voice 510, a lecture 520 for lecture materials, and a lecture 530 for motion. Here, of course, the online lecture content may also include other audio such as sound effects.

In FIG. 5 , it is assumed that the lecture on the first slide starts when the lecture starts.

Referring to FIG. 5 , the processor 120 may output a reading 520 of the lecture material for the first slide for a first time 521 .

When a predefined time elapses after the first time 521 ends, the processor 120 may output the instructor's voice 510 related to the first slide during the second time 511 .

Here, when an instructor's motion event occurs at any point during the second time period 511 , a solo sound 530 corresponding to the instructor's motion may be output during the third time period 531 .

For example, the third time 531 may be included in the second time 511 or may overlap at least part of the second time 511 .

Meanwhile, the processor 120 may output the reading 520 of the lecture material for the second slide during the fourth time 522 .

When a predetermined time elapses after the fourth time 522 ends, the processor 120 may output the instructor's voice 510 related to the second slide during the fifth time 512 .

Here, a time slicing technique is applied to the fourth time 522 when the reading 520 of the lecture material is output and the fifth time 512 when the lecturer's voice 510 is output at intervals (501). .

Through this, the reading 520 of the lecture material and the lecturer's voice 510 can be clearly distinguished and delivered to the visually impaired.

When an instructor's motion event occurs at any point during the fifth time 512 , a solo sound 530 corresponding to the instructor's motion may be output during the sixth time 532 .

For example, the sixth time 532 may be included in the fifth time 512 or overlap with at least a portion of the fifth time 512 .

Here, a tone differentiation technique is applied in which the tone of the instructor's voice 510 output during the fifth hour 512 and the tone of the instructor's solo voice 530 output during the sixth hour 532 are different. can (502).

For example, the tone of the instructor's voice 530 output during the sixth hour 532 may be lower than the tone of the instructor's voice 510 output during the fifth hour 512 .

As described above, by making the tone of the voice output as a description of the motion event different from the tone of the instructor's voice, the blind can hear both even if the voice output as a description of the motion event is output while the instructor's voice is output. distinguishable and clearly recognizable.

Also, the processor 120 may output the reading 520 of the lecture material for the third slide during the seventh time 523 .

When the predetermined time elapses after the seventh time 523 ends, the processor 120 may output the instructor's voice 510 related to the first slide during the eighth time 513 .

Here, when an instructor's motion event occurs at any two points of time during the eighth time period 513 , a solo sound 530 corresponding to the instructor's motion may be output during the ninth time period 533 and the tenth time period 534 .

For example, the ninth time 533 and the tenth time 534 may be included in the eighth time 513 or may overlap at least part of the eighth time 513 .

Hereinafter, with reference to FIGS. 6 to 8, a method of providing online lecture contents for the visually impaired according to actual lecture materials will be described in detail.

Among the lecture materials shown in FIG. 6, the first slide 610 is a part of the Goryeo song 'Gasiri' of an unknown author and an unknown date, also called 'Gwihogok', 'Gasiri, Gashiri, I Throw away, and I leave'. contains

7, the first slide 610 of the lecture material further includes 'Wise Jeungjeulga Daepyeongseongdae', which is the next phrase of 'I am gone and I am gone and I am gone'.

For example, the 'Wijeungjeulga Daepyeongseongdae' may be set to appear on one slide 610 together with an animation effect. Here, the animation effect may be various animation effects such as a dynamic animation effect and a color animation effect.

As another example, the 'Wijeungjeulga Daepyeongseongdae' may be set to be included in a slide different from the one slide. In this case, the other slides may include 'Gasiri, and I throw away, and I, and I, and I, and I, and I, and I,' and 'We, Jeungjeulga and Daepyeongseongdae,' which are part of 'Gasiri.'

8 illustrates audio sync of online lecture contents according to another embodiment of the present invention.

Referring to FIG. 8 , online lecture content may include a lecturer's voice 810, a lecture 820 for lecture materials, and a lecture 830 for motion. Here, of course, the online lecture content may also include other audio such as sound effects.

In FIG. 8 , it is assumed that the lecture on the first slide starts when the lecture starts.

Referring to FIG. 8 , the processor 120 may output a reading 820 of the lecture material for the first slide for a first time 821 .

As an example, the processor 120 transmits “Slide No. 7 contents”, which is an explanation of the first slide, along with the reading 820 of the lecture material, “I am gone and I am gone” at the first time (821). It can be output by voice.

When a predefined time elapses after the first time 821 ends, the processor 120 may output the instructor's voice 810 related to the first slide for a second time 811 .

For example, the processor 120 may output the instructor's voice 810 related to the first slide, “This serves to increase the excitement of the song without meaning” for the second time period 811 .

Here, when an instructor's motion event occurs at a specific time point during the second time period 811 , a solo sound 830 corresponding to the instructor's motion may be output during the third time period 831 .

For example, when a motion event of the instructor underlining 'I' occurs at a specific point in time during the second time 811, the processor 120 displays “underline”, which is a description of the motion event, and “underline”, which is a part corresponding to the underline. I” can be output during the third time 831 from the point corresponding to the specific point in time.

Meanwhile, the processor 120 may output a reading 820 of lecture material for a phrase having an animation effect for a fourth time period 822 .

For example, the processor 120 transmits “animation content”, which is an explanation indicating that it has an animation effect, and “we jeungjulga calmness,” which is the corresponding content, to the fourth time for 'We Jeungjeulga Peaceful Seongdae' shown through an animation effect. During (822), it can be output.

When a predetermined time elapses after the fourth time 822 ends, the processor 120 may output an instructor's voice 810 that is an explanation of the animation effect for the fifth time 812 .

Here, a time slicing technique is applied to the fourth time 822 when the reading 820 of the lecture material is output and the fifth time 812 when the lecturer's voice 810 is output at intervals.

Through this, the reading 820 of the lecture material and the lecturer's voice 810 can be clearly distinguished and delivered to the visually impaired.

If an instructor's motion event occurs at a specific time point during the fifth time period 812, a solo sound 830 for the instructor's motion may be output during the sixth time period 832.

For example, when a motion event displaying the instructor's highlighter occurs at a specific time point during the fifth time 812, a description of the motion event "highlighter" and a text corresponding to the area where the highlighter is displayed are "upper jeungjeulga Daepyongseong University" ” may be output during the sixth time period 832 .

Here, a tone differentiation technique is applied in which the tone of the instructor's voice 810 output during the fifth time period 812 and the tone of the lecturer's solo speech 830 for motion output during the sixth time period 832 are different. can

For example, the tone of “Highlighter Wijeungjeulga Daepyeongseongdae,” which is the solo sound 830 for the instructor's motion output during the sixth hour 832, is the instructor's voice 810 output during the fifth hour 812, “ Here is the text: This part is the chorus.”

As described above, by making the tone of the voice output as a description of the motion event different from the tone of the instructor's voice, the blind can hear both even if the voice output as a description of the motion event is output while the instructor's voice is output. distinguishable and clearly recognizable.

9 is a block diagram of a method for providing online lecture contents according to an embodiment of the present invention.

Referring to FIG. 9 , the processor 120 may deep-learn online lectures (videos) to generate online lecture contents for the visually impaired.

For example, the processor 120 may perform analysis on a large number of online lecture files (910). Also, the processor 120 may learn scheduling for solo sounds based on the analyzed file.

In this case, the processor 120 may generate a text-to-speech (TTS) file based on text included in the lecture material (920).

Also, the processor 120 may generate lecture audio/video. Alternatively, the processor 120 may generate only audio for providing the visually impaired.

The processor 120 may generate a solo sound for the instructor's motion.

The processor 120 may generate online lecture contents for the visually impaired, including constant lecture material reading, lecture audio/video, and lecturer motion reading.

10 is a detailed block diagram of a method for providing online lecture contents according to an embodiment of the present invention.

Referring to FIG. 10 , the processor 120 may deep-learn online lectures (videos) to generate online lecture contents for the visually impaired.

For example, the processor 120 may perform analysis on a large number of online lecture files (910). Also, the processor 120 may learn scheduling for solo sounds based on the analyzed file.

The processor 120 may generate a reading sound of the lecture material (920).

Specifically, the processor 120 may perform analysis of lecture materials based on deep learning (921). Also, the processor 120 may generate a TTS solo sound by applying a time slicing technique (922).

Also, the processor 120 may generate lecture audio/video. Alternatively, the processor 120 may generate only audio for providing the visually impaired.

Also, the processor 120 may generate a solo sound for the instructor's motion (940).

Specifically, the processor 120 may analyze the instructor's motion based on deep learning (941).

In addition, the processor 120 may generate a TTS solo sound for the instructor's motion by applying a tone differentiation technique (942).

Based on the above-described operation, the processor 120 may generate online lecture contents for the visually impaired, including the above-described lecture material reading, lecture audio/video, and instructor motion reading.

11 is a block diagram of a detailed configuration of a user terminal or server according to an embodiment of the present invention.

Referring to FIG. 11 , a user terminal or server 1100 includes a communication unit 1110 , a storage unit 1120 and a processor 1130 .

The communication unit 1110 performs communication. The communication unit 1110 may communicate with an external electronic device through various communication methods such as BT (BlueTooth), WI-FI (Wireless Fidelity), ZigBee, IR (Infrared), NFC (Near Field Communication), and the like.

The storage unit 1120 may store an O/S (Operating System) software module for driving a user terminal or server 1100 and data for configuring various UI screens provided in a display area.

Also, the storage unit 1120 is capable of reading and writing.

The processor 1130 generally controls the operation of the user terminal or server 1100 using various programs stored in the storage unit 1120 .

Specifically, the processor 1130 includes a RAM 1131, a ROM 1132, a main CPU 1133, a graphics processing unit 1134, first to n interfaces 1135-1 to 1135-n, and a bus 1136. include

Here, the RAM 1131, the ROM 1132, the main CPU 133, the graphic processing unit 1134, and the first to n interfaces 1135-1 to 1135-n may be connected to each other through a bus 1136. .

The first to n interfaces 1135-1 to 1135-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The ROM 1132 stores a command set for system booting and the like. When a turn-on command is input and power is supplied, the main CPU 1133 copies the O/S stored in the storage 1130 to the RAM 1131 according to the command stored in the ROM 1132 and executes the O/S. boot up the system

When booting is completed, the main CPU 1133 copies various application programs stored in the RAM 1131 and executes the copied application programs in the RAM 1131 to perform various operations.

The main CPU 1133 accesses the storage unit 1130 and performs booting using the O/S stored in the storage unit 1130 . In addition, the main CPU 1133 performs various operations using various programs, contents, data, and the like stored in the storage unit 1130 .

The graphics processing unit 1134 creates a screen including various objects such as icons, images, and texts by using a calculation unit and a rendering unit.

12 is a flowchart of a method for providing online lecture contents according to an embodiment of the present invention.

Referring to FIG. 12, a method of providing online lecture content for the visually impaired includes a process of outputting text included in lecture materials as audio for a first hour (1210), and a lecturer's voice included in online lecture contents for a second hour. Outputting (1220) and, when the instructor's motion event occurs, outputting (1230) a description of the instructor's motion event in audio for a third time corresponding to the occurrence time of the motion event. can include

For example, the aforementioned second time period may start after a predetermined time period after the first time period ends.

Also, as an example, the above-described third time may be included in the second time.

In the above-described example, the third time may be set to start at the time when the instructor's motion event occurs.

Meanwhile, in the above-described online lecture content providing method, the step of outputting the text included in the lecture material for the first hour as a voice may further include a step of outputting a number of a slide including the text as a voice.

In addition, in the above-described online lecture content providing method, the process of outputting the text included in the lecture material for the first hour as a voice includes, when the text includes an animation effect, a process of outputting a guide for the animation effect as a voice. can include more.

In the above example, the motion event may include at least one of an underline motion, a highlighter motion, a checking motion, a text addition motion, and a text deletion motion.

In addition, in the above example, a tone of a voice output as a description of a motion event may be set to be different from that of an instructor.

For example, the tone of a voice output as the description of the motion event may be set to be lower than that of the instructor.

On the other hand, the above-described method for providing online lecture contents according to various embodiments of the present invention is implemented as computer-executable program code and stored in various non-transitory computer readable media to be executed by a processor. It can be provided to each server or devices.

For example, when a process of outputting text included in lecture materials as audio for a first hour, a process of outputting a lecturer's voice included in online lecture contents for a second hour, and a motion event of the instructor occur, the motion event A non-transitory computer readable medium in which a program for performing a process of outputting a description of the instructor's motion event as a voice during the third time corresponding to the time of occurrence may be provided.

A non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short moment, such as a register, cache, or memory. Specifically, the various applications or programs described above may be stored and provided in non-transitory readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

While embodiments of the present invention have been shown and described above, those skilled in the art may make various changes in form and detail without departing from the spirit and scope of the present embodiments as defined by the appended claims and equivalents thereto. you will understand that you can

Online lecture content provision system: 1
Servers: 11, 200
User Terminal: 12, 100
Reservoir: 110, 210
Processor: 120, 220

Claims (20)

In the method of providing online lecture contents for the visually impaired, which is performed in a user terminal,
outputting a text included in one of at least one lecture slide included in lecture materials for a first hour as a voice;
outputting a number of a lecture slide including the text among the at least one lecture slide during the first time by voice;
outputting a lecturer's voice corresponding to one of the one or more lecture slides during a second time period when a predetermined time period elapses after the first time period ends;
When a checking motion event for at least a portion of the text included in one of the at least one lecture slide is generated by the instructor, during the third time from the occurrence of the checking motion event, the instructor continuously outputting the name of the checking motion event and the checked at least part of the text included in one of the at least one lecture slide as audio;
When text included in another one of the at least one lecture slide included in the lecture material has an animation effect, continuously outputting a phrase indicating that the text has the animation effect and a phrase subject to the animation effect as voice; and
When a predefined time elapses after continuously outputting the phrase indicating having the animation effect and the phrase subject to the animation effect as audio, the instructor's voice as an explanation of the phrase subject to the animation effect is output. Including;
The tone of the voice through which the name of the checking motion event is output and the tone of the voice through which the at least part of the checked text is output are set lower than the tone of the instructor's voice output during the second time,
The second time period begins a predetermined time after the first time period ends and includes at least a portion of the third time period;
The third time starts when the instructor's checking motion event occurs,
The checking motion event,
An online lecture content providing method comprising at least one of an underlining motion, a highlighter motion, and a checking motion.
delete delete delete delete delete delete delete delete In the user terminal,
storage unit; and
During the first hour, the text included in one of the at least one lecture slide included in the lecture material is output as a voice;
Outputting the number of a lecture slide including the text among the at least one lecture slide during the first time by voice;
When a predefined time elapses after the first time has elapsed, an instructor's voice corresponding to one of the at least one lecture slide is output for a second time,
When a checking motion event for at least a portion of the text included in one of the one or more lecture slides is generated by the instructor, during the third time from the occurrence of the checking motion event, the instructor Continuously outputting the name of the checking motion event and the checked at least part of the text included in one of the at least one lecture slide as voice;
When text included in another one of the at least one lecture slide included in the lecture material has an animation effect, a phrase indicating that it has the animation effect and a phrase subject to the animation effect are continuously output as voice;
When a predefined time elapses after continuously outputting the phrase indicating having the animation effect and the phrase subject to the animation effect as audio, the instructor's voice as an explanation of the phrase subject to the animation effect is output. Including; a processor that
The tone of the voice through which the name of the checking motion event is output and the tone of the voice through which the at least part of the checked text is output are set lower than the tone of the instructor's voice output during the second time,
The second time period begins a predetermined time after the first time period ends and includes at least a portion of the third time period;
The third time starts when the checking motion event of the instructor occurs,
The checking motion event,
A user terminal including at least one of an underlining motion, a highlighter motion, and a checking motion.
delete delete delete delete delete delete delete delete in the server,
storage unit; and
During the first hour, the text included in one of the at least one lecture slide included in the lecture material is output as a voice;
Outputting the number of a lecture slide including the text among the at least one lecture slide during the first time by voice;
When a predefined time elapses after the first time has elapsed, an instructor's voice corresponding to one of the at least one lecture slide is output for a second time,
When a checking motion event for at least a portion of the text included in one of the at least one lecture slide is generated by the instructor, during the third time from the occurrence of the checking motion event, the instructor Continuously outputting the name of the checking motion event and the checked at least part of the text included in one of the at least one lecture slide as voice;
When text included in another one of the at least one lecture slide included in the lecture material has an animation effect, a phrase indicating that it has the animation effect and a phrase subject to the animation effect are continuously output as voice;
When a predefined time elapses after continuously outputting the phrase indicating having the animation effect and the phrase subject to the animation effect as audio, the instructor's voice as an explanation of the phrase subject to the animation effect is output. Including; a processor that
The tone of the voice through which the name of the checking motion event is output and the tone of the voice through which the at least part of the checked text is output are set lower than the tone of the instructor's voice output during the second time,
The second time period begins a predetermined time after the first time period ends and includes at least a portion of the third time period;
The third time starts when the checking motion event of the instructor occurs,
The checking motion event,
A server comprising at least one of an underlining motion, a highlighter motion, and a checking motion.
A non-transitory computer readable medium storing computer instructions that cause the user terminal to perform an operation when executed by a processor of a user terminal, wherein the operation comprises:
outputting a text included in one of at least one lecture slide included in lecture materials for a first hour as a voice;
outputting a number of a lecture slide including the text among the at least one lecture slide during the first time by voice;
outputting a lecturer's voice corresponding to one of the one or more lecture slides during a second time period when a predetermined time period elapses after the first time period ends;
When a checking motion event for at least a portion of the text included in one of the at least one lecture slide is generated by the instructor, during the third time from the occurrence of the checking motion event, the instructor continuously outputting the name of the checking motion event and the checked at least part of the text included in one of the at least one lecture slide as audio;
When text included in another one of the at least one lecture slide included in the lecture material has an animation effect, continuously outputting a phrase indicating that the text has the animation effect and a phrase subject to the animation effect as voice; and
When a predefined time elapses after continuously outputting the phrase indicating having the animation effect and the phrase subject to the animation effect as audio, the instructor's voice as an explanation of the phrase subject to the animation effect is output. Including;
The tone of the voice through which the name of the checking motion event is output and the tone of the voice through which the at least part of the checked text is output are set lower than the tone of the instructor's voice output during the second time,
The second time period begins a predetermined time after the first time period ends and includes at least a portion of the third time period;
The third time starts when the instructor's checking motion event occurs,
The checking motion event,
A non-transitory computer-readable medium comprising at least one of an underlining motion, a highlighter motion, and a checking motion.

Images