KR20160074072A

KR20160074072A - real time education system for a deaf-mute school

Info

Publication number: KR20160074072A
Application number: KR1020140182861A
Authority: KR
Inventors: 황기현
Original assignee: 동서대학교산학협력단
Priority date: 2014-12-18
Filing date: 2014-12-18
Publication date: 2016-06-28

Abstract

The present invention relates to a real-time education system for schools for the deaf, comprising: a wearable glass (10) including a camera to record a video of a lecture in real time and transmit the video to a server; a server configured to store the real-time video received from the wearable glass (10) including the camera via a wireless communications network; and a conversion unit configured to analyze and convert the real-time video stored in the server. The real-time education system for schools for the deaf enables a person with a physical disability such as a person who is deaf and a person who is hard of hearing to receive and learn in real time the same lecture content as a person without disabilities by including the unique compositions described above. Also, since real-time lecture contents are stored in the server, it is possible to repetitively watch the video stored in the server after the class ended, thereby enhancing learning effects.

Description

A real-time education system for a deaf-mute school

Technology convergence between heterogeneous industries has been accelerating for the purpose of providing convenience to life along with the development of IT technology. Today, there is a growing interest in devices and service methods that can be supplemented with weaknesses by utilizing developed IT technology in providing various systems and systems for the weak person.

The inconvenience caused by birth, after-birth, and accidents is inevitably disadvantageous in many respects compared to the general public. In order to overcome this situation and enjoy equal rights with the general public, It is very natural to build.

The perception of this is getting better, but it is still lacking in many areas and it is one of the tasks to be solved urgently.

Accordingly, in the present invention, it is aimed to design a system capable of solving the inconvenience in terms of education which is one of the problems of the physical weakness, and taking the same education in real time in the same manner as the general public.

Among the human senses, vision and hearing are the most important sensory elements that have the greatest influence on context recognition and judgment.

It is natural that it is a big obstacle to knowledge acquisition when the important sense is inconvenient. In the present invention, by providing auxiliary equipment for the physical weakness related to visual and auditory sense, it is less inconvenient and suggests an easy method of learning It has meaning.

Recently, as the interest in the wearable type equipment based on the sensing has been increased, there have been variously presented devices which are in direct contact with the human body, such as a wearable watch and glass, Among the various functions of the smart phone, it has all the functions such as shooting video in real time, transmitting and receiving data using the wireless communication network.

In addition, since today's moving picture that is photographed and stored in this way has a digital form not only of the image but also of the sound inputted through the microphone, it can be converted into braille and character by utilizing it.

According to a network-based educational service providing system disclosed in the prior art, a network communication network for connecting an unspecified number of communication lines to each other for data communication; A communication link is established with the outside providing education service through the network communication network, and then basic teaching material data used for any one education program selected by the learner among a plurality of education programs provided from the outside is received, The moving picture data obtained by photographing the learning progress state of the educator provided from the outside after the execution of the program is displayed together with the basic teaching material data through the one education program window for the learner executed on the web browser, A plurality of reference data made up of still images, moving picture data, and caption data prepared in advance by the educator is inputted from the outside and displayed through the education program window for the learner, and symbols and character data inputted by the educator using the whiteboard function outside Receiving from the plurality of display by the display Do with the training window for students and simultaneously overlapping the transparent window, the transparent window educator data selected by using the (layer) on the basic function data learner materials computer; A plurality of reference data consisting of still image data, moving image data, caption data, and data used for a transparent window function, which are used in a specific education program, Reference data Outputs selection data to the outside, outputs symbols and character data input by the educator who selected the whiteboard function to the outside, Transparent window selected by the educator to use over the basic teaching material data, An educator computer; And a specific education program to be provided to a plurality of learners based on the basic text data previously entered by the educator and a plurality of reference data consisting of still images, moving picture data, and caption data, and data used for the transparent window function, And when the training program selection data is inputted from the plurality of learner computers, the basic teaching material data used for the specific education program is transmitted to the corresponding learner computer, and when the real-time education program broadcasting time comes, And outputs the basic reference material data location information according to the learning progress to a plurality of learner computers, and when the reference data selection data is input from the educator computer, And outputting to the plurality of learner computers a plurality of learner computers in response to input of symbol and character data input by an educator according to a whiteboard function from the educator computer, And a server computer for superimposing the transparent window data selected by the educator among the plurality of transparent window data constructed in the database to the plurality of learner computers when the transparent window selection data selected by the educator is input Based educational service providing system.

As another prior art, according to the learning management system for on-line education and the learning guidance method using the same, the at least one learner terminal capable of accessing the Internet and the educator terminal are used to transmit the education multimedia An online learning system for transmitting information to a learner terminal, the system comprising: extracting audio and video information necessary for learning transmitted from the learner terminal before starting learning to construct a learning state database (DB) And a learning management system server for comparing and analyzing the audio and video information of the learner in real time and transmitting a warning signal to the learner terminal and the educator terminal in case of inconsistency, Educational contents by allowing web access It provides a Web server, and; A database server configured to store and manage a learning state database (DB) constructed of audio and video information of a learner transferred before the learning starts from the learner terminal, a learner and an educator information DB, and various lecture information DBs; A multimedia server for transmitting multimedia information of education contents transmitted from the educator terminal in real time to a learner terminal; A comparison detection server for comparing the audio and video information of the learner transmitted from the learner terminal in real time with the learning state database stored in the database server and detecting whether the learning attitude is bad or not according to the inconsistency; And a learning control server for controlling the entire system and controlling the transmission of the warning signal to the learner and the educator terminal when the comparison detection server notifies the learning attitude failure, The frequency data obtained by extracting a frequency component by receiving a necessary sound is stored in the database server as a text file or an image file and the frequency data of the audio information transmitted in real time after the start of learning is compared and analyzed to determine whether or not there is a mismatch And a learning management system for online education.

However, the conventional system as described above has disadvantages in that the physical weakness such as the blind and the hearing loss can not receive or learn the same class contents as the ordinary person in real time.

It is an object of the present invention to provide a system which is helpful for learning by minimizing elements that cause difficulties in acquiring learning due to inconvenience of the physically weak in lectures conducted in real time, We provide lesson contents so that learners can take real-time learning contents with braille, and lessons are provided to learners and hearing-impaired people by subtitle.

According to an aspect of the present invention, there is provided a real-time education system for a deaf-mute school, the system comprising: a wearable glass having a camera for taking a lecture in real time and transmitting the lecture to a server; A server for storing a real-time moving image received from a wearable glass to which a camera is attached using a wireless communication network; And a conversion unit for analyzing and converting the real-time moving image stored in the server.

The converting unit may include a voice extracting unit that extracts voice data from a real-time moving image obtained by the wearable glass to which the camera is attached, a converting unit that converts the voice data into braille and caption based on the extracted voice, And a terminal.

The real-time education system for the deaf-and-child school according to the present invention is advantageous in that the physical abbreviations such as the blind and the hearing impaired can receive the same class contents as the general public in real time by having the above- .

Also, since the contents of real-time lectures are stored in the server according to the present invention, the learning effect can be improved by repeatedly listening to the lectures after the lecture is over utilizing the video stored in the server.

1 is a conceptual diagram of a real-time education system for a deaf-mute school of the present invention.
2 is a block diagram of a media conversion system for deafness in a real-time education system for a deaf-mute school of the present invention.
3 is a flowchart of a real-time education system for the deaf-mute school of the present invention.
4 is a flowchart of a conversion unit in a real-time education system for a deaf-mute school of the present invention.

The present invention comprises a wearable glass (10) with a camera, a base station (20) for connecting wireless communication, a real time video storage server (30) and a media conversion system (40) The present invention relates to a method for providing service to a physically weak person so as to recognize the same.

In addition, the media conversion system 40 for deaf-mute of the present invention extracts a voice signal from a real-time moving image stored on a digital basis, and the extracted voice signal is converted through a conversion unit and output through a terminal displaying braille and subtitles in real time .

The present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a conceptual diagram of an overall system for real-time education for a deaf-mute school of the present invention, FIG. 2 is a diagram of a media conversion system for deaf-mute in a real-time education system for a deaf- And FIG. 4 is a flowchart of the conversion unit in the real-time education system for the present invention's deaf-mute school.

The present invention will be described in more detail with reference to the accompanying drawings. As shown in FIG. 1, when a participant receives a lesson wearing a wearable glass having a camera attached thereto, And the acquired video is transmitted to a server for storing real-time video through a wireless communication network such as Bluetooth, Wifi, or LTE. In this case, the video and audio data are based on the digital format, and the wearable glass 10 with the camera is a commercially available product such as Google Glass have.

The video stored in the real-time video server is converted into braille and subtitle formats through the media conversion system for deaf-mute, and is displayed on the terminal. The video captured in real time is configured based on the digital format, . Therefore, it is possible to construct a character corresponding to each sound by analyzing the voice signal.

By displaying these characters on the terminal in the form of braille and subtitles by means of terminals that can be displayed in real time after passing through the converter, it is possible to minimize discomfort to the physical weak sufferers due to blindness or hearing loss, An equal learning environment can be provided.

Accordingly, the present invention relates to a system for relieving the disadvantages of learning due to obstacles in the classroom, and more particularly, to providing a real-time instructional content to the blind as braille, This system has the advantage of solving the inconvenience of learning due to physical disabilities.

In addition, the learning contents can be stored in the real-time video server so that the learning contents can be repeatedly heard, thereby improving the learning efficiency, and it is possible to confirm learning contents that are missed due to carelessness for a while through re-listening .

10: wearable glass with camera 20: base station
30: Real-time video storage server
40: Media Conversion System for Deaf Children
41: Moving picture 42:
43: converting section 44: braille
45: Subtitle

Claims

A wearable glass 10 with a camera for taking a lecture in real time and transmitting it to a server; A server for storing a real-time moving image received from the wearable glass 10 to which the camera is attached using a wireless communication network; And a conversion unit for analyzing and converting the real-time moving image stored in the server.

The apparatus according to claim 1, wherein the converting unit comprises: a voice extracting unit for extracting voice data from the real-time moving image obtained by the wearable glass (10) to which the camera is attached; a braille and subtitle conversion And a terminal capable of displaying a title, a title, and a caption in real time.

2. The method according to claim 1, wherein if the wearer wears the wearable glass (10) with the camera attached thereto, the lesson is taken, the lesson content is taken in real time by Google Glass, and the obtained movie is Bluetooth, The video and audio data are transmitted to the server for storing real-time moving pictures through the LTE wireless communication network. At this time, the moving pictures captured by the wearable glass 10 with the camera attached thereto and stored in the real-
The video stored in the real-time video server is converted into braille and subtitle formats through the media conversion system for deaf-mute, and is displayed on the terminal. The video captured in real time is configured based on the digital format, The character corresponding to each sound can be analyzed by analyzing the voice signal and the thus configured character is displayed on the terminal in the form of braille and caption by the terminal capable of displaying in real time after passing through the converter A real-time education system for deaf children, characterized by minimizing inconvenience in the class and providing a learning environment equal to that of ordinary people to the physical weak suffering from blindness or hearing loss.