KR101789057B1 - Automatic audio book system for blind people and operation method thereof - Google Patents

Abstract

The present invention relates to an automatic audio book system for a visually impaired person and a method of operating the audio book system for a visually impaired person who can conveniently use ordinary books without recording them, A code recognition device for recognizing an OID code of the printed matter and transmitting OID information corresponding to the OID code, a control unit for receiving the OID information transmitted from the code recognition device via wireless communication, A user terminal for receiving text content data related to the text and operating a text-to-speech (TTS) or downloading audio data to listen to a visually impaired person with a sound, a storage device for storing introductory information of the printed matter, , An OID transmitted through the user terminal via a communication network or a relay The user can browse the storage device for introduction information or text content data related to the printed matter according to the information and download the entire data to the user terminal at one time, And a server for providing a part of contents to the user terminal after a necessary operation corresponding to a request of an application program provided in the user terminal is provided so that a blind person can select a book such as a general book and listen to the contents from a desired page have.

Description

Technical Field [0001] The present invention relates to an automatic audio book system for blind people,

The present invention relates to an automatic audio book system for a visually impaired person and a method of operating the same. More particularly, the present invention relates to an automatic audio book system for a visually impaired person and a method of operating the same.

2. Description of the Related Art A portable terminal has been used in a wide variety of fields due to convenience of use and ease of portability. In recent years, portable devices have become personal items that are so essential that everybody, regardless of whether they are young or old. Mobile handset manufacturers are increasingly expanding their capabilities for underprivileged neighbors. Due to the development of the technology of the portable terminal, various functions are provided in the portable terminal, but the input / output method which the public can use is adopted. Accordingly, the portable terminal provides specialized functions for people who are not able to utilize the functions of the portable terminal such as the elderly and the disabled person. For example, a portable terminal is provided with a function (voiceover or talkback) for outputting voice in response to a blind person's input for a person with low vision or a visually impaired person. In the conventional audio output function, when a blind person touched an object displayed on the screen, it outputs what the object is by voice.

That is, despite the expansion of the service area using the mobile terminal, the service has been provided mainly to the normal persons, and the visually impaired has been neglected from the consumer group of the mobile communication service. Furthermore, since it is difficult for the visually impaired to identify the basic key buttons and the like necessary for the portable terminal, many difficulties have arisen in using the mobile communication service. Therefore, the problem of the terminal control of the visually impaired is solved by providing the terminal for the visually impaired using the braille. In other words, the visually impaired can check the braille of the terminal by hand and check the words, sentences etc. of the braille. However, the portable terminal can not provide braille to the output data, and visually impaired people can not confirm the contents of the data (text data) output to the electronic device.

In order to solve this problem, the portable terminal can convert text data into audio data through a text-to-speech (TTS) function and output it. In this manner, however, a blind person can confirm the location of data converted into audio data I can not. Accordingly, there is a need for an apparatus and a method of an electronic device for reproducing a content using a voice guidance function in order to solve the above problems.

In other words, the blind, a blind person, can not predict the position and orientation of an object, so it must randomly touch and manipulate the object accidentally to touch the object correctly. When the object is touched, the portable terminal outputs a voice as to what the object is.

In recent years, as described above, a TTS technology has been installed in a portable terminal, and a printed matter having an OID code (object identifier) code printed on a small size has been widely used. In addition to these printed materials, electronic pens for recognizing OID codes and systems for providing learning contents using user terminals are also used.

For example, when text data, position and area information on a page are obtained from an electronic file used for printing a book, and the content of the paper book is touched with the electronic pen using the information and the OID technology, And a technique for driving a file have been proposed.

Examples of such techniques are described in documents 1 and 2 below.

For example, the following Patent Document 1 discloses an apparatus for providing a voice guidance function in an electronic device, comprising: at least one processor; a memory; at least one Wherein the program outputs a reproduction screen of a content, confirms an arrangement of data constituting an output screen, sets a data analysis area, and processes the input of the blind person to the set data analysis area Wherein the arrangement of the data includes at least one of a line, a line start point, a line end point, a sentence start point, a sentence end point, and a page of an output screen.

1, the electronic device 100 includes an input module 110, a display module 120, a sound setting module 130, a position information extraction module 140, a coordinate confirmation module 140, (150), a sound output module (160), a storage module (170) and a control module (180), the method comprising: generating two or more multi-dimensional spaces corresponding to a screen of the electronic device An operation of setting sound information for the electronic device, an operation of extracting position information of a focused point on the screen of the electronic device, an operation of confirming corresponding coordinates on the multi-dimensional space based on the position information, And outputting a sound according to the sound information set in the coordinates.

Korean Patent Publication No. 10-2014-0019167 (published on April 14, 2014) Korean Patent Publication No. 10-2016-0032602 (published on March 24, 2014)

However, in the above-described Patent Document 1, a touch input position of a blind person who selects content data in an electronic device for providing a voice guidance function for a visually impaired person is derived from an electronic device, and a direction of data analysis (data reading) There has been a problem in that general printing can not be utilized.

The technique disclosed in Patent Document 2 can allow a user such as a blind person to recognize a screen configuration or content of the electronic device through the multidimensional space, The screen of the electronic device can be understood in the form of an icon or a text arrangement on the multidimensional space through the sound. However, this technique also has a problem that the general book can not be read easily.

In other words, the visually impaired can read the book using the Braille book. Recently, the general book can be read more through the audio book that the voice actor and others read and record.

However, Braille books are not easy to make and expensive, and various books for visually impaired people can not be accessed. Also, there is a problem that it is difficult to make various books as audio books due to the cost of recording audio books.

The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an automatic audio system for a visually impaired person who can produce a book which can be read by a visually impaired person at low cost, Book system and a method of operating the same.

Another object of the present invention is to provide an automatic audio book system and a method of operating the same for a visually impaired person who can learn various fields of the visually impaired persons and can easily find out the meaning of words / .

Another object of the present invention is that blind persons who are not blind can not read the text but can recognize the location of the text. Such persons with disabilities can listen to the words and sentences separately, and if they do not know, And an operation method thereof.

It is another object of the present invention to provide a function similar to an e-book by allowing an off-line paper book to be interlocked with a user terminal so that the general public can easily use an environment for reading to an audio book when reading with eyes is inconvenient, The present invention provides an automatic audio book system and a method of operating the same that can easily search and translate a word that is unknown in a book.

In order to achieve the above object, an automatic audio book system for a visually impaired person according to the present invention is an automatic audio book system for a visually impaired person who supports a visually impaired person to read and learn a lot of books, A code recognition device which recognizes an OID code of the printed matter and transmits OID information corresponding to the OID code, a code recognition device which recognizes the OID code transmitted from the code recognition device via wireless communication, A user terminal for receiving text content data related to the printed matter according to the OID information to operate a text-to-speech (TTS) or downloading audio data and playing a voice to a visually impaired person; A storage device for storing textual content data of information and printed matter, a communication network Searches the storage device for introduction information or text content data related to the printed matter according to the OID information transmitted through the repeater and transmits the entire data to the user terminal at one time, And a server for providing some contents to the user terminal after a necessary operation corresponding to a request of an application program provided in the user terminal according to a position touched by the code recognition device.

In the automatic audio book system according to the present invention, the printed matter is a book, and the OID code is provided on a cover page of the book, a Seneca, a table of contents, and a page corresponding to each contents.

Further, in the automatic audio book system according to the present invention, the server may include a receiving module for receiving a value or an instruction of an OID code transmitted through a communication network or a repeater, a value or an instruction of an OID code received by the receiving module, An extraction module for extracting introduction information or text content data related to the printed matter from the storage device and transmitting the extracted introduction information or text content data to the user terminal in response to a value or command of the OID code determined by the determination module, And a selection module for determining whether a value or command of the OID code in the code recognition device is word selection.

Further, in the automatic audio book system according to the present invention, the user terminal includes an application for driving introduction information or text content data related to the printed matter in response to a value or command of an OID code by a TTS.

Further, in the automatic audio book system according to the present invention, it is preferable that the automatic audio book system further comprises a plurality of content servers having a content database in which contents are stored, and the user terminal transmits information on words selected by the code recognition device to the storage device Or a database downloaded to the user terminal, and outputs the retrieved voice.

Further, in the automatic audio book system according to the present invention, the OID codes are sequentially arranged in a grid as mxn fine codes, and the OID codes are used to identify pages of a book, And is printed with a different OID code according to the OID code.

According to another aspect of the present invention, there is provided a method of operating an automatic audiobook system for a visually impaired person, the method comprising the steps of: (a) (B) a step of (a) touching a printed matter in the step (a) with a code recognition device, (c) in the step b) outputting a description of the printed matter touched at the user terminal as a voice, (d) touching the code recognition device with respect to any page in the printed matter, (D) when the code recognition device is operated during the output in the step (d), the execution of the step (d) is suspended And outputting a description of a word reproduced immediately before the user terminal as a voice.

Further, in the method of operating the automatic audio book system according to the present invention, the method further comprises the step of (f) explaining the meaning of the text by touching the text of the printed matter with the code recognition device.

As described above, according to the automatic audio book system and operating method for a visually impaired person according to the present invention, a book such as a general book is almost identical to a production cost of a general book, The effect is obtained that the contents can be heard from a desired page.

According to the automatic audio book system for the visually impaired and the method of operating the same according to the present invention, when a disabled person listens to the contents of a book, the user can search for the unknown word immediately, .

In addition, according to the automatic audio book system and operating method for a visually impaired person according to the present invention, it is possible to make a book which considers the blind persons even without paying a great deal of money for publishing a book.

In addition, according to the automatic audio book system and operating method thereof for a visually impaired person according to the present invention, visually impaired persons who are not blind, viewing a bright screen of a user terminal may deteriorate their visual acuity, While watching this book, learning can be done by selecting a unit of one page, one sentence, and an arbitrary block, and learning is possible by touching an unknown word by listening to the word and learning is possible under self-initiative.

In addition, according to the automatic audio book system and operating method thereof for a visually impaired person according to the present invention, it is also possible for a general person who is not visually impaired to read by eyes when traveling on a bus, subway, train, airplane, You can listen to the contents of the book and you will be able to give another reading fun. When you meet a word or term you do not know in the book, you can touch the word with electronic pen, .

1 is a block diagram of an apparatus for outputting conventional screen information as a sound,
2 is a block diagram of an automatic audiobook system for the visually impaired according to the present invention;
3 is a diagram for explaining a state in which an OID code (object identifier code) is recorded in the book shown in FIG. 2,
FIG. 4 is a configuration diagram of the code recognition device shown in FIG. 2,
5 is a configuration diagram of the server shown in FIG. 2;
6 is a diagram for explaining a process of storing an OID code in a book and storing it in a storage device according to the present invention,
7 is a diagram for explaining an operation state of an automatic audio book for a visually impaired person according to the present invention.

These and other objects and novel features of the present invention will become more apparent from the description of the present specification and the accompanying drawings.

The automatic audio book system for the visually impaired according to the present invention can automatically use the same printed matter without visually handicapped persons at a high cost in producing a general printed matter and can provide an automatic audio book .

According to the automatic audio book according to the present invention, it is possible to directly select a book in a bookstore or a shelf of a library, and to publish and supply a book without a great additional cost so that blind people can learn various fields. It also provides the ability for the visually impaired to find out the meaning of words / terms that they do not know easily, so that self-directed learning can be performed.

In addition, by providing a function similar to an e-book by allowing an offline paper book to be interlocked with a user terminal, it is possible to easily use the reading environment with an audio book when the public is uncomfortable in reading the book while reading a paper book. It also provides the ability to search and translate easily when a term comes up.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a configuration and an operating method of the present invention will be described with reference to the drawings.

FIG. 2 is a block diagram of an automatic audio book system for a visually impaired person according to the present invention, FIG. 3 is a diagram for explaining a state in which an OID code is recorded in the book shown in FIG. 2, 2 is a configuration diagram of the code recognition device shown in Fig. 2, and Fig. 5 is a configuration diagram of the server shown in Fig.

As shown in FIG. 2, the automatic audio book system for a visually impaired person according to the present invention is an automatic audio book system for a visually impaired person who supports the contents of a book with many visually impaired persons, A code recognition device 20 for recognizing an OID code of the printed matter 10 and transmitting OID information corresponding to the OID code, Receives the OID information transmitted from the code recognition device 20 through wireless communication, receives text content data related to the printed matter 20 according to the OID information, operates a text-to-speech (TTS) A user terminal 30 for downloading audio data and sounding the audio data to a visually impaired person, introduction information of the printed matter 10, and text content data of the printed matter 10 According to the OID information transmitted through the user terminal 30 via the storage device 50, the communication network 1 or the relay 2 storing the introductory information or the text content data related to the printed matter 10 to the storage device 50 And the entire data is downloaded to the user terminal 30 at one time or the request is made to the application program provided in the user terminal 30 according to the position touched by the page or code recognition device 20 And a server (40) for providing some contents to the user terminal (30) after necessary operations. The system according to the present invention includes a plurality of content servers 60 having a content database in which information is exchanged with the server 40 and the user terminal 30 through the communication network 1 and various contents are stored.

The communication network 1 is not limited to a specific network as a network capable of wired or wireless Internet and the repeater 2 may be connected to the smartphone and the server 40 using the smart phone, A conventional smartphone relay can be connected directly.

The printed matter 10 on which the OID code is written is a normal book, and includes an OID code printing area made up of a virtual lattice, as shown in Fig. 3, and the OID code is printed in each virtual lattice Another OID code is printed, and the OID code is arranged in each grid according to a predetermined rule. The OID code is provided on the cover of the book, Seneca (a book, etc.) between a front cover and a back cover, a table of contents, and a page corresponding to each contents. In particular, since the book according to the present invention is provided with the OID code in Seneca, it is possible for the visually impaired person to directly select the book inserted in the shelf of the bookstore or the library by checking the information of the book by voice.

As shown in FIG. 3, the OID code printing area may have, for example, a width of m and a length of n, and m × n fine codes may be sequentially arranged in each grid. For example, a virtual grid may be formed at intervals of 1 mm for all the pages to be printed, OID codes may be sequentially determined from left to right of the page, and OID codes may be continuously printed to the bottom line of the page . In other words, the same OID code is printed on the same grid, and the OID code of the next sequence is printed on the next grid on the right side. Therefore, since there are n lines including m lattices in the page, there are m x n lattices in the page, and OID codes corresponding to that number are used.

Accordingly, when a blind person touches an arbitrary position on the page using a code recognition device 20 such as an electronic pen capable of recognizing the OID code, the OID code in the specific grid is recognized and read, Further, the position information corresponding to the OID code is calculated, so that it is possible to know which position the blind person has pointed to. For example, in FIG. 3, when the code recognition device 20 touches a portion of (1), it can be determined that a code of (P x n x 1) touches the printed grid.

When the OID codes are printed sequentially or in accordance with predetermined rules as described above, even if an error occurs in designating an object area and assigning various attribute values during development and production, conversion to a printed OID code The information about the area (position) of the object does not affect the print contents since the OID code value is not given according to the specification of the area (position) of the object. Therefore, even if the printed matter is printed, if there is no error in the printing itself, there is an advantage that the error in the manufacturing process can be corrected.

The code recognition device 20 has a function of scanning an OID code and transmitting information on the OID code to the user terminal 30 through wireless communication, for example, Bluetooth communication. The code recognition device 20 is, for example, an electronic pen having a scanning function. The electronic pen may be assigned a unique number. The electronic pen may be provided with a function of a pencil (pencil), a ball pen, Can be used in combination.

As shown in FIG. 4, the code recognition device 20 includes a recognition unit 21 for scanning and recognizing an OID code, a control unit 22 for controlling the power on / off in the code recognition device 20, A transmission unit 23 for transmitting information on the OID code recognized by the recognition unit 21 to the terminal 30 and a power supply unit 24 for supplying power required for the recognition unit 21 and the transmission unit 23 . For example, when the communication with the user terminal 30 is not established, the control unit 22 controls the power supply unit 24 to reduce the power consumption by automatically turning off the power supply after waiting three minutes. The power supply unit 24 For example, it is desirable to have a lithium polymer battery and be configured to be chargeable to 5V 0.5A DC using a micro USB connector. The transmitting unit 23 may have a wireless communication function such as Zigbee or Bluetooth with the user terminal 30 or may be connected to the user terminal 30 by wire to send and receive signals.

The user terminal 30 may include a web application for recognizing OID code information and a speaker for voice output, which is applied to various wired and wireless environments, operates TTS (Text-To-Speech) That is, the user terminal 30 is a smart phone, a smart pad, a smart TV, or a notebook computer as an intelligent terminal having an Internet communication and an information search function, capable of executing an application for operating the TTS, , And a desktop computer. When a smart phone is applied, for example, it is connected to the server 40 through the communication company's repeater 2 and the like. That is, the user terminal 30 receives the value or command of the OID code scanned from the code recognition device 20 by wireless communication, and for example, the value or command of the OID code is received by the application built in the user terminal 30 If it is judged to be executable, the value or command of the OID code which is self-processed by the user terminal 30 and not executed by the application is transmitted to the server 40 via the communication network 1 or the relay 2 . That is, the user terminal 30 according to the present invention is a portable electronic device such as a smart phone having a speaker, and includes a portable terminal having a speaker, a mobile phone, a media player, a tablet computer, a handheld computer, or a PDA (Personal Digital Assistant). It may also be any portable electronic device, including devices combining two or more of these devices.

5, the server 40 includes a receiving module 41 for receiving a value or an instruction of an OID code transmitted through the communication network 1 or the repeater 2, A judgment module 42 for judging whether the value or command of the OID code is the contents of the printed matter 10 registered in the storage device 50 or the contents of the printed matter 10 corresponding to the value or command of the OID code judged by the judgment module 42 10, a selection module 44 for judging whether the OID code value or command in the code recognition device 20 is a word selection, a transmission module 45 ).

The receiving module 41 and the transmitting module 45 are not limited to a specific receiver and a transmitter, but are typically a receiver and a transmitter provided in a server.

The determination module 42 determines the value or command of the OID code transmitted to the printed matter 10 according to the present invention as to whether or not the electronic pen as the code recognition device 20 is operated. For example, when a visually impaired person touches an electronic pen and information about the electronic pen is transmitted through the user terminal 30 and received by the receiving module 41, the text content data related to the printed matter 10 is stored in the storage device 50).

The extraction module 43 extracts the text content data determined by the determination module 42 from the storage device 50 and transmits the text content data extracted by the user terminal 30 through the transmission module 45 , Allowing the visually impaired to listen to the text content data via the user terminal 30 by voice.

The selection module 44 receives a control signal from the control unit 22 of the code recognition device 20 through the user terminal during the operation of the TTS function in the user terminal 30 with respect to the page of the printed matter 10 selected by the blind person, For example, the operation button of the electronic pen selects whether or not a request for the TTS function word description is made by judging whether a pressed signal has been transmitted. That is, if the control signal from the control unit 22 of the recognition device 20 requests a word description during operation of the TTS function in the user terminal 30, the user terminal 30 temporarily stops the TTS function, Find the last played word and a description of a few words before it, then play it back to the TTS, and then try the TTS again from where it left off. There are many ways to find the last played word, but you can also find it by calculating the average playing time. Such a word description may be transmitted through the content server 60 to the word selected by the selection means 44, but is not limited to this, and may be determined by a direct connection between the user terminal 30 and the content server 60 .

The respective functions of the determination module 42, the extraction module 43 and the selection module 44 are realized by a hardware configuration or a program partitioned in the server 40. However, the functions of the determination module 42, the extraction module 43, ). ≪ / RTI > That is, in the automatic audio book system for the visually impaired according to the present invention, the function of the server 40 can be realized in the user terminal 30. For example, when the determination module 42, the extraction module 43, and the selection module 44 are realized by the user terminal, the code of the electronic pen, which is the control signal in the control unit 22 of the code recognition device 20, The user terminal 30 does not transmit the operation signal of the button to the server but directly judges from the user terminal 30 to determine whether the TTS is a driving word or a word selection and transmits the corresponding information to the server 40 Can be adopted. Accordingly, the user terminal 30 may store and operate an application for executing the determination module 42, the extraction module 43, and the selection module 44.

The storage device 50 is a database that stores information about the printed matter 10 in which the OID code is embedded, that is, a cover or seneca information corresponding to a book, text information, location information of text, 50 are separated from the server 40, but the present invention is not limited to this, and the server 40 may be integrally configured. The construction of the storage device 50 according to the present invention will be described later.

The content server 60 may provide additional data on the concept of an ontology for words scanned by the recognition unit 21 of the code recognition device 20. [ As such additional data, explanations about words and the like may be provided to the visually impaired person as a voice according to the selection in the selection module 44.

Next, the publication of the book and the management of information corresponding to the OID code in the automatic audio book according to the present invention will be described with reference to FIG.

6 is a diagram for explaining a process of storing an OID code in a book and storing it in a storage device according to the present invention.

In order to realize the automatic audio book according to the present invention, as shown in FIG. 6, application text is created for a book as a printed article (S10). Such text can be written by a writer directly in a normal WORD file, HWP file, TEXT file, or the like by an editor. This text generates information related to the text as an electronic file for printing a book (S20). That is, the RAW text data is extracted from the electronic document file by applying the automatic data extraction method, and the area information (i.e., the position information) where the text is located within the print page is calculated and extracted. The extracted text data and the location information of the text data are stored in the storage device 50 as object information, and the code recognition device 20 calculates an object at a location pointed by the blind person, . The extracted text data and the positional information are arranged in a text flow by separating sentences and paragraphs (S30). In addition, data related to words, idioms, terms, sentences and grammar related to the extracted text may be configured and stored in the storage device 50 as attribute data of the object.

After the flow of the text is sorted in step S30 and a subtitle, a title, and the like are found and displayed, a cover of the book, Seneca, etc., has an OID code corresponding to a code value for describing the book Designates an OID code so as to obtain positional information on the page corresponding to the contents of the book, and stores the corresponding information in the storage device 50. [

When the visually impaired person touches Seneka, which is the cover of the book published in the above step S50, with the electronic pen as the code recognition device 20, the electronic pen is a book capable of obtaining book information And transmits the recognized code to the user terminal 30. The user terminal 30 receives this code and can give a blind person a necessary explanation including the title of the book by means of a text-to-speech (TTS) function.

Next, the operation of the automatic audio book according to the present invention will be described with reference to FIG. 7.

FIG. 7 is a diagram for explaining an operation state of an automatic audio book for a visually impaired person according to the present invention.

First, the book for the visually impaired wants to read (S100). The purchase of such a book can be freely purchased at a general bookstore with the book containing the OID code according to the present invention. That is, the blind person can touch the book mark or Seneka of the book at the bookstore with the code recognition device 20, thereby listening to the information about the book and purchasing the desired book. Of course, the visually impaired can receive guidance from the book seller for the convenience of purchasing the book.

If the label of the book or Seneka is touched with the electronic pen as the code recognition device 20 at step S110, the recognition section of the code recognition device 20 selects the book The information corresponding to the OID code is transmitted to the server 40 via the user terminal 30 and the determination module 42 of the server transmits the information corresponding to the transmitted OID code Is stored in the storage device (50). When the determination module 42 determines that the content is stored in the storage device 50, it transmits the cover or Seneca information stored in the storage device 50 to the user terminal 30 through the transmission module 45. Such sign or Seneca information may be voice information and may be extracted by the extraction module 43 provided in the server 40 and transmitted to the user terminal 30. [ However, the present invention is not limited to this, and the text information transmitted from the server 40 may be outputted as voice information by the TTS application provided in the user terminal 30. [

If the visually impaired person wants a book as a result of touching the cover or Seneca with the code recognition device 20 in step S110, the blind person selects a page of the book (S120). For example, The book is expanded and the arbitrary position on the page is touched while the button being the control unit 20 of the code recognition device 20 is pressed (S130). The code recognition device 20 reads the coordinate of the touched position as shown in FIG. 3 and transmits it to the user terminal 30. The user terminal 30 transmits the coordinate position to the server 40 (S140 ), The determination module 42 calculates the number of pages of the book using the received coordinate position, and transmits the calculated page number to the user terminal 30 so as to output it by voice (S150).

Although it has been described in the above steps S120 and S150 that the voice information is outputted by transmitting and receiving stepwise between the user terminal 30 and the server 40, the present invention is not limited to this. In the step S110, The blind person can receive the entire information of the information on the book purchased by the user terminal 30 at one time and execute the steps S120 and S150 only in the user terminal 30. [ And can be executed only in the user terminal 30 in each step described below. In addition, if there is a subtitle or a titles on the page selected in the above step S120 as needed, the titles may be read together and sounded.

In step S150, the visually impaired person hears information on the page and determines whether the page is a desired page (S160). If not, the user can select a desired page by passing a proper page number in front of or behind the book in step S170.

After the desired page is thus found, the arbitrary position of the page is touched by the code recognition device 20 in a state where the button of the control unit 22 of the code recognition device 20 is released (S180). The code recognition device 20 reads the coordinates corresponding to the position and transmits the coordinates to the user terminal 30. The user terminal 30 calculates the page of the book by using the received coordinate information, The data is extracted by the extraction module 43 and transmitted to the user terminal 30. The user terminal 30 drives the TTS in response to the data so that the visually impaired can hear the information of the corresponding page by voice (S190 , S200). Since the text data stored in the storage device 50 includes a comma, a period, and a question mark, the user terminal 30 can also use the information to drive the TTS so that text can be read as smoothly as possible. The driving of the TTS in the step S200 is executed by the TTS function application provided in the user terminal 30, but it is not limited thereto and may be executed by the server.

On the other hand, if a blind person touches a button which is a control unit of the code recognition device 20 immediately after an unknown word is heard while listening to a sound, a button pressing signal is transmitted to the user terminal 30 via the transmission unit 23 . When the user terminal 30 receives a signal indicating that the button has been pressed, it is determined that the word is selected (S210), the TTS function is suspended, and a few words reproduced immediately before are used Is obtained. At this time, there are various methods for obtaining explanatory text data. The easiest example would be to use a pre-search on the Internet via a number of content servers 60 or to embed a dedicated text dictionary in the user terminal 40 or storage device 50. The word description text thus obtained is output to the visually impaired person as a word information voice output through the TTS drive in the user terminal 30 (S220). If you have told us all the required explanatory text, give a signal to play back the body, then play the paused body text. This process is executed and completed until the blind person finishes using the automatic audio book (S230).

On the other hand, if necessary, after reading each page, the user may be able to hear a page read completion tone and wait. This will allow the visually impaired to focus more and listen to the content. Also, a blind person can press the button of the electronic pen to read the next page in the air.

Also, by changing the function of the terminal or pressing the button of the electronic pen, the operation of the app can be changed to the learning mode for the blind rather than the blind. In this mode, the user does not read the book on a page-by-page basis, but reads the area set by the user or reads it in sentence or paragraph. Also, if you touch a word with the electronic pen, you will search for the word and you will hear the meaning.

It also collects the words that have been searched and provides them to listen again if necessary.

Although the present invention has been described in detail with reference to the above embodiments, it is needless to say that the present invention is not limited to the above-described embodiments, and various modifications may be made without departing from the spirit of the present invention.

By using the automatic audio book system and operating method for a visually impaired person according to the present invention, a book such as a general book can be selected by a blind or partly blind person so that contents can be heard from a desired page, Leading learning can be made possible.

10: Printed matter
20: Code recognition device
30: User terminal
40: Server
50: Storage device

Claims (8)

It is an automatic audio book system for the visually impaired, which supports the visually impaired to read and learn books,
A printed matter in which contents (contents) and regularly arranged OID (object identifier) codes are recorded,
A code recognition device that recognizes an OID code of the printed matter and transmits OID information corresponding to the OID code,
Receives the OID information transmitted from the code recognition device via wireless communication, receives text content data related to the printed matter according to the OID information, operates a text-to-speech (TTS) A user terminal that sounds to the disabled,
A storage device for storing introductory information of the printed matter and text content data of the printed matter,
Or retrieves introductory information or text content data related to the printed matter from the storage device according to the OID information transmitted through the communication network or the repeater, downloads all the found data to the user terminal at once, And a server for providing a part of contents to the user terminal after performing an operation corresponding to a request of an application program provided in the user terminal according to a position touched by the code recognition device,
Wherein the printed matter is a book, the code recognition device is an electronic pen, the electronic pen is automatically powered off after waiting three minutes if communication with the user terminal is not established,
The OID code is sequentially arranged in an OID code printing area composed of m x n lattices, and is printed on a cover, a Seneca, a table of contents of the book, and a page corresponding to each content, Is printed with a different OID code according to the coordinates of the touch position,
The user terminal plays a page sound and then sounds a page read completion tone,
If the control signal is a word description request from the recognition device during operation of the TTS function in the user terminal, the server temporarily stops the TTS function, and if the last played word and a description To the TTS, then activates the TTS function again from the stopped position,
The code recognition device transmits the operation signal to the user terminal when the operation signal is inputted by the user's button operation so as to immediately provide the explanation of the unknown word during operation of the audiobook,
When the operation signal is received, the user terminal determines the selection of the corresponding word, searches for the corresponding term, and outputs word information by voice.
And a function of storing the retrieved word and re-listening is provided. delete The method of claim 1,
The server includes a receiving module for receiving a value or an instruction of an OID code transmitted through a communication network or a repeater,
A judgment module for checking whether the value of the OID code or the command received from the receiving module is the content of the printed matter registered in the storage device,
An extraction module for extracting introduction information or text content data related to the printed matter corresponding to a value or command of the OID code determined by the determination module from the storage device and transmitting the extracted introduction information or text content data to the user terminal,
And a selection module for determining whether the value or command of the OID code in the code recognition device is a word selection. The method of claim 1,
Wherein the user terminal comprises an application for driving introduction information or textual content data associated with the printed matter to a TTS in response to a value or command of an OID code. The method of claim 1,
Further comprising a plurality of content servers having a content database in which content is stored,
Wherein the user terminal searches for information on words selected by the code recognition device in the storage device or a plurality of content servers or in a database downloaded to a user terminal and outputs the information by voice. delete A method of operating an automatic audio book system for a visually impaired person to assist the visually impaired described in any one of claims 1 and 3 to read and learn books,
(a) a step in which a code recognition device is touched to the print by user's operation with an OID (object identifier) code regularly arranged with content (content) embedded in the print,
(b) outputting a description of the printed matter touched at the step (a) as a voice at the user terminal,
(c) outputting, when the user touches the code recognition device with respect to an arbitrary page in the printed matter, the contents recorded on the page,
(d) when the code recognition device is operated in the middle of the output in the step (c), the execution of the step (c) is suspended, the description of the word reproduced immediately before is outputted as a voice from the user terminal, Lt; RTI ID = 0.0 > TTS < / RTI > function,
Wherein the printed matter is a book, the code recognition device is an electronic pen, the electronic pen is automatically powered off after waiting three minutes if communication with the user terminal is not established,
In step (c), the user terminal sounds a page,
In the step (d), the code recognition device transmits the operation signal to the user terminal when the operation signal is inputted by the user's button operation so as to immediately provide the explanation of the unknown word during the operation of the audio book,
When the operation signal is received, the user terminal determines the selection of the corresponding word, searches for the corresponding term, outputs the word information as a voice, stores the retrieved word and provides a function for listening again,
The OID code is sequentially arranged in an OID code printing area composed of m x n number of lattices, and is arranged on a cover, a Seneca, a table of contents of the book, and a page corresponding to each content, And printing is performed in a different OID code according to coordinates of the touch position. 8. The method of claim 7,
(e) if the text of the printed matter is touched by the code recognition device, explaining the meaning of the text by voice.

Images