KR101842396B1 - System for studying of sentence, and method for studying of sentence using the same - Google Patents

Abstract

The present invention discloses a sentence learning system and a sentence learning method using the same. The sentence learning system comprises a scanning pen and a sentence learning device. The scanning pen includes: a first switching unit for switching on or off a scanning beginning command of a sentence to be scanned; a second switching unit for switching on or off a multi-scanning command of the sentence; a scanning unit for scanning images of the sentence; a controller for controlling scanning motions of the scanning unit; and a communication unit for transmitting scanning data on the sentence scanned by the scanning unit. The sentence learning device performs processing of the images and extraction of letters by using the scanning data transmitted from the scanning pen. In addition, the sentence learning device performs processing of images and extraction of letters so that each of the scanning data, generated by repetition of switching on or off of the scanning beginning command when the multi-scanning command is switched on, can form one sentence, and composes and outputs sentences corresponding to learning commands of a user by using data on the extracted letters. Therefore, the sentence learning system and the sentence learning method using the same can scan sentences for learning a language and can variously compose and output compositions of the scanned sentences.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sentence learning system and a sentence learning method using the sentence learning system.

The present invention relates to a sentence learning system for a language such as Korean or English, and more particularly, to a sentence learning system and a sentence learning method using the sentence learning system.

Nowadays, interest in language ability has been greatly increased since childhood. A lot of time, effort, and money are invested in learning the correct language for Korean or English, and various learning methods are provided.

The most common and common learning process involves viewing, understanding, and memorizing each language sentence in a specific textbook, such as a book that is tailored to learn a language, and an audio tape or audio file to supplement it as needed. However, although language learning that proceeds in this way can be memorized through continuous repetition of the same sentence, it is difficult to utilize it appropriately in a real situation when it is used in a form similar to the sentence.

In addition, among the existing language learning methods, learning by memorizing the words or sentences unconditionally repeatedly leads to a side effect that reduces the learner 's motivation even though it takes a lot of learning time and cost. Accordingly, there is a need to avoid various conventional language learning methods so that various sentence patterns can be created based on the user.

An object of the present invention is to provide a sentence learning system that scans a sentence for language learning, synthesizes various components of the scanned sentence in various ways, and outputs a sentence learning method using the sentence learning system .

According to an embodiment of the present invention, there is provided a sentence learning system including a first switching unit for switching on or off a scanning start command for a sentence to be scanned, A second switching unit for on-switching or off-switching the multi-scanning command, a scanning unit scanning the image for the sentence, A controller for controlling a scanning operation of the scanning unit, and a communication unit for transmitting scanning data for the sentence scanned by the scanning unit; And a sentence learning device for performing image processing and character extraction using the scanning data sent from the scanning pen, wherein the sentence learning device is configured to perform on-switching of the scanning start command in a state in which the multi- Image processing and character extraction are performed so that each of the scanning data generated in accordance with the repetition of the off-switching operation constitutes one sentence, and a sentence corresponding to the learning instruction of the user is synthesized and output using the extracted character data .

Wherein the controller compares an interrupt time from when the scanning start command is off-switching to when there is on-switching of the scanning start command to a reference time in a state where the multi-scanning command is on-switched, The scanning data generated according to the scanning operation after the interruption time and the scanning data generated according to the scanning operation before the interruption time are processed as independent scanning data so as to correspond to the sentence components constituting one sentence And mapping the sentence components according to the scanning operation after the interruption time and the sentence components according to the scanning before the interruption time to the common object group constituting the sentence.

Wherein the controller processes the scanning data according to the scanning operation after the interruption time and the scanning data according to the scanning prior to the interruption time into single sentence data if the interruption time is not greater than the reference time .

The sentence learning apparatus includes an image processing unit that performs image processing using the scanning data transmitted from the scanning pen; A character extracting unit for extracting character data from image-processed scanning data; A data storage unit for storing the extracted character data; A user interface unit for receiving a learning command for sentence learning from a user and outputting an image or voice according to the input learning command; And a control unit for controlling operations of the image processing unit, the character extracting unit, the data storage unit, and the user interface unit, wherein the control unit is configured to use the character data stored in the data storage unit, And the synthesized sentence is displayed through the user interface unit.

The control unit controls the display unit to sequentially display other sentence components replacing sentence components selected by the user from among the plurality of sentence components displayed on the user interface unit.

The data storage unit stores at least one of word data, idiomatic data, and example component data that constitute a sentence.

According to another aspect of the present invention, there is provided a sentence learning method including scanning a sentence to be scanned using a scanning pen, and transmitting scanning data for the scanned sentence; Extracting the character data from the scanned data transmitted from the scanning pen; And a step of synthesizing and outputting a sentence corresponding to the learning command using the character data when a learning command for learning a sentence is input from a user, the method comprising: extracting image data and character data for the scanning data; Is characterized in that image scanning and character extraction are performed so that each scanning data generated in accordance with repetition of on-switching and off-switching of the scanning start command constitutes one sentence in a state in which the multi-scanning command is on-switched.

Wherein the step of scanning the sentence includes comparing an interrupt time from when the scanning start command is off-switching to when there is on-switching of the scanning start command to a reference time in a state where the multi-scanning command is on- The scanning data generated according to the scanning operation after the interruption time and the scanning data generated according to the scanning operation preceding the interruption time correspond to the sentence components constituting the one sentence, Data is mapped so that a sentence component according to the scanning operation after the interruption time and a sentence component according to the scanning prior to the interruption time become a common object group constituting the sentence.

Wherein the step of scanning the sentence comprises: if the interrupt time is not greater than the reference time, if the scanning data after the interruption time and the scanning data according to the scanning before the interruption time are one sentence, And processing it with data.

Wherein the step of synthesizing and outputting the sentence corresponding to the learning instruction comprises the steps of displaying a plurality of sentence components constituting one sentence according to the learning instruction and selecting one of the plurality of sentence components displayed by the user And sequentially displaying other sentence constituent elements replacing the element.

According to the present invention, image processing and character extraction are performed so that each scanning data generated according to a multi-scanning command constitutes one sentence, and a plurality of sentence components So that the sentence for language learning can be variously combined and provided to the user so that the language learning can be performed while continuously causing the interest of the user.

1 is a block diagram of an embodiment for explaining a sentence learning system according to the present invention.
FIG. 2 is a block diagram of an embodiment for explaining the scanning pen shown in FIG. 1. FIG.
3 is a reference view of an embodiment showing the appearance of the scanning pen shown in Fig.
4A is a reference diagram of an embodiment for explaining a homogeneous scanning mode among multi-scanning modes under control of a controller.
4B is a reference view of an embodiment for explaining a mixed scanning mode among multi-scanning modes controlled by a control unit.
5 is a block diagram of an embodiment for explaining a sentence learning apparatus according to the present invention.
FIG. 6 is a reference view illustrating a sentence displayed on the user interface unit according to the control of the control unit shown in FIG. 5;
7 is a flowchart of an embodiment for explaining a sentence learning method according to the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art, and the following embodiments may be modified in various other forms, The present invention is not limited to the following embodiments. Rather, these embodiments are provided so that this disclosure will be more thorough and complete, and will fully convey the concept of the invention to those skilled in the art.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an," and "the" include plural forms unless the context clearly dictates otherwise. Also, " comprise "and / or" comprising "when used herein should be interpreted as specifying the presence of stated shapes, numbers, steps, operations, elements, elements, and / And does not preclude the presence or addition of one or more other features, integers, operations, elements, elements, and / or groups. As used herein, the term "and / or" includes any and all combinations of one or more of the listed items.

Although the terms first, second, etc. are used herein to describe various elements, regions and / or regions, it should be understood that these elements, components, regions, layers and / Do. These terms do not imply any particular order, top, bottom, or top row, and are used only to distinguish one member, region, or region from another member, region, or region. Thus, the first member, region or region described below may refer to a second member, region or region without departing from the teachings of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings schematically showing embodiments of the present invention. In the figures, for example, variations in the shape shown may be expected, depending on manufacturing techniques and / or tolerances. Accordingly, embodiments of the present invention should not be construed as limited to any particular shape of the regions illustrated herein, including, for example, variations in shape resulting from manufacturing.

1 is a block diagram of an embodiment for explaining a sentence learning system 10 according to the present invention.

1, the sentence learning system 10 includes a scanning pen 100 and a sentence learning apparatus 200. [

The scanning pen 100 scans the object to be scanned, that is, the sentence, and transmits the scanning data according to the scanning of the sentence to the sentence learning apparatus 200. [

FIG. 2 is a block diagram of an embodiment for explaining the scanning pen 100 shown in FIG. 1, and FIG. 3 is a reference view of an embodiment showing the appearance of the scanning pen 100 shown in FIG.

2 and 3, the scanning pen 100 includes a first switching unit 110, a second switching unit 120, a scanning unit 130, a controller 130, (140) and a communication unit (150).

The scanning pen 100 includes a pen-shaped housing H, a first switching unit 110 is disposed at a lower end portion of the housing, and a second switching unit 120 is disposed at a side portion of the housing H . 3 shows the shape of the housing H of the scanning pen 100 and the positions of the first switching unit 110 and the second switching unit 120 disposed on the housing H are illustrative, The positions where the first switching unit 110 and the second switching unit 120 are disposed may be variously changed according to the shape of the housing H. [

The first switching unit 110 may be located at the lower end of the housing H of the scanning pen 100 as described above. The first switching unit 110 contacts the adjacent area of the object or the object to be scanned, Lt; / RTI > Here, the object can be any object that can be printed on a publication (e.g., paper, fabric, etc.) or can be scanned, such as characters, figures, or pictures displayed on a display device (e.g., tablet PC, smart phone, desktop PC, And may include sentences specifically for language learning. In the following, the term 'sentence' will be used instead of the term 'object', and the term 'object' will be used as needed. Further, the sentence components used in the following may be elements constituting a sentence, and may include, for example, a subject, a slave unit, a target fish unit or a fisher unit. A sentence component may be referred to as a subject part, a predicate part, a target part, or a bore part in that such a sentence component corresponds to a part when compared to an article.

The first switching unit 110 performs an on switching operation to start scanning of a sentence according to a scanning start command input from a user. The first switching unit 110 transfers the on-switching scanning start command to the controller 140.

In the case where a scanning start command is on-switched and a multi-scanning command to be described later is not input through the second switching unit 120, such a scanning start command may be referred to as a single scanning command for a sentence. The single scanning command is used to perform a scanning operation to cause scanning data generated according to one scanning operation (for example, when the scanning start command is switched off after the scanning start command is once switched on) to be stored in one memory area Command. In contrast, a multi-scanning command, which will be described later, may be a scanning command for mapping the scanning data corresponding to two or more scanning operations to form a single sentence.

The first switching unit 110 may be a pressure sensitive sensor operated by the pressure applied by contacting the object. When the pressure sensitive sensor is turned on, it is recognized as a scanning start command, and when the pressure sensitive sensor is turned off, it can be recognized as a scanning end command.

The first switching unit 110 in contact with the object may include a scanning start button for moving the scanning pen 100 in the lengthwise direction of the housing H by the own load of the scanning pen 100 or an external force of the user. The scanning start button may be a shape protruding from the scanning pen 100 so as to be able to move in contact with the object, such as a sharp tip shape or a ball shape for minimizing the friction with the object.

The scanning start button protrudes outward from the lower end of the housing H when the self-weight of the scanning pen 100 or the external force of the user does not act. In addition, the scanning start button is inserted into the housing H by the up-and-down movement when the self-weight of the scanning pen 100 or the external force of the user acts. When the scanning start button is inserted into the housing H, the scanning pen 100 recognizes the insertion of the scanning start button as a scanning start instruction.

The scanning start button may protrude outward from the lower end of the housing H so that the scanning pen 100 may be operated by its own load or by an external force of the user The first switching unit 110 may include an elastic member (for example, a spring) for moving the scanning start button up or down, so that the scanning start button is inserted into the housing H by the up and down movement And may include a structure having an elastic force. Accordingly, the first switching unit 110 maintains the interval between the scanning unit 130 and the object to be constant so that the scanning operation of the scanning pen 100 can be efficiently performed.

The second switching unit 120 may be located at the side of the housing H of the scanning pen 100 as shown in FIG. 3, and receives a multi-scanning command for the sentence.

The second switching unit 120 performs an on-switching operation for multi-scanning on the sentence according to the multi-scanning command input from the user. The second switching unit 120 transfers the on-switched multi-scanning command to the controller 140.

As described above, the multi-scanning command may be a command to process the scanning data according to two or more scanning operations to be one sentence, so that one stitching can be performed for two or more scanning operations. The multi-scanning operation is performed by inputting a scanning command through the second switching unit 120, and the actual multi-scanning operation is performed by the multi-scanning command through the second switching unit 120 and the multi-scanning command by the first switching unit 110 A scanning start command is input to perform a multi-scanning operation.

The second switching unit 120 may include a multi-scanning button that reciprocates in the width direction of the housing H by an external force of the user. The multi-scanning button is protruded outward from a side portion of the housing (H) when no external force acts on the user. Further, the multi-scanning button is inserted into the housing H by reciprocating movement when an external force of the user is applied. When the multi-scanning button is inserted into the housing H, the scanning pen 100 recognizes the insertion of the multi-scanning button as a multi-scanning command.

When the external force of the user does not act, the multi-scanning button is projected to the outside from the side portion of the housing H, and when the external force of the user is applied, the multi-scanning button is inserted into the housing H The second switching unit 120 may include an elastic member (for example, a spring) for reciprocating movement of the multi-scanning button or a structure having an elastic force.

The scanning unit 130 scans an image of an object, i.e., a sentence, under the control of the controller 140. The scanning unit 130 may be positioned at the lower end of the housing H and may be located adjacent to the first switching unit 110. The scanning unit 130 can scan an image of a line region having a predetermined width and a long length.

The scanning unit 130 may include an image sensor capable of scanning an image for an object. For example, the image sensor may include a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). Such an image sensor may be classified into a line image sensor or a wide image sensor depending on a range in which an image of an object can be scanned at one time. The line image sensor means that a plurality of light receiving elements are arranged in a linear shape having a predetermined length, and the wide image sensor means that a plurality of light receiving elements are arranged in a rectangular shape having a certain width and length. In addition, the scanning unit 130 may include a light source for applying illumination to an object to be scanned in order to obtain a good image for the object.

The controller 140 performs a scanning operation or a scanning operation of the scanning unit 130 according to a scanning start command input through the first switching unit 110 and / or a multi-scanning command input through the second switching unit 120 150 in accordance with the control signal. To this end, the controller 140 may include a programmable logic controller (PLC), a CPU, and a memory. In addition, the controller 140 may perform a function of processing the image acquired by the scanning unit 130. [ Here, as an example of the image processing, extraction may be performed on an image stitching or stitching image using an optical character recognition (OCR) method. In addition, in the case where the scanning pen 100 can be connected to other devices on the network, the controller 140 may perform image processing and / or character extraction operations related to image processing with distributed processing of devices connected to the network.

When only the scanning start command is inputted through the first switching unit 110, the controller 140 controls the scanning operation of the scanning unit 130 for single scanning. For example, when the scanning start button corresponding to the first switching unit 110 is on-switched, the controller 140 instructs the scanning unit 130 to start scanning for a single scanning of the object. Accordingly, the scanning unit 130 performs a single scanning operation on the object. When the scanning start button is turned off while the single scanning operation for the object is being performed, the controller 140 instructs the scanning unit 130 to terminate the single scanning for the object. Accordingly, the scanning unit 130 ends the single scanning operation on the object.

When a scanning start command is input through the first switching unit 110 and a multi-scanning command is input through the second switching unit 120, the controller 140 performs scanning of the scanning unit 130 for multi- And controls the operation. For example, when the scanning start button corresponding to the first switching unit 110 is on-switched and the multi-scanning button corresponding to the second switching unit 120 is on-switched, And instructs the scanning unit 130 to start scanning for multi-scanning. Accordingly, the scanning unit 130 performs multi-scanning on the object. The scanning pen 100 may receive a control signal instructing the sentence learning apparatus 200 to execute the multi-scanning operation mode. Here, the multi-scanning operation mode may include the homogeneous scanning mode or the mixed scanning mode depending on the operation mode. The controller 140 may control the scanning operation of the scanning unit 130 so as to operate in any one of the multi-scanning operations according to the control signal of the sentence learning apparatus 200.

The homogeneous scanning mode means that the scanning start command is repeatedly turned on and off in a state where the multi-scanning command is on-switched, thereby processing the scanning data corresponding to each scanning operation to be one object. For example, in accordance with the input of both the scanning start command and the multi-scanning command, the controller 140 controls the scanning of the objects having two lines of sentence including line breaks, one line at a time, It is possible to control storage and image processing as a single object.

4A is a reference diagram of another embodiment for explaining the homogeneous scanning mode under the control of the controller 140. [ Table 1 below is a table for explaining the sequential operation procedure for the homogeneous scanning mode of FIG. 4A.

process Scanning start button Multi-scan button Object scanning P1 On On L1 scanning P2 off On Stop scanning (line break) P3 On off L2 scanning P4 off off Scanning terminated

Referring to FIG. 4A and Table 1, in the first process P1, when the scanning start button is on-switched and the multi-scanning button is on-switched, the scanning unit 130 controls the object And executes the scanning for the first line (L1) constituting it. Thereafter, in the second process P2, the scanning unit 130 controls the scanning start button to be turned off and the multi-scanning button to remain in the on-switching state, The scanning operation is paused because the scanning start button is in the off-switching state according to the control. At this time, although the scanning operation itself is suspended, the operation mode for multi-scanning is maintained because the multi-scanning button maintains the on-switching state. Thereafter, in the third process P3, when the scanning start button is switched on again and the multi-scanning button is maintained in the on-switching state, the scanning unit 130 controls the scanning unit 130 And performs scanning for the second line (L2) constituting the object. Then, in a fourth step P4, when the scanning start button is off-switching and the multi-scanning button is off-switching, the scanning unit 130 ends the multi-scanning operation under the control of the controller 140. [ In other words, the controller 140 can perform continuous scanning for the next line after scanning one line constituting the object, and recognizes the object as a single object for two or more lines requiring line wrapping, So that it is possible to perform a homogeneous multi-scanning mode in which processing can be performed.

In the mixed scanning mode, it is determined whether or not the interruption time from when the scanning start command is off-switching to when the scanning start command is on-switching is within the reference time while the multi-scanning command is on-switching, The scanning operation is performed so as to be independent objects, and mapping of the object according to the scanning operation after the interrupt time and the object according to the scanning before the interrupt time are mapped to each other. When the interrupt time is greater than the reference time, the controller 140 forms a sentence between the scanning data generated according to the scanning operation after the interruption time and the scanning data generated according to the scanning operation before the interruption time Each of the sentence components according to the scanning operation after the interruption time and the sentence components according to the scanning prior to the interruption time are processed with independent scanning data corresponding to the sentence constituent elements, Mapped to be a group.

When the interrupt time is longer than the reference time (for example, 2 [seconds]), the interrupt time is a time before the next multi-scanning after the multi-scanning is performed. The scanning operations are each treated as separate objects, and when the interrupt time is within the reference time, the multi-scanning operations before and after the interrupt time are processed as one object. That is, the controller 140 compares the interrupt time with the reference time, and if the interrupt time is larger than the reference time, the object according to the scanning operation after the interrupt time is different from the object according to the scanning before the interrupt time Objects are mapped so that the objects according to the scanning operation after the interruption time and the objects according to the scanning before the interruption time are indexed into the elements constituting one sentence. Mutual mapping to objects means that, depending on the access of one object, the corresponding mapped object can be accessed. In addition, the controller 140 may process the scanning data according to the scanning operation after the interruption time and the scanning data according to the scanning prior to the interruption time as single scanning data.

4B is a reference diagram of an embodiment for explaining a mixed scanning mode according to the control of the controller 140. As shown in FIG. Table 2 below is a table for explaining the sequential operation procedure for the mixed scanning mode of FIG. 4B.

process Scanning start button Multi-scan button Whether the object is scanned P1 On On E1 Scanning P2 off On Stop scanning (interrupt time) P3 On On E2 Scanning P4 off On Stop scanning (interrupt time) P5 On On E3 Scanning P6 off off Scanning terminated

Referring to FIGS. 4B and 2, in the first process P1, when the scanning start button is on-switched and the multi-scanning button is on-switched, the scanning unit 130 controls the object And executes the scanning for the first sentence component (E1) among the constituent sentence components. Thereafter, in the second process P2, when the scanning start button is off-switched and the multi-scanning button remains in the on-switching state, the scanning unit 130 suspends the scanning operation under the control of the controller 140 do. Thereafter, in the third step P3, when the scanning start button is switched on again and the multi-scanning button is maintained in the on-switching state, the scanning unit 130 is controlled by the controller 140, Of the second sentence component (E2). Thereafter, in the fourth step P4, when the scanning start button is switched off again and the multi-scanning button is maintained in the on-switching state, the scanning unit 130 controls the scanning operation in accordance with the control of the controller 140 Stop. Thereafter, in the fifth step P5, when the scanning start button is switched on again and the multi-scanning button is maintained in the on-switching state, the scanning unit 130, under the control of the controller 140, Of the third sentence component (E3). Thereafter, in a sixth step P6, when the scanning start button is off-switched and the multi-scanning button is also off-switched, the scanning unit 130 terminates the multi-scanning operation under the control of the controller 140. [ At this time, if the interruption time is greater than the reference time in the second process P2 or the fourth process P4, the controller 140 may perform the first process P1, the third process P3, or the fifth process P5 (P1), the third process (P1), and the third process (P1) so that each object can be a sentence component constituting one sentence as a group of common objects (P3) or the fifth process (P5).

On the other hand, the sentence components constituting the object do not necessarily have to be complete sentences. For example, at least one of the first sentence component E1, the second sentence component E2 or the third sentence component E3 described above May be scanning data corresponding to a blank space. At this time, the blank may be scanning data functioning as a substitute area in which various sentence components can be inserted.

The communication unit 150 may include a wired and / or wireless communication port or a communication module that can be connected to the sentence learning apparatus 200 on various communication networks such as an intranet, the Internet, and the like. The communication port or communication module may be configured using an appropriate communication protocol such as Universal Serial Bus (USB), Ultra-wideband (UWB), Zigbee, Bluetooth, The communication unit 150 may transmit the scanning data of the object scanned by the scanning unit 130 to the sentence learning apparatus 200 under the control of the controller 140. [

The sentence learning apparatus 200 performs image processing and character extraction using the scanning data transmitted from the scanning pen 100. At this time, the sentence learning apparatus 200 performs image processing such that each scanning data generated according to the repetition of on-switching and off-switching of the scanning start command in a state in which the multi-scanning command is on- Extracts sentences corresponding to the user's learning instruction using the extracted character data, and outputs the synthesized sentences.

5 is a block diagram of an embodiment for explaining a sentence learning apparatus 200 according to the present invention.

5, the sentence learning apparatus 200 may include an image processing unit 210, a character extraction unit 220, a data storage unit 230, a user interface unit 240, and a control unit 250.

The image processing unit 210 may perform image processing using the scanning data transmitted from the scanning pen 100. [ The image processing unit 210 generates an image strip (referred to as image stitching) corresponding to an actual image of the object from a plurality of images successively transmitted from the scanning pen 100. That is, the image processing unit 210 may perform a stitching process for sequentially connecting line images sequentially transmitted. In addition, the image processing unit 210 may perform noise removal and / or monochromatic processing from the image received from the scanning pen 100.

The image processing unit 210 may process image data scanned by a single scanning command or a multi-scanning command. In this case, in the case of data scanned according to the homogeneous scanning mode among the multi-scanning commands, the image processing unit 210 may perform image processing as one object with respect to the scanning data. Also, in the case of data scanned according to the mixed scanning mode among the multi-scanning commands, the image processing unit 210 can perform image processing as independent objects for each of the scanning data mutually mapped to elements constituting one sentence have.

The character extracting unit 220 can extract character data from the scanned image subjected to image processing in the image processing unit 210. [ For this, the character extracting unit 220 may include an optical character reader (OCR) module, and the OCR module may use the character extraction algorithm for the stitched image in the image processing unit 210 to convert the character data corresponding to the image Can be extracted.

The data storage unit 230 stores the character data extracted by the character extraction unit 220. The data storage unit 230 may store scanned, image-processed, and character-extracted data according to a single scanning command. In addition, the data storage unit 230 may store scanned, image-processed, and character-extracted data according to a multi-scanning command. At this time, in the case of data scanned according to the homogeneous scanning mode among the multi-scanning commands, the data storage unit 230 may store the image processed and character extracted data as one object in a single memory address area. In addition, in the case of data scanned according to the mixed scanning mode among the multi-scanning commands, the data storage unit 230 is an independent memory element for independent data elements mutually mapped to elements constituting a single sentence, Area.

In addition, the data storage unit 230 may store at least one of word data, idiomatic data, and example sentence data constituting a sentence. Here, the word data, idiomatic data, and example component data are different from the character data extracted from the scanning data by the above-described scanning pen 100, and may be stored in the data storage unit 230 through a separate storing process . Such word data, idiomatic data, and example component data can function as a sentence database for composing various sentences.

The user interface unit 240 may receive a scanning mode of the scanning pen 100, that is, a single scanning mode or a multi-scanning mode from a user. In particular, the user interface unit 240 may receive a scanning command for either the homogeneous scanning mode or the mixed scanning mode among the multi-scanning modes. For this, the user interface unit 240 may include a keypad, a jog shuttle, a touch screen, or the like as an input module.

In addition, the user interface unit 240 receives a learning instruction for learning a sentence from a user, and outputs a sentence corresponding to the inputted learning instruction as a video or a voice. To this end, the user interface unit 240 may include a display module or an audio output module. The user interface unit 240 may convert the extracted characters into voice information using a text-to-speech (TTS) module and output the converted voice information through an audio output module.

The control unit 250 controls operations of the image processing unit 210, the character extraction unit 220, the data storage unit 230, and the user interface unit 240. In particular, the control unit 250 synthesizes a plurality of sentence components constituting a sentence using the character data stored in the data storage unit 230, and controls the synthesized sentence to be displayed through the user interface unit 240 . The control unit 250 accesses the sentence corresponding to the learning instruction from the data storage unit 230 and transmits the sentence corresponding to the learning instruction to the user interface unit 240. [ As shown in FIG. At this time, the control unit 250 may control to sequentially display other sentence components replacing the sentence component selected by the user from a plurality of sentence components displayed on the user interface unit 240. [ The control unit 250 stores information on the sentences generated according to the repetitive learning for the other sentence components that replace the sentence component selected by the user. Based on the stored sentences, May combine with the selected sentence components to sequentially display other sentence components for forming one sentence.

In addition, the control unit 250 is a different sentence component that replaces the sentence component selected by the user from among a plurality of sentence components displayed on the user interface unit 240. The control unit 250 controls the display unit 240 to display a blank, You may. At this time, the blank displayed on the user interface unit 240 may function as a substitute area into which various sentence components can be inserted, perform a margin process so that the user can recall various sentence components have.

6 is a reference diagram illustrating a sentence displayed on the user interface unit 240 under the control of the control unit 250. As shown in FIG.

Referring to FIG. 6, it can be seen that the sentence components E1. E2 and E3 are combined to represent one sentence. The sentence elements E1. E2 and E3 shown in FIG. 6 are elements constituting one sentence, that is, "I started my own business ", and the mixed scanning mode among the multi-scanning commands of the scanning pen 100 And is subjected to image processing and character extraction by the image processing unit 210 and the character extracting unit 220 of the sentence learning apparatus 200 and is mutually mapped as an element constituting one sentence in the data storage unit 230. [ And stored. If the user selects one of the sentence components E1, E2 and E3, for example, E3 (my own business), from among various sentences stored in the data storage unit 230, , The sentence components of E1 (I) and E2 (started) mapped to E3 may be accessed together and displayed in the user interface unit 240. [

At this time, when the user selects any one of the sentence components E2 (started), for example, among the sentence components E1, E2, and E3 displayed on the user interface unit 240, Quot; abandoned "or" stopped " in place of E2 (started) in place of E2 (started) selected by the user. Here, sentence components such as "abandoned" or "stopped" may be accessed from word data, idiomatic data, or example component data previously stored in the data storage unit 230. In order to access other sentence components that replace the E2 (started) selected by the user, the control unit 250 uses the sentence analysis algorithm to combine the sentence components E1 (I) and E3 (my own business) A sentence component that can constitute the sentence can be accessed from the data storage unit 230.

7 is a flowchart of an embodiment for explaining a sentence learning method according to the present invention.

The scanning pen 100 scans the sentence to be scanned, and transmits the scanned data of the scanned sentence to the sentence learning apparatus 200 (step S300).

The scanning pen 100 confirms whether a scanning start command is input from a user and performs an on-switching operation to start scanning of the object when a scanning start command is input. The scanning start command may be referred to as a single scanning command for the object. The scanning pen 100 confirms whether a multi-scanning command is input from the user, and performs an on-switching operation for multi-scanning on the object when a multi-scanning command is input.

The scanning pen 100 may scan the scanning data corresponding to the respective scanning operations according to repetition of the on-switching and the off-switching of the scanning start command in the state that the multi-scanning command is on-switched to be the same object. For example, according to the input of both the scanning start command and the multi-scanning command, the scanning pen 100 scans each line for each object having two lines of sentences including a line break, As an object of.

Also, the scanning pen 100 compares the interrupt time from when the scanning start command is off-switching to when there is on-switching of the scanning start command to the reference time in a state where the multi-scanning command is on-switching, The scanning data generated according to the scanning operation after the interruption time and the scanning data generated according to the scanning operation preceding the interruption time correspond to the sentence components constituting the one sentence, And maps the sentence components according to the scanning operation after the interruption time and the sentence components according to the scanning before the interruption time to the elements constituting the sentence. If the interrupt time is not greater than the reference time, the scan data according to the scanning operation after the interruption time and the scanning data according to the scanning prior to the interruption time are processed as single scanning data.

After step S300, the sentence learning apparatus 200 extracts character data from the scanned data transmitted from the scanning pen from the image data and image-processed scanning data (step S302). The sentence learning apparatus 200 generates an image strip corresponding to an actual image of an object from a plurality of images successively transmitted from the scanning pen 100 and also removes noise from the received image and / or monochromatic ) Processing.

The sentence learning apparatus 200 performs the image processing and the character data so that each scanning data generated in accordance with the repetition of on switching and off switching of the scanning start command constitute one sentence in a state in which the multi- .

In particular, the sentence learning apparatus 200 can perform image processing as one object with respect to the scanning data in the case of data scanned according to the homogeneous scanning mode among the multi-scanning commands. Also, in the case of data scanned according to the mixed scanning mode among the multi-scanning commands, the sentence learning apparatus 200 performs image processing as independent objects for each of the scanning data mutually mapped to elements constituting one sentence . Thereafter, the sentence learning apparatus 200 can extract the character data corresponding to the image using the character extraction algorithm for the stitched image.

After the step S302, the sentence learning apparatus 200 receives a learning instruction for the sentence learning from the user and synthesizes and outputs the sentence corresponding to the learning instruction using the character data (S304).

The sentence learning apparatus 200 displays a plurality of sentence components constituting a sentence according to the learning instruction, and further includes another sentence component that replaces the sentence component selected by the user from among the displayed plurality of sentence components Can be sequentially displayed.

In accordance with the learning instruction of the user, the sentence learning device 200 accesses and displays a sentence corresponding to the learning instruction of the user from the database. At this time, the sentence learning apparatus 200 may sequentially display other sentence components replacing the sentence component selected by the user from the plurality of displayed sentence components. The sentence learning apparatus 200 may combine the already displayed sentence components with sentence analysis elements using a sentence analysis algorithm to access other sentence components that replace the sentence components selected by the user Sentence components can be accessed from the database.

The present invention can be applied to various playback apparatuses by being implemented in a software program and recorded in a predetermined recording medium readable by a computer. The various playback devices may be a PC, a notebook, a portable terminal, and the like. For example, the recording medium may be a hard disk, a flash memory, a RAM, a ROM, or the like embedded in each reproduction apparatus, or an external optical disk such as a CD-R or a CD-RW, a compact flash card, a smart media, have.

Although the embodiments of the present invention have been described above, the embodiments disclosed in the specification of the present invention do not limit the present invention. The scope of the present invention should be construed according to the following claims, and all the techniques within the scope of equivalents should be construed as being included in the scope of the present invention.

100: Scanning pen
110: first switching unit
120: a second switching unit
130: Scanning section
140: controller
150:
200: Sentence learning device
210:
220:
230: Data storage unit
240: User interface section
250:

Claims (10)

A first switching unit for switching the scanning start command on or off for a sentence to be scanned, a second switching unit for on-switching or off-switching the multi-scanning command for the sentence, A scanning unit that scans the image; A controller for controlling a scanning operation of the scanning unit, and a communication unit for transmitting scanning data for the sentence scanned by the scanning unit; And
And a sentence learning device for performing image processing and character extraction using the scanning data sent from the scanning pen,
The controller comprising:
Comparing the interrupt time and the reference time from when the scanning start command is on-switched to when the scanning start command is on-switching after the multi-scanning command is on-switched in the mixed scanning mode during the multi-scanning mode, When the interrupt time is larger than the reference time, the first scanning data generated according to the scanning operation preceding the interrupt time and the second scanning data generated according to the scanning operation after the interrupt time are scanned And mapping the sentence component according to the first scanning data and the sentence component according to the second scanning data to a common object group constituting a sentence,
The sentence learning apparatus comprises:
The first scanning data and the second scanning data mapped to the common object group according to the mixed scanning mode perform image processing and character extraction so as to become the sentence constituting elements constituting the sentence, And outputting or outputting a blank corresponding to each of the sentence components constituting the sentence independently of the sentence components constituting the sentence, . delete The method according to claim 1,
The controller comprising:
When the interrupt time is not greater than the reference time, processes the scan data according to the scanning operation after the interruption time and the scanning data according to the scanning time prior to the interruption time into single sentence data. Sentence learning system. The method according to claim 1,
The sentence learning apparatus comprises:
An image processing unit that performs image processing using the scanning data transmitted from the scanning pen;
A character extracting unit for extracting character data from image-processed scanning data;
A data storage unit for storing the extracted character data;
A user interface unit for receiving a learning command for sentence learning from a user and outputting an image or voice according to the input learning command; And
And a control unit for controlling operations of the image processing unit, the character extracting unit, the data storage unit, and the user interface unit,
Wherein,
Wherein the control unit synthesizes a plurality of sentence constituent elements constituting a sentence by using the character data stored in the data storage unit, and displays the synthesized sentence through the user interface unit. The method of claim 4,
Wherein,
And controls to sequentially display other sentence components replacing sentence components selected by the user from among the plurality of sentence components displayed on the user interface unit. The method of claim 5,
The data storage unit stores,
And at least one of word data, idiomatic data, and example component data constituting a sentence is stored. Scanning a sentence to be scanned using a scanning pen, and transmitting scanning data for the scanned sentence;
Extracting the character data from the scanned data transmitted from the scanning pen; And
And synthesizing and outputting a sentence corresponding to the learning instruction using the character data when a learning instruction for learning a sentence is input from a user,
The step of scanning the sentence comprises:
The interlace time and the reference time from when the scanning start instruction is on-switching to when the scanning start instruction is on-switching after the scanning start instruction is off-state is compared with the reference time in the mixed scanning mode among the multi-scanning modes, Scanning is performed so that the first scanning data generated according to the scanning operation before the interrupt time and the second scanning data generated according to the scanning operation after the interrupt time correspond to the independent object, Mapping a sentence component according to the first scanning data and a sentence component according to the second scanning data to a common object group constituting a sentence,
Extracting the character data, and synthesizing and outputting a sentence corresponding to the learning instruction,
The first scanning data and the second scanning data mapped to the common object group according to the mixed scanning mode perform image processing and character extraction so as to become the sentence constituting elements constituting the sentence, And a sentence element corresponding to a learning instruction of a user is synthesized and output, and each of the sentence elements constituting the sentence is independently replaced or outputted as a blank. . delete The method of claim 7,
The step of scanning the sentence comprises:
When the interrupt time is not greater than the reference time, processes the scan data according to the scanning operation after the interruption time and the scanning data according to the scanning time prior to the interruption time into single sentence data. Sentence learning method. The method of claim 7,
Synthesizing and outputting a sentence corresponding to the learning instruction,
And displaying the plurality of sentence components constituting one sentence according to the learning instruction and sequentially displaying other sentence components replacing the sentence component selected by the user from among the plurality of displayed sentence components .

Images