KR20150094389A - Method and apparatus for providing service of context information by using camera - Google Patents

Abstract

According to the present invention, a method for providing a text information service using a camera includes the steps of: wirelessly transmitting a scan image of a subject, obtained by the camera, to a mobile terminal; extracting text data from the scan image; converting the extracted text data into voice data; and outputting the converted voice data into voice.

Description

Technical Field [0001] The present invention relates to a method and a device for providing character information using a camera,

The present invention relates to a technique for providing a character information service, and more particularly, to a character information service method using a camera suitable for providing a character information service using a camera and a character- And a device therefor.

In recent years, the spread of the use of mobile terminals such as smart phones and tablet PCs has widened widely and the living environment of people has been greatly changed. For example, in addition to the functions of the telephone, smart phones are used in various industries such as education, finance, business, And it is becoming a 'computer in the hand'.

In other words, smartphone users are actively utilizing various additional functions provided by smartphone for information, leisure, hobbies, work and other activities. Particularly, in recent years in which well-being is important, the content of mobile terminals related to health has received a great response to a large number of users.

On the other hand, as one of the additional services installed in the mobile terminal, there is a text-to-speech conversion service for converting a text message received from another terminal into voice data and outputting voice through a speaker of the portable terminal.

Accordingly, in consideration of the character-to-voice conversion service of the mobile terminal, characters (texts) such as books are scanned by a camera at a short distance through a combination with a short-range wireless communication such as Bluetooth or the like and outputted as a voice through a portable terminal, If the mother of the mother can place a portable terminal beside the baby lying in the bedroom and scan a baby book with a camera to provide a service such that characters of a book to be scanned are output through a portable terminal, It will be possible to further enhance the fulfillment of desire.

However, at present, no proposal is made for this service model.

Korean Patent Laid-Open Publication No. 2013-0075944 (Publication date: 2013. 07.08)

The present invention provides a new character information service capable of wirelessly transmitting a scanned image of a subject acquired through a camera to a portable terminal, extracting character data from the scanned image and converting the character data into voice data, Technique.

In addition, the present invention can wirelessly transmit a scanned image of a subject obtained through a camera to a portable terminal, convert the character data from the scanned image into voice data, and transmit the voice data to another portable terminal at a remote place We propose a new character information service technique.

The problems to be solved by the present invention are not limited to those mentioned above, and another problem to be solved by the present invention can be clearly understood by those skilled in the art from the following description will be.

According to one aspect of the present invention, there is provided a method of wirelessly transmitting a scanned image of a subject obtained through a camera to a portable terminal, extracting character data from the scanned image, converting the extracted character data into voice data And outputting the converted voice data by voice. The present invention also provides a method of providing a character information service using a camera.

The camera of the present invention may be an app-set camera with a finger or pen wearing type.

The method of the present invention further comprises the steps of determining whether or not the extracted character data is scrap character information for a memo before conversion to the voice data, And storing the scrap character information in a pre-designated memory area.

The method of the present invention further includes the steps of determining whether or not the extracted character data is scrap character information for a memo before the conversion into the voice data, And sending the scrap character information wirelessly to a web server via a network for storing a memo.

The discriminating process of the present invention can recognize the character data extracted from the scanned image obtained in the state that the memo function button mounted on one side of the app-selection camera is selected as the scrap character information.

According to another aspect of the present invention, there is provided an app-setter camera that acquires a scanned image of a subject and wirelessly transmits the scanned image to a portable terminal, extracts character data from the scanned image, converts the extracted character data into voice data, The character information service apparatus using the camera of the portable terminal is provided.

The app-set camera of the present invention may be a finger or pen wearing type.

The app-set camera of the present invention may be a rechargeable camera.

The app-setter camera of the present invention further includes a memo function button mounted at a predetermined position, and the portable terminal recognizes the character data extracted from the scan image obtained in the state that the memo function button is selected as scrap character information Can be stored in the designated memory area.

The abscissa camera of the present invention further includes a memo function button mounted at a predetermined position, and the portable terminal recognizes the character data extracted from the scan image obtained in the state that the memo function button is selected as scrap character information , And wirelessly sending the scrap character information to a web server via a network for storing a memo in the web space.

The portable terminal of the present invention includes a character extracting unit for extracting the character data from the scanned image, a character-to-speech converting unit for converting the extracted character data into voice data, a voice- And a display unit.

The apparatus of the present invention may further comprise a character information discrimination unit for discriminating whether or not the extracted character data is scrap character information.

The character information determination unit of the present invention can store the scrap character information in the pre-designated memory area when it is determined as the scrap character information.

The apparatus of the present invention may further include a memo dispatch unit for wirelessly sending the scrap character information to the web server via the network for storing the memo in the web space when the character information determining unit determines the scrap character information have.

According to another aspect of the present invention, there is provided a method of wirelessly transmitting a scanned image of a subject obtained through a camera to a portable terminal, extracting character data from the scanned image, And transmitting the converted voice data to a previously designated portable terminal. The present invention also provides a method of providing a character information service using a camera.

According to another aspect of the present invention, there is provided an app-setter camera that acquires a scanned image of a subject and wirelessly transmits the scanned image to a portable terminal, and a facsimile machine that extracts character data from the scanned image, converts the extracted character data into voice data, And transmits the converted voice data to a designated destination terminal via a network.

The predetermined destination terminal of the present invention may be a portable terminal or a wired communication terminal.

The present invention extracts character data from a scanned image of a subject obtained through a camera, converts the extracted character data into voice data, and outputs the voice data through a speaker or transmits the voice data to other portable terminals via a network. It is possible to effectively satisfy the desire and further enhance the competitiveness relative to the additional service of the portable terminal.

1 is a network configuration diagram suitable for providing a character information service according to the first embodiment of the present invention.
Figs. 2A to 2C are views illustrating an app-setter camera applied to the present invention. Fig.
3 is a block diagram of a character information service apparatus on the portable terminal side according to the first embodiment of the present invention.
4 is a flowchart illustrating a main process of providing a character information service using a camera according to the first embodiment of the present invention.
5 is a flowchart illustrating a main process of memorizing scrap characters selected by the user according to the first embodiment of the present invention.
6 is a network configuration diagram suitable for providing the character information service according to the second embodiment of the present invention.
7 is a block diagram of a character information service apparatus on the portable terminal side according to the second embodiment of the present invention.
8 is a flowchart illustrating a main process of providing a character information service using a camera according to the second embodiment of the present invention.

First, the advantages and features of the present invention, and how to accomplish them, will be clarified with reference to the embodiments to be described in detail with reference to the accompanying drawings. While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. It is to be understood that the following terms are defined in consideration of the functions of the present invention, and may be changed according to intentions or customs of a user, an operator, and the like. Therefore, the definition should be based on the technical idea described throughout this specification.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[Example 1]

1 is a network configuration diagram suitable for providing a character information service according to the first embodiment of the present invention, and may include an app setter camera 110, a portable terminal 120, a web server 130, and the like.

Referring to FIG. 1, the appsession camera 110 acquires a scanned image by photographing a subject such as a book, a guide board, a guidance menu, and the like, and transmits the acquired scanned image through a short distance wireless communication such as Bluetooth To the terminal 120, and the like.

2A, the appsession camera 110 includes, for example, a main body 202 made of elastic silicon or a thimble material, a camera 204 mounted on one side of the main body, Or a power switch 206 for turning on / off the power through rotation in a counterclockwise direction.

2A, although the appsession camera 110 may be equipped with a built-in rechargeable battery, the rechargeable battery may be connected to an external power source (not shown) connected through a charging pin 208 Lt; / RTI > That is, the camera 204 mounted on the apparel camera 110 may be referred to as a rechargeable camera.

In FIG. 2A, a description numeral 210 denotes a memo function button. When the scan image photographed in the state that the memo function button 210 is selected is wirelessly transmitted to the portable terminal 120, recognition information for scrap Recognition code) may be generated and transmitted to the mobile terminal 120 together with the scan image. Here, the selection of the memo function button may mean that the button is on or pressed.

To this end, a scrap recognition code generator and a transmitter (for example, a wireless signal modulator, a transmission antenna, etc.) for short range wireless communication such as Bluetooth are built in the appsession camera 110. That is, the scan image data acquired through the camera 204 is modulated into a wireless signal that can be wirelessly transmitted through a wireless signal modulator, and then wirelessly transmitted to the mobile terminal 120 through a transmission antenna.

In addition, since the main body 202 of the apparel decal camera 110 is made of silicone or thimble material having elasticity, the apparel camera 110 is, for example, a finger wearing type that is used by being detachably attached to a finger as shown in FIG. 2B Or may be a pen-wearing type that is used by being detachably inserted into a pen or the like as shown in FIG. 2C.

Next, the portable terminal 120 is a terminal capable of loading (loading) a character information service application for realizing the present embodiment, such as a mobile communication terminal, a personal portable communication terminal, a smart phone, a wireless LAN terminal, A slate PC, and a notebook PC, and can provide a function of extracting characters (text) from a scan image wirelessly transmitted from an appsession camera 110, To this end, the portable terminal 120 may be equipped with the components as shown in FIG.

3 is a block diagram of a character information service apparatus on the portable terminal side according to the first embodiment of the present invention. The character information service apparatus includes an image receiving unit 302, a character extracting unit 304, a character / voice converting unit 306, A character information determination unit 310, a memory unit 312, a note sending unit 314, and the like.

Referring to FIG. 3, the image receiving unit 302 receives scan image data transmitted from the appsession camera 110 and restores original image data before modulation, and transmits the scanned image data to the character extracting unit 304 For this purpose, the image receiving unit 302 may include a receiving antenna for short range wireless communication, a wireless signal demodulator, and the like.

Next, the character extracting unit 304 may provide a function of extracting character data (text) from a scanned image transmitted from the image receiving unit 302. Such extraction of character data may be performed, for example, And a well-known image analysis algorithm (a character extraction algorithm using boundary feature extraction of characters or images). Here, the extracted character data (or the character data into which the scrap recognition information is inserted) is transmitted to the character-to-speech conversion unit 306 and the character information determination unit 310, respectively.

The character / voice conversion unit 306 may provide a function of converting character data extracted through the character extraction unit 304 into specific voice data. For this purpose, the memory unit 312 may include at least one (Tone color) data and at least one female voice (tone color) data are stored in advance, and the user of the portable terminal can select any one of the previously stored voice data as the service target voice.

Here, the voice data may be voice of domestic and foreign entertainers such as talent, singer, comedian, etc., or voice of famous domestic and foreign athletes. Such voice data may be downloaded from a mobile web server or the like Can receive.

Then, the voice display unit 308 processes the voice data transmitted from the character-voice conversion unit 306 into voice signals that can be expressed through a speaker (or earphone) or the like (signal amplification, noise removal, etc.) Or to display it on an earphone.

On the other hand, when the character data is transferred from the character extraction unit 304, the character information determination unit 310 checks whether or not the scrap recognition information (the identification code) is the scrap character information (scrap character data) (For example, digital recording of a memo selected by the user) or delivering the scrap character information to the memo dispatcher 314 when the scrap character information is judged to be scrap character information Can be provided.

Next, when the scrap character information is transmitted from the character information determination unit 310, the note sending unit 314 modulates the scrap character information into a wireless transmittable data signal for storing a memo in the web space, 1 to the web server 130 shown in FIG. 1. For this purpose, the memo transmitter 314 includes a radio signal modulator for data communication, a transmission antenna, and the like.

The network may be any one of a second generation (2G) communication network, a third generation (3G) communication network, a fourth generation (4G) communication network and a fifth generation (5G) communication network, or a wireless communication network including a combination of at least two communication networks And a wired communication network including a wired Internet and the like.

1 may be a server system capable of providing a web cloud service to portable terminal users. In accordance with the present invention, scrap character information (memo information) is received from a portable terminal A function of storing corresponding memo information in a web memory space allocated (allocated) to the user of the portable terminal can be provided.

Next, a series of processes for providing the character information service to the user of the portable terminal using the character information service apparatus according to the present embodiment having the above-described configuration will be described in detail.

4 is a flowchart illustrating a main process of providing a character information service using a camera according to the first embodiment of the present invention.

4, when a user of the mobile terminal operates the appsession camera 110 to photograph a subject, a scanned image of the subject obtained through the camera 204 is wirelessly transmitted to the portable terminal 120 (step 402 ).

Here, the character information service application installed in the mobile terminal 120 is set to be automatically executed when a scanned image is received from the appsession camera 110, or may be set to be executed by the user's operation (e.g., , Clicking an app icon, etc.).

Next, the image receiving unit 302 receives the scanned image data transmitted from the appsession camera 110 and restores the scanned image data to original data before modulation, and then transfers the original data to the character extracting unit 304. The character extracting unit 304 Character data (text) is extracted from the restored scanned image (step 404).

Then, the character-to-speech converting unit 306 converts the extracted character data into specific speech data using the speech data stored in the memory unit 312 (step 406), and transmits the character data to the speech display unit 308 . For this purpose, the memory unit 312 stores at least one male voice (tone color) data and at least one female voice (tone color) data.

The voice display unit 308 processes the converted voice data into a voice signal that can be displayed through a speaker (or an earphone), and then expresses the converted voice data through a speaker or earphone (not shown) (step 408).

As a result, a person who owns or is around the portable terminal can listen to the voice displayed through the speaker (or earphone) of the portable terminal. Here, the displayed voice may be a text voice recorded in a subject (for example, a book, a guide book, a guide board, a guidance menu, guidance information, etc.) photographed with an apparel camera.

5 is a flowchart illustrating a main process of memorizing scrap characters selected by the user according to the first embodiment of the present invention.

Referring to FIG. 5, the character extracting unit 304 extracts character data (text) from the restored scanned image and transfers the extracted character data (text) to the character information discriminating unit 310 (step 502).

In response to this, the character information determination unit 310 determines whether or not the character transferred from the character extraction unit 304 is scrap character information in which scrap recognition information (recognition code) is inserted, or character data in which scrap recognition information is not inserted Information) (step 504). Here, the scrap character information refers to text information extracted from a scanned image (picked up) in a state where the user selects the memo function button 210 of the appsession camera 110.

When it is determined in step 504 that the scrap recognition information is the embedded scrap character information, the character information determination unit 310 outputs the scrap character information (scrap character data) as memo processing, that is, Information is stored in the pre-designated memory area of the memory unit 312 or sent to the web server 130 via the note sending unit 314 (step 506).

[Example 2]

FIG. 6 is a network configuration diagram suitable for providing the character information service according to the second embodiment of the present invention, and may include an app-setter camera 610, a mobile terminal 620, a called terminal 630, and the like.

6, since the appsession camera 610 has substantially the same function and configuration as the corresponding constituent member shown in Fig. 1, i.e., the appsession camera 110, unnecessary redundant description for the sake of brevity of description The configuration of the appsession camera 610 and the detailed description of each function are omitted.

Next, the portable terminal 620 is a terminal capable of loading (loading) a character information service application for realizing the present embodiment, such as a mobile communication terminal, a personal portable communication terminal, a smart phone, a wireless LAN terminal, A slate PC, and a notebook PC, which extracts a character (text) from a scanned image wirelessly transmitted from an appsession camera 110 and converts the text into a voice, and outputs the converted voice data to a remote To the called terminal (e.g., portable terminal or wired communication terminal). For this purpose, the portable terminal 620 may be equipped with the components shown in Fig.

7 is a block diagram of a character information service apparatus on the portable terminal side according to the second embodiment of the present invention. The character information service apparatus includes an image receiving unit 702, a character extracting unit 704, a character / voice converting unit 706, 708 and a voice data transmitting unit 710.

7, the image receiving unit 702 receives scanned image data transmitted from the apparel decryption camera 10 and restores the original scanned image data to raw data before modulation, and transmits the original data to the character extracting unit 704 For this purpose, the image receiving unit 702 may include a receiving antenna for short range wireless communication, a wireless signal demodulator, and the like.

Next, the character extracting unit 704 may provide a function of extracting character data (text) from a scanned image transmitted from the image receiving unit 702. The extraction of such character data may be performed, for example, And a well-known image analysis algorithm (a character extraction algorithm using boundary feature extraction of characters or images).

The character / voice conversion unit 706 may provide the function of converting the character data extracted through the character extracting unit 704 into specific voice data. To this end, the memory unit 708 is provided with at least one (Tone color) data and at least one female voice (tone color) data are stored in advance, and the user of the portable terminal can select any one of the previously stored voice data as the service target voice.

Here, the voice data stored in the memory unit 708 may mean voice data substantially identical to the voice data stored in the memory unit 312 of FIG.

Next, the voice data transmitting unit 710 can provide the function of modulating the converted voice data into a wirelessly transmittable data signal, and then transmitting the voice data to the receiving terminal 630 at a remote location shown in FIG. 6 through the network To this end, the voice data transmitter 710 includes a radio signal modulator for data communication and a transmission antenna.

The network may be any one of a second generation (2G) communication network, a third generation (3G) communication network, a fourth generation (4G) communication network and a fifth generation (5G) communication network, or a wireless communication network including a combination of at least two communication networks And a wired communication network including a wired Internet and the like.

6 may be, for example, a portable terminal, and may include voice data received from the portable terminal 620 via the network (i.e., character data extracted from a scanned image acquired by an app- To the outside through a speaker (or earphone), or to store it in an internal memory.

Next, a series of processes for providing the character information service to the user of the portable terminal using the character information service apparatus according to the present embodiment having the above-described configuration will be described in detail.

8 is a flowchart illustrating a main process of providing a character information service using a camera according to the second embodiment of the present invention.

Referring to FIG. 8, when a user of the mobile terminal operates the appsession camera 610 to photograph a subject, a scanned image of the subject obtained through the camera is wirelessly transmitted to the portable terminal 620 (step 802).

Here, the character information service application installed in the portable terminal 620 is set to be automatically executed when a scanned image is received from the appsession camera 610, or may be set to be executed by the user's operation (e.g., , Clicking an app icon, etc.).

Next, the image receiving unit 702 receives the scanned image data transmitted from the app-setter camera 610 and restores the scanned image data to original data before modulation, and then transfers the original data to the character extracting unit 704. The character extracting unit 704 Character data (text) is extracted from the restored scanned image (step 804).

Then, the character-to-speech converting unit 706 converts the extracted character data into specific voice data using the voice data stored in the memory unit 708 (step 806), and transmits the voice data to the voice data transmitting unit 710 . To this end, at least one male voice (tone color) data and at least one female voice (tone color) data are stored in the memory unit 708.

Subsequently, the voice data transmitting unit 710 modulates the voice data transmitted from the text-to-speech converting unit 706 into a wirelessly transmittable data signal, and transmits the data signal to the receiving terminal 630 at a remote location via the network (step 808).

Therefore, by displaying the voice data received from the portable terminal 620 (that is, the voice data obtained by converting the character data extracted from the scanned image acquired by the appsession camera into voice) through the speaker or the like , A person who owns or is in the vicinity of the called terminal can listen to the voice displayed through the speaker of the called terminal 630. [ Of course, the destination terminal 630 can also store voice data received from the mobile terminal 620 in the internal memory.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims. It is easy to see that this is possible. In other words, the embodiments disclosed in the present invention are not intended to limit the scope of the present invention but to limit the scope of the technical idea of the present invention.

Therefore, the scope of protection of the present invention should be construed in accordance with the following claims, and all technical ideas within the scope of equivalents should be interpreted as being included in the scope of the present invention.

110, 610: App-set camera
120, and 620:
130: Web server
302, and 702:
304, 704: character extracting unit
306, and 706:
308:
310: Character information discrimination unit
312, and 708:
314:
630:
710: Voice data transmission unit

Claims (20)

Transmitting a scan image of a subject acquired through a camera to a portable terminal;
Extracting character data from the scanned image;
Converting the extracted character data into voice data;
The process of outputting the converted voice data
And a character information service method using the camera.
The method according to claim 1,
The camera comprises:
The apps with a finger or pen
A method of character information service using a camera.
3. The method of claim 2,
The method comprises:
Determining whether or not the extracted character data is scrap character information for a note before conversion into the voice data;
Storing the scrap character information in a pre-designated memory area of the mobile terminal when it is determined that the scrap character information is the scram character information
Further comprising the steps of:
3. The method of claim 2,
The method comprises:
Determining whether or not the extracted character data is scrap character information for a note before conversion into the voice data;
When it is determined that the scrap character information is the scrap character information, wirelessly sending the scrap character information to the web server via the network for storing the memo in the web space
Further comprising the steps of:
The method according to claim 3 or 4,
The determining process may include:
Recognizing character data extracted from a scanned image obtained in a state that a memo function button mounted on one side of the app-set camera is selected as the scrap character information
A method of character information service using a camera.
An app-setter camera for acquiring a scanned image of a subject and wirelessly transmitting the scanned image to a portable terminal,
Extracting character data from the scanned image, converting the extracted character data into voice data and outputting the voice data,
A character information service apparatus using a camera.
The method according to claim 6,
The apparel camera may further include:
Wear a finger or pen
A character information service device using a camera.
8. The method of claim 7,
The apparel camera may further include:
Rechargeable camera
A character information service device using a camera.
The method according to claim 6,
The apparel camera may further include:
And a memo function button mounted at a predetermined position,
The mobile terminal includes:
The character data extracted from the scanned image acquired in the state that the memo function button is selected is recognized as scrap character information and is stored in the designated memory area
A character information service device using a camera.
The method according to claim 6,
The apparel camera may further include:
And a memo function button mounted at a predetermined position,
The mobile terminal includes:
Recognizes the character data extracted from the scan image obtained in the state that the memo function button is selected as scrap character information, and wirelessly transmits the scrap character information to the web server via the network for storing the memo in the web space
A character information service device using a camera.
The method according to claim 6,
The mobile terminal includes:
A character extracting unit for extracting the character data from the scan image,
A character / voice conversion unit for converting the extracted character data into voice data;
And a voice output unit
And the character information service apparatus using the camera.
12. The method of claim 11,
The apparatus comprises:
A character information discriminating section for discriminating whether or not the extracted character data is scrap character information,
Wherein the character information service apparatus further comprises:
13. The method of claim 12,
Wherein the character information determination unit comprises:
When it is determined as the scrap character information, the scrap character information is stored in the pre-designated memory area
A character information service device using a camera.
14. The method of claim 13,
The apparatus comprises:
And a memo dispatch unit for wirelessly sending the scrap character information to the web server via the network in order to store the memo in the web space when the character information determining unit determines the scrap character information,
Wherein the character information service apparatus further comprises:
Transmitting a scan image of a subject acquired through a camera to a portable terminal;
Extracting character data from the scanned image;
Converting the extracted character data into voice data;
And transmitting the converted voice data to a previously designated portable terminal
And a character information service method using the camera.
16. The method of claim 15,
The camera comprises:
The apps with a finger or pen
A method of character information service using a camera.
An app-setter camera for acquiring a scanned image of a subject and wirelessly transmitting the scanned image to a portable terminal,
The mobile terminal extracts character data from the scanned image, converts the extracted character data into voice data, and transmits the converted voice data to a pre-
A character information service apparatus using a camera.
18. The method of claim 17,
The apparel camera may further include:
Wear a finger or pen
A character information service device using a camera.
19. The method of claim 18,
The apparel camera may further include:
Rechargeable camera
A character information service device using a camera.
18. The method of claim 17,
The pre-
A portable terminal or a wired communication terminal
A character information service device using a camera.

Images