KR101986292B1 - Auto sketch terminal - Google Patents

Abstract

An embodiment of the present invention provides an auto sketch terminal which comprises: a text-corresponding image database in which a text-corresponding image which is an image matched to each text is allocated and stored; a terminal input unit receiving text input; a terminal display unit displaying an image; and a terminal control unit extracting a text-corresponding image matched to a text inputted through the terminal input unit from the text-corresponding image database to display the text-corresponding image on the terminal display unit.

Description

An auto sketch terminal

The present invention relates to a terminal for sketching an image when drawing a webtoon, an illustration, and the like as a sketch terminal.

As Internet technology develops, the Internet creates a new life culture. Intelligent multimedia terminals such as personal computers, IPTV, laptop computers, smart phones and tablets have become a necessity for modern people.

Due to the spread of the Internet and smartphones, there has also been a great change in the cartoon market, transformed from monograms for bookstores and bookstores to digital forms. Webtoon is a compound word of web and cartoon, and collectively refers to cartoons served through the Internet. Cartoons of video animation using video, audio dubbing, flash technique, etc. are being provided as well as online cartoons which currently scan comic books as they are.

In the early days of Webtoon, it was a short episode that deals with emotional contents and everyday life, but it gradually develops its narrative structure and utilizes a unique way of directing using scrolling. Due to the threat of comic book stores and scanned cartoons, the domestic offline comics market continues to shrink, but Webtoons evolves and serves as a new form of service and becomes the center of the domestic cartoon market.

Currently, the webtoon service is implemented by a technique of displaying a two-dimensional cartoon image on the screen. The multimedia terminal downloads the webtoon image file selected by the reader of the webtoon and displays it on the screen. Is displayed on the screen of the multimedia terminal, and is managed by manually reading the downloaded webtoon image.

On the other hand, an illustration is a picture produced to be used for conveying meaning to a third party or to be implied in a content, and classified as a design work. Design is abbreviated as illustration. In other words, the picture suggests that the opponent finds the danger that is easy to understand and thinks and devotes to the work. The illustration occupies a major part with incidents or recollections of the Aghasago, and has a particularly intimate relationship with the depictions, but the illustration has its own essence and means of illustration.

As described above, the webtoons and illustrations described above are popularized. The artists who sketch the webtoons and illustrations use the intelligent multimedia terminals such as personal computers and tablets to produce webtoons and illustrations.

However, those who want to create a webtoon or an illustration, even if they have a great story and ideas, will be passive in creating a webtoon or illustrations if their sketch skills are poor. Especially, teenagers who are dreaming to draw a webtoon or illustrations are increasing, but there are not many adolescents who give up their dreams when they see their painting skills.

Korean Patent Publication No. 10-2013-0126532

The technical problem of the present invention is to provide a means by which a user can easily sketch an image when drawing a web toon or an illustration.

An embodiment of the present invention is a text-corresponding image database in which a text-corresponding image, which is an image matched to each text, is assigned and stored; A terminal input unit receiving text input; A terminal display unit for displaying an image; And a terminal control unit for extracting a text corresponding image matching the text input through the terminal input unit from the text corresponding image database and displaying the extracted text corresponding image on the terminal display unit.

The sketch terminal comprises: a terminal microphone for receiving audio; And a STT converter for converting a voice of a user input through the terminal microphone into text, wherein the terminal controller extracts a text corresponding image matching the converted text from the user voice from the text corresponding image database Can be displayed on the terminal display unit.

An audio frequency characteristic corresponding image database in which an audio frequency characteristic corresponding image which is an image matched to the audio frequency characteristic is assigned and stored; And an audio frequency characteristic calculator for calculating an audio frequency characteristic that is a frequency characteristic of audio input through the terminal microphone, wherein the terminal control unit controls the audio frequency characteristic corresponding image matched to the audio frequency characteristic to the audio frequency Corresponding image database and display it on the terminal display unit.

The text corresponding image stored in the text corresponding image database and the audio frequency characteristic corresponding image stored in the audio frequency characteristic corresponding image database are individual sketch images drawn by the user.

The terminal control unit detects whether ambient noise, which is an audio of a different frequency band, is input in addition to the audio of the audio frequency band through the terminal microphone. If only the voice is detected, A corresponding image corresponding to the text converted from the voice and an audio frequency characteristic corresponding image matched to the frequency characteristic of the ambient noise can be displayed together when ambient noise other than voice is detected together.

In displaying the text-corresponding image matched with the text converted from the speech and the audio frequency characteristic corresponding image matched with the frequency characteristic of the ambient noise together, the text corresponding image and the audio frequency characteristic corresponding image are overlapped or displayed And the like.

When the text corresponding image and the audio frequency corresponding image are overlapped, the image having the larger audio decibel is displayed in a darker color in the text corresponding image and the audio frequency corresponding image.

When a text-corresponding image and an audio frequency characteristic corresponding image are superimposed, it is possible to display an image having a larger audio decibel larger among the text corresponding image and the audio frequency corresponding image.

Wherein the automatic sketch terminal includes a screen position selection interface providing a screen position selection interface for selecting a screen position to display the text corresponding image or the audio frequency characteristic corresponding image from the user, The text corresponding image or audio frequency corresponding image can be displayed on the screen position selected through the screen position selecting interface.

According to the embodiment of the present invention, an image is automatically sketched through a text or voice input when drawing a webtoon or an illustration, thereby enhancing user convenience.

1 is a perspective view of an auto sketch terminal according to an embodiment of the present invention;
2 is a block diagram of a configuration of an auto-sketch terminal according to an embodiment of the present invention;
Figure 3 is an illustration of a text-aware image database in accordance with an embodiment of the present invention.
FIG. 4 is a diagram illustrating a state in which a user sketches automatically according to a text input according to an embodiment of the present invention. FIG.
FIG. 5 is a diagram illustrating a state in which a sketch is automatically performed according to a user's voice input according to an embodiment of the present invention; FIG.
FIG. 6 is a diagram illustrating a state in which an audio frequency characteristic corresponding image matching an audio frequency characteristic is automatically sketched according to an embodiment of the present invention. FIG.
FIG. 7 is a diagram illustrating an example in which a text-corresponding image and an audio frequency characteristic corresponding image are displayed in a non-overlapping manner according to an embodiment of the present invention; FIG.
FIG. 8 is a diagram illustrating an example in which a text-corresponding image and an audio frequency characteristic corresponding image are superimposed on each other according to an embodiment of the present invention. FIG.
9 is an exemplary screen in which a matching image of a user's voice is drawn more darkly when the user's voice is greater than ambient audio according to an embodiment of the present invention.
Figure 10 is an exemplary screen in which the matching image of ambient audio is drawn more darkly if the ambient audio is greater than the user's voice, in accordance with an embodiment of the present invention.
Figure 11 is an exemplary screen in which a matching image of a user's voice is drawn larger if the user's voice is greater than ambient audio according to an embodiment of the present invention.
Figure 12 is an exemplary screen in which the matching image of ambient audio is depicted more darkly if the ambient audio is greater than the user's voice, in accordance with an embodiment of the present invention.
13 is an exemplary screen of a screen location selection interface according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and how to achieve them, will be apparent from the following detailed description of embodiments thereof taken in conjunction with the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the exemplary embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of the invention to those skilled in the art. And the present invention is only defined by the scope of the claims. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

FIG. 1 is a perspective view of an auto-sketch terminal according to an embodiment of the present invention. FIG. 2 is a block diagram illustrating the configuration of an auto-sketch terminal according to an embodiment of the present invention. FIG. 4 is a diagram illustrating an automatic sketching according to a user's text input according to an exemplary embodiment of the present invention. FIG. 5 is a diagram illustrating an example of automatic sketching according to an embodiment of the present invention. FIG. 6 is a diagram illustrating a state in which an audio frequency characteristic corresponding image matching an audio frequency characteristic is automatically sketched according to an embodiment of the present invention. Referring to FIG.

The auto sketch terminal 100 of the present invention automatically sketches using text and sound information such as text and voice. Thus, by displaying an image corresponding to text input, it is possible to facilitate the production of a webtoon.

For example, it is possible to analyze an emotion felt in a voice when inputting by voice, to sketch an image corresponding to the analyzed emotion, or to perceive a surrounding sound (for example, a car horn sound) Reflect the surrounding situation in the sketch and input the text (eg, if you enter the word "spiky head", the spiky head will automatically be sketched), and automatically save the user's drawing so that you can simply sketch .

The auto sketch terminal 100 of the present invention can be implemented as a tablet, a smart phone, or the like as shown in FIG. Therefore, the auto sketch terminal 100 has a general operation unit and an input / output unit in terms of hardware, and is implemented in various types of languages such as C, C ++, Java, Visual Basic, Visual C, And a program module that performs branch functions. Also, it can be implemented using a web program that is variously provided according to an operating system such as Google and a window. Typical examples include Internet Information Server (IIS) and CERN, NCSA, and APPACH used in a UNIX environment Can be used.

In addition, smart phones and tablets are intelligent terminals that add computer support functions such as internet communication and information retrieval, so that users can install desired applications. Therefore, not only the wireless Internet can be directly connected to the Internet, but various browsing programs can be used to access the Internet. In addition, unlike existing mobile phones, hundreds of various applications (applications) can be installed, added or deleted as desired by the user, so that the user can create desired applications, You can implement an interface.

In addition, the drawings illustrate examples of a smart phone and a tablet. However, the present invention can be applied not only to a smart phone but also to a desktop PC, a slate PC, a notebook computer, a personal digital assistant Assistants, and Portable Multimedia Player (PMP). Of course, it is needless to say that the terminal to which the present invention is applicable is not limited to the above-described kind, but may include all terminals including input / output means and calculation means.

2, the auto-sketch terminal 100 of the present invention includes a text-corresponding image database 170, an audio frequency characteristic corresponding image database 180, a terminal input unit 110, a terminal display unit 120, An STT transformer 140, an audio frequency characteristic calculating unit 150, and a terminal controller 190. The STT transformer 140, In addition, a screen position selection interface providing unit 160 may be further included.

The text-corresponding image database 170 is a database in which a text-corresponding image, which is an image matched to each text, is allocated and stored. For example, as shown in FIG. 3, a tree image is assigned and stored as a text-corresponding image in the 'tree' text, and an airplane image is allocated and stored as a text-corresponding image in the 'airplane' text.

The audio frequency characteristic corresponding image database 180 is a database in which audio frequency characteristic corresponding images, which are images matched to the audio frequency characteristics, are allocated and stored. Here, the audio frequency characteristic may be a value indicating a characteristic of an audio frequency, and may be any one of a characteristic value such as an average value of the frequency of the input audio, a maximum frequency value, and a minimum frequency value.

The text-corresponding image stored in the text-corresponding image database 170 and the audio frequency characteristic corresponding image stored in the audio frequency characteristic corresponding image database 180 may be individual sketch images drawn by the user. The user can preliminarily store an image of himself or herself in advance as a text corresponding image or an audio frequency characteristic corresponding image, and can call and use it when necessary.

The text corresponding image database 170 and the audio frequency characteristic corresponding image database 180 may be stored in a hard disk drive, an SSD drive, a flash memory, a compact flash A module capable of inputting and outputting information such as a card, an SD card (Secure Digital Card), an SM card (Smart Media Card), an MMC card (Multi-Media Card), or a Memory Stick And may be provided in a separate apparatus.

The terminal input unit 110 is a module that receives text input.

The terminal display unit 120 is a module for displaying an image. The terminal input unit 110 and the terminal display unit 120 may be implemented as a single type of touch screen panel. A touch screen panel is a display window provided on a front surface of a terminal to provide a touch screen screen capable of simultaneously performing input and display, and includes a graphical user interface (GUI) for communicating with a user Display.

The terminal microphone 130 receives audio signals. The audio signal input through the microphone is converted into a digital signal through a modem (MODEM) and a codec (CODEC).

The STT conversion unit 140 is a module for converting a user's voice input through the terminal microphone 130 into text. Speech to Text (STT) technology, which is a speech recognition technology, is a technology for converting speech to text as is known. Accordingly, the user's voice input through the terminal microphone 130 can be converted into text.

The audio frequency characteristic calculator 150 calculates an audio frequency characteristic, which is a frequency characteristic of audio inputted through the terminal microphone 130. When audio other than voice is input, that is, when the audio inputted through the microphone is converted into SST, it is calculated that the frequency characteristic of the audio to be inputted is not a meaningful text character. For example, when the surrounding audio of the train sound is heard, the frequency characteristic of the train sound can be calculated, and when the surrounding audio of the wave sound is heard, the frequency characteristic of the wave sound can be calculated. Here, the frequency characteristic may correspond to various characteristic values such as an average frequency value of audio, a maximum frequency frequency, and a frequency pattern.

The terminal control unit 190 is implemented as an MCU (Main Control Unit) for controlling each function module of the auto sketch terminal 100 so that an auto sketch can be performed on the image according to the user text input or voice input according to the present invention. do.

First, an example of auto sketching of an image corresponding to a text according to a user's text input will be described.

In order to automatically display an image according to the user's text input on the auto sketch terminal 100, the terminal control unit 190 converts the text corresponding image matched to the text input through the terminal input unit 110 into a text- (170) and displays it on the terminal display unit (120).

For example, as shown in FIG. 4 (a), when a user inputs' tree 'to the auto sketch terminal 100, a' tree 'image corresponding to the input' And is displayed on the terminal 100. Similarly, when the user inputs 'airplane' to the auto sketch terminal 100, an 'airplane' image corresponding to the 'airplane' is displayed on the auto sketch terminal 100, as shown in FIG. Therefore, a user who wants to draw a webtoon or an illustration can display the image only by inputting text without having to sketch an image for each image.

Secondly, an example will be described in which an auto sketch of an image corresponding to a voice is performed according to a user's voice input.

In order to automatically display an image according to a user's voice input on the auto sketch terminal 100, the terminal control unit 190 transmits a text-corresponding image matched with the text converted from the user's voice to the text-corresponding image database 170 And displays it on the terminal display unit 120.

For example, as shown in FIG. 5 (a), when the user speaks 'wood' toward the auto sketch terminal 100, the 'tree' image corresponding to the auto- And displayed on the sketch terminal 100. Similarly, when the user speaks 'airplane' toward the auto sketch terminal 100, an 'airplane' image corresponding to the 'airplane' is displayed on the auto sketch terminal 100. Therefore, a user who wants to draw a webtoon or an illustration can easily display the image by calling the name of the desired image without having to sketch the image one by one.

Also, the terminal control unit 190 can display not only the user's voice but also surrounding audio as an image. To this end, the terminal control unit 190 extracts an audio frequency characteristic corresponding image matched with the audio frequency characteristic from the audio frequency characteristic corresponding image database 180 and displays it on the terminal display unit 120.

6 (a), the terminal control unit 190 calculates a frequency characteristic of a train sound and outputs a 'train' image corresponding thereto to an audio frequency characteristic corresponding image database (for example, 180 and displays the corresponding 'train' image as shown in FIG. 6 (b).

In the same manner, when the surrounding sound wave is heard, the terminal control unit 190 calculates the frequency characteristic of the wave sound, extracts the 'wave' image corresponding thereto from the audio frequency characteristic corresponding image database 180, .

In addition, the terminal control unit 190 detects whether ambient noise, which is audio in a different frequency band, is input through the terminal microphone 130 in addition to the audio of the audio frequency band, And performs an operation. 7 to 13 will be described in detail below.

FIG. 7 is a diagram illustrating an example in which a text-corresponding image and an audio frequency characteristic corresponding image are displayed in a non-overlapping manner according to an embodiment of the present invention. FIG. FIG. 9 is an exemplary screen in which a matching image of a user's voice is drawn more darkly when a user's voice is larger than ambient audio according to an embodiment of the present invention, and FIG. FIG. 11 is a diagram illustrating an example screen in which the matching image of the surrounding audio is drawn more darkly when the surrounding audio is larger than the user's voice according to the embodiment of FIG. 12 is an exemplary screen in which a matching image is drawn in a larger size, FIG. 13 is an exemplary diagram illustrating a screen position selection interface according to an exemplary embodiment of the present invention. Referring to FIG.

In addition to the voice as the audio of the voice frequency band, it is further detected through the terminal microphone 130 whether ambient noise, which is audio of another frequency band, is inputted. If only the voice is detected as the form of the input audio, Only the text-corresponding image that is matched with the image is displayed on the screen.

On the other hand, when ambient noise other than voice is also detected, a text-corresponding image matched with the text converted from the voice and an audio frequency characteristic corresponding image matching the frequency characteristic of the ambient noise are displayed together. For example, if a user is typing 'tree' and you hear a train sound around you, display the 'tree' image and the 'train' image together on one screen.

Further, in displaying the text corresponding image matched with the text converted from the voice and the audio frequency characteristic corresponding image matched with the frequency characteristic of the ambient noise together, it is preferable that the text corresponding image and the audio frequency characteristic corresponding image are superimposed or not overlapped Display.

A method of displaying the text corresponding image and the audio frequency corresponding image without overlapping is a method in which, for example, as shown in Fig. 7 (a), when a user sounds a voice as " , 'Wood' images and 'train' images on a single screen.

On the other hand, a method of superimposing a text corresponding image and an audio frequency corresponding image on each other is a method in which, for example, as shown in Fig. 8 (a) , 'Wood' images and 'train' images on a single screen.

Therefore, a user who draws a webtoon or an illustration can display an image of his / her intended voice in a special sound environment and display it on a single screen. Note that the option to display or overlay these two images in a non-overlapping manner can be determined by user selection.

On the other hand, when the text-corresponding image and the audio frequency characteristic corresponding image are superimposed, it is possible to darkly display the image having the larger audio decibel (dB) among the text corresponding image and the audio frequency characteristic corresponding image. Accordingly, a sketch having various types of contour lines can be made depending on whether the user voice is made larger or smaller.

For example, as shown in FIG. 9 (a), when a user voice called 'tree' and a surrounding audio of 'train' are simultaneously input, the audio decibel of the user voice, When the decibel is larger than the decibel of the audio, as shown in Fig. 9 (b), the image of the user tree "tree" is displayed darker than the "train" image.

On the other hand, as shown in FIG. 10 (a), when the user voice called 'tree' and the surrounding audio of 'train' are simultaneously input, the decibel of the surrounding audio of 'train' If it is larger than the audio decibel, the 'train' image is darker than the 'tree' image, which is the user voice, as shown in FIG. 10 (b).

In a case where the text corresponding image and the audio frequency characteristic corresponding image are displayed in a superimposed manner in another manner, an image having a larger audio decibel can be displayed in a larger size among the text corresponding image and the audio frequency corresponding image. Accordingly, a sketch having various shape sizes can be made depending on whether the user's voice is made larger or smaller.

For example, as shown in FIG. 11 (a), when a user voice called 'tree' and a surrounding audio of 'train' are simultaneously input, the audio decibel of the user voice, When the decibel is larger than the decibel of the audio, as shown in Fig. 11 (b), the image of the user tree "tree" is displayed larger than the "train" image.

On the other hand, as shown in FIG. 12 (a), when the user voice called 'tree' and the surrounding audio of 'train' are simultaneously input, the decibel of the surrounding audio of 'train' If it is larger than the audio decibel, the 'train' image is displayed larger than the 'tree' image of the user voice as shown in FIG. 12 (b).

In addition, the auto-sketch terminal 100 further includes a screen position selection interface providing unit 160 for providing a screen position selection interface 10 for selecting a screen position to display a text corresponding image or an audio frequency characteristic corresponding image, As shown in FIG.

Accordingly, the terminal control unit 190 can display the text corresponding image or the audio frequency corresponding image at the selected screen position through the screen position selection interface 10.

For example, as shown in FIG. 13 (a), when the user selects "center" in the screen position selection interface 10, the sketched image is displayed in the center of the screen, Similarly, when the user selects the 'upper left' in the screen position selection interface 10, the sketched image is displayed at the upper left of the screen. The displayed image can be changed by touching and dragging.

The embodiments of the present invention described above are selected and presented in order to facilitate the understanding of those skilled in the art from a variety of possible examples. The technical idea of the present invention is not necessarily limited to or limited to these embodiments Various changes, modifications, and other equivalent embodiments are possible without departing from the spirit of the present invention.

100: Auto sketch terminal
110: terminal input unit 120: terminal display unit
130: terminal microphone 140: SST conversion section
150: Audio frequency characteristic calculating section
160: Screen position selection interface
170: Text-aware image database
180: Database for audio frequency characteristics
190:

Claims (9)

A text-corresponding image database in which a text-corresponding image that is an image matching the text is allocated and stored;
A terminal input unit receiving text input;
A terminal display unit for displaying an image; And
A terminal control unit for extracting a text corresponding image matching the text input through the terminal input unit from the text corresponding image database and displaying the extracted text corresponding image on the terminal display unit;
A terminal microphone for receiving audio;
An STT converter for converting a voice of a user input through the terminal microphone into text;
An audio frequency characteristic corresponding image database in which an audio frequency characteristic corresponding image which is an image matched to the audio frequency characteristic is assigned and stored; And
And an audio frequency characteristic calculating unit for calculating an audio frequency characteristic that is a frequency characteristic of audio inputted through the terminal microphone,
The terminal control unit,
A text corresponding image matching the text converted from the user voice is extracted from the text corresponding image database and displayed on the terminal display unit,
An audio frequency characteristic corresponding image matching the audio frequency characteristic is extracted from the audio frequency characteristic corresponding image database and displayed on the terminal display unit,
Wherein the audio frequency characteristic includes at least one characteristic value of an average value, a maximum frequency value, and a minimum frequency value of an audio frequency for a sound generated from an object and a material.
delete delete The method according to claim 1,
Wherein the text corresponding image stored in the text corresponding image database and the audio frequency characteristic corresponding image stored in the audio frequency characteristic corresponding image database are individual sketch images drawn by the user.
The method according to claim 1,
The terminal control unit,
The terminal microphone detects whether ambient noise, which is audio of a different frequency band, is input in addition to audio of a voice frequency band through the terminal microphone,
Only the text corresponding image matching the text converted from the voice is displayed,
And displays an image corresponding to the text matched with the text converted from the voice together with an image corresponding to the audio frequency characteristic matched with the frequency characteristic of the ambient noise when ambient noise other than voice is detected together.
The method of claim 5, further comprising displaying a text-corresponding image matched with the text converted from the speech and an audio frequency characteristic corresponding image matching the frequency characteristic of ambient noise,
Wherein the text corresponding image and the audio frequency characteristic corresponding image are displayed in an overlapping or non-overlapping manner, respectively.
The method of claim 6,
When the text-corresponding image and the audio frequency characteristic corresponding image are superimposed,
Corresponding to the text-corresponding image and the audio frequency characteristic corresponding image, the image having a larger audio decibel is displayed more intensely.
The method of claim 6,
When the text-corresponding image and the audio frequency characteristic corresponding image are superimposed,
Wherein the image corresponding to the text corresponding image and the audio frequency characteristic corresponding image is displayed with a larger audio decibel.
The method according to claim 1,
The auto-
And a screen position selection interface for providing a screen position selection interface for selecting a screen position at which the text corresponding image or the audio frequency characteristic corresponding image is to be displayed,
Wherein the terminal control unit displays the text corresponding image or the audio frequency corresponding image at a screen position selected through the screen position selecting interface.

Images