WO2017188470A1

WO2017188470A1 - Method and system for drawing picture by using smart pen

Info

Publication number: WO2017188470A1
Application number: PCT/KR2016/004378
Authority: WO
Inventors: 최원만
Original assignee: 예스튜디오 주식회사
Priority date: 2016-04-26
Filing date: 2016-04-27
Publication date: 2017-11-02
Also published as: KR20170121915A

Abstract

Disclosed is a method and system for drawing a picture by using a smart pen. A method for drawing a picture by using a smart pen according to an embodiment of the present invention comprises the steps of: receiving, from a smart pen, recognition color information corresponding to a surrounding color sensed by the smart pen; displaying a recognition color corresponding to the received recognition color information and at least one relating color associated with the recognition color; determining, as a final color, a color selected by a user's input among the recognition color and the relating color; and outputting a picture corresponding to a movement trajectory of the smart pen in the determined final color.

Description

Drawing method and system using smart pen

The present invention relates to a drawing using a smart pen, and more particularly, to a method and system for drawing using a smart pen that can easily draw a picture by correcting the sensed color to improve the accuracy of the color to be sensed. .

Smartphone penetration among children and adolescents in Korea has recently increased to 50% for elementary school students and 80% for secondary school students. In addition to high smartphone holdings among children and adolescents, the rate of overuse is also increasing. Smartphones are a useful tool for keeping you safe in an emergency, but indiscriminate use can cause mental health problems for children. In particular, there are games, social media addiction, harmful content exposure, online bullying, poor learning ability, and ADHD symptoms. If you are seriously addicted to these smart devices, you may experience a drop in time or space. In particular, continuous use of smart devices from early childhood can affect school life or daily life.

But smart devices don't have this drawback. Recently, art psychotherapy using painting has been used a lot. Particularly, in the case of a young child who is difficult to express, psychological state can be analyzed using such art psychological therapy. At this time, a child who needs art psychological treatment may draw a picture using a smart device, and proceed with psychotherapy by analyzing a child's drawing pattern. By using smart devices in this way, data can be conveniently managed and analyzed.

The technical problem to be achieved by the present invention is to improve the accuracy of the color to be sensed by the smart pen, while improving the problems associated with the use of children's smart devices smart pen that can easily draw a picture The present invention provides a drawing method and system.

Smart pen according to an embodiment of the present invention comprises a main body for allowing a user to hold the smart pen; Sensing unit for sensing the surrounding color; A notification unit for notifying the user of information related to the sensing of the ambient color; A setting unit configured to set an output color of the smart pen with color information corresponding to the sensed ambient color; And an output unit for outputting information on the set output color to draw a picture on a smart paper or a smart terminal according to the set output color.

Furthermore, a smart pen according to an embodiment of the present invention includes a sensing button for controlling the operation of the sensing unit; And a controller configured to control the sensing unit and the notification unit to control sensing and notification of the surrounding color when the sensing button is input.

Furthermore, the smart pen according to an embodiment of the present invention further includes a correction unit for correcting the color information based on the illuminance value sensed by the illuminance sensor included in the sensing unit, and the setting unit includes the corrected color. Information may be set as an output color of the smart pen.

The sensing unit senses a target pattern when a sensing target is set as a pattern, and the setting unit sets pattern information corresponding to the sensed target pattern as an output pattern of the smart pen, and the output unit is smart according to the set output pattern. Information about the set output pattern may be output to draw a picture on a paper or a smart terminal.

Furthermore, the smart pen according to an embodiment of the present invention may further include a coordinate recognition unit for recognizing the coordinates displayed on the smart paper corresponding to the movement trajectory of the smart pen.

Drawing system using a smart pen according to an embodiment of the present invention is a smart pen; And a smart device for visually outputting a picture corresponding to the movement trajectory of the smart pen, wherein the smart pen includes: a main body for allowing a user to hold the smart pen; Sensing unit for sensing the surrounding color; A notification unit for notifying the user of information related to the sensing of the ambient color; A setting unit configured to set an output color of the smart pen with color information corresponding to the sensed ambient color; And an output unit configured to output information about the set output color to the smart device such that a picture is drawn on the smart device according to the set output color.

The smart device may include a display configured to display the output color received from the smart pen and at least one related color associated with the output color; And a controller configured to determine a color selected by the user's input among the output color and the related color as a final color, and to output a picture corresponding to the movement trajectory of the smart pen to the display unit as the determined final color. can do.

The smart device further includes a learning unit learning a final color for each of the colors received from the smart pen based on the colors received from the smart pen and the final colors determined by the user's input. The display unit may display a first color learned about the output color received from the smart pen and at least one related color related to the first color.

The smart device includes a sensing unit for sensing the ambient illuminance of the smart device; A correction unit correcting information on the output color received from the smart pen based on the sensed ambient illuminance value; A display unit to display the corrected color and at least one related color associated with the corrected color; And a controller configured to determine a color selected by the user's input among the output color and the related color as a final color, and to output a picture corresponding to the movement trajectory of the smart pen to the display unit as the determined final color. can do.

The smart device further includes a voice recognition unit recognizing a voice for a color input from the user in a preset language, and the display unit displays the voice recognized color and at least one related color associated with the voice recognized color. can do.

A drawing method using a smart pen according to an embodiment of the present invention comprises the steps of receiving recognition color information corresponding to the ambient color sensed by the smart pen from the smart pen; Displaying a recognition color corresponding to the received recognition color information and at least one related color associated with the recognition color; Determining a color selected by a user's input among the recognized color and the related color as a final color; And outputting a picture corresponding to the movement trajectory of the smart pen in the determined final color.

Furthermore, the drawing method using the smart pen according to an embodiment of the present invention is the final for each of the colors based on the colors recognized and received by the smart pen and the final colors determined by the user's input The method may further include learning a color, and the displaying may include displaying a learned first color for the recognition color received from the smart pen and at least one related color associated with the first color.

Furthermore, the drawing method using a smart pen according to an embodiment of the present invention comprises the steps of sensing the peripheral illumination; And correcting the recognition color based on the sensed ambient illuminance value, wherein the displaying may display the corrected recognition color and at least one related color associated with the corrected recognition color. .

According to the embodiments of the present invention, since the surrounding color may be sensed to represent a desired color, it may be more convenient to express and use color more accurately.

According to embodiments of the present invention, a user corrects a color sensed by the smart pen based on a peripheral illumination value of the smart pen or smart device, displays the corrected color and related colors related to the corrected color on the screen, and then By determining the final color based on the input, you can improve the accuracy of the color and easily draw the picture in the desired color.

In this way, while improving the problems associated with the use of children's smart devices, it can be usefully used for art psychotherapy of children difficult to express using the advantages of smart devices.

1 is a view for explaining the overall operation of the drawing system using a smart pen according to an embodiment of the present invention.

2 is a view for explaining the configuration of a smart pen in a drawing system using a smart pen according to an embodiment of the present invention.

3 is a view illustrating a configuration of a smart device in a drawing system using a smart pen according to an embodiment of the present invention.

4 is a diagram illustrating a method of sensing an ambient color using a smart pen according to an embodiment of the present invention.

5 is a diagram illustrating an example for describing a process of determining a final color based on a user input in a smart device.

FIG. 6 is a flowchart illustrating an example embodiment for describing a process of recognizing a color in a smart pen.

7 is a flowchart illustrating an operation of drawing a picture using a smart pen according to an embodiment of the present invention.

8 is a flowchart illustrating an embodiment of operation S720 of FIG. 7.

FIG. 9 is a flowchart illustrating another operation of step S720 illustrated in FIG. 7.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. Also, like reference numerals in the drawings denote like elements.

1 is a view for explaining the overall operation of the drawing system using a smart pen according to an embodiment of the present invention. The drawing system using the smart pen may include the smart pen 110 and the

smart devices

120 and 130.

The smart pen 110 senses a desired ambient color, sets color information corresponding to the sensed ambient color, and then communicates the output color with the

smart devices

120 and 130 to draw the set color information as the output color. Through the transmission to the smart device (120, 130).

In this case, the smart pen 110 may include a sound function that can audibly notify the user of a voice according to each situation such as the start of sensing of the surrounding color, the end of sensing, the sensed color, and the like. It may also include means for providing a screen.

In addition, if necessary, the smart pen 110 may further include a sensing button for sensing the surrounding color, so that the peripheral color may be sensed using the smart pen when the sensing button is input.

In addition, the smart pen 110 may include an illumination sensor for sensing the ambient illumination in order to prevent an error in color recognition by the illumination of the surrounding environment, and when the ambient illumination value is sensed by the illumination sensor, the sensed ambient By correcting the sensed ambient color based on the illuminance value, it is possible to accurately recognize the ambient color through correction according to the ambient illumination. Of course, the smart pen 110 does not necessarily include an illuminance sensor, and although the smart pen 110 includes an illuminance sensor, the smart pen 110 does not necessarily correct the ambient color sensed by the smart pen 110. For example, when the smart pen 110 includes an illuminance sensor, the smart pen 110 transmits the sensed ambient color and the ambient illuminance value to the smart terminal 130 through wireless communication, thereby surrounding the smart terminal 130. The ambient color can be corrected based on the illuminance value. As another example, when the smart pen 110 does not include an illuminance sensor, the smart pen 110 transmits the sensed ambient color to the smart terminal 130 through wireless communication, and illuminance provided in the smart terminal 130. The ambient color may be corrected based on the ambient light value sensed using the sensor. This is described in FIG. 3.

As such, the smart pen 110 of the present invention may sense a surrounding color to represent a desired color, and thus, the user may feel a more accurate color expression and convenience.

The configuration of the smart pen 110 will be described in detail with reference to FIG. 2.

The

smart devices

120 and 130 may visually output a picture corresponding to the movement trajectory of the smart pen 110. The

smart devices

120 and 130 may include the smart paper 120 or the smart terminal 130.

The system according to an embodiment of the present invention may draw a picture on the smart paper 120 using a smart pen.

The smart paper 120 is indicated by the coordinates 121. The smart pen 110 may recognize the pattern on which the user draws the picture 122 by recognizing the coordinates displayed on the smart paper 120 through the sensor of the smart pen 110.

In addition, the user may store a history of a process of drawing the drawing 122 in the smart pen 110. For example, the user may include a process of sensing an ambient color using a sensor of the smart pen 110, a time for drawing a picture, a pattern for drawing a picture, and the like. The stored information may be transmitted to the smart terminal 130. The information transmitted to the smart terminal 130 may be used, for example, for art psychotherapy of the user.

Also, the smart pen 110 may control the smart paper 120 to communicate with the smart terminal 130 by transmitting the picture 122 drawn by the user on the smart paper 120. For example, when a specific button mounted on the smart pen 110 is pressed, the drawing 122 drawn on the smart paper 120 may be transmitted to the smart terminal 130. Then, the smart terminal 130 may also display the same picture 131 as the picture 122 drawn by the user on the smart paper 120. The information transmitted to the smart terminal may be used for a specific purpose, for example, art psychotherapy or SNS.

In addition, the system according to the embodiment of the present invention is not limited to drawing on the smart paper by using the smart pen 110, it is also possible to draw directly on the smart terminal 130 (or a user terminal). That is, the drawing function may be performed in the smart terminal using the ambient color recognized by the smart pen.

This smart terminal 130 will be described in FIG. 3.

Referring to FIG. 2, the smart pen 200 includes a sensing unit 210, a correction unit 220, a notification unit 230, a display unit 240, a setting unit 250, an output unit 260, and a coordinate recognition unit. 270, a controller 280, and a communication unit 290.

Here, the correction unit 220 and the display unit 240 may not include a corresponding function as necessary, this portion may be determined according to the connection function with the smart terminal. The smart pen 200 in the present invention may include a main body for the user to hold the smart pen, the components shown in Figure 2 may be configured in the main body.

The sensing unit 210 senses the surrounding color. In other words, the sensing unit 210 may sense an ambient color to indicate a color desired by the user. For example, when a user senses an apple using a smart pen, the smart pen may sense the color of the apple through the sensing unit. At this time, the smart pen senses the apple to encrypt the color of the apple, that is, the red color, and the encrypted color may be displayed on the smart paper or the smart terminal. A process of sensing the ambient color through the sensing unit 210 will be described in more detail with reference to FIG. 4.

The sensing unit 210 may be operated by the control of the control unit 280. When the sensing button (not shown) provided in advance is pressed by a user or an external contact, the sensing unit 210 may be controlled by the control by the control unit 280. Can be performed. That is, the sensing unit 210 does not sense the surrounding color when the sensing button is not pressed, and senses the surrounding color under the control of the control unit 280 when the sensing button is pressed.

In this case, the sensing unit 210 may include an illuminance sensor as needed, and in the case where the illuminance sensor is included, the sensing unit 210 may provide a sensed ambient illuminance value by sensing the ambient illuminance. Of course, the peripheral illumination value may be provided to the correction unit when correcting the ambient color sensed by the smart pen, and may be provided to the smart terminal through the communication unit when correcting the ambient color sensed by the smart terminal.

In addition, the sensing unit 210 may sense a pattern. For example, when the sensing target of the smart pen is set as a pattern, the sensing unit 210 may sense the target pattern, and may also sense the color of the target pattern when sensing the target pattern. Of course, when the sensing unit 210 senses the pattern, it is obvious that the configuration of the smart pen and the configuration of the smart terminal to be described below are changed to the content of the sensed pattern.

The correction unit 220 corrects the sensed ambient color based on the received ambient light intensity value when the ambient light intensity value and the sensed ambient color information of the surrounding environment are received from the sensing unit 210. That is, the correction unit 220 may reduce or minimize the recognition error of the surrounding color by correcting the color error recognized according to the surrounding illumination using the surrounding illumination value.

Of course, such a correction unit 220 may be omitted when the correction of the surrounding color in the smart device.

The notification unit 230 is a component for audibly providing information related to the sensing of the smart pen to the user. The notification unit 230 includes a sound function and provides a sensing function performed by the control by the controller 280 as sound. .

For example, the notification unit 230 may provide a sound for the start of sensing when the sensing of the ambient color starts, and provide a sound for the end of the sensing when the sensing of the ambient color ends. When the color information about the surrounding color is set, a sound for the set color information may be provided.

The display unit 240 displays color information being performed or set in the smart pen 200 on the screen, and displays information related to sensing, set color information, and setting information of the smart pen on the screen. Of course, the display unit 240 may be omitted if necessary.

The setting unit 250 sets the color information of the surrounding color recognized by the smart pen 200 as the output color of the smart pen.

In this case, when the correction unit 220 is provided, the setting unit 250 may set the color information corrected by the correction unit 220 as an output color, and when the correction unit 220 is omitted, the sensing unit ( Color information sensed by 210 may be set as an output color.

The output unit 260 may output information about an output color set to draw a picture on a smart paper or a smart terminal according to the set output color. In other words, the smart pen can sense the surrounding color to indicate the desired color, so that the user can feel more accurate color expression and convenience.

The coordinate recognition unit 270 recognizes the coordinates displayed on the smart paper corresponding to the movement trajectory of the smart pen.

At this time, the coordinate recognition unit 270 may recognize a process of drawing a picture on the smart paper by the user by recognizing the coordinates displayed on the smart paper. For example, a history of sensing an ambient color, a time for drawing a picture, and a pattern for drawing a picture may be recognized using a sensor of a smart pen. And you can store these histories.

The information thus stored may be transmitted to the smart terminal. In other words, the history of the process of drawing on the smart paper can be transmitted to the smart terminal. The information transmitted to the smart terminal may be used, for example, art psychotherapy of the user.

Such a smart pen may draw a picture directly on the smart terminal with the color indicated by sensing not only the smart paper but also the surrounding color. At this time, by detecting and displaying the sensed color, more accurate color expression is possible.

The controller 280 is a means for controlling the configuration means constituting the smart pen.

In this case, the controller 280 may control the sensing unit 210 and the notification unit 230 when the sensing button is input to control the sensing of the surrounding color and the notification of information related to the sensing.

The communication unit 290 performs wireless communication with the smart paper or the smart terminal under the control of the control unit 280.

Although the smart pen has been described as the sensing of the ambient color by the sensing unit in FIG. It may also include a configuration for recognizing.

In addition, the smart pen may be added with a voice recognition function as needed.

Referring to FIG. 3, the smart terminal 300 includes a sensing unit 310, a correction unit 320, a notification unit 330, a display unit 340, a voice recognition unit 350, a learning unit 360, and a storage unit. 370, a control unit 380, and a communication unit 390. Here, the sensing unit 310 may be omitted when the peripheral illumination value is received from the smart pen.

The sensing unit 310 includes an illuminance sensor and senses an ambient illuminance of the smart terminal 300 and outputs an ambient illuminance value.

The correction unit 320 corrects the information on the output color received from the smart pen.

In this case, when the smart pen is a smart pen that does not include an illuminance sensor, the corrector 320 may correct information on the output color based on the ambient illuminance value sensed by the sensing unit 310. It is possible to know whether the illumination sensor is included on the basis of the identification information on the.

Further, the correction unit 320 may correct the output color received from the smart pen to the first color based on the learning information on the final color learned according to the color information received from the smart pen. In this case, the first color for each output color may be learned by learning between a user selection of the final color using the user interface described below and learning of the received output color.

The notification unit 330 may perform the same function as the function of the notification unit described in the smart pen, and may inform the sensing related information through communication with the smart pen.

Of course, the notification unit 330 may also inform the smart terminal of the information related to performing or selecting a function related to the present invention as a sound function.

The display unit 340 displays (or displays) the output color received from the smart pen and at least one related color related to the output color, so that the final color can be selected through a user input.

In this case, when the output color is corrected by the peripheral illumination value, the display unit 340 may display the color corrected by the peripheral illumination value and at least one related color related to the corrected color on the screen. When corrected to the first color by the learning information learned for each output color, the first color and at least one related color related to the first color may be displayed on the screen.

For example, as illustrated in FIG. 5A, the display unit 340 displays the output color 510 received from the smart pen and

related colors

520, 530, and 540 related to the output color 510 on the screen. User input allows the final color to be determined.

As another example, as illustrated in FIG. 5B, the display unit 340 corrects the corrected color 540 and the corrected color 540 when the output color 510 received from the smart pen is corrected by the ambient illumination value or the learning information. The

relevant colors

510, 520, and 530 related to) may be displayed on the screen to determine the final color through user input. In FIG. 5B, the corrected color 540 and

related colors

510, 520, and 530 associated with the corrected color 540 are illustrated and described with reference to FIG. 5A, but the present invention is not limited thereto. Related colors may be determined as other colors.

The voice recognition unit 350 is a constituent means for recognizing a user's voice and performs voice recognition on a language set by the user.

For example, the voice recognition unit 350 may provide voice-recognized color information to the controller or display unit by recognizing a voice for a color input in a language set by a user.

The learning unit 360 outputs the final colors according to each of the output colors based on the result of the final color finally selected by the user among the colors displayed through the display unit for each of the output colors received from the smart pen, thereby outputting the output colors. Learn the final color by color.

In this case, the learner 360 may additionally reflect not only the output color but also the peripheral illumination value, thereby learning the final color according to the output color and the peripheral illumination value.

The storage unit 370 is a configuration means for storing information according to the present invention. The storage unit 370 stores learning data about a final color for each output color, a drawing history generated by a smart pen, picture data transmitted from a smart sheet, and the like.

The controller 380 is a color displayed on the display unit 340 (wherein, the color represents one of a color corrected by learning information and a color corrected based on an output color received from a smart pen, a peripheral illumination value, and learning information). ) And the color selected by the user's input among the at least one related color related to the corresponding color as the final color, and outputs the picture corresponding to the movement trajectory of the smart pen to the display unit with the determined final color.

The communication unit 390 receives data related to drawing by performing wireless communication with the smart paper or the smart pen under the control of the control unit 380.

In addition, although not shown, the smart pen according to the present invention may provide braille output corresponding to the set output color.

As shown in FIG. 4, the smart pen 411 may indicate a color desired by the user by sensing an ambient color through the sensing unit. For example, when the user senses the apple 420 using the smart pen 411, the smart pen 411 may sense the color of the apple 420 through the sensing unit.

In this case, the smart pen 411 may sense the color of the apple, for example, red by sensing the color of the apple 420, and may display the encrypted color on the smart paper or the smart terminal.

The same color 431 as the color of the apple may be displayed on the smart terminal 430 using the smart pen 412 that senses the color of the apple. Of course, it has been described in detail through the above-described description that the color information sensed through the ambient illuminance value and the learning information may be corrected and the accuracy of the color to be sensed may be improved through the above description. It is apparent that the drawing function can be performed with the color of 420. In this way, the surrounding color can be sensed to represent the desired color, which makes it more convenient to express and use color more accurately. The smart pen 411 can draw a picture not only on smart paper but also on a smart terminal.

FIG. 6 is a flowchart illustrating an embodiment for describing a process of recognizing a color in a smart pen, and illustrates an operation flowchart of the smart pen shown in FIG. 2. 6 illustrates an operation of correcting and providing a sensed ambient color using a peripheral illumination value in a smart pen.

Referring to FIG. 6, the smart pen senses the surrounding color and provides a notification through sound (or voice) related to the sensing (S610).

Here, step S610 may be performed by the sensing unit and the notification unit of the smart pen, and the sensing notification function may notify the user by voice of the start of sensing, the end of sensing, and the sensed color information using the sound function.

In order to correct the ambient color sensed by the step S610, the ambient light of the smart pen is sensed using the illumination sensor, and the sensed ambient color is corrected based on the sensed ambient light value (S620).

In this case, in operation S620, when the peripheral color correction using the peripheral illumination value is not performed in the smart pen, the operation for the peripheral color correction may be omitted.

When the ambient color is corrected by the step S620, the corrected ambient color is set as the output color, and the set output color information is transmitted to the user terminal, for example, the smart terminal, so that the related color related to the output color or the output color is output from the smart terminal. A picture drawing function may be performed using the apparatus (S640).

Although not described in FIG. 6, the function of the smart pen in FIG. 2 may also be included in the process of recognizing color in the smart pen of FIG. 6.

FIG. 7 is a flowchart illustrating an operation of drawing a picture using a smart pen according to an embodiment of the present invention, and illustrates an operation flowchart of the smart terminal illustrated in FIG. 3.

Referring to FIG. 7, a drawing method using a smart pen according to the present invention receives color information (output color information in FIG. 6) transmitted from a smart pen in a smart device, and relates to the received output color and output color. A plurality of related colors are displayed (S710 and S720).

Here, in step S720, when the illuminance sensor is not provided in the smart pen that transmits the output color information, as illustrated in FIG. 8, the peripheral illuminance of the smart terminal is sensed using the illuminance sensor provided in the smart terminal and sensed. The output color is corrected based on the ambient illuminance value, and the corrected output color and related colors related to the corrected output color are displayed on the screen (S810 and S820).

Of course, in step S720, when the illuminance sensor is provided in the smart pen transmitting the output color information, and the peripheral illuminance value of the smart pen is received from the smart pen, the output color is corrected based on the received peripheral illuminance value, and the corrected output is performed. Related colors related to the color and the corrected output color may be displayed on the screen. If the output color information received from the smart pen is the color information already corrected by the peripheral illumination value sensed by the smart pen, the step of FIG. 7 is performed. As described in S720, the output color and related colors related to the output color may be displayed.

In addition, step S720 may correct the output color by using the learning information on the final color learned for each output color. As shown in FIG. 9, in step S720, the final color according to each of the received output colors is learned. The output color received in step S710 is corrected to the first color based on the learned information, and the first color and related colors related to the first color are displayed on the screen (S910 and S920).

If colors for clearly determining the ambient color sensed by the smart pen on the screen are displayed in step S720, the final color is determined based on a user input, and the final color determined according to the movement trajectory of the smart pen is displayed on the screen. By outputting to the smart terminal, the drawing function is performed (S730 and S740).

In this case, when the final color for the output color is determined by the step S730, a learning process of the final color for the output color may be performed using the corresponding output color and the determined final color. You can update it.

Here, in operation S740, when the color and the pattern are sensed by the smart pen, a drawing function having the color and the pattern may be performed.

In addition, the history of the drawing process in step S740 may be stored in the smart pen, the history stored in the smart pen may be transmitted to the smart terminal.

At this time, the history of the drawing process may recognize the process of the user drawing on the smart paper by recognizing the coordinates displayed on the smart paper corresponding to the movement trajectory of the smart pen through the coordinate recognition unit of the smart pen. For example, a history of sensing an ambient color, a drawing time, and a drawing pattern may be recognized and stored in the smart pen using a sensor of the smart pen.

In addition, the method according to the embodiment of the present invention can control the smart paper to transmit the smart paper communicates with the smart terminal. For example, when a specific button mounted on the smart pen is pressed, a picture drawn on smart paper can be transmitted to the smart terminal. Then, the same picture as that drawn by the user on the smart paper can be displayed on the smart terminal. The information transmitted to the smart terminal may be used for art psychotherapy or SNS, for example.

Although not described in FIG. 7, all of the functions described in the above-described smart pen and smart terminal of FIGS. 2 and 3 may be included, and these functions may be included in the method according to the present invention.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be, for example, processors, controllers, arithmetic logic units (ALUs), digital signal processors, microcomputers, field programmable arrays (FPAs), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For convenience of explanation, one processing device may be described as being used, but one of ordinary skill in the art will appreciate that the processing device includes a plurality of processing elements and / or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as parallel processors.

The software may include a computer program, code, instructions, or a combination of one or more of the above, and configure the processing device to operate as desired, or process it independently or collectively. You can command the device. Software and / or data may be any type of machine, component, physical device, virtual equipment, computer storage medium or device in order to be interpreted by or to provide instructions or data to the processing device. Or may be permanently or temporarily embodied in a signal wave to be transmitted. The software may be distributed over networked computer systems so that they may be stored or executed in a distributed manner. Software and data may be stored on one or more computer readable recording media.

The method according to the embodiment may be embodied in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the media may be those specially designed and constructed for the purposes of the embodiments, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the claims that follow.

Claims

A main body for allowing a user to hold a smart pen;

Sensing unit for sensing the surrounding color;

A notification unit for notifying the user of information related to the sensing of the ambient color;

A setting unit configured to set an output color of the smart pen with color information corresponding to the sensed ambient color; And

An output unit for outputting information on the set output color to draw a picture on a smart paper or a smart terminal according to the set output color

Smart pen containing a.
The method of claim 1,

A sensing button for controlling an operation of the sensing unit; And

Control unit for controlling the sensing and notification of the ambient color by controlling the sensing unit and the notification unit when the sensing button is input

Smart pen, characterized in that it further comprises.
The method of claim 1,

A correction unit correcting the color information based on an illuminance value sensed by an illuminance sensor included in the sensing unit

More,

The setting unit

The smart pen, characterized in that for setting the corrected color information as the output color of the smart pen.
The method of claim 1,

The sensing unit

When the sensing target is set as a pattern, the sensing target pattern is detected.

The setting unit

Setting pattern information corresponding to the sensed target pattern as an output pattern of the smart pen,

The output unit

And a smart pen outputting information on the set output pattern to draw a picture on a smart paper or a smart terminal according to the set output pattern.
The method of claim 1,

Coordinate recognition unit for recognizing the coordinates displayed on the smart paper corresponding to the movement trajectory of the smart pen

Smart pen, characterized in that it further comprises.
Smart pens; And

Smart device for visually outputting a picture corresponding to the movement trajectory of the smart pen

Including,

The smart pen,

A main body for allowing a user to hold the smart pen;

Sensing unit for sensing the surrounding color;

A notification unit for notifying the user of information related to the sensing of the ambient color;

A setting unit configured to set an output color of the smart pen with color information corresponding to the sensed ambient color; And

An output unit for outputting information on the set output color to the smart device such that a picture is drawn on the smart device according to the set output color

Drawing system using a smart pen comprising a.
The method of claim 6,

The smart device

A display unit to display the output color received from the smart pen and at least one related color associated with the output color; And

A control unit which determines a color selected by the user's input among the output color and the related color as a final color, and outputs a picture corresponding to the movement trajectory of the smart pen to the display unit as the determined final color;

Drawing system using a smart pen, characterized in that it comprises a.
The method of claim 7, wherein

The smart device

Learning unit for learning the final color for each of the colors received from the smart pen based on the colors received from the smart pen and the final colors determined by the user's input

More,

The display unit

And a first color learned about the output color received from the smart pen and at least one related color related to the first color.
The method of claim 6,

The smart device

Sensing unit for sensing the peripheral illumination of the smart device;

A correction unit correcting information on the output color received from the smart pen based on the sensed ambient illuminance value;

A display unit to display the corrected color and at least one related color associated with the corrected color; And

A control unit which determines a color selected by the user's input among the output color and the related color as a final color, and outputs a picture corresponding to the movement trajectory of the smart pen to the display unit as the determined final color;

Drawing system using a smart pen, characterized in that it comprises a.
The method of claim 7, wherein

The smart device

Speech recognition unit for recognizing the voice of the color input from the user in a preset language

More,

The display unit

And displaying at least one related color associated with the speech recognized color and the speech recognized color.
Receiving recognition color information from the smart pen corresponding to the ambient color sensed by the smart pen;

Displaying a recognition color corresponding to the received recognition color information and at least one related color associated with the recognition color;

Determining a color selected by a user's input among the recognized color and the related color as a final color; And

Outputting a picture corresponding to a movement trajectory of the smart pen with the determined final color;

Drawing method using a smart pen comprising a.
The method of claim 11,

Learning a final color for each of the colors based on the colors recognized and received by the smart pen and the final colors determined by the user input;

More,

The displaying step

And displaying at least one related color related to the first color and the learned first color with respect to the recognized color received from the smart pen.
The method of claim 11,

Sensing ambient illuminance; And

Correcting the recognition color based on the sensed ambient illuminance value

More,

The displaying step

And displaying at least one related color associated with the corrected recognition color and the corrected recognition color.