KR20150101843A - Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor - Google Patents

Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor Download PDF

Info

Publication number
KR20150101843A
KR20150101843A KR1020140023636A KR20140023636A KR20150101843A KR 20150101843 A KR20150101843 A KR 20150101843A KR 1020140023636 A KR1020140023636 A KR 1020140023636A KR 20140023636 A KR20140023636 A KR 20140023636A KR 20150101843 A KR20150101843 A KR 20150101843A
Authority
KR
South Korea
Prior art keywords
sketch
information
image
search
stroke
Prior art date
Application number
KR1020140023636A
Other languages
Korean (ko)
Inventor
전혁준
신형철
전병기
Original Assignee
에스케이플래닛 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 에스케이플래닛 주식회사 filed Critical 에스케이플래닛 주식회사
Priority to KR1020140023636A priority Critical patent/KR20150101843A/en
Publication of KR20150101843A publication Critical patent/KR20150101843A/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Abstract

The present invention relates to a sketch retrieval system with a guide responding to a drawing situation having the outlines of the corresponding parts of rough sketch images provided to the guide appear relatively bolder or more distinct than those of other parts while performing a sketch through a sketch retrieval interface screen, a user apparatus, a service providing apparatus, a service method thereof, and a recording medium having a computer program recorded therefor. The present invention easily identifies the rough sketch image when the rough sketch image is overlapped with other rough sketch images, thereby easily drawing a picture along the rough sketch image.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sketch retrieval system, a user apparatus, a service providing apparatus, a service method thereof, and a recording medium on which a computer program is recorded, and computer readable medium having computer program recorded there}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sketch search system, a user apparatus, a service providing apparatus, a service method thereof, and a recording medium on which a computer program is recorded, A user device, a service providing device, a service method thereof, and a computer program recorded thereon, the sketch search system having a guide responsive to a sketch image drawing situation such that an outline or internal state of sketch images provided to the sketch image is variable.

In recent years, demand for multimedia information services has increased along with the development of computers and communication technologies. VOD (Video On Demand) service, digital library, medical field (for example, Telemedicine, medical image retrieval), and so on.

At the beginning of the research, a text-based search has been used in which a person manually adds an index to all multimedia data to be searched, and a user searches for desired information using a keyword.

However, this method takes a lot of time and content, and there is a problem that efficiency of retrieval is greatly deteriorated when a viewpoint of a person who adds an index is different from a viewpoint of a searching user. In addition, there is a disadvantage that complex attributes of multimedia data can not be expressed accurately by text alone. In order to overcome this problem, a content - based retrieval method is needed to extract features that can represent the contents of multimedia data and to perform indexing and detection based on the features.

One of these contents-based search methods is to recognize a picture drawn while the user touches the touch pad and to perform a search using the recognized result. However, when the sketch quality is poor, the accuracy of the search result is lowered. In order to solve this problem, a sketch corresponding to a sketch situation is sometimes provided to guide the sketch operation. However, since a plurality of candidate sketches are provided in a superimposed manner, the sketch can not be clearly distinguished, A situation occurs.

Korean Patent No. 1005407480000 [Title: Improved Query Method for Content-Based Retrieval and Recording Medium Saving Program for Implementing the Method]

In order to minimize the inconvenience of the user, the present invention provides a sketch search interface for responding to a drawing situation in which a sketched outline among the outline of sketch images provided as guides during sketching is relatively thicker or clearer than other outlines A user apparatus, a service providing apparatus, a service method thereof, and a recording medium on which a computer program is recorded.

In addition, the present invention provides a sketch search system having a guide that responds to a drawing situation in which an outline is relatively thick or clear when a first drawing is performed, and a relatively large or clear inner area is provided when a sketch is gradually specified, A service providing method thereof, and a recording medium on which a computer program is recorded.

A sketch search user device having a guide responsive to a drawing situation according to an embodiment of the present invention includes a sketch area for displaying a sketch to provide a guide for sketch input and a sketch area for sketch search results, A stroke recognition unit for detecting and outputting stroke information of a user during a sketch in the sketch area, a display interface unit for varying a representation state of the sketch output in the sketch area according to the stroke information input through the stroke recognition unit, A sketch image variable part for relatively emphasizing a part of the sketch and a stroke information of the user inputted through the sketch search interface part to the service providing device and then receiving a sketch image corresponding to the sketch according to a series of input strokes and a search result So Sketch search may include a control unit that outputs to the interface unit.

As an example related to the present invention, the outline of the sketch image within a predetermined working radius is displayed in a relatively bold shape as compared with the outline of another sketch image, and the outline of the inner area of the sketch image is gradually emphasized Can be displayed.

An apparatus for providing a sketch search service provided with a guide responsive to a drawing situation according to an exemplary embodiment of the present invention includes a sketch image database unit storing a plurality of sketch images, a sketch image database unit for storing a sketch image database based on a series of stroke information received from the user apparatus, A sketch image for selecting a sketch from a database and generating information on a sketch emphasis of the sketch image selected based on the sketch state according to the stroke information, a sketch image variable information sketch, a sketch image, And a sketch search information providing unit for providing information on the sketch to the user device.

As an example related to the present invention, the sketch image database unit may further store an original image corresponding to a sketch image, and the sketch search information providing unit may provide an original image corresponding to the sketch together with a selected sketch to the user device as a search result have.

As an example related to the present invention, the sketch image database unit further stores web page link information corresponding to an original image, and the sketch search information providing unit provides web page link information corresponding to an original image provided as a search result, Device.

As an example related to the present invention, the sketch image variable information providing unit may include information for making the sketch corresponding to the stroke information correspond to a sketch that does not correspond to the sketch, or a modified sketch in which the corresponding sketch is more vividly or boldly deformed It can be created with information about the sketch to emphasize.

As an example related to the present invention, the sketch image variable information providing unit may generate information for blurring the sketch that does not correspond to the stroke information, or information about the sketch for emphasizing the changed sketch in which the unmatched sketch is further blurred can do.

According to one embodiment of the present invention, the sketch image variable information providing unit determines information about the sketch to be emphasized so that the area inside the object frame of the selected sketch can be gradually emphasized by judging the sketch progress according to the accumulation of the series of stroke information can do.

A sketch search service method having a guide responsive to a drawing situation according to an embodiment of the present invention includes the steps of receiving stroke information input to a sketch area from a user device having a sketch area in which a sketch is displayed, A step of selecting sketch images corresponding to a series of stroke information in which the providing apparatus is received, varying a presentation state of sketched images so that the sketch area related to the sketch is relatively emphasized based on the stroke information, And providing the service providing apparatus to the user apparatus so that the selected sketch image whose display state is variable is used as a sketch of the sketch region.

A computer program for performing a sketch search service method having a guide responsive to a drawing situation according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The sketch search system having a guide responsive to a drawing situation according to an exemplary embodiment of the present invention provides stroke recognition information generated through a sketch area of a sketch search interface, and provides sketch images received according to stroke recognition information A user apparatus that displays the sketch area in a sketch area while varying the expression so that the sketch area is relatively emphasized, receives the stroke recognition information from the user apparatus, selects outline sketch images corresponding to the series of stroke information, And a service providing device for providing a user device with an emphasis on a border of an object or an outline of an inner area in a sketch image corresponding to the sketch.

The present invention allows an outline of a sketched sketch outline of sketched images provided as a guide during sketching through a sketch search interface to be relatively thicker or sharper than other outlines, There is an effect that it is easy to draw along the outline image because the discrimination about the outline is increased.

In addition, in the present invention, the outline of the outer frame of the object is made relatively thick or clear at the beginning of the sketch, and when the sketch is gradually materialized, the outline of the inner area is gradually thickened or articulated. The guide object can be easily distinguished and the sketch can be continuously predicted.

1 is a block diagram showing a configuration of a sketch search system provided with a guide responsive to a drawing situation according to an embodiment of the present invention.
2 is a block diagram showing a configuration of a user apparatus of a sketch search system provided with a guide responsive to a drawing situation of the present invention.
3 is a block diagram showing a configuration of a service providing apparatus of a sketch search system provided with a guide responsive to a drawing situation of the present invention.
4 is a flowchart illustrating a sketch search service method in a sketch search system provided with a guide responsive to a drawing situation of the present invention.
5 is an exemplary view showing an example of a sketch search screen in a search system provided with a guide responsive to a drawing situation of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms can be understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as "comprising" or "comprising" and the like should not be construed as encompassing various elements or various steps of the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating a configuration of a sketch search system having a guide responsive to a drawing situation according to an embodiment of the present invention. As shown in FIG. 1, a user apparatus 100, a user apparatus 100, And a service providing apparatus 200 connected thereto.

The user apparatus 100 provides the sketch search interface composed of the sketch area and the search result output area to the user so that the user transmits the stroke recognition information about the stroke applied by the user while performing the sketch through the sketch area to the service providing apparatus 200 The candidate sketch image is received and displayed in the sketch area and the search result output area. Since the candidate sketch image is for helping the sketch, the outline extracted image may be used so as to correspond to the actual sketch. In the sketch area, the candidate sketch image is superimposed and displayed as a blurred sketch, and the user can use it as a guide to help the sketch process. If the original image corresponding to the sketch image is further received, the candidate sketch image is displayed as a sketch in the sketch area, and the original image corresponding to the candidate sketch image is displayed in the search result output area in various ways (list, scroll, etc.) .

Meanwhile, in the embodiment of the present invention, when providing a candidate sketch image superimposed on a sketch area, the user device 100 may further sharpen or outline the outline of the sketch image that the user follows among the overlapped sketches according to the sketch progress state of the user Let it be displayed in bold to prevent situations where it is difficult to distinguish objects to be drawn by overlapping outlines. Also, the user device 100 may be configured such that the intricate interior of the object represented by the sketch is initially blurred, and then the sketch for the sketch guide is displayed according to the sketch state So that the user can easily follow it.

The service providing apparatus 200 extracts candidate sketch images based on the stroke information provided from the user device 100 and provides them as sketch search information. The sketch search information includes an original image corresponding to the candidate sketch image, Lt; RTI ID = 0.0 > web page. ≪ / RTI > When the service providing apparatus 200 provides a candidate sketch image to be provided to the user apparatus 100, the service providing apparatus 200 may provide each of the candidate sketches to the user apparatus 100 or may provide an overlapped image.

The variable candidate sketch image during the above-described sketching process, that is, the candidate sketch image emphasizing the selection sketch or emphasizing the inner region according to the sketch progression, is received by the user device 100 and displayed in the sketch area Or provide the sketch image reflecting the emphasis area to the user device 100 when the service providing device 200 provides the candidate sketch image based on the stroke information received from the user device 100 It is possible.

For example, when the service providing apparatus 200 substantially manages the sketch search interface provided to the user apparatus 100 with a kind of web program, when the user cumulatively receives the stroke performed on the sketch area, And display it in the sketch area of the user device 100. At this time, it is possible to provide a flexible overlapping sketch according to the progress state of the sketch process.

2 is a block diagram showing a configuration of a user apparatus of a sketch search system provided with a guide responsive to a drawing situation of the present invention.

2, the user apparatus 100 includes a sketch search interface unit 110, a stroke recognition unit 120, a sketch image variable unit 130, and a controller 140.

Not all of the components of the user device 100 shown in Fig. 2 are required, and a user device 100 capable of implementing a sketch search system by more components than the components shown in Fig. 2 is implemented And the user device 100 can be implemented by fewer components than shown when a substantial sketch image variable is performed in the service providing apparatus 200. [

The user device 100 is a terminal capable of transmitting and receiving various data via a communication network according to a key operation of a user. The user device 100 may be a tablet PC, a notebook PC, a laptop, A smart phone, a personal digital assistant (PDA), and a mobile communication terminal.

The user device 100 also includes a browser for communicating with the service providing apparatus 200 via the communication network 300, a memory for storing programs and protocols, a microprocessor for executing and controlling various programs, and the like The terminal device may be a terminal device. That is, if the user apparatus 100 can perform server-client communication with the service providing apparatus 200 and can execute a sketch search service using a guide responsive to a drawing situation, any terminal can be used, A PDA, and the like. Meanwhile, the user device 100 is preferably formed with a touch screen, but is not limited thereto.

The sketch search interface unit 110 includes a sketch area for displaying a sketch for providing a sketch input guide and a searched result output area for listing sketch search results. The sketch search interface unit 110 sketches a sketch image provided from the service providing apparatus 200, Area and the search result output area. At this time, the original image of the sketch image output in the sketch area may be output in the search result output area. In addition, the original image may include the link information of the homepage, so that when the user clicks on the homepage, the user can move to the homepage of the original image and access detailed information.

The sketch search interface unit 110 may include general input devices such as, for example, a small keyboard, a pen mouse, a joystick, a touch screen, a touch pad, and the like.

The stroke recognition unit 120 detects and outputs the stroke information of the user during sketching in the sketch area.

The sketch image variable 130 receives stroke information of the user and recognizes the sketch work area. After expanding the recognized work area to a preset work area range, the outline of the sketch in the extended work area is made thicker than the other outline Display. For example, it is possible to expand the frame portion of the sketch through which the outline is passed at the position where the user provided the stroke in the plurality of sketches to the work area, and to display it clearly or in bold so that the corresponding frame portion can be drawn easily. The sketch corresponding to the outline of the sketch may be gradually vividly or boldly displayed to guide the sketch to the detailed sketch.

The sketch image variable 130 receives sketch image variable information from the sketch image variable information providing unit 230 of the service providing apparatus 200 and displays the sketch image variable information on one or more sketches output in the sketch region. Here, the sketch image variable information indicates that the outline of the sketch image positioned within the predetermined working radius is relatively thick or clear relative to the other outline at the beginning of the sketch operation, and when the sketch time is recognized as the latter time of the sketch operation, And may be configured in the service providing apparatus 200. For example, the service providing apparatus 200 may be configured such that the internal area is relatively thick or clearly displayed.

The control unit 140 transmits a sketch search execution request signal according to a user's input to the service providing apparatus 200 and controls the sketch search interface provided by the service providing apparatus 200 to be displayed on the screen, And provides a communication environment between the user device 100 and the service providing device 200 so that sketch searching is performed through the service providing device 200. [

The control unit 140 directly or cumulatively processes the stroke information of the user input through the sketch search interface unit 110 and provides the stroke information to the service providing apparatus 200. The control unit 140 displays the candidate sketch image selected from the service providing apparatus 200, And controls the sketch search interface unit 110 to display the sketch search information including the original image corresponding thereto in a sketch area and a search result output area. The control unit 140 extracts only the minutia information from the stroke information input from the sketch search interface unit 110 and provides only the minutia information to the service apparatus 200. The user apparatus 100 and the service providing apparatus 200, It is possible to prevent the problem that the service speed is lowered by reducing the mutual load.

3 is a block diagram showing a configuration of a service providing apparatus of a sketch search system provided with a guide responsive to a drawing situation of the present invention.

3, the service providing apparatus 200 basically comprises a sketch image database unit 210, a sketch image variable information providing unit 220, and a sketch search information providing unit 230.

The illustrated sketch image database 210 stores a plurality of sketch images and corresponding original images. If necessary, web page links linked to the original and category information analyzing the web page content can also be stored. The plurality of sketch images may be classified and stored and managed according to categories. Here, the sketch image may be a border of a specific object and an outline image of the inside.

The sketch image variable information providing unit 220 generates sketched image variable information that changes the display state of the sketch image when the sketch line of the user is approximated within a certain range with respect to the sketch images superimposed on the sketch region, 100). In other words, the user can accumulate the strokes of the user to construct information about the sketch, and provide information about the sketch image to be emphasized according to the sketch state to the user device 100. Of course, as described above, when the sketch image variable 130 of the user device 100 varies the sketch image corresponding to the stroke of the user, the function of the sketch image variable information providing unit 220 may be reduced The sketch image variable information providing unit 220 may perform a sketch variable according to a substantial sketch state when the sketch image changing unit 130 of the user device 100 simply changes the rendering state.

For example, the sketch image variable information providing unit 220 may vary the outline of the sketch image so that the outline of the sketch image becomes coarse and clear when the sketch line of the user is within a certain range, and when the progress degree of the sketch operation exceeds the preset time It is possible to generate sketch image variable information that allows the inner area of the sketch image to be displayed clearly or in bold, and provide the sketch image variable information to the user device 100.

The sketch search information providing unit 230 provides the sketch search information including the sketch image to be emphasized by the sketch image variable information providing unit 220 to the user device 100 according to the stroke information received from the user device 100 do. The sketch search information provided to the user device 100 may include a candidate sketch image to be displayed in the sketch area and the search result output area, an original image corresponding to the candidate sketch image, and link information linked to the original image. The candidate sketch image included in the sketch search information or the original image corresponding thereto is provided to the user device 100 as a search result and the user device 100 displays the search result in the search result output area of the sketch search interface 110 Can be displayed on a screen or can be provided by a scroll method.

The sketch search information providing unit 230 provides an interval setting menu item for setting the interval between the sketch line and the drag line to the user device 100 and displays the sketch information to the user device 100 by the interval setting method selected according to the interval setting menu item Can set the interval of the sketch line drawn in the sketch according to the drag line and the drag line and expose the sketch line on the sketch along the drag line when the stroke information is inputted within the set interval.

That is, when the user sketches along the sketch image of the sketch region, the sketched tool is covered with the edge line of the sketch image, which makes it inconvenient to sketch. For example, this phenomenon may be small for thin pens, but if the sketch tool is thick, such as the user's hand, the sketch tool will hide the sketch image, making it difficult to sketch based on the sketch image. If the sketch is sketched along the edge line of the sketch image at a position spaced apart from the edge line of the sketch image, a drag line may be displayed along the sketch line along the edge line of the sketch image. The sketch search information providing unit 230 of the service providing apparatus 200 provides an interval setting menu item and can set the relation between the drag line and the sketch line by selecting the interval setting menu item at the initial stage of the sketch operation or at a desired time point have.

The interval setting menu item includes a first interval setting menu item for simultaneously setting the interval between the sketch line and the drag line by clicking the drag area and the draw area with a double-touch, and a first interval setting menu item for sequentially clicking the drag area and the draw area, A second interval setting menu item for setting an interval between the sketch line and the drag line by setting the edge length by selecting both end points where the drag area and the draw area meet, 3 interval setting menu item, and a fourth interval setting menu item for setting the interval between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting.

The sketch search information providing unit 230 may select the edge when the third interval setting menu item or the fourth interval setting menu item is selected to change the positions of the drag area and the draw area.

In the previous embodiment, the sketch search information providing unit 230 of the service providing apparatus 200 has an additional user interface support function for solving a situation where it is difficult to perform a sketch while checking a sketch when a user inputs a stroke through a sketch interface However, such a function may be performed independently or in conjunction with the service providing apparatus 200 in the sketch search interface unit 110 of the user apparatus 100. [ This will be apparent to those skilled in the art from the foregoing description and thus will not be described further.

A sketch searching method in a sketch searching system provided with a guide responsive to the drawing situation thus constructed will be described in detail with reference to the accompanying drawings.

4 is a flowchart illustrating a sketch search service method in a sketch search system provided with a guide responsive to a drawing situation of the present invention.

As shown in FIG. 4, the service providing apparatus 200 determines whether a sketch search execution request signal is received from the user device 100 (S110). If the sketch search execution request signal is received, And a search result output area to the user device 100 (S120).

The service providing apparatus 200 determines whether or not stroke recognition information is received from the user device 100 (S130). If the determination result indicates that the stroke recognition information has been received, the service providing apparatus 200 transmits the stroke recognition information to the filtering condition And extracts the sketch images (S140).

Then, the user device 100 displays the overlapped sketch image in the sketch area, and the outline of the sketch images located within the predetermined radius from the area where the sketch operation is performed during the sketch operation is sharpened or bolded, In accordance with the progress of the sketch operation, the inner area is provided in a sharp or bold variable manner (S150). Of course, the control of the variable presentation method for the sketch image may be mainly performed in the service providing apparatus 200 or may be performed in a manner that the service providing apparatus 200 and the user apparatus 100 share functions have.

If it is determined in step S130 that the stroke recognition information is not received, the service providing apparatus 200 determines whether or not a termination signal is received from the user device 100. If the termination signal is received, the service providing apparatus 200 terminates the sketch search service mode S160).

5 is an exemplary view showing an example of a sketch search screen in a search system provided with a guide responsive to a drawing situation of the present invention. FIG. 5A is a diagram illustrating a state in which an outline corresponding to a predetermined radius or reference from an area being sketched is shown in bolder than another outline; FIG. 5B is a diagram illustrating an example in which, when a user completes most of a sketch with respect to an edge of an object, And a detailed sketch is guided to be displayed.

As shown in FIG. 5A, FIG. 5A shows an example in which a border portion of a sketch that is selected and followed by a user in the overlapped sketch image is displayed in a darker and thicker manner. Only the edges of the object along the sketch can be easily distinguished and the other areas can be lightly displayed or the inner area can be dimly displayed so that the border of the desired object can be clearly sketched while the overlapped sketch is guided do.

FIG. 5B shows a case where a detailed inner outline is displayed in a clear and bold shape, which is hardly displayed when the sketch of the rim of the object is completed to some extent, and the sketch of the detailed inner area can be continued . The inner region of the border can be variably expressed in such a manner that the stroke information forming the sketch accumulates gradually and is gradually emphasized. In this way, you can obtain desired search results more precisely. In addition, you can learn how to sketch a desired object or easily check the final result while completing a detailed sketch.

Of course, it is not the method shown in the figure, but a scheme in which a sketch is provided for a certain area centered on a point at which a stroke is input, and a sketch that is not a target to be drawn are applied to other types of emphasizing schemes .

A computer program for performing a sketch search service method having a guide responsive to a drawing situation according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

A sketch search service method having a guide responsive to a drawing situation according to an embodiment of the present invention can be created by a computer program, and the codes and code segments constituting the computer program can be easily deduced by a computer programmer in the field . In addition, the computer program is stored in a computer readable medium and readable and executed by a computer, a user apparatus according to an embodiment of the present invention, a service providing apparatus, etc., A sketch search service method can be implemented.

The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium. A computer program for implementing a sketch search service method having a guide responsive to a drawing situation according to an embodiment of the present invention may be stored and installed in a built-in memory such as a user device or a service providing device. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing a sketch search service method having a guide responsive to a drawing situation according to an embodiment of the present invention may be installed in a user apparatus or a service providing apparatus through an interface .

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

In the present invention, when the sketch is sketched through the sketch search interface screen, the area to be sketched or the outline of the sketch is made thicker or more clearly than the outline of the other part, The present invention can be applied to various services that maximize advertisement by repeatedly exposing products, products, images and the like according to the user's input by utilizing it.

100: user equipment 110: sketch search interface unit
120: stroke recognition unit 130: sketch image variable unit
140: control unit 200: service providing apparatus
210: Sketch image database unit 220: Sketch image variable information providing unit
230: sketch search information providing unit 300: communication network

Claims (11)

A sketch search interface unit having a sketch area in which a sketch for providing a guide for sketch input is displayed and a sketch search result output area in which sketch search results are listed;
A stroke recognition unit for detecting and outputting stroke information of a user during sketching in a sketch area;
A sketch image variable unit that varies a representation state of a sketch output in a sketch region according to stroke information input through the stroke recognition unit to relatively emphasize a part of a sketch to be sketched; And
And a control unit for transmitting the stroke information of the user inputted through the sketch search interface unit to the service providing apparatus and receiving the sketch image and the search result corresponding to the sketch corresponding to the series of input strokes and outputting the result to the sketch search interface unit A sketch search user device having a context sensitive guide. The method according to claim 1,
Wherein the sketch image modifier displays the outline of the sketch image within a predetermined working radius relatively thicker than the outline of the other sketch image and gradually displays the inner area outline of the sketch image according to the sketch operation continuation, A sketch search user device having a context sensitive guide. A sketch image database unit storing a plurality of sketch images;
A sketch image variable information generation unit for generating a sketch image based on a series of stroke information received from a user device and generating information on a sketch image to be emphasized based on a sketch state based on the stroke information, Offering; And
And a sketch search information providing unit for providing information on sketches and emphasized sketches selected in the sketch image variable information providing unit to a user device. The method of claim 3,
Wherein the sketch image database unit further stores an original image corresponding to the sketch image and the sketch search information providing unit provides the original image corresponding to the sketch together with the selected sketch to the user apparatus as a search result, The sketch search service providing apparatus comprising: 5. The method of claim 4,
The sketch image database unit further stores web page link information corresponding to an original image, and the sketch search information providing unit provides web page link information corresponding to an original image provided as the search result to a user apparatus as a search result Wherein the sketch search service providing apparatus is provided with a guide responsive to a drawing situation. The method of claim 3,
The sketch image variable information providing unit may include information for making the sketch corresponding to the stroke information correspond to a sketch that is not corresponding to the sketch or a sketch for emphasizing a changed sketch in which the corresponding sketch is more vividly or boldly deformed Wherein the sketch search service providing apparatus is provided with a guide responsive to a drawing situation. The method of claim 3,
Wherein the sketch image variable information providing unit generates information for blurring the sketch that does not correspond to the stroke information or information about a sketch for emphasizing the changed sketch in which the unmatched sketch is further blurred. The sketch search service providing apparatus comprising: The method of claim 3,
Wherein the sketch image variable information providing unit generates information on a sketch to be emphasized so as to progressively emphasize the area inside the object frame of the selected sketch by judging the progress of the sketch according to the accumulation of the series of stroke information, The sketch search service providing apparatus comprising: The service providing apparatus comprising: receiving stroke information input to a sketch area from a user apparatus having a sketch area in which a sketch is displayed;
The service providing apparatus selecting sketch images corresponding to the received series of stroke information;
Varying a representation state of the selected sketch images so that the service providing apparatus relatively emphasizes a sketch area related to the sketch based on the stroke information; And
And providing the service providing apparatus with a selection sketch image in which the presentation state is changed to be used as a sketch of a sketch area to the user apparatus. A computer program for executing a sketch search service method having a guide responsive to a drawing situation according to claim 9. A method of providing stroke recognition information generated through a sketch region of a sketch search interface and displaying a received sketch image on the sketch area while varying a representation so that a sketch region associated with the sketch is relatively emphasized according to the stroke recognition information, ; And
The stroke recognition information is received from the user device, the outline extracted sketch images corresponding to the series of stroke information are selected, and based on the recognized stroke information, a frame of the object in the sketch image or an outline of the inner area And a service providing device for providing the service providing device to the user device.
KR1020140023636A 2014-02-27 2014-02-27 Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor KR20150101843A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020140023636A KR20150101843A (en) 2014-02-27 2014-02-27 Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020140023636A KR20150101843A (en) 2014-02-27 2014-02-27 Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor

Publications (1)

Publication Number Publication Date
KR20150101843A true KR20150101843A (en) 2015-09-04

Family

ID=54242880

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020140023636A KR20150101843A (en) 2014-02-27 2014-02-27 Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor

Country Status (1)

Country Link
KR (1) KR20150101843A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180066440A (en) 2016-12-09 2018-06-19 장보라 Apparatus for learning painting, method thereof and computer recordable medium storing program to perform the method
CN109542309A (en) * 2018-12-06 2019-03-29 北京物灵智能科技有限公司 A kind of drawing method and system based on electronic equipment
KR20230013664A (en) * 2021-07-15 2023-01-27 중앙대학교 산학협력단 Prosthetic arm capable of automatic object recognition with camera and laser

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20180066440A (en) 2016-12-09 2018-06-19 장보라 Apparatus for learning painting, method thereof and computer recordable medium storing program to perform the method
CN109542309A (en) * 2018-12-06 2019-03-29 北京物灵智能科技有限公司 A kind of drawing method and system based on electronic equipment
KR20230013664A (en) * 2021-07-15 2023-01-27 중앙대학교 산학협력단 Prosthetic arm capable of automatic object recognition with camera and laser

Similar Documents

Publication Publication Date Title
US11314804B2 (en) Information search method and device and computer readable recording medium thereof
US11592980B2 (en) Techniques for image-based search using touch controls
US8289287B2 (en) Method, apparatus and computer program product for providing a personalizable user interface
US8751972B2 (en) Collaborative gesture-based input language
CN103677618B (en) Text identification device and method for terminal
JP6427559B6 (en) Permanent synchronization system for handwriting input
US20120102401A1 (en) Method and apparatus for providing text selection
US20090243998A1 (en) Apparatus, method and computer program product for providing an input gesture indicator
US20090002324A1 (en) Method, Apparatus and Computer Program Product for Providing a Scrolling Mechanism for Touch Screen Devices
US9569107B2 (en) Gesture keyboard with gesture cancellation
US20090051661A1 (en) Method, Apparatus and Computer Program Product for Providing Automatic Positioning of Text on Touch Display Devices
US20100153890A1 (en) Method, Apparatus and Computer Program Product for Providing a Predictive Model for Drawing Using Touch Screen Devices
US8938123B2 (en) Electronic device and handwritten document search method
US9588678B2 (en) Method of operating electronic handwriting and electronic device for supporting the same
KR101158679B1 (en) Method for directly inputting figure on electronic document, and computer-readable recording medium storing program of directly inputting figure on electronic document
US9501220B2 (en) Device and method for extracting data on a touch screen
KR20150101843A (en) Sketch retrieval system with guide responding by drawing situation, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor
US20150042587A1 (en) Method and apparatus for providing intelligent information
CN104572997A (en) Content acquiring method and device and user device
KR20150097250A (en) Sketch retrieval system using tag information, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor
KR102213861B1 (en) Sketch retrieval system, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor
KR20150093045A (en) Sketch Retrieval system, user equipment, service equipment and service method based on meteorological phenomena information and computer readable medium having computer program recorded therefor
JP2017062584A (en) Electronic apparatus and method
CN104571579A (en) Information processing method and device
US20240118803A1 (en) System and method of generating digital ink notes

Legal Events

Date Code Title Description
WITN Withdrawal due to no request for examination