KR102213861B1 - Sketch retrieval system, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor - Google Patents

Abstract

The present invention provides the search results according to the user's sketch input to the sketch area as a candidate sketch and induces it to be drawn along. In addition, an individual search result image separately provided in the search result output area can be used as a sketch to proceed with a desired sketch. A sketch retrieval system, a user device, a service providing device, a service method, and a recording medium in which a computer program is recorded. Candidate sketch images according to the search results as well as sketch areas configured to perform sketches on overlapping candidate sketches. By directly sketching the individual candidate sketch images selected in the individually listed search result output area, it is possible to clearly sketch some of the specific candidate sketch images that are difficult to distinguish with overlapping candidate sketches. Even if the desired object is not clearly identified while the images are superimposed, there is an effect of selecting the correct object and proceeding with the sketch.

Description

Sketch retrieval system, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor}

The present invention relates to a sketch search system, a user device, a service providing device, a service method thereof, and a recording medium in which a computer program is recorded. In particular, the search results according to the user's sketch input are provided to a sketch area as candidate sketches and drawn accordingly A sketch search system, a user device, a service providing device, and a record of the service method and computer program, which enables the user to proceed with the desired sketch by using the individual search result image separately provided in the search result output area as a draft. It is a medium.

Recently, with the development of computer and communication technology, the demand for multimedia information service is increasing, and VOD (Video On Demand) service to be used for still image and video search and broadcasting production on the Internet, electronic library, medical field (for example, There is an increasing need for research on multimedia search technologies that can be applied, such as telemedicine and medical image search).

In the early stages of research, text-based search has been used in which a person directly adds an index to all multimedia data to be searched, and users also search for desired information using a subject word.

However, this method takes a lot of time and content, and when the viewpoints of the person who adds the index and the user who searches are inconsistent, there is a problem that the efficiency of the search is greatly reduced. In addition, there is a disadvantage in that complex properties of multimedia data cannot be accurately expressed with text alone. In order to compensate for this, a content-based search method that extracts features representing the contents of multimedia data and performs indexing and detection based on the extracted features is needed.

One of these content-based search methods, the image search method, recognizes a picture drawn by a user while touching the touch pad and allows the search to be performed using the recognized result. However, if the sketch quality is poor, the accuracy of the search result decreases. In order to solve this problem, sketches corresponding to the sketch situation are sometimes provided to guide the sketching work, but since multiple candidate sketches are overlapped and provided as sketches, it is not possible to clearly distinguish the objects to be drawn according to the sketch. There is a situation that takes place.

Korean Patent Registration No. 1005407480000 [Name: an improved query method for content-based search and a recording medium storing a program for implementing the method]

In order to minimize such inconvenience to users, the present invention provides an individual candidate sketch image selected from the search result output area in which candidate sketch images are individually listed according to the search result as well as the sketch area configured to sketch on the overlapped candidate sketch. The aim is to make it possible to perform sketching directly, so that even a part of a specific candidate sketch image, which is difficult to distinguish with overlapping candidate sketches, can be clearly performed.

In addition, it is an object of the present invention to perform a sketching operation by selecting a desired candidate sketch image from among candidate sketch images exposed in a search result output area while sketching and applying it as a sketch image on the sketch area.

A sketch search user device according to an embodiment of the present invention includes a sketch search interface unit, a sketch search interface including a sketch area displaying an overlapped sketch to provide a guide for sketch input and a search result output area listing sketch search results. The stroke recognition unit that detects and outputs the user input through the negative sketch area and the search result output area as stroke information and the stroke information of the stroke recognition unit are transmitted as stroke recognition information to the service providing device, and based on the similarity according to the stroke recognition information. Thus, a control unit for receiving sketch search information including the selected candidate sketch and the original image corresponding thereto from the service providing device and displaying the sketch area of the sketch search interface unit and the search result output area.

As an example related to the present invention, when a sketch operation is performed from a search result output area, the controller may apply a sketch line generated on a corresponding candidate sketch image to the sketch line on the sketch area.

As an example related to the present invention, when a desired candidate draft image is selected for a plurality of candidate draft images exposed in the search result output area, the selected candidate draft image may be provided by overlapping the sketch area.

The apparatus for providing a sketch search service according to an embodiment of the present invention includes a sketch image database unit in which a sketch image and an original image corresponding thereto are stored, a sketch area configured to draw along the sketch, and a search result providing search results according to the sketched content. Receives stroke recognition information for the stroke input through the sketch area and the search result output area from a user device equipped with an output area, and selects candidate sketch images from the sketch database unit according to the similarity based on the received stroke recognition information. It may include a sketch image providing unit and a sketch search information providing unit that provides the candidate sketch selected by the sketch image providing unit and the corresponding original image to the user device so that they can be displayed in the sketch area and the search result output area of the user device, respectively. have.

As an example related to the present invention, the sketch search information providing unit provides a spacing setting menu item for setting the spacing between the sketch line and the drag line to the user device, and by the user by the spacing setting method selected according to the spacing setting menu item. You can set the distance between the drawn drag line and the sketch line drawn on the sketch according to the drag line, and when stroke information is input within the set distance, the sketch line can be exposed on the sketch along the drag line.

As an example related to the present invention, the spacing setting menu item is a first spacing setting menu item for setting the spacing between the sketch line and the drag line by simultaneously clicking the drag area and the draw area with a double touch, and the drag area and the draw area in sequence. Click to set the distance between the sketch line and the drag line by selecting the second spacing setting menu item to set the spacing between the sketch line and the drag line, and setting the edge length by selecting both end points where the drag area and the draw area meet, and set the spacing between the sketch line and the drag line. At least one of the third spacing setting menu item exposing the edge to the edge and the fourth spacing setting menu item setting the spacing between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting.

As an example related to the present invention, when the third spacing setting menu item or the fourth spacing setting menu item is selected, the position of the drag area and the draw area can be changed by selecting an edge.

As an example related to the present invention, the sketch image database unit further stores web page link information corresponding to the original image, and the sketch search information providing unit may also provide web page link information corresponding to the original image to the user device.

In the sketch search service method according to an embodiment of the present invention, the service providing device receives a sketch search execution request signal from a user device, and the service providing device includes a sketch area and a search result output area in response to the sketch search execution request signal. Providing a search interface to the user device, the service providing device receiving stroke recognition information for both the sketch area and the search result output area from the user device, and the service providing device using the stroke recognition information as a filtering condition for a sketch image After selecting the items, it may include the step of transmitting to the user device.

In the sketch search service method according to an embodiment of the present invention, the service providing device receives a signal for touching a search result output area of the sketch search interface, and when the service providing device receives a signal touching the search result output area Recognizing a sketch line made on the candidate sketch image, and applying the recognized sketch line to the sketch line on the sketch area by the service providing device to proceed with the sketch work.

A computer program for performing the sketch search service method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

A sketch search system according to an embodiment of the present invention provides a sketch search interface, transmits stroke information of the user input through the sketch search interface, receives sketch images corresponding to the transmitted stroke information, and receives the sketch of the sketch search interface. The candidate sketch image of the search result output area selected by the user is superimposed on the sketch area, and when sketching is performed from the search result output area, the sketch line created on the candidate sketch image is displayed on the sketch area. When the stroke recognition information is received from the user device and the stroke recognition information is received, a service providing device that selects a candidate sketch image based on the similarity of the stroke recognition information and provides it to the user device.

The present invention allows direct sketching to be performed not only on the sketch area configured to sketch on the overlapped candidate sketch, but also on the individual candidate sketch image selected in the search result output area in which candidate sketch images are individually listed according to the search result. By making it possible to clearly sketch a part of the specific candidate sketch image, which is difficult to distinguish with the candidate sketch, it is possible to select the correct object and proceed with the sketch even if the desired object is not clearly identified in the state of overlapping multiple sketch images. It can have an effect.

In addition, the present invention selects a desired candidate sketch image from among the candidate sketch images exposed in the search result output area while sketching, and applies it as a sketch image on the sketch area to perform a sketch operation, It has the effect of obtaining a sketch result more accurately and quickly by allowing the sketch image to be applied to the sketch area.

1 is a block diagram showing the configuration of a sketch search system according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a user device according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a service providing apparatus according to an embodiment of the present invention.
4 is a flowchart showing a sketch search service method according to an embodiment of the present invention.
5 is a flowchart illustrating a sketching process in a candidate sketch output area in a sketch search service method according to an embodiment of the present invention.
6 is an exemplary view illustrating a sketch search interface of a user device according to an embodiment of the present invention.
7 is an exemplary view for explaining that a sketch line formed on a candidate sketch image output from a user device is reflected on a sketch line on a sketch area according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention, and is excessively comprehensive. It should not be construed as a human meaning or an excessively reduced meaning. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various elements or various steps described in the invention, and some of the elements or some steps are included. It should be construed that it may not be, or may further include additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe the constituent elements, but the constituent elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 is a block diagram showing the configuration of a sketch search system according to an embodiment of the present invention.

As shown in FIG. 1, a sketch search system according to an embodiment of the present invention includes a user device 100, a service providing device 200, and a communication network 300.

The user device 100 provides a sketch search interface consisting of a sketch area and a search result output area to the user, and transmits stroke recognition information on the stroke applied by the user while sketching through the sketch area to the service providing device 200. Accordingly, the candidate draft image is provided and displayed in the sketch area and the search result output area. In the sketch area, the candidate draft image is superimposed and displayed as a blurry draft, and the user can use it as a guide to assist in the sketching process. If the original image corresponding to the sketch image is further received, the candidate sketch image is displayed as a sketch in the sketch area, and the original image corresponding to the candidate sketch image is displayed in various ways (list, scroll method, etc.) in the search result output area. .

On the other hand, in an embodiment of the present invention, a candidate sketch image provided in the search result output area as well as the sketch area of the user device 100 or an original image corresponding thereto is selected, and a part of the sketch is performed on it by using the image as a sketch. can do. In this case, the stroke applied to the image is reflected in the corresponding sketch area. In fact, the individual candidate sketch image provided in the search result output area or the original image corresponding thereto is one of the sketch images provided by overlapping the sketch area, so referring to the ratio expressed in the sketch area, the image provided in the search result output area The stroke point applied may be expressed in correspondence with the sketch area. Through this method, a sketch for a specific part that is difficult to distinguish in the overlapped sketch can be progressed using individual images in the search result output area in which the corresponding part is clearly expressed.

Of course, an error may occur when the stroke applied to the image of the search result output area is reflected in the sketch area, but this can be easily corrected if the scale or alignment can be adjusted.

The service providing device 200 extracts a candidate sketch image based on the stroke information provided from the user device 100 and provides it as sketch search information.In the sketch search information, the original image corresponding to the candidate sketch image and provided when selecting it Link information for a web page to be used may be included.

As another example, when the service providing device 200 is provided with a kind of web program and substantially manages the sketch search interface provided to the user device 100, whether the user performs a sketch work on the sketch area or on the search result output area. When sketching is performed on the sketch area after checking whether sketching is performed, a candidate sketch image is extracted based on the stroke recognition information according to the sketching operation and provided to the user device 100, and sketched in the search result output area. When the work is performed, the search content is configured by applying the sketch line generated on the candidate sketch image to the sketch line on the sketch area, and then extracting the candidate sketch image based on this, and providing it to the user device 100.

The user device 200 allows a user to select one of a plurality of candidate draft images in a drag-and-drop method and then overlap the draft image on the sketch area to be used as a guide draft image. In this case, it is possible to increase the expression weight of the selected candidate sketch so that the corresponding candidate sketch image can be more clearly identified, and only the selected candidate sketch images can be overlaid with the sketch area of the sketch area.

2 is a block diagram showing the configuration of a user device of the sketch search system of the present invention.

The user device 100 illustrated in FIG. 2 includes a sketch search interface unit 110, a stroke recognition unit 120, and a control unit 130.

Not all of the components of FIG. 2 are essential components of the user device 100, and a user device 100 capable of implementing a sketch search system may be implemented by more components than those shown in FIG. 2 In addition, the user device 100 may be implemented by fewer components.

The user device 100 refers to a terminal capable of transmitting and receiving various data via a communication network according to a user's key operation, and a tablet PC, a laptop, a smart phone, and personal portable information It may be any one of a terminal (PDA: Personal Digital Assistant) and a mobile communication terminal.

In addition, the user device 100 includes a browser for communicating with the service providing device 200 via the communication network 300, a memory for storing programs and protocols, and a microprocessor for calculating and controlling by executing various programs. It refers to the terminal device being used. That is, the user device 100 can perform server-client communication with the service providing device 200, and any terminal can be used as long as it can execute the sketch search service, and includes all communication computing devices such as mobile communication terminals and PDAs. It is a broad concept. Meanwhile, the user device 100 is preferably manufactured in a form having a touch screen, but is not limited thereto.

In particular, the user device 100 according to an exemplary embodiment of the present invention stores stroke recognition information according to the sketch operation when a sketch operation is performed so that an arbitrary shape is formed on the sketch area of the sketch search interface consisting of a sketch area and a search result output area. Generates and transmits, and exposes the received candidate sketch image in response to the stroke recognition information in the search result output area, allows sketching to be performed on the sketch area or the search result output area, and sketches the created sketch line on the search result output area It is reflected in the sketch line on the area.

The sketch search interface unit 110 includes a sketch area in which an overlapped sketch to provide a guide for sketch input is displayed and a search result output area in which sketch search results are listed.

The stroke recognition unit 120 detects a user input through the sketch area of the sketch search interface unit 110 as stroke information and outputs it to the control unit 130. Here, when the stroke recognition unit 120 recognizes the stroke information and outputs it to the control unit 130, the control unit 130 may extract features of the sketch and then transmit only the feature information of the extracted sketch to the service providing apparatus 200. As a result, the load between the user device 100 and the service providing device 200 is reduced so that a problem of a decrease in service speed can be prevented in advance. In addition, the stroke recognition unit 120 may include a general input device such as, for example, a small keyboard, a pen mouse, a joystick, a touch screen, and a touch pad.

The control unit 130 transmits the stroke information of the stroke recognition unit 120 to the service providing device 200 as stroke recognition information, and generates a candidate sketch selected based on the similarity according to the stroke recognition information and an original image corresponding thereto. The included sketch search information is received from the service providing apparatus 200 and displayed in the sketch area and the search result output area of the sketch search interface unit 110.

When a sketch work is performed from the search result output area, the control unit 130 applies the sketch line generated on the corresponding candidate sketch image to the sketch line on the sketch area and displays it, while a sketch search execution request signal according to the user's input (search Sends information to be serviced) to the service providing device 200, and sketch search information (overlapping candidate sketch information, individual candidate sketch information or corresponding video) provided by the service providing device 200 It outputs through the interface unit 110, and provides a communication environment between the user device 100 and the service providing device 200 so that product search through sketch is performed through the sketch search interface.

When a desired candidate draft image is selected for a plurality of candidate draft images exposed in the search result output area, the controller 130 superimposes the selected candidate draft image with a high weight of the sketch area and provides it.

The sketch search interface unit 110 searches for a sketch image (or an original image corresponding thereto) provided in response to the stroke information generated by sketching through the sketch area provided from the service providing device 200 in the sketch search interface. When a sketch is performed on any of the images exposed on the result output area and the search result output area is performed, the sketch line is reflected as a sketch line on the sketch area.

3 is a block diagram showing the configuration of a service providing apparatus of the sketch search system of the present invention.

As shown in FIG. 3, the service providing apparatus 200 includes a sketch image database unit 210, a sketch image providing unit 220, and a sketch search information providing unit 230.

The service providing device 200 receives stroke recognition information from the user device 100, extracts the sketch images using the stroke recognition information as a search condition, provides the extracted sketch images to the user device 100, and provides the extracted sketch images to the user device 100. When a sketch work is performed, a sketch image for a guide is selected from the search result output area using stroke recognition information and is superimposed on the sketch area, and when sketch work is performed from the search result output area, a sketch line created on the candidate sketch image Is applied to the sketch line on the sketch area.

The sketch image database unit 210 stores a plurality of sketch images, an original image corresponding thereto, and web page information linked to the original image.

The draft image providing unit 220 selects a candidate draft image from the draft database unit 210 according to a similarity range based on the stroke recognition information received from the user device 100.

The draft image providing unit 220 may overlap the candidate draft image selected by the user in the search result output area on the guide draft image on the sketch area to be exposed.

When a sketch search execution request signal is received from the user device 100, the sketch search information providing unit 230 provides sketch search information corresponding to the sketch search interface unit 110 of the user device 100 (the candidate sketch and the corresponding original Image) is provided to the user device 100. The sketch search information provided to the user device 100 may include a sketch area and a candidate sketch image to be displayed in the search result output area, an original image corresponding to the candidate sketch image, and link information connected to the corresponding original image. The candidate sketch image included in the sketch search information or the original image corresponding thereto is provided to the user device 100 as a search result, and the user device 100 displays the search result in the search result output area of the sketch search interface unit 110. Can be listed on one screen or provided by scrolling.

The sketch search information providing unit 230 provides a spacing setting menu item for setting the spacing between the sketch line and the drag line to the user device 100, and is drawn by the user according to the spacing setting method selected according to the spacing setting menu item. Sets the distance between the drag line and the sketch line drawn on the sketch according to the drag line, and when stroke information is input within the set distance, the sketch line can be exposed on the sketch along the drag line.

That is, when the user sketches along the sketch image of the sketch area, the edge line of the sketch image is covered by the sketching tool, so that it is possible to inconvenient to sketch. For example, in the case of a thin pen, this phenomenon may be less, but if the sketch tool is thick, such as a user's hand, the sketch image is hidden by the sketch tool, making it difficult to sketch based on the sketch image. Accordingly, when sketching along the edge line of the sketch image at a location spaced apart from the edge line of the sketch image, it can be implemented so that the drag line is expressed along the edge line of the sketch image according to the sketch line. The sketch search information providing unit 230 of the service providing device 200 provides a spacing setting menu item, and may set the relationship between the drag line and the sketch line by selecting the spacing setting menu item at the beginning of the sketch work or at a desired time point. have.

The spacing setting menu item is the first spacing setting menu item that sets the spacing between the sketch line and the drag line by double-touching the drag area and the draw area simultaneously, and the sketch line and the drag line by sequentially clicking the drag area and the draw area. Select the second spacing setting menu item to set the spacing of, and the edge length by selecting both end points where the drag area and the draw area meet to set the spacing between the sketch line and the drag line, and to expose the edge between the set spacing. 3 It consists of a spacing setting menu item, and a fourth spacing setting menu item for setting the spacing between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting.

When the third spacing setting menu item or the fourth spacing setting menu item is selected, the sketch search information providing unit 230 selects an edge to change the positions of the drag area and the draw area.

In the previous embodiment, when the sketch search information providing unit 230 of the service providing device 200 checks the sketch when the user inputs a stroke through the sketch interface, an additional user interface support function to solve a situation where it is difficult to perform a sketch. Although it has been shown that this function can be provided, such a function may be performed independently of or interlocked with the service providing device 200 in the sketch search interface unit 110 of the user device 100. This is apparent to those of ordinary skill in the art through the above description, so a separate description will be omitted.

Then, a sketch search service method based on the above-described configuration will be described in detail with reference to the accompanying drawings.

4 is a flowchart showing a sketch search service method according to an embodiment of the present invention.

As shown in FIG. 4, the service providing device 200 determines whether a sketch search execution request signal is received from the user device 100 (S110). When a sketch search execution request signal is received as a result of determination, the user device 100 provides a sketch search interface consisting of a sketch area and a search result output area to the user through the sketch search interface unit 110, and the user obtained through the sketch area Stroke recognition information according to the stroke of and tag information corresponding to the image set as the sketch of the sketch area are transmitted to the service providing device 200 as a filtering condition (S120).

The service providing device 200 determines whether stroke recognition information is received from the user device 100 (S130), and when the stroke recognition information is received as a result of the determination, the service providing device 200 filters the stroke recognition information As a result, the sketch images are extracted (S140) and then transmitted to the user device 100 to be exposed through the search result output area (S150).

At this time, as shown in FIG. 6, in the candidate sketch exposure method, one candidate sketch image is exposed in each divided space constituting the search result output area divided into a plurality of areas, and the user collectively displays the candidate sketch images at once. After checking with, you can directly select the sketch video you want. In addition, even if the user does not select the sketch image, the user can check whether a sketch image is selected and applied as another sketch according to his or her sketch line.

On the other hand, another method of exposing the candidate sketch image is a scroll method, and in the scroll method, the candidate sketch area is exposed to the minimum under the sketch area, and then left and right scroll arrow buttons are provided so that the user clicks the scroll arrow button or displays the content. By dragging the button, you can view the previously provided candidate draft image again or check the provided candidate draft image.

5 is a flowchart illustrating a sketching process in a candidate sketch output area among a sketch search service method according to an embodiment of the present invention based on the above-described configuration.

As shown in FIG. 5, the service providing device 200 determines whether a signal that touches the search result output area is received in the sketch search interface (S210), and receives a signal that touches the search result output area as a result of the determination. If so, the service providing apparatus 200 checks whether a sketch operation is performed on the candidate sketch image of the search result output area (S220), and determines whether the sketch operation is in a state (S230).

As a result of determining the sketch work state, when a sketch work is being performed, the service providing device 200 recognizes a sketch line made on the candidate sketch image as shown in FIG. 7 (S240), and places the recognized sketch line on the sketch area. The sketch is applied to the sketch line to proceed (S250).

At this time, in order to reflect the sketch line made on the candidate sketch image on the sketch line on the sketch area, first, scale and align the candidate sketch image with the superimposed sketch image on the sketch area, and then scale the additional stroke part applied to the corresponding image. And the alignment is applied to be added to the sketch line currently being worked on. This scaling and alignment is preferably done automatically, but can also be done manually.

Finally, the service providing device 200 allows the user to select one of a plurality of candidate sketch images in the search result output area and superimpose them on the guide sketch image on the sketch area, and at this time, weights are applied to the other candidate sketch images. It can be implemented so that it is exposed in an exposure method different from that of those. For example, it can be implemented to be made of a thick edge line or to differentiate from other superimposed sketch images by different exposure colors.

6 is an exemplary diagram illustrating a sketch search screen of a user device according to an embodiment of the present invention. The illustrated screen shows an example of a sketch search interface provided through a user device.FIG. 6A is a case of using a terminal with a relatively large screen. While the user draws a picture directly on the sketch area configured on the touch screen, an overlapping sketch in the screen When the sketch is completed with reference to, the candidate sketch image with high similarity is extracted according to the user's stroke and the overlapping sketch image in the sketch area is updated, and the extracted candidate sketch image or the original image linked thereto are listed in the search result output area on the right. It is provided in the form. For reference, when an image of a corresponding search result output area is selected to check a search result, a web page providing various additional information such as a product sales page, an advertisement page, and a related company homepage may be provided.

6B is an example of a sketch search interface when a terminal with a relatively small screen is used. As shown, the size of the search result output area is reduced to increase the proportion of the sketch area as much as possible. In this case, the search result output area may be scrolled using the left and right arrows, or may be scrolled by a user's gesture.

On the other hand, in sketch search, there may be a situation in which the sketch is covered by a sketch tool such as a user's finger or a pen. This problem can be solved through various methods of separating the area where the actual stroke is expressed and the area that the user touches. Some can be solved. For example, if you select a location to provide the actual stroke and then draw a line by touching an area spaced from it, you can take a method of drawing a line at the first selected location. Of course, the separation distance or the stroke provision location selection method may vary according to various methods.

7 is an exemplary view for explaining that a sketch line formed from a candidate sketch image output to a user device according to an embodiment of the present invention is reflected on a sketch line on a sketch area. As shown in the illustrated example, when a user selects one of the candidate sketch images in the search result output area while sketching in the sketch area and sketches directly on the corresponding image, the sketch line drawn directly on the candidate sketch image is reflected in the sketch area. 7A is an example of a case applied to a terminal with a relatively large screen, and FIG. 7B is a case of using a terminal with a relatively small screen. When a user selects a candidate sketch image provided by a scrolling method, the corresponding image is popped up on the screen The sketch line directly sketched on the pop-up candidate sketch image is immediately reflected in the sketch area.

A computer program for performing the sketch search service method according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The sketch search service method according to an embodiment of the present invention can be written in a computer program, and codes and code segments constituting the computer program can be easily inferred by a computer programmer in the art. In addition, the corresponding computer program is stored in a computer readable media, and is read and executed by a computer or a service providing device according to an embodiment of the present invention, thereby implementing a sketch search service method.

Information storage media include magnetic recording media, optical recording media, and carrier wave media. A computer program implementing the sketch search service method according to an embodiment of the present invention may be stored and installed in an internal memory such as a user device or a service providing device. Alternatively, an external memory such as a smart card storing and installing a computer program implementing the sketch search service method according to an embodiment of the present invention may be mounted on a user device or a service providing device through an interface.

The above contents may be modified and modified without departing from the essential characteristics of the present invention by those of ordinary skill in the technical field to which the present invention pertains. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

The present invention is provided based on the stroke recognition information generated while the sketching work is performed by the user, and if a sketch is performed directly on the desired candidate sketch image among candidate sketch images exposed in the search result output area, the sketch line on the sketch area is displayed. By reflecting and making the sketch work done, users can accurately sketch the product they want to search for, and this allows not only to receive the desired product as a search result, but also to use it to expose a lot of products to the user to advertise. It can be widely used in the service field.

100: user device 110: sketch search interface unit
120: stroke recognition unit 130: control unit
200: service providing device 210: sketch image database unit
220: sketch image providing unit 230: sketch search information providing unit
300: network

Claims (12)

A sketch search interface unit having a sketch area displaying an overlapped sketch to provide a guide for sketch input and a search result output area displaying sketch search results;
A stroke recognition unit configured to detect and output a user input through the sketch area and the search result output area of the sketch search interface unit as stroke information; And
The service providing device transmits stroke information of the stroke recognition unit as stroke recognition information to a service providing device, and provides sketch search information including a candidate sketch selected based on the similarity according to the stroke recognition information and an original image corresponding thereto A control unit that receives from and displays in the sketch area and the search result output area of the sketch search interface unit
Including,
When a sketch operation is performed from the search result output area, the control unit applies a sketch line generated on the candidate sketch image provided in the search result output area to the sketch line on the sketch area,
The sketch search interface unit provides a spacing setting menu item for setting the spacing between the sketch line and the drag line, and according to the drag line drawn by the user and the drag line according to the spacing setting method selected according to the spacing setting menu item. A sketch search user device, comprising: setting an interval of the sketch line drawn on the sketch, and exposing the sketch line on the sketch of the sketch area along the drag line when the stroke information is input within the set interval . delete delete A sketch image database unit in which the sketch image and the original image corresponding thereto are stored;
Receives stroke recognition information for the stroke input through the sketch area and the search result output area from a user device having a sketch area configured to draw along the sketch and a search result output area that provides search results according to the sketched contents. , A sketch image providing unit for selecting a candidate sketch image from the sketch image database unit according to a similarity based on the received stroke recognition information; And
A sketch search information providing unit that provides the candidate sketch selected by the sketch image providing unit and the corresponding original image to the user device so that they can be displayed in the sketch area and the search result output area of the user device, respectively.
Including,
The sketch search information providing unit provides an interval setting menu item for setting the interval between the sketch line and the drag line to the user device, and the drag line and the drag line drawn by the user according to the interval setting method selected according to the interval setting menu item. The spacing of the sketch lines drawn on the draft is set according to the drag line, and when stroke information corresponding to the stroke recognition information is input to the user device within the set spacing, the user device may determine the sketch area along the drag line. Characterized in that the sketch line is exposed on the sketch,
When receiving a sketch search execution request signal from the user device, in response to the sketch search execution request signal, a sketch search interface consisting of the sketch area and the search result output area is provided to the user device, and the search result of the sketch search interface When a signal touching the output area is received, a sketch line made on the candidate sketch image provided in the search result output area is recognized, and the recognized sketch line is applied to the sketch line on the sketch area to proceed with the sketching process. Sketch search service providing device, characterized in that. delete delete delete delete delete delete delete Provides a sketch search interface, transmits user's stroke information input through the sketch search interface, receives sketch images corresponding to the transmitted stroke information, and provides them by overlapping with the sketch of the sketch search interface, selected by the user. A user device that superimposes the candidate sketch image of the search result output area on the sketch area and reflects the sketch line generated on the candidate sketch image on the sketch area when a sketch is performed from the search result output area; And
When the stroke recognition information is received from the user device, it includes a service providing device that selects a candidate sketch image based on the similarity of the stroke recognition information and provides it to the user device,
The user device provides a spacing setting menu item for setting the spacing between the sketch line and the drag line, and according to the drag line drawn by the user and the drag line according to the spacing setting method selected according to the spacing setting menu item. Using tag information, characterized in that an interval of a sketch line drawn on a sketch is set, and when the stroke information is input within a set interval, the sketch line is exposed on the sketch of the sketch search interface along the drag line. Sketch search system.

Images