KR102213856B1 - Product search system with a sketch, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor - Google Patents

Abstract

The present invention extracts sketch images in response to the user's stroke created by touching the sketch area, outputs the extracted sketch images as a search result to the search result output area, and exposes the sketch images with high similarity superimposed on the sketch area. However, a product search system through sketches, a user device, a service providing device, a service method, and a computer program that highlight and expose when overlapping with a weight for the paid draft images, or that are frequently provided as candidate sketch images. Regarding the recorded recording medium, when the candidate sketch image provided to the user device is constructed as a database on the service providing device, the user who uploads the image can determine the cost of the sketch exposure of the image. Accordingly, when providing the uploaded image as a sketch image, it is possible to differentiate, thereby increasing the advertising effect by providing and exposing more images of users who have paid more money to the user device.

Description

Product search system with a sketch, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor }

The present invention relates to a product search system through sketch, a user device, a service providing device, a service method thereof, and a recording medium in which a computer program is recorded. In particular, a sketch image corresponding to a user's stroke when performing a sketch through a sketch area A product search system and user device through sketch that extracts and exposes the extracted sketch images by overlapping them on the sketch area, but provides paid sketch images to differentiate from non-paid sketch images , A service providing device, a service method thereof, and a recording medium in which a computer program is recorded.

Recently, with the development of computer and communication technology, the demand for multimedia information service is increasing, and VOD (Video On Demand) service to be used for still image and video search and broadcasting production on the Internet, electronic library, medical field (for example, There is an increasing need for research on multimedia search technologies that can be applied, such as telemedicine and medical image search).

In the early stages of research, text-based search has been used in which a person directly adds an index to all multimedia data to be searched, and users also search for desired information using a subject word.

However, this method takes a lot of time and content, and when the viewpoints of the person who adds the index and the user who searches are inconsistent, there is a problem that the efficiency of the search is greatly reduced. In addition, it has the disadvantage that the complex properties of multimedia data cannot be accurately expressed with text alone. In order to compensate for this, a content-based search method that extracts features representing the contents of multimedia data and performs indexing and detection based on the extracted features is needed.

This method has the advantage of automatically extracting features from multimedia data and using them in the indexing process, thereby reducing the time and manpower required for database construction, and thus many studies are currently being conducted.

This image search method allows users to recognize a picture drawn while touching the touchpad, and to perform a search using the recognized result, so that a result similar to the sketch drawn by the user is simply provided. B, it does not reflect the request of the provider who provided the search image provided as a result.

Korean Patent Registration No. 1005407480000 [Name: an improved query method for content-based search and a recording medium storing a program for implementing the method]

In order to minimize the user's discomfort, the present invention extracts sketch images in response to the user's stroke generated by touching the sketch area, outputs the extracted sketch images as a search result in the search result output area, and Product search system, user equipment, and services through sketches that superimpose and expose high draft images in the sketch area, but emphasize and expose when overlapping with a weight for the draft images that have been paid for, or provide frequently as candidate sketch images. The purpose of this is to provide a recording medium on which a provision device, a service method thereof, and a computer program are recorded.

In addition, the present invention allows the sketch image to be exposed to the sketch area only within a preset number of strokes for the sketch image for which the draft exposure cost has not been paid, or only when the accuracy with the user's sketch image is within a preset range. It aims to provide a product search system, a user device, a service providing device, a service method thereof, and a recording medium in which a computer program is recorded.

A user device for product search through a sketch according to an embodiment of the present invention is a sketch search interface having a sketch area displaying an overlapped sketch to provide a guide for sketch input and a search result output area listing sketch search results. The stroke recognition unit that detects the user input through the sketch area of the sub, sketch search interface unit as stroke information and outputs it to the control unit and the stroke information of the stroke recognition unit are generated as stroke recognition information and transmitted to the service providing device, and The sketch search information including the candidate sketch selected based on the similarity and the weight according to the exposure cost for the candidate sketch and the corresponding original image is received from the service providing device and displayed in the sketch area of the sketch search interface and the search result output area. It may include a control unit.

As an example related to the present invention, the control unit receives candidate sketches including more clearly expressed candidate sketches according to a weight according to the exposure cost, or displays an overlapped image of candidate sketches including more clearly expressed candidate sketches. It can be received and displayed in the sketch area.

The apparatus for providing a service for product search through a sketch according to an embodiment of the present invention includes a sketch image database unit in which the sketch image and the corresponding original image and exposure cost information are stored, and the weight and candidate for the paid sketch image with exposure cost. Based on the similarity based on the stroke recognition information received from the user device, the paid sketch image management unit that determines the selection range of the sketch images, the weight of the paid sketch image management unit, and the candidate sketch image selection range, selects candidate sketch images from the sketch image database unit. And a sketch search information providing unit that provides the candidate sketch selected by the candidate sketch image providing unit and the original image corresponding thereto to the user device.

As an example related to the present invention, the sketch image providing unit may include a sketch search information providing unit, characterized in that the sharpness of the candidate sketch is adjusted according to a weight.

As an example related to the present invention, when the number of strokes exceeds a certain number of strokes based on the stroke recognition information, the sketch image providing unit may select only the paid sketch image as a candidate sketch.

As an example related to the present invention, the paid draft image management unit may increase the weight as the candidate draft exposure cost increases.

As an example related to the present invention, in the case of a free sketch image, the paid sketch image management unit may control the sketch image providing unit to be provided to the user device only when the similarity according to the user's stroke is greater than a preset reference value.

As an example related to the present invention, the sketch image database unit further stores web page link information corresponding to the original image, and the sketch search information providing unit may also provide web page link information corresponding to the original image to the user device.

A product search service method through sketch according to an embodiment of the present invention includes the steps of receiving, by a product search service providing device through sketch, stroke recognition information provided from a user device, a sketch image stored in a database by the service providing device and an original corresponding thereto. For the image and exposure cost information, determining the weight of the paid sketch image for which the exposure cost exists and the selection range of candidate sketch images, similarity and paid sketch images based on the stroke recognition information received from the user device by the service providing device The method may include selecting a candidate sketch image from the database according to a weight of and a candidate sketch image selection range, and providing, by a service providing device, the selected candidate sketch and an original image corresponding thereto to the user device.

As an example related to the present invention, when the number of strokes exceeds a certain number of strokes based on the stroke recognition information received from the user device, the service providing device may include determining a selection range of candidate sketch images as paid sketch images.

A computer program for performing a product search service method through sketches according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

The product search service system through sketch according to an embodiment of the present invention provides a sketch search interface, transmits user's stroke information input through the sketch search interface, and receives sketch images corresponding to the transmitted stroke information to sketch. When the stroke recognition information is received from the user device and the user device provided by overlapping with the sketch of the search interface, the number of strokes is checked, and if the number of receptions is less than or equal to the preset number, a candidate sketch consisting of a free sketch image and a paid sketch image A service providing device that provides an image to the user device and provides a candidate sketch image composed of only paid sketch images to the user device when the number of times of reception is greater than a preset number may be included.

The present invention extracts sketch images in response to the user's stroke created by touching the sketch area, outputs the extracted sketch images as a search result to the search result output area, and exposes the sketch images with high similarity superimposed on the sketch area. However, there is an effect that products can be advertised using the candidate sketch image by giving weights to the draft images for which the exposure cost has been paid to highlight them when they are overlapped or to be frequently provided as candidate sketch images.

In addition, in the present invention, when a sketch image for which no exposure cost is paid is exposed to the sketch area, it is exposed only within a preset number of strokes or only when the accuracy is within a preset range. If desired, it has the effect of inducing the use of paid services to generate revenue.

1 is a block diagram showing the configuration of a product search system through sketches according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a user device of a product search system through a sketch of the present invention.
3 is a block diagram showing the configuration of a service providing apparatus of a product search system through a sketch of the present invention.
4 is a flowchart showing a sketch search process of the product search system through sketch of the present invention.
5 is an exemplary screen diagram illustrating an example of a system sketch search screen in the product search system through sketch of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention, and is excessively comprehensive. It should not be construed as a human meaning or an excessively reduced meaning. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various elements or various steps described in the invention, and some of the elements or some steps are included. It should be construed that it may not be, or may further include additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe the constituent elements, but the constituent elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 is a block diagram showing the configuration of a product search system through sketches according to an embodiment of the present invention.

As shown in FIG. 1, the product search system through sketch includes a user device 100 and a service providing device 200 connected to the user device 100 through a communication network 300.

The service providing device 200 collects or uploads candidate sketch images to be provided to the user device 100 from various providers, constructs a database, and extracts the corresponding sketch images in response to the stroke recognition information received from the user device 100. , The extracted candidate sketch images are transmitted as search results to the user device 100, and are output to the search result output area of the sketch search interface of the user device 100, while being superimposed on and outputted to the sketch area. At this time, the service providing device 100 determines and registers a candidate draft exposure cost for some of the uploaded images, and has different weights according to the determined candidate draft exposure cost, and the sketch search interface of the user device 100 according to the weight. When exposed to the sketch area of, the exposure method should be different. For example, the higher the exposure cost of a given candidate sketch, the greater the weight, and when the weight is high, when exposed to the sketch area of the sketch search interface of the user device 100, it is exposed more clearly than other draft images, or as a candidate sketch image. In various ways, such as being provided frequently, it is exposed to the sketch search interface of the user device 100 with a high weight.

The service providing device 200 also collects or registers a free image that does not have a candidate sketch exposure cost, and in the case of a free image, it is not provided to the user device 100 or output to the sketch area only until stroke recognition information is received a predetermined number of times. It can be done (for example, only the initial 10 is provided), or it can be output in the sketch area only if the accuracy falls within a preset ranking (for example, TOP 5). Of course, it can also be provided as a default exposure method without this limitation.

Eventually, the service providing device 200 collects or receives an image to be used as a candidate sketch, and registers a candidate sketch that is registered for a fee by increasing the exposure frequency as the display shape is emphasized or the accuracy determination range is widened when provided as a search result. It is possible to advertise the video. On the other hand, if such differentiated exposure is repeated, the search target will become accustomed to the video, so the advertisement effect for the corresponding product may continue even after the paid registration period has passed.

The user device 100 transmits the stroke recognition information obtained from the user to the service providing device 200 and receives and provides a candidate sketch as a result of the search.

2 is a block diagram showing the configuration of a user device according to an embodiment of the present invention.

As shown in FIG. 2, the user device 100 includes a control unit 110, a stroke recognition unit 120, and a sketch search interface unit 130. However, not all of these components are essential components of the user device 100, and the user device 100 capable of implementing a product search system through sketch by more components than the components shown in FIG. It may be implemented, or the user device 100 may be implemented by fewer components.

The user device 100 refers to a terminal capable of transmitting and receiving various data via a communication network according to a user's key operation, and a tablet PC, a laptop, a smart phone, and personal portable information It may be any one of a terminal (PDA: Personal Digital Assistant) and a mobile communication terminal.

In addition, the user device 100 includes a browser for communicating with the service providing device 200 via the communication network 300, a memory for storing programs and protocols, and a microprocessor for calculating and controlling by executing various programs. It refers to the terminal device being used. That is, the user device 100 can communicate with the service providing device 200 and server-client, and any terminal can be used as long as it can execute a product search service through a sketch, and a communication computing device such as a mobile communication terminal or a PDA. It is a broad concept that includes both. Meanwhile, the user device 100 is preferably manufactured in a form having a touch screen, but is not limited thereto.

In particular, the user device 100 according to an embodiment of the present invention provides a sketch search interface consisting of a sketch area and a search result output area, and candidate sketches to be provided through the sketch search interface are provided from the service providing device 200. . The sketch area guides the sketching process by receiving the user's stroke information and displaying the overlapped sketch area received from the service providing device 200 accordingly, and the search result output area guides the sketching process. An image is displayed so that the user can check the result. Naturally, the image in the search result output area can be linked to a related web page, so that additional information on the search result can be checked according to the user's selection. At this time, the sketch images superimposed on the sketch area are exposed in different ways according to the weight, so that the guide direction in which the user completes the sketch can be induced differently. For example, a sketch image with a high weight is exposed more clearly than other sketch images so that the user can refer to it more to complete the sketch.

The control unit 110 transmits a sketch search execution request signal (information to perform a search service) according to a user's input to the service providing device 200, and sketch search information (overlapping) provided by the service providing device 200 Candidate sketch information, individual candidate sketch information or an image corresponding thereto) is output through the sketch search interface unit 130, and the user device 100 and the service providing device ( 200) It provides a communication environment with each other.

When the sketch area is touched by the user, the stroke recognition unit 120 recognizes it as stroke information and outputs it to the control unit 110. Here, when the stroke recognition unit 120 recognizes the stroke information and outputs it to the control unit 110, the control unit 110 extracts features of the sketch and then transmits only the feature information of the extracted sketch to the service providing apparatus 200. As a result, the load between the user device 100 and the service providing device 200 is reduced so that a problem of a decrease in service speed can be prevented in advance. In addition, the stroke recognition unit 120 may include a general input device such as, for example, a small keyboard, a pen mouse, a joystick, a touch screen, and a touch pad.

The sketch search interface unit 130 superimposes the candidate sketch image according to the stroke recognition information as a sketch image on the sketch area of the sketch search interface, and provides different exposure according to the weight of the overlapped candidate sketch image. In this case, the service providing device 200 provides a plurality of candidate sketch images according to stroke information input through the sketch area, and overlaps a plurality of sketch images closest to the stroke information among the provided candidate sketches to the sketch area. Provides, and allows sketching based on the sketch. At this time, the service providing device 200 receives the information on the rough image exposure cost corresponding to the image, and determines a weight of the image based on the uploaded information on the exposure cost. In this way, when the sketch image is provided through the sketch area of the sketch search interface of the user device 100 according to a predetermined weight, the exposure method is different.

3 is a block diagram showing the configuration of a service providing apparatus of a product search system through a sketch of the present invention.

As shown in FIG. 3, the service providing device 200 includes a sketch search information providing unit 210, a sketch image database unit 220, a sketch image providing unit 230, and a paid sketch image management unit 240.

When a sketch search execution request signal is received from the user device 100, the sketch search information providing unit 210 provides sketch search information corresponding to the sketch search interface unit of the user device 100 to the user device 100. The sketch search information provided to the user device 100 may include a sketch area and a candidate sketch image to be displayed in the search result output area, an original image corresponding to the candidate sketch image, and link information connected to the corresponding original image. The candidate sketch image included in the sketch search information or the original image corresponding thereto is provided to the user device 100 as a search result, and the user device 100 displays the search result in the search result output area of the sketch search interface unit 130. Can be listed on one screen or provided in a scrolling manner.

The sketch image database unit 220 stores at least one sketch image, an original image corresponding thereto, and information on a web page linked to the original image, and includes weight information according to paid registration when the stored sketch image is registered for a fee. I can.

When the stroke recognition information is received from the user device 100, the draft image providing unit 230 extracts sketch images with high similarity among the sketch images stored in the sketch image database unit 220 as candidate sketches. The candidate sketches, which are classified, extracted and weighted, are provided to the sketch search information providing unit 210 to be transmitted to the user device 100.

On the other hand, the sketch image providing unit 230 checks the number of stroke receptions provided from the user device 100 and extracts a candidate sketch image consisting of a free sketch image and a paid sketch image when the reception frequency is less than or equal to a preset number of times. If the number of receptions is greater than the preset number, only paid sketch images can be extracted.

The paid sketch image management unit 240 registers the provider's image information (the sketch image, the original image, and the link) in the sketch image database unit 220, while checking whether paid registration and reflecting the information, and the sketch image providing unit 230 ), the draft image providing unit 230 manages to have different weights according to the cost paid as the candidate draft exposure cost for the paid draft image provided through, and the method of exposure from the user device 100 is different according to the weight. ) To control.

For example, the paid draft image management unit 240 manages the weight to increase as the candidate draft exposure cost increases. For example, by superimposing a plurality of candidate draft images on the sketch area of the sketch search interface of the user device 100 When exposing, as the cost of exposing the candidate draft is higher, the draft image providing unit 230 may be controlled to expose the candidate draft corresponding to a higher sharpness.

In addition, in the case of a free sketch image, the paid sketch image management unit 240 may control the sketch image providing unit 230 so that it is provided to the user device 100 only when the accuracy according to the user's stroke is greater than a preset reference value. .

Then, a sketch search method in the product search system through sketch configured as described above will be described in detail with reference to the accompanying drawings.

4 is a flowchart showing a product search service method through a sketch of the present invention.

Referring to FIG. 4, the service providing device 200 determines whether a sketch search execution request signal is received from the user device 100 (S110). As a result of the determination, when a sketch search execution request signal is received, the service providing device 200 interactively reacts to the user's stroke through the sketch search interface unit 130 of the user device 100, and the sketch to be displayed in the sketch search interface unit is In preparation to provide search information, the user device 100 provides a sketch search interface including a sketch area and a search result output area to the user through the sketch search interface unit 130 (S120).

The service providing device 200 determines whether the user's stroke information is received from the user device 100 (S130), and when the user's stroke information is received from the user device 100 as a result of the determination, the service control device 200 Determines whether the number of received strokes is less than or equal to the number of reference strokes (S140).

If stroke information is not received as a result of determining the stroke information reception, the service providing device 200 determines whether an end signal for ending the sketch product search service is received from the user device 100 (S170), and then an end signal. When is received, the search service through sketch is terminated.

When stroke information is received and the number of received strokes is less than or equal to the number of reference strokes, the service providing device 200 extracts a free sketch image and a paid sketch image with high similarity to the sketch drawn so far, and a preset number of candidate sketch images They are generated and provided to the user device 100 as a sketch search result (S150). Of course, a superimposed sketch image to be displayed in the sketch area may be separately generated, or the original image and link information to be displayed in the search result output area may also be provided to the user device 100. Meanwhile, in this process, the paid sketch image provided to the user device 100 is managed by the paid sketch image management unit 240 to reflect the weight of the paid sketch image. For example, the paid sketch image management unit 240 receives the candidate sketch exposure cost information while receiving the image to be provided as the candidate sketch image and stores it in the sketch image database unit 220, and the sketch image providing unit 230 is currently When selecting a candidate sketch similar to the sketch drawn up to, the paid sketch image is extracted more frequently by reflecting the weight according to the exposure cost information stored in the database under the control of the paid sketch image management unit 240, or the ranking of the extracted candidate sketch image is changed. Differential candidate sketch information such as sharpening of the display can be generated.

When the number of strokes received while the stroke information is received is greater than the number of the reference strokes, the service providing apparatus 200 provides candidate sketch images composed of only paid sketch images to the user device 100 (S160). Even in this case, differentiation can be given between paid candidate sketches according to exposure cost information.

5 is an exemplary screen diagram for explaining a system sketch search screen in the product search system through sketch of the present invention. The illustrated screen shows an example of a sketch search interface provided through a user device.FIG. 5A is a case of using a terminal with a relatively large screen. The user draws a picture directly on the sketch area configured on the touch screen while drawing an overlapping sketch within the screen. When the sketch is completed with reference, search results, which are similar and paid for, based on the user's stroke, are interactively provided in the form of a list on the right. In the search result output area on the right, each candidate sketch may be listed according to ranking by reflecting the weight according to the similarity and exposure cost, and the original image corresponding to the candidate sketch may be displayed. When a desired result image is selected, a web page providing various additional information such as a product sales page, an advertisement page, and a related company homepage may be provided.

5B is an example of a sketch search interface when a terminal with a relatively small screen is used. As shown, the size of the search result output area is reduced to increase the proportion of the sketch area as much as possible. In this case, the search result output area may be scrolled using the left and right arrows, or may be scrolled by a user's gesture.

On the other hand, in sketch search, there may be a situation in which the sketch is covered by a sketch tool such as a user's finger or a pen. This problem can be solved through various methods of separating the area where the actual stroke is expressed and the area that the user touches. Some can be solved. For example, if you select a location to provide the actual stroke and then draw a line by touching an area spaced from it, you can take a method of drawing a line at the first selected location. Of course, the separation distance or the stroke provision location selection method may vary according to various methods.

A computer program for performing a product search service method through sketches according to the above-described embodiment may be stored in the recording medium on which the computer program according to the embodiment of the present invention is recorded.

A product search service method through a sketch according to an embodiment of the present invention can be written with a computer program, and codes and code segments constituting the computer program can be easily inferred by a computer programmer in the relevant field. In addition, the computer program is stored in a computer readable media, and is read and executed by a computer or a service providing device according to an embodiment of the present invention, thereby implementing a product search service method through sketch. I can.

Information storage media include magnetic recording media, optical recording media, and carrier wave media. A computer program implementing a product search service method through sketches according to an embodiment of the present invention may be stored and installed in an internal memory such as a user device or a service providing device for product search through sketches. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing a product search service method through sketches according to an embodiment of the present invention may be mounted on a service providing device through an interface.

The above contents may be modified and modified without departing from the essential characteristics of the present invention by those of ordinary skill in the technical field to which the present invention pertains. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

The present invention extracts sketch images in response to the user's stroke created by touching the sketch area, outputs the extracted sketch images as a search result to the search result output area, and exposes the sketch images with high similarity superimposed on the sketch area. However, in the service field that advertises and sells all types of products or products that can be depicted as pictures, by placing weights on the paid draft images and highlighting them when overlapping or providing them frequently as candidate draft images. It can be widely used.

100: user device 110: control unit
120: stroke recognition unit 130: sketch search interface unit
200: service providing device 210: sketch search interface providing unit
220: sketch image database unit 230: sketch image providing unit
240: paid sketch video management unit 300: communication network

Claims (12)

A sketch search interface unit having a sketch area displaying an overlapped sketch to provide a guide for sketch input and a search result output area displaying sketch search results;
A stroke recognition unit configured to detect and output a user input through the sketch area of the sketch search interface unit as stroke information; And
The stroke information of the stroke recognition unit is transmitted as stroke recognition information to a service providing device, and the candidate sketch selected based on the weight according to the similarity according to the stroke recognition information and the exposure cost for the candidate sketch and the original image corresponding thereto A product search user device through sketch, comprising: a control unit for receiving the sketch search information included from the service providing device and displaying it in the sketch area and the search result output area of the sketch search interface unit. The method of claim 1,
The control unit receives candidate sketches including candidate sketches that are more clearly expressed according to a weight according to the exposure cost, or receives an overlapped image of candidate sketches including candidate sketches that are more clearly expressed, and places them in the sketch area. Product search user device through a sketch, characterized in that to display. A sketch image database unit in which the sketch image and the corresponding original image and exposure cost information are stored;
A paid sketch image management unit that determines a weight for a paid sketch image for which an exposure cost exists and a selection range of candidate sketch images;
A sketch image providing unit that selects a candidate sketch image from the sketch image database unit according to a similarity based on the stroke recognition information received from a user device, a weight of the paid sketch image management unit, and a selection range of a candidate sketch image; And
An apparatus for providing a product search service through sketch, including a sketch search information providing unit that provides the candidate sketch selected by the sketch image providing unit and the original image corresponding thereto to the user device. delete The method of claim 3,
When the number of strokes exceeds a certain number of strokes based on the stroke recognition information, the sketch image providing unit selects only a paid sketch image as the candidate sketch. delete delete delete Receiving, by an apparatus for providing a product search service through sketch, stroke recognition information provided from a user device;
Determining, by the service providing device, a weight for a paid sketch image having an exposure cost and a selection range of candidate sketch images for the sketch image stored in the database, the original image corresponding thereto, and the exposure cost information;
Selecting, by the service providing device, a candidate sketch image from the database according to a similarity based on the stroke recognition information received from the user device, a weight for the paid sketch image, and a selection range of the candidate sketch image; And
And providing, by the service providing device, the selected candidate sketch and the original image corresponding thereto to the user device. delete delete A user device that provides a sketch search interface, transmits stroke information of a user input through the sketch search interface, receives sketch images corresponding to the transmitted stroke information, and superimposes them with a sketch of the sketch search interface; And
When the stroke recognition information, which is the stroke information, is received from the user device, the number of stroke reception is checked, and if the number of receptions is less than or equal to a preset number, a candidate sketch image composed of a free sketch image and a paid sketch image is transferred to the user device. And a service providing device that provides, to the user device, a candidate sketch image composed of only paid sketch images when the number of receptions is greater than a preset number of times.

Images