KR102207514B1 - Sketch retrieval system with filtering function, user equipment, service equipment, service method and computer readable medium having computer program recorded therefor - Google Patents

Abstract

The present invention is equipped with a customized filtering function that collects various information that can be known from the sketch progress status generated during sketching, and provides different search results for each user by using pre-collected user profile information and category information. It relates to a sketch search system, a user device, a service providing device, a service method thereof, and a recording medium in which a computer program is recorded. Candidate sketch images are provided according to the stroke recognition information, and created while sketching is performed using the candidate sketch images as a guide. It is effective to provide different candidate sketch images for each user by collecting and analyzing various types of information, and by searching and providing candidate sketch images with filtering conditions generated using the analysis results. In addition, in providing a candidate sketch image used as a guide for the user's sketching work, the weight of the category is evaluated by reviewing the condition of the stroke or the quality of the sketch such as the line formation condition (line shaking condition) and repetition mistake (number of erasing). In addition, even if the curve is the same according to the weight, candidate draft images belonging to different categories are provided, thereby enabling a customized search for each user.

Description

Sketch retrieval system with filtering function, user equipment, service equipment, service method and computer readable medium having computer with customized filtering function program recorded therefor}

The present invention relates to a sketch retrieval system equipped with a customized filtering function, a user device, a service providing device, a service method thereof, and a recording medium in which a computer program is recorded. In particular, various information that can be known from a sketch progress state generated during a sketch work A sketch search system, a user device, a service providing device, a service method, and a computer program equipped with a customized filtering function that collects and provides different search results for each user using the previously collected user's profile information and category information It relates to the recorded medium.

Recently, with the development of computer and communication technology, the demand for multimedia information service is increasing, and VOD (Video On Demand) service to be used for still image and video search and broadcasting production on the Internet, electronic library, medical field (for example, There is an increasing need for research on multimedia search technologies that can be applied, such as telemedicine and medical image search).

In the early stages of research, text-based search has been used in which a person directly adds an index to all multimedia data to be searched, and users also search for desired information using a subject word.

However, this method takes a lot of time and content, and when the viewpoints of the person who adds the index and the user who searches are inconsistent, there is a problem that the efficiency of the search is greatly reduced. In addition, there is a disadvantage in that complex properties of multimedia data cannot be accurately expressed with text alone. In order to compensate for this, a content-based search method that extracts features representing the contents of multimedia data and performs indexing and detection based on the extracted features is needed.

This image search method recognizes the picture that users draw while touching the touch pad, and searches using the recognized result. Therefore, users set only the sketched picture as a search condition, but do not add other search conditions. Therefore, the same content is provided to all users who sketched similar pictures, and the individual characteristics of the users are not reflected. In particular, it is possible to add a method of constructing a query for a search by manually adding a separate filtering condition, but if a manual task of adding filtering conditions is added in a search method that requires user effort such as sketch, it is inconvenient for users. As a result, service satisfaction may decrease.

Korean Patent Registration No. 1005407480000 [Name: an improved query method for content-based search and a recording medium storing a program for implementing the method]

In order to minimize such inconvenience to users, the present invention collects various information derived from the sketch state during sketch work when candidate sketch images are provided according to stroke recognition information and sketch work is performed using the candidate sketch image as a guide. And analyzing the candidate draft image filtering conditions, and then providing the extracted candidate draft images according to the filtering conditions.

In addition, the present invention provides a candidate sketch image that is used as a guide for the user's sketching work, by reviewing the condition of the stroke or the quality of the sketch such as the line formation state (line shaking state) and repetition error (number of erasing). The purpose is to apply weights and provide candidate sketch images that belong to different categories even if they are the same sketch according to the weight.

In addition, an object of the present invention is to search for and provide candidate sketch images that can be satisfied by the user by additionally reflecting search selection information selected by the user such as personal information and category of the user.

A sketch search user device equipped with a customized filtering function according to an embodiment of the present invention is a sketch search interface having a sketch area displaying an overlapped sketch to provide a guide for sketch input and a search result output area listing sketch search results. A stroke recognition unit that detects and outputs the user input through the sketch area of the sketch search interface unit as stroke information, and the sketch status information about the stroke state and sketch quality obtained during sketching of the sketch area by receiving stroke information from the stroke recognition unit. When sketching is performed from the sketch state information generation unit and the sketch area that collects and outputs, stroke information is input from the stroke recognition unit to generate stroke recognition information, and the sketch state information and stroke recognition information of the sketch state information generation unit are used. 1 It may include a control unit that generates filtering condition information and transmits it to the service providing device.

As an example related to the present invention, the first filtering condition information may be characterized by consisting of at least one or more of stroke state information and sketch quality information.

According to an embodiment of the present invention, a sketch search service providing apparatus equipped with a customized filtering function includes a sketch image database in which a plurality of sketch images and original images corresponding thereto are stored together with category information, a stroke state obtained during sketch work from a user device, and A sketch image providing unit and a sketch image display unit that selects candidate sketch images from the sketch image database unit based on the received first filtering condition information by receiving the sketch status information regarding the sketch quality and the first filtering condition information including stroke information. It may include a sketch search information providing unit for providing the candidate sketch image selected in the study and the original image corresponding thereto to the user device.

As an example related to the present invention, the sketch image providing unit generates second filtering condition information according to the user's personal information and search information selected by the user, and provides the sketch image searched by the second filtering condition information to the user device. It can be characterized.

As an example related to the present invention, the draft image providing unit may analyze first filtering condition information and assign a weight to a category of the candidate draft image.

As an example related to the present invention, the stroke state includes information on the degree to which the stroke is shaken or repeatedly erased, and the sketch quality includes information on the quality level by classifying sketch quality through learning or the degree of consistency with the sketch. It can be characterized.

As an example related to the present invention, the draft image providing unit may be characterized in that it changes the weight information of the category and the first filtering condition information by analyzing a state in which the category to which the provided candidate draft image belongs is changed during the sketching process. have.

A sketch search service method with a customized filtering function according to an embodiment of the present invention is a step of performing a sketch operation by receiving a user's stroke through a sketch search interface by a user device, and a sketch operation performed by the user device through the sketch search interface. Collecting sketch status information including information on the stroke status and sketch quality obtained during the process and the stroke information at this time, the user device transmits the stroke information and sketch status information as first filtering condition information to the service providing device And receiving, by the user device, candidate sketch images extracted from the service providing device according to the first filtering condition information.

According to another embodiment of the present invention, a sketch search service method equipped with a customized filtering function includes the steps of receiving, by a service providing device, a sketch search execution request signal from a user device, a stroke state obtained by the service providing device during sketch work from the user device, and Receiving first filtering condition information including sketch status information and stroke information on sketch quality, selecting candidate sketch images according to the first filtering condition information by a service providing device and transmitting them to a user device, and providing a service The device receives and analyzes the sketch status information collected while sketching is being performed using the candidate sketch images as a guide, then selects a category according to the analysis result, and transmits the candidate sketch images included in the selected category to the user device. It may include the step of.

A computer program for performing a sketch search service method having a customized filtering function according to the above-described embodiment may be stored in the recording medium according to the embodiment of the present invention.

The sketch search system according to an embodiment of the present invention receives candidate sketch images based on the stroke recognition information generated through the sketch area of the sketch search interface to perform a sketch work, and sketch state information generated as the sketch work progresses. A user device that transmits and stroke information as first filtering condition information, receives candidate sketch images extracted according to the first filtering condition information, and exposes them to the candidate sketch output area, and receives first filtering condition information from the user device. It may include a service providing device that determines a category of a candidate sketch image after analyzing the stroke state or the quality state of the sketch, extracts the candidate sketch images included in the determined category, and transmits it to the user device.

The present invention provides candidate sketch images according to stroke recognition information, collects and analyzes various information obtained according to the sketch state while sketching is performed using the candidate sketch image as a guide, and uses the analysis result to generate candidate sketch images. By searching and providing draft images, there is an effect that a customized search is possible by providing different candidate draft images for each user.

In addition, the present invention provides a candidate sketch image used as a guide for the user's sketch work, by reviewing the state of the stroke or the quality of the sketch, such as the line formation state (line shake state) and repetition mistake (number of erases). By applying a weight of a category and providing candidate sketch images belonging to different categories even if they have the same curve according to the weight, customized search results for each user can be provided, thereby increasing individual search satisfaction.

In addition, the present invention has the effect of providing candidate sketch images that can satisfy the user by additionally reflecting search selection information selected by the user, such as personal information and category of the user.

1 is a block diagram showing the configuration of a sketch search system equipped with a customized filtering function according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a user device according to an embodiment of the present invention.
3 is a block diagram showing the configuration of a service providing apparatus according to an embodiment of the present invention.
4 is a flowchart illustrating a process of generating first filtering condition information in a sketch search system equipped with a customized filtering function according to an embodiment of the present invention.
5 is a flowchart showing a sketch search service method equipped with a customized filtering function according to an embodiment of the present invention.
6 is an exemplary view illustrating an example of a sketch search screen of a sketch search system equipped with a customized filtering function according to an embodiment of the present invention.

It should be noted that the technical terms used in the present invention are only used to describe specific embodiments, and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be interpreted as generally understood by those of ordinary skill in the technical field to which the present invention belongs, unless otherwise defined in the present invention, and is excessively comprehensive. It should not be construed as a human meaning or an excessively reduced meaning. In addition, when a technical term used in the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present invention should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present invention includes a plurality of expressions unless the context clearly indicates otherwise. In the present invention, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various elements or various steps described in the invention, and some of the elements or some steps are included. It should be construed that it may not be, or may further include additional components or steps.

In addition, terms including ordinal numbers such as first and second used in the present invention may be used to describe the constituent elements, but the constituent elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the present invention, when it is determined that a detailed description of a related known technology may obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the spirit of the present invention and should not be construed as limiting the spirit of the present invention by the accompanying drawings.

1 is a block diagram showing the configuration of a sketch search system equipped with a customized filtering function according to an embodiment of the present invention.

As shown in FIG. 1, the sketch search system provided with a customized filtering function includes a user device 100 and a service providing device 200 connected to the user device 100 through a communication network 300.

The user device 100 provides a sketch search interface consisting of a sketch area and a search result output area to the user, and transmits stroke recognition information on the stroke applied by the user while sketching through the sketch area to the service providing device 200. Accordingly, the candidate draft image is provided and displayed in the sketch area and the search result output area. If the original image corresponding to the sketch image is further received, the candidate sketch image is displayed as a sketch in the sketch area, and the original image corresponding to the candidate sketch image is displayed in the search result output area in various ways.

The user device 100 superimposes the candidate sketch images received through the sketch area and provides them as a guide during the user's sketch work (individual candidate sketch images may be received and superimposed and provided, or the overlapped image may be initially received. May be).

The user device 100 generates first filtering condition information by collecting stroke information and sketch state information obtained during the user's sketching process using this sketch image as a guide, and provides the first filtering condition information to the service providing device ( 200). Here, the sketch status information includes stroke status information, including shaking (confirmed by the flatness of the stroke line or the difference from the corresponding sketch), frequently erased due to repeated mistakes (when drawing the same line multiple times), This is a variety of information that can be detected during sketching, including the degree of consistency of the scholar and the quality level by classifying sketch quality through learning.

After analyzing the first filtering condition information, the service providing device 200 selects a category consisting of candidate sketch images to be transmitted to the user device 100, and selects candidate sketch images included in the selected category to the user device 100. ).

Meanwhile, the service providing device 200 may be implemented to selectively generate second filtering condition information by additionally reflecting the user's personal information or a category previously selected by the user in addition to the first filtering condition information and provide candidate sketch images accordingly. Alternatively, the service providing device 200 may generate first filtering condition information by receiving only stroke information from the user device 100.

2 is a block diagram showing the configuration of a user device according to an embodiment of the present invention.

As shown in FIG. 2, the user device 100 providing a sketch search service function to which a customized filtering function is added includes a sketch search interface unit 110, a stroke recognition unit 120, a sketch state information generation unit 130, and It consists of a control unit 140.

Not all of the components of the user device 100 shown in FIG. 2 are essential components, and the user device 100 capable of implementing a sketch search system may be implemented by more components than the components shown in FIG. 2. Alternatively, the user device 100 may be implemented by using fewer components.

The user device 100 refers to a terminal capable of transmitting and receiving various data via a communication network according to a user's key operation, and a tablet PC, a laptop, a smart phone, and personal portable information It may be any one of a terminal (PDA: Personal Digital Assistant) and a mobile communication terminal.

In addition, the user device 100 includes a browser for communicating with the service providing device 200 via the communication network 300, a memory for storing programs and protocols, and a microprocessor for calculating and controlling by executing various programs. It refers to the terminal device being used. That is, the user device 100 can perform server-client communication with the service providing device 200, and any terminal can be used as long as it can execute the sketch search service, and includes all communication computing devices such as mobile communication terminals and PDAs. It is a broad concept. Meanwhile, the user device 100 is preferably manufactured in a form having a touch screen, but is not limited thereto.

In particular, the user device 100 according to an embodiment of the present invention receives candidate sketch images based on the stroke recognition information generated through the sketch area of the sketch search interface, and allows the sketch work to be performed, and occurs as the sketch work progresses. The sketch status information is transmitted as first filtering condition information to the service providing device 200, and sketch search information including a candidate sketch image is input from the service providing device 200 in response to the first filtering condition information to search for a sketch. The sketch area of the interface 110 and the search result output area are exposed.

The sketch search interface unit 110 provides a sketch area in which an overlapped sketch to provide a guide for sketch input is displayed and a search result output area in which sketch search results are listed. Here, sketch search information including a sketch image is provided in the sketch area and the search result output area. The sketch search information is search information received from the service providing device 200, and may include a candidate sketch image, an original image corresponding to the candidate sketch image, and link information connected to the corresponding original image. The candidate sketch image included in the sketch search information or the original image corresponding thereto is provided to the user device 100 as a search result. The user device 100 may display the candidate sketch image in the sketch area, and may arrange the candidate sketch image or the original image corresponding thereto in the search result output area on one screen or provide a scroll method. On the other hand, when an individual image (candidate sketch image or an original image corresponding thereto) that appears in the search result output area is selected, a web page according to the linked link information may be provided.

The stroke recognition unit 120 detects a user input through the sketch area of the sketch search interface unit 110 as stroke information and outputs it to the sketch state information generation unit 130 and the control unit 140. In this case, the stroke recognition unit 120 may include a general input device such as a small keyboard, a pen mouse, a joystick, a touch screen, and a touch pad.

The sketch state information generation unit 130 receives stroke information from the stroke recognition unit 120, collects sketch state information generated during sketching of the sketch area, and outputs it to the control unit 140.

The control unit 140 receives stroke information from the stroke recognition unit 120 when a sketch operation is performed from the sketch area, receives the sketch state information from the sketch state information generator 130, and receives the first filtering condition together with the stroke recognition information. Information is generated and transmitted to the service providing device 200. Here, the sketch state information included in the first filtering condition information includes stroke state information, sketch quality information, and the like. Stroke status information includes stroke rates that are frequently erased due to tremors or repeated mistakes, and sketch quality information includes similarity, consistency with mill drawings, and quality classification through learning. The service providing device 200 determines whether or not the elderly or skilled person is through the first filtering condition information generated by the control unit 140, and when it is identified as the elderly, the sketch information included in the category related to the elderly (I.e., the search result) is provided, and the system can be implemented to provide the sketch information (i.e., the search result) included in the currently fashionable category or the category that provides high-priced products, etc.

The controller 140 retrieves sketch search information (overlapping candidate sketch information, individual candidate sketch information, or an image corresponding thereto) received from the service providing device 200 in response to the first filtering condition information, and the sketch search interface unit 110 Through the sketch search interface unit 110, the user device 100 and the service providing device 200 provide a communication environment to each other so that the product search through the sketch is performed. Here, the service providing device 200 may select sketch search information using second filtering condition information including profile information of a user and category information previously selected by the user in addition to the first filtering condition information of the control unit 140.

On the other hand, when generating the stroke recognition information included in the first filtering condition information, the control unit 140 extracts the features of the sketch and then allows only the feature information of the extracted sketch. Therefore, the user device 100 and the service providing device (200) It is possible to prevent the problem of a drop in service speed in advance by reducing the mutual load.

3 is a block diagram showing the configuration of a service providing apparatus according to an embodiment of the present invention.

As shown in FIG. 3, the service providing apparatus 200 may include a sketch image database unit 210, a sketch image providing unit 220, and a sketch search information providing unit 230.

The service providing device 200 receives the first filtering condition information from the user device 100, analyzes the user's stroke state or the quality of the sketch, selects a category of the candidate sketch image, and is included in the selected category. Candidate draft images are extracted and transmitted to the user device 100.

The draft image database unit 210 stores a plurality of draft images and original images corresponding thereto. A plurality of sketch images may be classified by category and stored and managed.

The draft image providing unit 220 selects a candidate draft image from the draft image database unit 210 according to a similarity range based on the first filtering condition information received from the user device 100. Here, the draft image providing unit 220 enables the user to select a customized draft image by using the second filtering condition information consisting of the user's profile information and preselected category information in addition to the first filtering condition information.

The dense drawing image providing unit 220 may overlap the candidate sketch image selected by the user in the search result output area on the guide sketch image on the sketch area to be exposed.

The sketch image providing unit 220 extracts the sketch images by using stroke recognition information received from the user device 100 and the personal information of the user registered in advance as a primary filtering condition, and transfers the extracted sketch images to the user device 100. And extracts a candidate sketch image to be provided to the user device 100 according to the first filtering condition by receiving first filtering condition information from the user device 100.

The draft image providing unit 220 may add a weight to a category of the candidate draft image by analyzing the first filtering condition information.

The draft image providing unit 220 allows the user to select an assigned category corresponding to the candidate draft image, changes the first filtering condition information using the selected category, and uses the changed first filtering condition information. The sketch images may be extracted and provided to the user device 100.

The draft image providing unit 220 may change the weight information of the category and the first filtering condition information by analyzing a state in which the category to which the candidate draft image belongs is changed during the sketching process.

When a sketch search execution request signal is received from the user device 100, the sketch search information providing unit 230 stores the candidate sketch image extracted from the sketch image providing unit 220 and the corresponding original image (and link information) to the user device ( Sketch search information corresponding to the sketch search interface unit 110 (100) is provided to the user device 100 as sketch search information (candidate draft and an original image corresponding thereto). The sketch search information provided to the user device 100 may include a sketch area and a candidate sketch image to be displayed in the search result output area, an original image corresponding to the candidate sketch image, and link information connected to the corresponding original image. The candidate sketch image included in the sketch search information or the original image corresponding thereto is provided to the user device 100 as a search result, and the user device 100 displays the search result in the search result output area of the sketch search interface unit 110. Can be listed on one screen or provided by scrolling.

The sketch search information providing unit 230 provides a spacing setting menu item for setting the spacing between the sketch line and the drag line to the user device 100, and is drawn by the user according to the spacing setting method selected according to the spacing setting menu item. Sets the distance between the drag line and the sketch line drawn on the sketch according to the drag line, and when stroke information is input within the set distance, the sketch line can be exposed on the sketch along the drag line.

That is, when the user sketches along the sketch image of the sketch area, the edge line of the sketch image is covered by the sketching tool, so that it is possible to inconvenient to sketch. For example, in the case of a thin pen, this phenomenon may be less, but if the sketch tool is thick, such as a user's hand, the sketch image is hidden by the sketch tool, making it difficult to sketch based on the sketch image. Accordingly, when sketching along the edge line of the sketch image at a location spaced apart from the edge line of the sketch image, it can be implemented so that the drag line is expressed along the edge line of the sketch image according to the sketch line. The sketch search information providing unit 230 of the service providing device 200 provides a spacing setting menu item, and may set the relationship between the drag line and the sketch line by selecting the spacing setting menu item at the beginning of the sketch work or at a desired time point. have.

The spacing setting menu item is the first spacing setting menu item that sets the spacing between the sketch line and the drag line by double-touching the drag area and the draw area simultaneously, and the sketch line and the drag line by sequentially clicking the drag area and the draw area. Select the second spacing setting menu item to set the spacing of, and the edge length by selecting both end points where the drag area and the draw area meet to set the spacing between the sketch line and the drag line, and to expose the edge between the set spacing. 3 It consists of a spacing setting menu item, and a fourth spacing setting menu item for setting the spacing between the sketch line and the drag line by setting the drag area and the draw area according to the edge setting.

When the third spacing setting menu item or the fourth spacing setting menu item is selected, the sketch search information providing unit 230 selects an edge to change the positions of the drag area and the draw area.

In the previous embodiment, when the sketch search information providing unit 230 of the service providing device 200 inputs a stroke through the sketch interface, an input method and a sketch method for solving a situation where it is difficult to perform sketch while checking the sketch. It has been shown that an additional user interface support function, such as adding another picture, can be provided, but this function is performed independently or interlocked with the service providing device 200 in the sketch search interface unit 110 of the user device 100 It can also be done while doing. This is apparent to those of ordinary skill in the art through the above description, so a separate description will be omitted.

Hereinafter, a sketch search service method with a customized filtering function based on the above-described configuration will be described in detail with reference to the accompanying drawings.

4 is a flowchart showing a process of generating first filtering condition information in a sketch search service method equipped with a customized filtering function according to an embodiment of the present invention based on the above-described configuration.

First, the user device 100 performs a sketch work through the sketch search interface provided from the service providing device 200 (S110), and when a sketch work is performed through the sketch search interface, collects sketch state information generated during sketch work. Do (S120).

The user device 100 transmits the stroke recognition information and sketch status information as first filtering condition information to the service providing device 200 (S130), and the service providing device 200 is a candidate sketch according to the first filtering condition information. An image is selected and provided to the user device 100 (S140).

5 is a flowchart showing a sketch search process in a sketch search service method equipped with a customized filtering function according to an embodiment of the present invention.

As shown in FIG. 5, the service providing device 200 determines whether a sketch search execution request signal is received from the user device 100 (S210). When a sketch search execution request signal is received as a result of determination, the user device 100 provides a sketch search interface consisting of a sketch area and a search result output area to the user through the sketch search interface unit 110, and the user obtained through the sketch area Stroke recognition information according to the stroke of and tag information corresponding to the image set as the sketch of the sketch area are transmitted to the service providing apparatus 200 as filtering conditions (S220).

The service providing device 200 determines whether the first filtering condition information is received from the user device 100 (S230), and when the first filtering condition information is received as a result of the determination, a candidate sketch according to the first filtering condition information An image is selected (S240).

The service providing device 200 receives and analyzes the sketch state information collected while the sketching operation is being performed by using candidate sketch images as a guide, and then determines a category according to the analysis result (S250). Then, the candidate draft images included in the determined category are transmitted to the user device 100 (S260). Here, the service providing apparatus 200 selects candidate sketch images by adding second filtering condition information in addition to the first filtering condition information, and provides the selected candidate sketch images to the user device 100, so that a plurality of users are similar to each other. Even when sketching is performed, different candidate sketch images may be provided for each user, or the order of steps S250 and S240 may be changed.

6 is an exemplary view illustrating a sketch search screen of a sketch search system equipped with a customized filtering function according to an embodiment of the present invention. In the illustrated screen, the size of the search result output area is reduced to increase the proportion of the sketch area as much as possible. In this case, the search result output area may be scrolled using the left and right arrows, or may be scrolled by a user's gesture.

On the other hand, in sketch search, there may be a situation in which the sketch is covered by a sketch tool such as a user's finger or a pen. This problem can be solved through various methods of separating the area where the actual stroke is expressed and the area that the actual user touches. Some can be solved. For example, if you select a location to provide the actual stroke and then draw a line by touching an area spaced from it, you can take a method of drawing a line at the first selected location. Of course, the separation distance or the stroke provision location selection method may vary according to various methods.

In the recording medium on which the computer program according to the embodiment of the present invention is recorded, a computer program for performing the sketch search service method equipped with a customized filtering function according to the above-described embodiment may be stored.

The sketch search service method provided with a customized filtering function according to an embodiment of the present invention can be written in a computer program, and codes and code segments constituting a computer program can be easily inferred by a computer programmer in the art. In addition, the computer program is stored in a computer readable media, and is read and executed by a computer or a user device or a service providing device according to an embodiment of the present invention, thereby providing a customized filtering function. You can implement a sketch search service method.

Information storage media include magnetic recording media, optical recording media, and carrier wave media. A computer program that implements a sketch search service method equipped with a customized filtering function according to an embodiment of the present invention may be stored and installed in an internal memory such as a user device or a service providing device. Alternatively, an external memory such as a smart card storing and installing a computer program that implements a sketch search service method with a customized filtering function according to an embodiment of the present invention may be mounted on a user device or a service providing device through an interface. .

The above contents may be modified and modified without departing from the essential characteristics of the present invention by those of ordinary skill in the technical field to which the present invention pertains. Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

In the present invention, when candidate sketch images are provided according to stroke recognition information and sketching is performed using the candidate sketch image as a guide, various information generated during sketching is collected and analyzed to determine a filtering condition for a candidate sketch image, and then the filtering condition By providing the extracted candidate sketch images according to the user's desire to achieve the sketch, it can be applied to a service that maximizes advertisements by repeatedly exposing products, products, and images according to the user's input.

100: user device 110: sketch search interface unit
120: stroke recognition unit 130: sketch state information generation unit
140: control unit 200: service providing device
210: sketch image database unit 220: sketch image providing unit
230: sketch search information providing unit 300: communication network

Claims (11)

A sketch search interface unit having a sketch area displaying an overlapped sketch to provide a guide for sketch input and a search result output area listing sketch search results;
A stroke recognition unit configured to detect and output a user input through the sketch area of the sketch search interface unit as stroke information;
A sketch state information generator configured to receive stroke information from a stroke recognition unit and collect and output sketch state information regarding a stroke state and sketch quality obtained during sketching of the sketch area; And
When a sketching operation is performed from the sketch area, stroke information of the stroke recognition unit is input to generate stroke recognition information, and a candidate among a plurality of sketch images stored in the service providing device using the sketch status information and stroke recognition information of the sketch status information generation unit. A control unit that generates first filtering condition information for selecting a sketch image by the service providing device and transmits it to the service providing device
Including,
The stroke state includes information on a degree of shaking or repeatedly erasing the stroke, and the sketch quality includes information on a degree of correspondence with the sketch,
The first filtering condition information includes the stroke recognition information and the sketch state information generated based on the stroke information. A sketch search user device with a customized filtering function. delete A sketch image database unit in which a plurality of sketch images and an original image corresponding thereto are stored together with category information;
A candidate sketch image from the sketch image database unit based on the first filtering condition information received by receiving the first filtering condition information including the stroke information and the sketch state information about the stroke state and sketch quality obtained during sketching from the user device. A sketch image providing unit for selecting a picture; And
A sketch search information providing unit that provides a candidate sketch image selected by the sketch image providing unit and an original image corresponding thereto to a user device
Including,
The stroke state includes information on the degree to which the stroke is shaken or repeatedly erased, and the sketch quality is a sketch search interface unit having a sketch area in which an overlapped sketch is displayed to provide a guide for sketch input in the user device. An apparatus for providing a sketch search service with a customized filtering function, characterized in that it includes information on the degree of correspondence with the sketch displayed through. delete The method of claim 3,
The sketch search service providing device with a customized filtering function, wherein the sketch image providing unit analyzes the first filtering condition information and assigns a weight to a category of the candidate sketch image. delete ◈ Claim 7 was abandoned upon payment of the set registration fee. The method of claim 3,
The sketch image providing unit analyzes a state in which the category to which the provided candidate sketch image belongs is changed during the sketching process, and changes the weight information of the category and the first filtering condition information. Sketch search with a customized filtering function. Service provision device. delete delete delete delete

Images