JP2005038402A - Illicit use investigation service providing system of image data, device, method, program and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To retrieve on Web image data identical or similar to image data which is an investigation object when performing illicit use investigation of the image data requiring use permission, and to inform an investigation requester of the result. <P>SOLUTION: A server system 10 has a retrieval server 11 and a management server 12, and is connected to a client terminal 21<SB>1</SB>through a network 22. The management server 12 registers the image data inputted from the client terminal 21<SB>1</SB>in an investigation object DB 15 as an investigation object relative to each investigation requester, and sets an investigation condition for investigating whether the image data is illicitly used in a Web site group 30 on the network 22 or not. The retrieval server 11 calculates the feature amount of the image data registered in the investigation object DB 15, and retrieves image data identical or similar to the image data which is the investigation object based on the feature amount and the investigation condition. The management server 12 transmits the retrieved result to the client terminal 21<SB>1</SB>. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image data unauthorized use investigation service providing system, apparatus, method, program, and recording medium, and more specifically, an image for performing an unauthorized use investigation by searching for similar images of image data that require use permission. The present invention relates to an unauthorized use investigation service providing system, apparatus, method, program, and recording medium.

  Conventionally, a trademark search service by a third party has been provided. This service is intended to monitor the trademarks of others in order to protect trademarks owned by corporations or individuals. The above trademark search service periodically searches for newly applied or registered trademarks, and whether or not there is the same or similar trademark (name, logo, naming, etc.) requested by the client Conduct a survey. As a result, when the same or similar ones are hit, the results are created in a single form or a list format and reported to the client.

  As an example of the trademark search service, the client inputs a trademark, title, and target classification to be searched into a request form, and sends the request form by FAX or e-mail. At this time, one international classification can be designated as one search unit for one trademark, and up to three designations can be designated for one trademark. Next, the search is always automatically performed with a certain accuracy in accordance with a predetermined search condition, and all cases for the same and identical trademarks are output, and about 30 cases for the similar trademarks with the highest priority are output as reports. Search uses trademark publication data and application data added weekly.

  On the other hand, regarding the detection of illegal copyrighted works or similar image retrieval, the feature quantity registered in advance is compared with the feature quantity acquired by the search, and it is determined from the result whether the copyrighted work is an illegal copyrighted work. (For example, refer to Patent Document 1). In this method, a determination is made as to whether or not the URL, file name, file size, and calculated hash value acquired as the feature value match those registered in the feature value DB.

In addition, there are disclosed a plurality of attributes related to product design and a comparison table data related to those similarities, which are searched based on such information, taking account of design similarities (for example, patent literature) 2).
JP 2000-215238 A JP 2001-216323 A

  However, in the trademark search service as described above, since a search is performed using a specialized DB provided and operated by a predetermined institution, it is difficult to conduct a search for recording locations other than the DB. . Although it is possible to search using the Internet or the like, since it is a text search, it is not possible to search based on the characteristics of the image data itself.

  In the inventions described in Patent Document 1 and Patent Document 2, a wide search is possible using the Internet search robot, but similarity / non-similarity is determined depending on whether or not the data matches predetermined data. It is difficult to determine similarities due to differences in file formats, differences in modification, etc., and efficient and flexible search is not possible.

  The present invention has been made in view of the circumstances as described above, and when performing an unauthorized use investigation of image data that requires a license, calculates the feature amount of the image data that is the subject of the unauthorized use investigation, An image data unauthorized use investigation service providing system and apparatus that can search image data matching or similar to the image data from the Web based on the feature amount and notify the search requester of the search result as an investigation report The object is to provide a method, a program, and a recording medium.

  According to the first aspect of the present invention, a server device for conducting an unauthorized use investigation of image data requiring use permission and a terminal device used by an investigation requester who requests an unauthorized use investigation are connected via a network. In the image data unauthorized use investigation service providing system, the server device registers the image data input from the terminal device as a survey target in a survey target database for each survey requester, and the registered image A search condition setting means for setting a search condition for checking whether the data is illegally used on a website on the network, a feature amount of the image data registered by the search target registration means, and the calculated Based on the feature quantity and the search condition, image data that matches or is similar to the image data to be searched is added to the network. Similar image search means for searching from a Web site on a work, and search result notification means for notifying a search requester who uses the terminal device as a search report of the searched search result. .

  According to a second aspect of the present invention, in the first aspect of the invention, the feature amount is any one or more of a color, a pattern, a shape, and a layout of image data to be subjected to an unauthorized use investigation. It is.

  According to a third aspect of the present invention, in the first or second aspect of the invention, the survey object registration means receives the use permission of the image data together with the image data to be subjected to the unauthorized use investigation and the feature amount of the image data. The information about the user including the identification information of the Web site managed by the user is registered in the survey target database for each survey requester.

  According to a fourth aspect of the present invention, in the third aspect of the invention, the survey condition setting means excludes a Web site managed by a user registered in the survey target database from a target of an unauthorized use survey, and sets a survey condition. The feature is that it can be set.

  According to a fifth aspect of the present invention, in the invention according to any one of the first to fourth aspects, the investigation condition setting means is any one of a data format, a data capacity, and a data size of image data to be subjected to an unauthorized use investigation. It is characterized in that at least a plurality can be set.

  The invention according to claim 6 is the invention according to any one of claims 1 to 5, wherein the investigation condition setting means is any one of a domain type, a page type, and a page hierarchy of a website to be subjected to an unauthorized use investigation. It is characterized in that at least a plurality can be set.

  According to a seventh aspect of the present invention, in the invention according to any one of the first to sixth aspects, when the similar image search means searches for image data that matches or is similar to the image data to be searched, the search target database A predetermined range is set for the feature amount of the image data registered in the image data, and image data having the feature amount within the range is searched as a similar image from the image data included in the website on the network, and the similar image The image data searched for and the identification information of the Web site including the image data can be acquired.

  The invention according to claim 8 is the invention according to any one of claims 1 to 6, wherein the server device periodically circulates a website on the network, and features from image data included in the visited website And feature amount registration means for registering information relating to the calculated feature amount in the feature amount database in association with the identification information of the website, wherein the similar image search means matches the image data to be investigated or When searching for similar image data, a predetermined range is set for the feature amount of the image data registered in the database to be investigated, and the feature amount within the range is selected from the feature amounts registered in the feature amount database. As a result, it is possible to acquire image data corresponding to the searched feature amount and identification information of a website including the image data. Those were.

  The invention according to claim 9 is the invention according to claim 7 or 8, wherein the similar image search means sets similarity based on a feature amount of the image data acquired as a similar image, and the search is performed. The result notifying means sorts the image data in descending order of similarity set by the similar image searching means when displaying the search result on the terminal device for notification, and the sorted image data is converted into the image data. It is characterized in that it can be displayed together with image information including at least the identification information of the website including the image information and the similarity of the image data.

  The invention of claim 10 is the invention of claim 9, further comprising a sentence example database storing sentence examples of warning mails having different contents depending on the similarity set for each image data, and the search result notifying means includes: In the case where a warning mail is transmitted to a website including a similar image searched by the similar image search means, and the warning mail is transmitted to the website including the similar image, the sentence example database includes A sentence example corresponding to the similarity of the similar images is selected, the selected sentence example is set in the warning mail, and the warning mail in which the sentence example is set is transmitted to an email address included in the website. Is.

  According to an eleventh aspect of the present invention, in the invention according to the tenth aspect, the search result notifying means investigates before sending a warning mail in which a sentence example selected from the sentence example database is set to an email address included in the website. It is transmitted to the requester's terminal device, and after checking or correcting the content of the warning mail by the survey requester, the warning mail is transmitted to the mail address included in the Web site.

  According to a twelfth aspect of the present invention, in the invention according to any one of the first to eleventh aspects, the investigation target registration unit obtains, for each survey requester, an investigation history relating to the image data together with image data to be subject to unauthorized use investigation. The information is registered in the survey target database.

  According to a thirteenth aspect of the present invention, in the twelfth aspect of the invention, the investigation target registration unit searches the similar image retrieval unit for the number of times the warning mail is transmitted by the search result notification unit as the investigation history. It is characterized in that it is registered for each Web site including an image.

  According to a fourteenth aspect of the invention, in the invention of the twelfth or thirteenth aspect, the search result notifying means stepwise processes warning contents by the warning mail in accordance with the number of times the warning mail registered by the investigation target registration means is transmitted. It is characterized by changing to.

  The invention of claim 15 is the invention according to any one of claims 1 to 14, wherein the server device estimates the cost for the unauthorized use investigation based on the investigation condition set by the investigation condition setting means. An estimated amount calculating means for calculating, and before searching for similar images by the similar image searching means, the calculated estimated amount is notified to the survey requester, and when there is approval by the survey requester, It is characterized by executing a search for similar images.

  According to a sixteenth aspect of the present invention, in a server device for investigating unauthorized use of image data that requires a license, image data input from a survey requester is registered as a survey target in a survey target database for each survey requester. Survey target registration means, survey condition setting means for setting survey conditions for investigating whether or not the registered image data is illegally used on a website on the network, and image data registered by the survey target registration means A similar image search means for searching image data that matches or is similar to the image data to be searched based on the calculated feature value and the search condition from the website on the network, Search result notification means for notifying the search requester of the searched search results as a survey report. It is obtained by the butterfly.

  The invention according to claim 17 provides an unauthorized use investigation service by a server device connected via a network to a terminal device used by an investigation requester who requests an unauthorized use investigation of image data that requires a license. In the method for providing unauthorized use investigation service of image data, an investigation object registration step of registering image data input from the terminal device as an investigation object in an investigation object database for each investigation requester, and the registered image data on the network A survey condition setting step for setting a survey condition for investigating whether the website is illegally used; a feature amount of the image data registered in the survey target registration step; and the calculated feature amount and the Based on the survey conditions, image data that matches or is similar to the image data to be surveyed is selected. A similar image search step for searching from a Web site on the network, and a search result notification step for notifying a search requester who uses the terminal device as a search report of the searched search result. .

  The invention according to claim 18 is the invention according to claim 17, wherein the feature amount is one or more of a color, a pattern, a shape, and a layout of image data to be subjected to an unauthorized use investigation. It is.

  The invention according to claim 19 is the invention according to claim 17 or 18, wherein in the investigation object registration step, the image data to be subjected to unauthorized use investigation and the feature amount of the image data are received with permission to use the image data. The information about the user including the identification information of the Web site managed by the user is registered in the survey target database for each survey requester.

  According to a twentieth aspect of the present invention, in the nineteenth aspect of the present invention, in the investigation condition setting step, a website managed by a user registered in the investigation object database is excluded from the object of unauthorized use investigation, and the investigation condition is set. The feature is that it can be set.

  According to a twenty-first aspect of the present invention, in any one of the seventeenth to twentieth aspects, in the investigation condition setting step, any one of a data format, a data capacity, and a data size of image data to be subject to an unauthorized use investigation It is characterized in that at least a plurality can be set.

  The invention of claim 22 is the invention of any one of claims 17 to 21, wherein, in the investigation condition setting step, any one of a domain type, a page type, and a page hierarchy of a Web site subject to an unauthorized use investigation It is characterized in that at least a plurality can be set.

  According to a twenty-third aspect of the present invention, in the invention according to any one of the seventeenth to twenty-second aspects, when the similar image search step searches for image data that matches or is similar to the image data to be searched, the search target database A predetermined range is set for the feature amount of the image data registered in the image data, and image data having the feature amount within the range is searched as a similar image from the image data included in the website on the network, and the similar image The image data searched for and the identification information of the Web site including the image data can be acquired.

  According to a twenty-fourth aspect of the invention, in the invention of any one of the seventeenth to twenty-second aspects, the website on the network is periodically visited, the feature amount is calculated from the image data included in the visited website, A feature amount registration step of registering information about the calculated feature amount in the feature amount database in association with identification information of the website, and in the similar image search step, image data that matches or is similar to the image data to be investigated When searching, a predetermined range is set for the feature amount of the image data registered in the survey target database, and the feature amount within the range is searched from the feature amount registered in the feature amount database, As a result, it is possible to acquire image data corresponding to the searched feature amount and identification information of a website including the image data. One in which the.

  The invention of claim 25 is the invention of claim 23 or 24, wherein, in the similar image search step, similarity is set for the image data acquired as a similar image based on a feature amount of the image data, and the search is performed. In the result notification step, when the search result is displayed and notified on the terminal device, the image data is sorted in descending order of the similarity set in the similar image search step, and the sorted image data is It is characterized in that it can be displayed together with image information including at least the identification information of the Web site including data and the similarity of the image data.

  According to a twenty-sixth aspect of the present invention, in the twenty-fifth aspect of the invention, the example of the warning mail having different contents according to the similarity set for each image data is stored in the sentence example database, and in the search result notifying step, When a warning mail is transmitted to a website including a similar image searched by the similar image search step, a sentence example corresponding to the similarity of the similar image is selected from the sentence example database, and the selected sentence example The warning mail is set in the warning mail, and the warning mail in which the sentence example is set is transmitted to the mail address included in the Web site.

  According to a twenty-seventh aspect of the present invention, in the twenty-sixth aspect of the invention, a warning mail in which a sentence example selected from the sentence example database is set is sent to the terminal device of the survey requester before being sent to the mail address included in the website. Then, after the confirmation requester confirms or corrects the content of the warning mail, the warning mail is transmitted to the mail address included in the Web site.

  A twenty-eighth aspect of the invention is a program for executing a function as an unauthorized use investigation service providing system for image data according to any one of the first to fifteenth aspects.

  A twenty-ninth aspect of the invention is a program for executing the function as the server device according to the sixteenth aspect.

  A thirty-third aspect of the invention is a program for executing the image data unauthorized use investigation service providing method according to any one of the seventeenth to twenty-seventh aspects.

  A thirty-first aspect of the invention is a computer-readable recording medium on which the program according to any one of the twenty-eighth to thirty-third aspects is recorded.

  According to the present invention, when performing an unauthorized use investigation of image data that requires use permission, the feature amount of the image data to be subjected to the unauthorized use investigation is calculated, and based on the feature amount, By searching for similar image data on the Web and notifying the search requester of the search results as a search report, the search requester can easily and quickly search for similar images and Web sites on which the similar images are posted. Therefore, it is possible to plan and execute countermeasures against illegal use of trademarks and the like at an effective and appropriate timing.

  FIG. 1 is a block diagram showing an internal configuration example of an information processing apparatus according to the present invention. 1 is a CPU, 2 is a RAM, 3 is a ROM, 4 is a storage device such as an HDD, 5 is an input device, and 6 is a display device. , 7 is a communication device, 8 is an output device, and 9 is a system bus. A server device and a terminal device according to the unauthorized use investigation service providing system of the present invention are configured based on an information processing device as shown in FIG. 1, that is, a general-purpose computer. Information handled in this system is temporarily stored in the RAM 2 during the processing, and then stored in the ROM 3, and is read, modified, written, and the like by the CPU 1 as necessary. A program for causing the information processing apparatus to function as the present system or apparatus is stored in the ROM 3 or the storage device 4 and is executed by the CPU 1 reading it out as appropriate. Further, the progress of the process and the processing result are presented to the user through a display device 6 such as a CRT or LCD, and in each process, the user inputs necessary parameters from the input device 5 such as a keyboard and a mouse (pointing device). Specify input.

  The program may be provided with a graphical user interface (GUI) so that the user can operate the display device 6 easily. The communication device 7 communicates with other information processing devices via a network or the like. The CPU 1, the RAM 2, the ROM 3, the storage device 4, the input device 5, the display device 6, the communication device 7 and the output device 8 are connected by a system bus 9 and are mutually accessible.

FIG. 2 is a diagram for explaining a configuration example of an image data unauthorized use investigation service providing system according to an embodiment of the present invention. In FIG. 2, reference numeral 10 denotes a server system for providing an unauthorized use investigation service. The server system 10 includes a search server 11 having a function of searching for similar images and a management server 12 having a function of managing information related to a survey target, and 13 is for registering member (survey requester) information. Member DB, 14 is a sentence example DB in which sentence examples for performing various notifications by e-mail are registered, 15 is an investigation target DB for registering image data to be investigated, 20 is an investigation requester, 21 ₁ , 21 _2,... the client terminal to be used by the survey requester (hereinafter, often represented by the client terminal 21 _1), 22 network, 30 networks Web site group on click _22, 31 _1, 31 2, ₃₁ 3 ... are Web sites (hereinafter often represented by Web site 31 _1).

  The search server 11 has similar image search means 11a, and allows access to the survey target DB 15. The management server 12 includes a survey target registration unit 12a, a survey condition setting unit 12b, and a search result notification unit 12c, and can access the member DB 13, the sentence example DB 14, and the survey target DB 15. Further, the investigation target DB 15 includes image data 15a to be subjected to unauthorized use investigation, user information 15b including identification information of a Web site managed by a user who is licensed to use the image data 15a, investigation conditions 15c, image A feature value 15d extracted from the data 15a is registered. The Web site identification information included in the user information 15b is, for example, the URL of the Web site. The server system 10 according to the present embodiment is configured by two server devices, that is, the search server 11 and the management server 12. However, the functions of each server device may be integrated and configured by one server device. . The functions of the server system 10 may be distributed to other server devices and terminal devices via a network or the like.

  As an embodiment of the unauthorized use investigation service providing system of the present invention, the search server 11 or the management server 12 may access the member DB 13, the sentence example DB 14, and the investigation object DB 15 via a network or the like. That is, when each DB 13, 14, 15 is physically separated from the search server 11 or the management server 12, or each DB 13, 14, 15 is physically included in the search server 11 or the management server 12. Either form can be taken. Further, the search server 11 or the management server 12 stores a program for executing the functions of the above means.

The server system 10, the client terminal 21 ₁ , and the Web site 31 ₁ are connected via the network 22, but the network between the server system 10 and the client terminal 21 _{1, and} between the server system 10 and the Web site 31 _1. May be connected by different networks. That is, when the latter network is not limited to wired or wireless, but the Internet is connected by a dedicated line, telephone line, etc., the former network is an intranet using Internet technology, or even a dedicated line is used. However, a WAN (Wide Area Network), MAN (Metropolitan Area Network), or a LAN (Local Area Network) may be used depending on the installation location of the server system 10.

The unauthorized use investigation service providing system of the present invention includes an investigation object registration unit 12a, an investigation condition setting unit 12b, a similar image retrieval unit 11a, a retrieval result notification unit 12c, and DBs 13, 14, and 15. Research request form that was transmitted from the client terminal 21 ₁ via the network 22 (including the image data and check condition) is registered in the study DB15 by the management server 12 (surveyed registering means 12a and check condition setting means 12b) The The search server 11 (similar image search means 11a) searches for similar images from the website group 30 based on the registered survey request form, and the management server 12 (search result notification means 12c) sends the search results to the client terminal. 21 Send to ₁ .

Hereafter, each said means is demonstrated in detail.
First, the survey target registration means 12a surveys image data 15a (for example, photo data, design data, trademark data, title, trademark, logo, etc.) to be subjected to similarity search for each survey requester (company, etc.). Set and register in DB15. Since the image data 15a normally requires a license, if there is a contract (for example, usage rules) regarding the use of the image data 15a, information regarding the contract (for example, contract partner, contract partner URL, charge) User information 15b including a user name, e-mail address, target image, usage rule, etc.) is also set and registered in the survey target DB 15. In addition, when registering a new member, in addition to member (investigation requester) information, user information 15b (including a license list, a URL of a Web site managed by the user, usage rules, etc.) is stored in the member DB 13. You may register. In this case, the search server 11 may be configured to be accessible to both the investigation target DB 15 and the member DB 13 and acquire information necessary for similar image search.

  In ordinary companies, trademark applications and registered trademarks are managed (monitored), and the colors, sizes, character types, combinations with backgrounds, etc. that are permitted to be used for the company's trademarks, titles, logos, etc. are stipulated in detail. ing. Authorized users (for example, affiliated companies, dealers, branches, agents, etc.) must comply with these rules and contract with the top page of related websites (HP), products, advertisements, etc. Trademarks, titles, logos, etc. are displayed. Such usage rules are established for the purpose of managing a unified brand image including affiliated companies, whereby the affiliated companies can perform the same usage management as the parent company. In this case, use of a trademark or the like is permitted only to users of affiliated companies and the like who are licensed by contract.

  The survey condition setting unit 12 b sets a survey condition 15 c for investigating whether the image data 15 a registered by the survey target registration unit 12 a is illegally used in the Web site group 30 on the network 22. In other words, we investigate whether or not the intellectual property (for example, trademarks, titles, logos, etc.) subject to similar searches set by the survey requester of this system has been used without permission, and misperception confusion due to similar displays An investigation condition 15c is set to prevent this.

  In the case of an unauthorized use investigation, the server system 10 can also transmit a warning mail to the corresponding website as necessary, in addition to extracting a website with a possibility of unauthorized use. In addition, “all Web sites” or all types of files to be surveyed can be designated as survey targets. Furthermore, it is possible to extract image data similar to the image data to be investigated, set the similarity based on the feature amount of the extracted similar image, and perform sort display and category display based on the similarity Can do.

  Here, the investigation condition setting unit 12b may exclude the website managed by the user registered in the investigation object DB 15 from the object of the unauthorized use investigation and set the investigation condition 15c. That is, since the website (URL) registered in the investigation target DB 15 is a website managed by a licensed user, it is considered that there is no need for an unauthorized use investigation. Therefore, by excluding from unauthorized use investigation targets in advance, the investigation object can be narrowed down and efficiently investigated. Further, the investigation condition setting unit 12b can set at least one or more of the data format, data capacity, and data size of the image data to be subjected to the unauthorized use investigation, and can also set a website for the unauthorized use investigation. Any one or a plurality of domain types, page types, and page hierarchies can be set. In addition, the survey condition setting means 12b includes, as the survey condition 15c, a survey range (entire or part of the Web, etc.), an implementation schedule (for example, a survey is conducted once a day for 6 months, etc.), and a survey result. (For example, whether or not to send a warning mail), the country or region to be investigated (US, China, Europe, etc.), and other investigation conditions necessary for the unauthorized use investigation are set and registered.

Further, the investigation condition 15c will be described in detail based on a specific example.
The investigation condition 15c is various conditions for increasing the search efficiency by limiting the search range. Specifically, the following items can be set. In addition, by setting the survey condition 15c in detail and limiting the search range, it is possible to reduce the load on the system and adjust the fee for the survey (discount, etc.).

(1) Target period: The period during which the target image to be surveyed and its posted page are surveyed on the Web is limited. For example, the aim is to increase the search efficiency by eliminating the need to go back to the period before the survey target image is created or published, and by limiting the period. As a result, the service user may take a countermeasure such as making it unquestioned even if it is illegally used before a certain period of time.
(2) Survey cycle: In order to monitor unauthorized use, when a survey is repeatedly performed at regular intervals (periodically), the cycle is set.
(3) Types of images to be surveyed: Designate the types of images to be surveyed, such as “photograph”, “logo”, “trademark”, “illustration”, “painting”, etc. Appropriate search parameters (feature weighting) are set for the search target. When this condition is not set (not specified), it is possible to automatically determine an image registered as an image to be examined and automatically set a search parameter. By enabling both manual setting and automatic setting in this way, for example, the image to be investigated is a “photo”, but it has been modified to other types of images by applying some processing, It is also possible to cope with cases where unauthorized use has occurred.

(4) Color of main element: This is used to set whether or not to include in the search parameter the feature quantity related to the “color” of the image to be examined and the image to be examined. When a logo or graphic trademark is used illegally, there is a case where it is intended to change the image to be different from the image to be investigated for the purpose of misleading a third party. For example, if only feature values related to “color” are far apart even though feature values other than those related to “color” show a high degree of similarity, it is considered that the image is likely to be used illegally. Thus, detection can be performed by setting the feature amount related to the “color” in the detection parameter.

(5) Data format of the image to be inspected: The data format of the image to be inspected (for example, JPG, GIF, PNG, BMP, etc.) is limited. For example, when the image to be investigated is a photographic image in the JPG format, the image deteriorates when the image is converted into the GIF format. When acknowledging unauthorized use of degraded images, the scope of investigation can be narrowed down and efficiency can be improved by using only the data format different from the investigation target image. Also, considering the image formats that can be displayed by the Web browser, the above four types of limited data formats are available, but they cannot be displayed by Web browsers such as the TIFF format, but should be posted on the Internet and be ready for download. If this is an act that causes a disadvantage for the owner of the image to be investigated, the corresponding data format (such as the TIFF format) can be supported.

(6) Data capacity of the image to be surveyed: The data capacity of the image to be surveyed is limited. Similar to the data format of the image to be surveyed in (5) above, a large change in the data capacity with respect to the image to be surveyed is considered to be different from the original. Limit to not. Thereby, the efficiency can be further increased.

(7) Domain type: A domain type is set. This is intended to roughly limit the types of surveyed countries and surveyed organizations. For example, if a company that wants to expand overseas investigates in advance whether a trademark very similar to its own is being used overseas, Cases such as surveying other than the domain are assumed.

(8) Page type: Usually, a website such as a company is composed of a plurality of general pages such as “top page”, “company profile”, “new arrival information”, etc., and therefore, a website analysis method Is used to specify the page type. Thereby, the search target can be limited and the efficiency can be increased. For example, if the company logo of the survey requesting company A is posted on the “top page” of the B company website that has nothing to do with it, it may be mistaken for an affiliated company of company A, but is posted on the “link page” If so, it is highly likely that they are only introducing Company A or the products of Company A. In this way, the degree of disadvantage for the company A varies depending on the type of the posted page, and this can be dealt with by setting the page type.

(9) Page Hierarchy: Limits the depth of the hierarchy for the “top page” of the web site to be surveyed. As with the page type (8) above, the degree of disadvantage varies depending on the posting location on the website. For example, by excluding extremely deep pages from the survey target, the efficiency can be increased. .

  The unauthorized use investigation is executed by appropriately combining the investigation conditions 15c, that is, the above (1) to (9). At this time, according to the setting contents of these survey conditions 15c, the estimated amount of the survey cost can be calculated and displayed by an estimated amount calculation means described later. Further, by inputting the budget amount, the type of the image to be surveyed may be automatically determined, and standard survey conditions may be automatically set according to the input budget amount.

  The similar image search means 11a of the search server 11 has means for calculating the feature quantity 15d of the image data 15a registered by the survey object registration means 12a. The feature quantity 15d calculated by this feature quantity calculation means is registered in the survey target DB 15 together with the image data 15a. Further, the similar image search means 11a (feature quantity calculation means) can extract the feature quantity 15d from any one or a plurality of colors, patterns, shapes, and layouts of the image data 15a to be subjected to the unauthorized use investigation. The similar image search unit 11a searches the web site group 30 on the network 22 for image data that matches or is similar to the image data 15a based on the search condition 15c set by the search condition setting unit 12b and the feature value 15d of the image data 15a. To do.

FIG. 3 is a diagram illustrating an example of the feature amount calculated by the feature amount calculation unit.
As shown in FIG. 3, the similar image search unit 11 a uses the feature amount calculation unit to register characteristics such as the hue, color distribution, composition (texture and contour distribution), and pattern (texture) of the entire image when the image is registered. The amount is automatically extracted and converted into data. Further, similar data is searched using the data. Unlike search functions that use dates, keywords, file names, etc., colors that are difficult to represent with character data (the number of pixels in each color is used as a feature value), color distribution (represented from each part of the image) Search for images based on concepts such as color (features), composition (edges extracted from each part of the image are feature quantities), and patterns (analyze changes in luminance for each pixel to obtain feature quantities) .

The feature amount can be roughly divided into four categories, that is, a color system, an edge system, a shape system, and a pattern system.
1. Color system (a) Color histogram: characterized by the composition and amount of all colors.
(B) Main color: Characterized by main colors constituting the image.
(C) Color arrangement: Characterized by the arrangement (positional information) of colors in the image.
2. The edge system (a) is characterized by the edge amount and angle distribution included in the image.
(B) It is characterized by the edge amount, angle distribution, and position information included in the image.
3. Shape system (a) Curvature: Characterized by the degree of bending of the outer shape.
(B) Characterized by the flatness and moment of the object.
4). The pattern system (a) is characterized by a distribution of change in density.
(B) It is characterized by the distribution of the amount of change in density and position information.
(C) It is characterized by frequency characteristics obtained by Fourier transform and weblet transform.
Of the above feature amounts, the feature amount including the position information indicates a feature according to the shape.

Hereinafter, the types of survey target images and the characteristics of parameters will be described.
First, in the case of a graphic trademark, the color is irrelevant in most cases, and the weight of the “color system” feature amount is reduced, and the weight of the “edge system” or “shape system” feature amount is increased. Is effective. In the case of a graphic trademark, since there is little information such as a fine pattern and texture, the weight of the “pattern type” feature amount may be low.
Company logos and illustrations often contain color information unlike the above-mentioned graphic trademarks, and different colors (same shapes and different colors) may be allowed as the same. Increase or decrease. Also, as with graphic trademarks, it is considered that there is little information on fine patterns and textures, and the weight of the “pattern type” feature value may be low.

In an image such as a photograph or painting having a work property, since the entire image (up to the background) is meaningful, all the above-described feature amounts are effective.
In addition, feature values such as “color system”, “shape system”, and “pattern system” are effective for photographic images of persons and products that have portrait rights, regardless of the background, clothing, light conditions at the time of shooting, etc. Since priority is given to specifying the person or the product itself in the image, it is necessary to first perform pre-processing such as separating the background before extracting the image feature amount. The system of the present invention may be configured to perform the preprocessing. Also, when searching for a photograph of a textile product or the like, it is more effective to increase the weight of the “pattern type” feature value.

FIG. 4 is a flowchart for explaining an example of the feature amount calculation processing by the feature amount calculation means.
First, the search server 11 receives a “network path” or “URL” in which an image to be registered exists, and determines that the registration target image has been specified by specifying the received “network path” or “URL”. (Step S1).

  The registration image designation method from the registration requester may upload one image at a time, or may upload a plurality of images in a list. In addition, the designation of the directory where the images are stored or the directory list may be uploaded.

  Next, the search server 11 acquires a registration target image based on the designated “network path” or “URL” (step S2), and normalizes the size (number of pixels, aspect ratio, etc.) of the acquired image. (Step S3). Next, the feature amount is extracted from the normalized image. When there are a plurality of feature amount patterns (for example, a color system, an edge system, a shape system, and a pattern system), all the feature amounts are extracted according to the required conditions. Alternatively, the necessary calculation patterns are identified and their execution order is determined, and the feature amount is calculated according to the result (step S4). When a plurality of feature amount patterns are determined, the feature amount calculation patterns are appropriately combined to calculate each feature amount.

  Next, the search server 11 registers the received input information, the feature amount calculation pattern, and the calculation result in the DB in association with each other (step S5). It is determined whether or not registration for all images has been completed (step S6). If registration has been completed (in the case of YES), the process is terminated as it is. In step S6, if registration has not been completed (in the case of NO), Returning to step S4, the process is repeated.

  Furthermore, the specific processing of the similarity search can be performed based on, for example, the method described in Japanese Patent Laid-Open No. 2002-245045 or other known methods, and thus detailed description thereof is omitted here. It shall be.

  In addition, when the similar image search unit 11a of the present embodiment searches for image data that matches or is similar to the image data 15a to be investigated, a predetermined amount 15d of the image data 15a registered in the investigation target DB 15 is specified. A range is set, image data having a feature amount within the range is searched as a similar image from the image data included in the website group 30 on the network 22, and the image data and the image data searched as the similar image are searched for. Get the URL of the Web site that contains it.

  The setting of the predetermined range means setting a threshold value for determining how much of the feature amount range is regarded as similar in view of the feature amount of the image to be searched. For example, a threshold value is set for each feature amount of the image to be investigated, and if the feature amount of the image to be examined is within the threshold value, it is determined that the images to be examined are similar. According to this, since the threshold value is set for each feature amount, it is possible to confirm the degree of similarity with respect to an arbitrary feature amount. Further, a predetermined range, that is, a threshold value may be determined for the similarity described later. In this case, it is determined whether the similarity calculated based on the feature amount of the image to be investigated and the feature amount of the image to be examined is within the threshold value, and if the feature amount of the image to be examined is within the threshold value. For example, it is possible to determine that the images to be inspected are similar, and confirm the degree of similarity seen from the entire image.

  Regarding the setting of the threshold value, this system adjusts each weight by using a plurality of feature quantities such as “color system”, “edge system”, “shape system”, and “pattern system” described above in combination. be able to. The reason for adjusting the weighting of each feature amount is that there are a variety of images to be searched by the system, so the weighting of the feature amount is adjusted according to the type of image to increase the search accuracy. For example, the following weighting adjustment is performed for each representative image.

In the case of a graphic trademark, the shape itself is basically irrelevant, and the shape itself and the meaning of the shape are important. Therefore, since the feature quantity related to the color does not make sense, it is desirable to reduce or disable the weighting of the feature quantity related to the color.
Unlike the graphic trademark above, company logos and illustrations contain color information, but they do not have fine pattern information such as photographs and CG, so it is more effective to reduce the weight of the pattern-related features. .
In product photos and portraits, features such as the color, shape, and pattern of products and people are important, and the background does not make sense. Emphasis on quantity is effective in improving search accuracy.
In the case of paintings and photographs that have work characteristics, all the features are effective over the entire photograph.

Search result notifying unit 12c displays a result of retrieval by the similar image retrieval unit 11a to the client terminal 21 ₁ as a research report, and notifies the retrieval result to the survey requester. At this time, the document contents (words) to be notified may be registered in the sentence example DB 14 in advance as a template of all or part of the wordings. Furthermore, the searched image data is worded based on a predetermined classification. Or the searched image data may be displayed collectively on another screen.

  In the above-mentioned investigation report, in addition to displaying the image itself for images that are similar and found to be illegally used as a result of the search, the image URL, the image file name, the image posting site URL, the image posting site domain type (jp / com / de / Etc.), image posting site (published image: in what position on the page and in what style), similarity (0-100%), image size (dot / pixel), image file capacity (KB) , Displays the search period (date-date, linked to the survey cycle), regional trend, tampering tendency, maliciousness, and so on.

  The above-mentioned regional tendency refers to the name of the country to which the website belongs based on the domain type of the website, the description language, or the description of the site administrator, and the search target image is used in any country. It is possible to report whether it is large or not and plot it on a world map. In addition, even in the same country, it is also possible to report trends by domain, such as whether companies (co.jp) are frequently used illegally or schools (ac.jp).

  In addition, the above-mentioned tampering tendency may be a case where an unauthorized user tries to use the image by altering it to something different from the original (search target) image. For this purpose, it is conceivable to alter only some of the features of various image features. For example, a logo or a logo whose background color is changed is different from the original image only in the feature quantity of color even though other features such as shape and pattern are very similar. In this way, the search target image reports the tendency of which feature (color, shape, pattern, etc.) has been tampered with.

  In addition, the above-mentioned maliciousness level is similar to the above-mentioned tampering tendency, but most of the features are very similar, but if the degree of similarity is low for one or two image features, Although it can be determined, the lower the similarity between the features of one or two of the images, the lower the degree of alteration, and the higher the degree of alteration, the higher the degree of maliciousness.

  In addition, if an image that is the same as or similar to the search target image (and not permitted by the service user) is posted on the top page of the website, the website is operated by the service user. The intention to mislead a third party is considered strong. On the other hand, if the image is posted on a link page to an affiliated company or business partner, it is highly likely that the image is not intentionally misleading to a third party. In this way, the malicious level can be estimated based on the page type. In this system, by using a website analysis method, it is possible to determine and report the hierarchy of image posting pages, the page type, and the position in the page (the intention of misidentification is in the header) on the website.

  The website identification information includes domain name / URL, domain type, and the website analysis method. As the domain name / URL, a domain name of a Web site or a URL of a Web site to be excluded from the survey target, such as a survey requesting company and a related company, can be registered as a list. As for the domain type, the survey target countries can be limited by the domain type, such as jp = Japan, de = Germany, and ch = China. In addition, the website analysis method can identify the page hierarchy by clarifying the hierarchy structure by transition analysis in the website based on hyperlink information such as an html tag.

Here, the similar image search means 11a can set the similarity for the image data acquired as the similar image based on the feature amount of the image data. Search result notifying unit 12c, at the time of notification and displays the search result to the client terminal 21 _1, to sort the image data in descending order of the set similarity by similar image search unit 11a, the image data sorted, the You may make it display with the identification information (URL etc.) of the Web site containing image data, and the image information containing at least the similarity of image data. Further, the search result notifying means 12c individually displays the image data including the detailed information individually with the high similarity based on the similarity, and omits the detailed information for the image data with the intermediate similarity. A display (notification) method may be used in which individual display is performed and only image data is collectively displayed for image data with low similarity.

The similarity is the distance between the feature quantities themselves (that is, the distance between the image to be examined and the image to be examined) as a percentage when each feature quantity is used singly. When a quantity (in this example, color, edge, pattern, shape) is used, the weighted average distance of each feature quantity is expressed as a percentage. The calculation formula is shown in the following formula (1).
Similarity d = K (color) × d (color) + K (edge) × d (edge) + K (pattern) × d (pattern) + K (shape) × d (shape) Expression (1)
Where K is a weighting coefficient for each feature value, d is a value obtained by calculating the distance between the image to be examined and the image to be examined for each feature value.

  Here, when viewed from the user, it is determined that the similarity is 100% similar and 0% is not similar, but in this system, it is determined as similarity, and the similarity is 0. % Is equivalent to 100%, it is determined that there is no distance between the image to be surveyed and the image to be surveyed, and it is determined that they are similar, and 100% similarity is equivalent to 0% similarity. It is determined that the images are too far apart or not similar.

  The similar image search unit 11a calculates the distance between the feature amount of the image to be examined and the feature amount of the image to be examined. This is performed for all the images to be examined. From the above equation (1), the similarity for each image to be examined is calculated. Further, from the calculated similarity, the ones included in the preset range are picked up.

  Here, the threshold value set for the similarity may be set according to the purpose. For example, if the purpose is to send a warning mail to a website that is illegally used, that is, send a warning mail to the effect that the website is illegally used based on the search (survey) target list. For the purpose, set a high threshold value, target only images with a high similarity over a certain level, send a warning e-mail after taking steps to make sure that the user is using illegally clearly To do. Further, the determination may be made in consideration of the tampering tendency displayed in the investigation report and the malicious level.

  In addition, when the above purpose is to call attention to a website that may be illegally used, that is, on the assumption that an image similar to the search target image is posted and the Web site is not the search target. If the purpose is to send an e-mail that calls attention to the possibility that the image may be used without permission, the threshold is set to medium and only images with a certain degree of similarity or higher are targeted. Depending on the intention of the user of this system, the user's confirmation step may be omitted and a notice mail may be delivered. In addition, when the above purpose is to present an appropriate usage method, that is, to allow the use of a group company or the like, but to send an e-mail with contents confirming whether or not the usage method is correct. For this purpose, a Web page in which usage rules such as a company logo are described in advance is prepared, and an e-mail in which the URL is described is transmitted to prompt periodic confirmation.

The sentence example DB 14 stores a sentence example of a warning mail having different contents depending on the similarity set for each image data. At this time, sentence examples may be stored in a language corresponding to each country so that a warning mail can be transmitted to a foreign website.
The search result notification unit 12c includes a unit that transmits a warning mail to a Web site that includes a similar image searched by the similar image search unit 11a. Here, when transmitting a warning mail to the Web site 311 including the similar image, the search result notifying unit 12c selects a sentence example corresponding to the similarity degree of the similar image from the sentence example DB ₁₄ , and selects the selected sentence example. set the warning mail may be configured to transmit the warning mail to the mail address included in the Web site 31 _1. The search result notifying unit 12c, before sending the alert mail text example selected from text example DB14 is set to the mail address included in the Web site 31 _1, and sends it to the client terminal 21 ₁ of the survey sponsor, study after the contents confirmation or correction of the warning mail by requester may be configured to transmit the warning mail to the mail address included in the Web site 31 _1.

FIG. 5 is a flowchart for explaining an example of the image data unauthorized use investigation service providing method to which the present invention is applied. This example will be described based on the unauthorized use investigation service providing system shown in FIG. First, the management server 12 from the client terminal 21 ₁ when accepting the investigation request via the network 22, such investigation requester determines whether new registration (step S11), and if the new registration (the case of YES), Accepting input of member registration information (for example, member information, use permission list, usage rule, etc.) (step S12), registering the member registration information in the member DB 13 (step S13), and after completing registration, the user ID / PWD (Password) is issued (step S14), and the process proceeds to step S15.

In step S11, if it is not new registration, that is, if the member has already been registered (in the case of NO), the input of the user ID / PWD and the investigation purpose are selected (step S15). At this time, the user ID / PWD entered is collated whether the correct (step S16), (the case of NO) If the user ID / PWD is incorrect, an error message is displayed on the client terminal 21 ₁ (step S17), the user Determine whether or not to re-enter ID / PWD (by user) (step S18). If re-input (in case of YES), return to step S15 and repeat the process. To do.

  Next, when the user ID / PWD is authenticated in step S16, it is determined whether the purpose of the investigation is an unauthorized use investigation (by the user) (step S19), and an investigation other than the unauthorized use investigation (for example, a similar design investigation). In the case of (NO), other investigations are performed (step S20). In step S19, when the investigation purpose is an unauthorized use investigation (in the case of YES), an unauthorized use investigation relating to image data is performed (step S21). The management server 12 registers the image data 15a to be investigated and the investigation conditions 15c in the investigation target DB 15 (step S22), and the search server 11 calculates a feature value 15d from the image data 15a registered in the investigation target DB 15. (Step S23), a similar image included in the Web site group 30 is searched based on the calculated feature value 15d and the survey condition 15c (Step S24).

Next, the search server 11 sets a similarity based on the feature amount for the similar image searched in step S24 (step S25), and the management server 12 sets the similar image and the similar image. A survey report including at least image information including the similarity is transmitted to the survey requester (client terminal 21 ₁ ) (step S26). Next, the management server 12 determines whether or not to send a warning mail to the website displaying the similar image (selected by the user) (step S27). When the warning mail is sent to the website (in the case of YES) ), A warning mail corresponding to the similarity is generated, and the warning mail is distributed to the corresponding website (step S28).

  Next, the management server 12 determines whether or not to perform a similar search periodically from the survey condition 15c of the survey target DB 15 (step S29). When performing a similar search periodically (in the case of YES), the management server 12 proceeds to step S24. A similar image is searched from the Web site group 30 at predetermined intervals. In step S29, if the similarity search is not periodically performed, for example, in the case of a spot-like search (in the case of NO), the processing ends as it is. In step S27, when the warning mail is not transmitted to the website (in the case of NO), the process proceeds to step S29.

  FIG. 6 is a diagram for explaining a configuration example of an image data unauthorized use investigation service providing system according to another embodiment of the present invention. The server system 10 includes a search server 11 and a management server 12, and is a member. It has DB13, sentence example DB14, investigation object DB15, and feature-value DB16. The search server 11 includes similar image search means 11a and feature quantity registration means 11b, and makes it possible to access the survey target DB 15 and the feature quantity DB 16. The management server 12 includes a survey target registration unit 12a, a survey condition setting unit 12b, a search result notification unit 12c, and an estimated amount calculation unit 12d, and can access the member DB 13, the sentence example DB 14, and the survey target DB 15. In the unauthorized use investigation service providing system of the present embodiment, other configurations are different from the system configuration shown in FIG. 2 in that the feature amount registration unit 11b, the estimated amount calculation unit 12d, and the feature amount DB 16 are provided. Since this is the same as the system configuration shown in FIG. 2, description thereof is omitted here.

  The feature quantity registration unit 11b of the search server 11 periodically visits the website group 30 on the network 22 to calculate the feature quantity from the image data included in the website, and uses the calculated feature quantity as the URL of each website. And registered in the feature amount DB 16. In the server system 10 of the present embodiment, a similar image search is performed by comparing the feature quantity 15d of the image data 15a registered in the survey target DB 15 with the feature quantity registered in the feature quantity DB 16. That is, the similar image search unit 11a sets a predetermined range for the feature amount 15d of the image data 15a registered in the survey target DB 15 when searching for image data that matches or is similar to the image data 15a to be surveyed. Then, the feature amount registered in the feature amount DB 16 is searched for the feature amount within the range, and as a result, the image data corresponding to the searched feature amount and the URL of the website including the image data are acquired.

  Further, the estimated amount calculating means 12d calculates an approximate estimate of the cost for the unauthorized use investigation based on the investigation condition 15c set by the investigation condition setting means 12b. The management server 12 notifies the survey requester of the estimated amount calculated by the estimated amount calculation unit 12d before the similar image search unit 11a searches for a similar image. A similar image search may be executed. As another embodiment, a survey requester's budget limit (charge limit) may be set, and a survey corresponding to this budget limit may be performed.

A specific embodiment of the estimated amount calculation means 12d will be described below.
(1) Each time the survey condition 15c is set, the estimated amount is reduced.
Setting the survey condition 15c finely limits the survey range and reduces the load on the system, so the fee for the unauthorized use survey service is reduced.

(2) Charge according to the number of warning and warning mails and the degree of automation.
It is possible to set whether or not to automatically deliver a warning text or warning text prepared in advance to the administrator of the Web site determined to be illegal use based on the survey result or the email address of the inquiry destination. This system is also provided with a function for automatically generating this caution text or warning text, and it is possible to provide a step for editing the automatically generated text. Also, it is not necessary to set a caution or warning mail. Charges are calculated according to these settings.

(3) Free similar image search.
For example, the survey (search) is open to the public free of charge, and a list of images to be surveyed with high similarity is displayed as a search result. However, information such as the URL of the Web site on which the searched image is posted is not displayed unless a paid service is applied. As a result, the service user can apply for a paid service after confirming that the intended survey result can be obtained. In addition, when the investigation target is narrowed down in advance or the list registration of domain names and URLs for excluding the investigation target is performed, user registration is necessary, and it can be used only with a paid service. However, various conditions may be set free of charge.

  Here, the survey target registration unit 12a may register the survey history regarding the image data in the survey target DB 15 for each survey requester together with the image data to be subjected to the unauthorized use survey. At this time, the survey target registration unit 12a sets the number of times the warning mail is transmitted by the search result notification unit 12c as the survey history to be registered in the survey target DB 15 for each Web site including the similar image retrieved by the similar image search unit 11a. You may make it register to. Further, the search result notifying unit 12c changes the warning contents by the warning mail step by step (for example, warning up to 4 times, warning up to 5 times or more) according to the number of times of sending the warning mail registered by the survey target registration unit 12a. Etc.) may be changed.

  According to the present invention, since a similar image search can be realized with a simple system configuration, an unauthorized use investigation can be performed efficiently and at low cost. Moreover, since it can respond to any image data, it can be applied to a wide range of uses using image search. In addition, because it is possible to investigate websites with potential copyright infringement based on similar images, a site once closed by a malicious site operator who has infringed copyright has been changed and changed to a new URL. Even if it is raised, follow-up surveys are possible.

  FIG. 7 is a diagram for explaining a configuration example of an image data unauthorized use investigation service providing system according to another embodiment of the present invention. The unauthorized use investigation service providing system shown in the present embodiment shows a system configuration in the case where independent business entities manage and operate the search server 11 and the management server 12 respectively. The search server 11 includes a similar image search unit 11a, a feature amount registration unit 11b, an application service providing unit 11c, and a billing unit 11d, and can access the feature amount DB 16 and / or the survey target DB 15. The management server 12 includes a survey target registration unit 12a, a survey condition setting unit 12b, a search result notification unit 12c, and an estimated amount calculation unit 12d, and can access the member DB 13, the sentence example DB 14, and the survey target DB 15.

  As shown in FIG. 7, the present invention also has a form as an ASP (Application Service Provider) system that can provide the image search function of the search server 11 described so far as an application via a network. Is possible. In this case, the application service providing means 11c of the search server 11 possessed by the ASP service provider manages each means (similar image retrieval means 11a and / or feature amount registration means 11b) possessed by the search server 11 as an application via the network. A service provided to the server 12 side is provided to the management server 12 side that receives the service. The billing unit 11d charges the service provided by the application service providing unit 11c. The billing method by the billing unit 11d may determine the amount according to the search conditions (or survey results) such as the frequency of the similar search, the search range, the number of image data to be searched, the number of search hits, etc. A fixed amount system based on a predetermined unit such as a monthly unit, a daily unit, or a search unit may be used.

8 and 9 are flowcharts for explaining another example of the image data unauthorized use investigation service providing method to which the present invention is applied. FIG. 8 is a diagram showing the processing flow on the management server 12 side. FIG. 9 is a diagram showing a processing flow on the search server 11 side. This example will be described based on the unauthorized use investigation service providing system shown in FIG.
8, first, the management server 12 from the client terminal 21 ₁ when accepting the investigation request via the network 22, such investigation requester determines whether new registration (step S31), when the new registration (YES ), Accepting input of member registration information (for example, member information, use permission list, usage rule, etc.) (step S32), registering the member registration information in the member DB 13 (step S33), A user ID / PWD (password) is issued (step S34), and the process proceeds to step S35.

In step S31, if it is not new registration, that is, if membership registration has already been made (in the case of NO), the input of the user ID / PWD and the purpose of investigation are selected (step S35). At this time, the user ID / PWD entered is collated whether the correct (step S36), (the case of NO) If the user ID / PWD is incorrect, an error message is displayed on the client terminal 21 ₁ (step S37), the user Determine whether or not to re-enter ID / PWD (by user) (step S38). If re-input (in the case of YES), return to step S35 to repeat the process. To do.

  Next, when the user ID / PWD is authenticated in step S36, it is determined whether the purpose of the investigation is an unauthorized use investigation (by the user) (step S39), and an investigation other than the unauthorized use investigation (for example, similar design investigation) In the case of (NO), other investigation is performed (step S40). In step S39, when the investigation purpose is an unauthorized use investigation (in the case of YES), an unauthorized use investigation relating to image data is performed (step S41). The management server 12 registers the image data 15a to be investigated and the investigation condition 15c in the investigation target DB 15 (step S42), and requests the search server 11 to search for similar images (step S43). At this time, the search server 11 may be requested to include the image data 15a to be investigated.

  In FIG. 9, the search server 11 calculates a feature value 15d from the image data 15a registered in the survey target DB 15 (step S44), and is registered in the feature value DB 16 based on the calculated feature value 15d and the survey condition 15c. A similar image is searched by matching with the feature amount (step S45). Next, the search server 11 sets a similarity for the searched similar image based on the feature amount (step S46), and at least obtains the similar image and image information including the similarity of the similar image. The search result including it is notified to the management server 12 (step S47).

In FIG. 8, the management server 12 transmits a survey report based on the search result notified from the search server 11 to the survey requester (client terminal 21 ₁ ) (step S48). Next, the management server 12 determines whether or not to send a warning mail to the website displaying the similar image (selected by the user) (step S49). When the warning mail is sent to the website (in the case of YES) ), A warning mail corresponding to the similarity is generated, and the warning mail is distributed to the corresponding website (step S50).

  Next, the management server 12 determines whether or not to perform a similar search periodically from the survey condition 15c registered in the survey target DB 15 (step S51). When performing a similar search periodically (in the case of YES), the management server 12 performs step S52. Migrate to

  In FIG. 9, the search server 11 circulates the websites included in the website group 30 on the network 22 (step S52), searches for image data from each visited website (step S53), and searches the searched image. The feature amount of the data is calculated (step S54), and the calculated feature amount is registered in the feature amount DB 16 (step S55). This feature DB 16 is referred to by the search server 11 in step S45.

  Further, in step S51 shown in FIG. 8, if the similarity search is not periodically performed, for example, in the case of a spot search (in the case of NO), the processing is ended as it is. In step S49, when a warning mail is not transmitted to the website (in the case of NO), the process proceeds to step S51.

  10 and 11 are diagrams illustrating an example of a data table registered in the server system 10. FIG. 10A is a diagram showing an example of a requester information management table in which information on a survey requester to be investigated is registered, and FIG. 10B is an example of a trademark information management table in which information on a trademark is registered. FIG. 10A, the requester information management table includes, for example, a survey requester name (user company name), registration date, trademark information (displayed with an identification number), contract information (displayed with an identification number), and an expiration date. , Items such as image information (displayed with an identification number), URL, presence / absence of report information, last implementation date, and the like are registered. In FIG. 10B, the trademark information management table includes, for each trademark information (indicated by an identification number) registered in the client information management table, for example, trademark, reading (name), classification, image size, character type, Items such as color, modification, data type, attachment target (for example, HP, catalog, manual, etc.) are registered.

11A is a diagram illustrating an example of a contract information management table in which information related to a contract is registered, and FIG. 11B is a diagram illustrating an example of a form management table in which information regarding the contents of a warning mail is registered. FIG. 11C is a diagram illustrating an example of a similarity management table in which information related to the similarity set in the image data is registered.
In FIG. 11A, the contract information management table includes, for example, the registration date, trademark information, and contract for each company name (ie, the name of the company that is licensed to use the trademark) that has a trademark use contract. Items such as information, expiration date, and URL are registered. In FIG. 11B, the form management table includes, for example, a form name (for example, a warning letter, a recommendation letter, etc.), a registration date, a form (model) type (displayed by an identification number), and image data. Items such as similarity (A, B,...) And expiration date are registered. In FIG. 11C, the similarity management table includes, for each similarity of image data, for example, the type of form (model) linked to the form management table (displayed with an identification number), an expiration date, Items such as display methods (for example, detailed display, simplified display, etc.) are registered.

  FIG. 12 is a diagram showing an example of a service login screen in the unauthorized use investigation service providing system of the present invention, in which 40 is a service login screen, and the service login screen 40 includes a member registration page link 41, a member ID / It has a password input field 42, a survey purpose selection field 43, and a survey detail setting page link 44. In the case of new member registration, the survey requester who uses this service accesses the member registration page from the member registration page link 41 and performs member registration. In the case of a member, the member ID / password is entered in the member ID / password input field 42. Furthermore, the survey requester selects a desired course from the survey purpose (unauthorized use survey, suitability survey, design survey, etc.) selection column 43, and then clicks the survey detail setting page link 44 to enter the survey detail setting page. Transition to set detailed survey conditions.

  FIG. 13 is a diagram showing an example of the investigation condition setting screen in the unauthorized use investigation service providing system of the present invention. In the figure, 50 is an investigation condition setting screen, and the investigation condition setting screen 50 is a setting for registering investigation object images. 51, a survey period (report cycle) registration setting 52, a survey target image type registration setting 53, a file attribute registration setting 54, a site attribute registration setting 55, and a search start button 56. The survey requester can select the image data to be surveyed by clicking the “reference” button of the registration setting 51 of the survey target image. In the case of this example, the image data 51a and 51b are selected images. Further, when these image data are to be searched, a check box is checked. Only the image data with this check box checked is the subject of investigation, and if both are checked, a composite (or) search is performed.

  Next, in the registration setting 52 of the survey period (report cycle), it is possible to specify whether or not to search retroactively. When searching retroactively, the image data 51a and 51b were posted. Specify the period. In addition, the report cycle / number of times can be designated as, for example, every day × 1 time, and the management server 12 periodically distributes the investigation report according to the designated schedule.

  Next, in the type registration setting 53 of the image to be investigated, it is possible to specify the classification of the image data to be searched (for example, photo, company emblem, trademark, logo, etc.). In addition, it is possible to specify whether the color difference of the main element is to be searched or ignored.

  Next, in the file attribute registration setting 54, the format of the image data to be searched (for example, JPEG, GIF, PNG, etc.) can be specified. Further, it is possible to specify a capacity range (for example, 100 KB to 10000 KB) of image data to be requested for search. In addition, it is possible to specify a size range (for example, vertical 100 dots × horizontal 100 dots) of the image data requested to be searched.

  The site attribute registration setting 55 is an item to be checked when limiting the investigation target. For example, co. jp, ne. Select the method of limiting the survey target from the URL domain type such as jp, the method of limiting the survey target from the general page classification such as the top page of HP, or the method of limiting the survey target by page hierarchy from the domain. Can do.

  The survey requester clicks the search start button 56 after setting the above items on the survey condition setting screen 50. When the search start button 56 is clicked, the server system 10 starts a similar image search process.

  FIG. 14 is a diagram showing an example of a search result display screen in the unauthorized use investigation service providing system of the present invention, in which 60 is a search result display screen, and the search result display screen 60 is an original (search target) 61. , Search results 62, 63, 64. The search results 62, 63, and 64 have links to image data searched as similar images, image information related to the image data, image data posting sites, and warning / caution mail text creation screens, respectively. The image information includes, for example, URL, file name, similarity, image size, file capacity, and the like. The display order of these search results is sorted and displayed according to the similarity. Here, for example, when it is desired to send a warning / caution mail to a Web site corresponding to the search result 64, clicking the link 64a to the warning / caution mail text creation screen changes to a warning / caution mail creation form screen.

  As described above, since the survey requester can easily identify a similar image and a website on which the similar image is posted, a countermeasure for unauthorized use of a trademark, etc. is planned and executed at an effective and appropriate timing. can do.

  FIG. 15 is a diagram showing an example of a warning / caution mail creation form screen in the unauthorized use investigation service providing system of the present invention. FIG. 15A is a diagram illustrating a state in which a sentence example is set in the warning / caution mail creation form, and FIG. 15B is a diagram illustrating a state in which the sentence example in the warning / caution mail creation form is modified. Reference numeral 70 denotes a warning / caution mail creation form screen. The warning / caution mail creation form screen 70 has a “confirm content” button 71, a “return and modify” button 72, and a “send” button 73. ing. 15A and 15B, the warning / caution mail creation form 70 includes a “text (subject) type”, “destination address”, “sender (reply destination)”, “mail title”, “ Items such as “Warning / Caution” are included.

  In the above-mentioned “text (business) type”, a text registered in advance in the text example DB 14 is selected and the content is displayed in the “warning / caution text”. In “Destination Address”, a destination can be selected from a list of mail addresses specified in the Web site. In “transmission source (reply destination)”, an e-mail address acquired from the member information registered in the member DB 13 is set (however, it can be changed). “Mail title” and “Warning / Caution” are items that can be appropriately modified by the user. FIG. 15B shows a state where the “mail title” and the “warning / caution text” shown in FIG. 15A are corrected.

  FIG. 16 is a diagram showing another example of the search result display screen in the unauthorized use investigation service providing system of the present invention. In the figure, 80 is the search result display screen, and the search result display screen 80 is the original (search target). ) 81 and search results 82, 83, and 84. The search results 82, 83, and 84 have image data searched as similar images, image information related to the image data, and an image data posting site, respectively. This example shows a result of searching for a Web page that is not in the use permission list. In the case of the image data of the search result 82, it is posted on the supplier's site, but the logo color does not conform to the usage rules, and the background clipping is rough. Further, in the case of the image data of the search result 83, it is posted on a site where there is no transaction, but the background of the logo is not uniform. Further, in the case of the image data of the search result 84, it is a dealer site that handles its own products, but is not licensed. In this way, it is possible to easily confirm the state of use on various websites including use permission and unauthorized use. Can be planned and executed.

Here, the unauthorized use investigation service providing system of the present invention is not limited to trademark data or the like, and can be applied to any image data. Hereinafter, application examples to other image search services will be described.
FIG. 17 is a diagram showing another example of the search result display screen in the unauthorized use investigation service providing system of the present invention, in which 90 is the search result display screen, and the search result display screen 90 is the original (search target). ) 91, search results 92, 93, 94. The search results 92, 93, and 94 have image data searched as similar images, image information related to the image data, and a posting site for the image data, respectively. This example is an investigation of how the company's products (brand bags in this example) are handled on the Web (exposure, placement, etc.). By checking whether or not the searched Web site is, for example, an authorized agent, it is possible to investigate a purchased item or a counterfeit item from an unauthorized route.

  It is also possible to investigate whether the product image used in the auction site or the like is the same as that officially used by the manufacturer or seller of the product. It is also possible to search for whether or not the possessed image is illegally used on the Web in a company or the like that owns an image that is a copyrighted work such as a photographer or an illustrator.

  As described above, each embodiment has been described mainly with respect to each function in the image data unauthorized use investigation service providing system or apparatus according to the present invention. However, the present invention executes each step in the unauthorized use investigation service providing system or apparatus. As described as a method, it can take a form as a method for providing an unauthorized use investigation service. Similarly to the unauthorized use investigation service providing system or apparatus having these functions, a form as a program for causing a computer to function as an unauthorized use investigation service providing system or apparatus is also used as a recording medium recording the program. This form is also possible.

  An embodiment of a recording medium storing a program and data for realizing an illegal use investigation service providing function of image data according to the present invention will be described. Specifically, CD-ROM (-R / -RW), magneto-optical disk, DVD-ROM, FD, flash memory, memory card, memory stick, and other various ROM and RAM can be assumed as the recording medium. The functions of the system according to each embodiment of the present invention described above are executed on the recording medium by a computer, and the program for realizing the unauthorized use investigation service providing function is recorded and distributed, thereby realizing the function. make it easier. Then, the recording medium as described above is mounted on an information processing apparatus such as a computer and the program is read by the information processing apparatus, or the program is stored in a storage medium provided in the information processing apparatus. By reading, the unauthorized use investigation service providing function related to the present invention can be executed.

It is a block diagram which shows the example of an internal structure of the information processing apparatus concerning this invention. It is a figure for demonstrating the structural example of the unauthorized use investigation service provision system of the image data concerning one Embodiment of this invention. It is a figure which shows an example of the feature-value calculated by the feature-value calculation means. It is a flowchart for demonstrating an example of the feature-value calculation process by a feature-value calculation means. It is a flowchart for demonstrating an example of the unauthorized use investigation service provision method of the image data to which this invention is applied. It is a figure for demonstrating the structural example of the unauthorized use investigation service provision system of the image data concerning other embodiment of this invention. It is a figure for demonstrating the structural example of the unauthorized use investigation service provision system of the image data concerning other embodiment of this invention. It is a flowchart for demonstrating the other example of the unauthorized use investigation service provision method of the image data to which this invention is applied. It is a flowchart for demonstrating the other example of the unauthorized use investigation service provision method of the image data to which this invention is applied. It is a figure which shows an example of the data table registered in the server system. It is a figure which shows an example of the data table registered in the server system. It is a figure which shows an example of the service login screen in the unauthorized use investigation service provision system of this invention. It is a figure which shows an example of the investigation condition setting screen in the unauthorized use investigation service provision system of this invention. It is a figure which shows an example of the search result display screen in the unauthorized use investigation service provision system of this invention. It is a figure which shows an example of the warning / caution mail preparation form screen in the unauthorized use investigation service provision system of this invention. It is a figure which shows the other example of the search result display screen in the unauthorized use investigation service provision system of this invention. It is a figure which shows the other example of the search result display screen in the unauthorized use investigation service provision system of invention.

Explanation of symbols

1 ... CPU, 2 ... RAM, 3 ... ROM, 4 ... storage device, 5 ... input device, 6 ... display device, 7 ... communication device, 8 ... output device, 9 ... system bus, 10 ... server system, 11 ... search Server 11a ... Similar image search means 11b ... Feature amount registration means 11c ... Application service providing means 11d ... Billing means 12 ... Management server 12a ... Investigation target registration means 12b ... Investigation condition setting means 12c ... Search Result notifying means, 12d ... Estimated amount calculating means, 13 ... Member DB, 14 ... Example DB, 15 ... Investigation target DB, 15a ... Image data, 15b ... User information, 15c ... Investigation condition, 15d ... Feature quantity, 16 ... Feature DB 20 ... Survey requester, 21 ₁ , 21 ₂ ... Client terminal, 22 ... Network, 30 ... Web site group, 31 ₁ , 31 ₂ , 31 ₃ ... W eb site, 40 ... service login screen, 41 ... member registration page link, 42 ... member ID / password input column, 43 ... survey purpose selection column, 44 ... survey details setting page link, 50 ... survey condition setting screen, 51 ... survey Target image registration setting, 51a, 51b ... image data, 52 ... Investigation period (report cycle) registration setting, 53 ... Investigation target image type registration setting, 54 ... File attribute registration setting, 55 ... Site attribute registration setting 56 ... Search start button, 60, 80, 90 ... Search result display screen, 61, 81, 91 ... Original (search target), 62, 63, 64, 82, 83, 84, 92, 93, 94 ... Search results 64a ... link to warning / caution mail text creation screen, 70 ... warning / caution mail creation form screen, 71 ... "confirm content" button, 72 ... " To correct me "button, 73 ..." Send "button.

Claims (31)

  An unauthorized use investigation service for image data in which a server device for conducting unauthorized use investigation of image data requiring use permission and a terminal device used by an investigation requester who requests unauthorized use investigation are connected via a network. In the providing system, the server device includes a survey target registration unit that registers the image data input from the terminal device as a survey target in a survey target database for each survey requester, and the registered image data is a website on the network. A survey condition setting means for setting a survey condition for investigating whether or not it has been used illegally, and a feature amount of the image data registered by the survey target registration means, and the calculated feature amount and the survey condition Image data matching or similar to the image data to be investigated based on the Web Similar image search means for searching from a site, and search result notifying means for notifying a search requester who uses the terminal device of the searched search results as a survey report. Offer system.   2. The image data unauthorized use investigation service providing system according to claim 1, wherein the feature amount is one or a plurality of colors, patterns, shapes, and layouts of image data to be subjected to unauthorized use investigation. An image data unauthorized use investigation service providing system.   3. The unauthorized use investigation service providing system for image data according to claim 1, wherein the investigation object registration means uses the image data together with the image data to be investigated for unauthorized use and the feature amount of the image data. A system for providing an unauthorized use investigation service for image data, wherein information relating to a user including identification information of a Web site managed by a user receiving the registration is registered in the investigation target database for each investigation requester.   4. The unauthorized use investigation service providing system for image data according to claim 3, wherein the investigation condition setting means excludes a website managed by a user registered in the investigation object database from an object of an unauthorized use investigation. An image data unauthorized use investigation service providing system characterized in that investigation conditions can be set.   5. The unauthorized use investigation service providing system for image data according to claim 1, wherein the investigation condition setting means includes any one of a data format, a data capacity, and a data size of image data to be subjected to an unauthorized use investigation. 1 or a plurality of image data fraudulent use investigation service providing system, characterized in that at least one can be set.   6. The unauthorized use investigation service providing system for image data according to any one of claims 1 to 5, wherein the investigation condition setting means includes any one of a domain type, a page type, and a page hierarchy of a website subject to an unauthorized use investigation. Or a system for providing an illegal use investigation service for image data, characterized in that at least one or more can be set.   The unauthorized use investigation service providing system according to any one of claims 1 to 6, wherein the similar image retrieval unit retrieves image data that matches or is similar to image data to be investigated. A predetermined range is set for the feature amount of the image data registered in the survey target database, and image data having the feature amount within the range is searched as a similar image from the image data included in the website on the network, An unauthorized use investigation service providing system for image data, characterized in that image data searched as the similar image and identification information of a website including the image data can be acquired.   The unauthorized use investigation service providing system according to any one of claims 1 to 6, wherein the server device periodically circulates a web site on a network, and image data included in the visited web site. A feature amount registration unit that calculates a feature amount from the information and registers the information about the calculated feature amount in the feature amount database in association with the identification information of the Web site, and the similar image search unit includes image data to be investigated When searching for image data that matches or is similar to the image data, a predetermined range is set for the feature amount of the image data registered in the database to be investigated, and the range of the feature amount registered in the feature amount database is within the range. As a result, the image data corresponding to the searched feature value and the identification information of the website including the image data are obtained. Unauthorized survey service providing system of the image data, characterized in that the wear manner.   9. The unauthorized use research service providing system for image data according to claim 7 or 8, wherein the similar image search means sets similarity for image data acquired as a similar image based on a feature amount of the image data. The search result notification means sorts the image data in descending order of similarity set by the similar image search means when displaying and notifying the search result on the terminal device, and the sorted image data An unauthorized use investigation service providing system for image data, characterized in that it can be displayed together with identification information of a Web site containing the image data and image information including at least the similarity of the image data.   10. The unauthorized use investigation service providing system for image data according to claim 9, further comprising a sentence example database storing sentence examples of warning mails having different contents according to the similarity set for each image data, Includes means for transmitting a warning mail to a website including a similar image searched by the similar image search means, and when the warning mail is transmitted to a website including the similar image, the sentence example database A sentence example corresponding to the similarity of the similar image is selected from the above, the selected sentence example is set as the warning mail, and the warning mail in which the sentence example is set is transmitted to the mail address included in the website. A system for providing unauthorized use investigation services for image data.   11. The unauthorized use investigation service providing system for image data according to claim 10, wherein the search result notifying unit transmits a warning mail in which a sentence example selected from the sentence example database is set to an email address included in the website. Sent to the survey requester's terminal device, and after confirming or correcting the content of the warning mail by the survey requester, the warning mail is sent to the mail address included in the website. Unauthorized use investigation service provision system.   12. The unauthorized use investigation service providing system for image data according to any one of claims 1 to 11, wherein the investigation object registration means requests investigation of an investigation history relating to the image data together with image data to be subjected to unauthorized use investigation. A system for providing an unauthorized use investigation service for image data, wherein each person is registered in the investigation target database.   13. The unauthorized use investigation service providing system for image data according to claim 12, wherein the investigation object registration means retrieves, as the investigation history, the number of times a warning mail is transmitted by the search result notification means by the similar image retrieval means. An unauthorized use investigation service providing system for image data, wherein registration is performed for each Web site containing similar images.   14. The unauthorized use investigation service providing system for image data according to claim 12 or 13, wherein the search result notifying means is a warning content by the warning mail according to the number of times the warning mail is registered by the investigation target registration means. A system for providing an illegal use investigation service for image data, characterized by gradually changing the image data.   15. The unauthorized use investigation service providing system for image data according to any one of claims 1 to 14, wherein the server device has a cost for the unauthorized use investigation based on the investigation condition set by the investigation condition setting means. An estimated amount calculating means for calculating an approximate estimate is provided, and before the similar image search means searches for similar images, the calculated estimated amount is notified to the survey requester and approved by the survey requester. In this case, an image data unauthorized use investigation service providing system characterized in that a similar image search is executed.   In a server device for conducting an unauthorized use investigation of image data requiring use permission, an investigation object registration means for registering image data input from an investigation requester as an investigation object in an investigation object database for each investigation client; A survey condition setting unit that sets a survey condition for investigating whether or not the registered image data is illegally used on a website on the network, and a feature amount of the image data registered by the survey target registration unit is calculated. Similar image search means for searching image data that matches or is similar to the image data to be searched based on the calculated feature amount and the search condition, and a search report on the search result And a search result notification means for notifying the survey requester as   Image data unauthorized use investigation service for providing an unauthorized use investigation service by a server device connected via a network to a terminal device used by an investigation requester who requests an unauthorized use investigation of image data requiring use permission In the providing method, a survey target registration step of registering the image data input from the terminal device as a survey target in a survey target database for each survey requester, and the registered image data is illegally used on a website on the network A survey condition setting step for setting a survey condition for investigating whether or not and a feature amount of the image data registered in the survey target registration step is calculated, and the survey is performed based on the calculated feature amount and the survey condition. Image data matching or similar to the target image data is transferred to the Web on the network. And a search result notification step of notifying a search requester who uses the terminal device of the search result as a search report. How to provide.   18. The method for providing an unauthorized use investigation service for image data according to claim 17, wherein the feature amount is one or more of a color, a pattern, a shape, and a layout of image data to be subjected to an unauthorized use investigation. An illegal use investigation service providing method for image data.   19. The method for providing an unauthorized use investigation service for image data according to claim 17 or 18, wherein, in the investigation object registration step, together with the image data subject to unauthorized use investigation and the feature amount of the image data, the use permission for the image data. A method for providing an unauthorized use investigation service for image data, wherein information relating to a user including identification information of a Web site managed by a user receiving the registration is registered in the investigation object database for each investigation requester.   20. The method for providing an unauthorized use investigation service for image data according to claim 19, wherein, in the investigation condition setting step, a website managed by a user registered in the investigation target database is excluded from an unauthorized use investigation target. A method for providing an illegal use investigation service for image data, characterized in that investigation conditions can be set.   21. The image data unauthorized use investigation service providing method according to claim 17, wherein in the investigation condition setting step, any one of a data format, a data capacity, and a data size of image data to be subjected to an unauthorized use investigation. A method for providing an illegal use investigation service for image data, characterized in that at least one or a plurality of these can be set.   22. The method for providing an unauthorized use investigation service for image data according to claim 17, wherein, in the investigation condition setting step, any one of a domain type, a page type, and a page hierarchy of a website to be subjected to an unauthorized use investigation. A method for providing an illegal use investigation service for image data, characterized in that at least one or a plurality of these can be set.   23. The method of providing unauthorized use investigation service for image data according to claim 17, wherein, in the similar image search step, when searching for image data that matches or is similar to image data to be investigated, A predetermined range is set for the feature amount of the image data registered in the survey target database, and image data having the feature amount within the range is searched as a similar image from the image data included in the website on the network, An image data unauthorized use investigation service providing method characterized in that image data searched as the similar image and identification information of a Web site including the image data can be acquired.   23. The unauthorized use investigation service providing method for image data according to any one of claims 17 to 22, wherein a website on the network is periodically visited, and a feature amount is calculated from the image data included in the visited website. And a feature amount registration step of registering information relating to the calculated feature amount in the feature amount database in association with the identification information of the website, and in the similar image search step, matches or resembles image data to be investigated When searching for image data, a predetermined range is set for the feature amount of the image data registered in the database to be investigated, and the feature amount in the range is searched from the feature amount registered in the feature amount database. As a result, the image data corresponding to the searched feature amount and the identification information of the website including the image data can be acquired. Unauthorized survey service providing method of the image data, characterized in that the the like.   25. The improper use investigation service providing method for image data according to claim 23 or 24, wherein, in the similar image search step, similarity is set based on a feature amount of the image data acquired as a similar image. In the search result notification step, when the search result is displayed and notified to the terminal device, the image data is sorted in descending order of the similarity set in the similar image search step, and the sorted image data is A method for providing an unauthorized use investigation service for image data, characterized in that it can be displayed together with image information including at least the identification information of the website including the image data and the similarity of the image data.   26. The method for providing an unauthorized use investigation service for image data according to claim 25, wherein a sentence example of a warning mail having different contents according to the similarity set for each image data is stored in a sentence example database, and the search result notification In the step, when a warning mail is transmitted to the website including the similar image searched by the similar image search step, the sentence example corresponding to the similarity degree of the similar image is selected from the sentence example database, and the selection is performed. A method for providing an unauthorized use investigation service for image data, comprising: setting a sentence example as a warning mail, and transmitting the warning mail including the sentence example to a mail address included in the website.   27. The method for providing an illegal use investigation service for image data according to claim 26, wherein a terminal of a survey requester is sent before a warning mail in which a sentence example selected from the sentence example database is set is sent to an email address included in the website. An unauthorized use investigation service providing method for image data, comprising: transmitting to an apparatus, and after confirming or correcting the content of the warning mail by the investigation requester, the warning mail is transmitted to a mail address included in the Web site.   The program for performing the function as an unauthorized use investigation service provision system of the image data of any one of Claims 1 thru | or 15.   The program for performing the function as a server apparatus of Claim 16.   A program for executing the image data unauthorized use investigation service providing method according to any one of claims 17 to 27.   A computer-readable recording medium on which the program according to any one of claims 28 to 30 is recorded.