JP6728704B2 - Information processing system, information processing method, and image retrieval system - Google Patents

Description

The present invention relates to an information processing system, an information processing method and an image retrieval system.

For example, an image search technique is known in which a feature point is extracted from a captured image obtained by capturing an image with a camera, and an image having many similar feature points is searched from a pre-registered image group. Using this image retrieval technology, images of specific photographs and printed materials are registered in a database in association with various electronic data, and similar images are searched from this database using captured images of these photographs and printed materials. An image search system that presents cooperation information associated with similar images is known (for example, Patent Document 1).

When implementing a service using the image search system as described above, it is desirable to fully consider the convenience of the user who uses the service and the profit of the service provider and the cooperation information provider. Therefore, a mechanism that enables efficient operation of the image retrieval system is required.

The present invention has been made in view of the above, and an object thereof is to provide a mechanism that enables efficient operation of an image search system.

In order to solve the above-mentioned problems and achieve the object, the present invention provides a searched image based on a similarity with a search target image according to a search request from a database in which a searched image and association information are associated and registered. An information processing system including an image search system that searches for a search request, and transmits cooperation information associated with the searched image to be searched to a transmission source of a search request, and a customer-side system operated by a customer of the image search system. The image search system includes a search module for causing a terminal device to execute transmission of a search request, a module distribution unit that associates the module identification information for identifying the search module with the module distribution information, and a search module for the terminal device. And a search unit that executes a search on the database according to the module identification information included in the search request transmitted from the terminal device by being executed on the module distribution unit. A plurality of retrieved search modules distributed to the customer side system, and the database performs a search common to the plurality of module identification information and a first database that performs a search corresponding to each of the plurality of module identification information. And a second database, the search unit selects which of the first database and the second database is to be searched based on the module identification information included in the search request .

According to the present invention, it is possible to provide a mechanism that enables efficient operation of an image search system for searching for registered images.

FIG. 1 is a diagram schematically showing the configuration of an example of an information processing system applicable to the embodiment. FIG. 2 is a functional block diagram of an example for explaining the function of the search server applicable to the embodiment. FIG. 3 is a block diagram schematically showing the configuration of an example of an information processing system applicable to the embodiment. FIG. 4 is a diagram conceptually showing the structure of the image search DB applicable to the embodiment. FIG. 5 is a block diagram showing a hardware configuration of an example of a management server applicable to the embodiment. FIG. 6 is a functional block diagram of an example for explaining the function of the management server applicable to the embodiment. FIG. 7 is a block diagram showing a hardware configuration of an example of a search terminal applicable to the embodiment. FIG. 8 is a functional block diagram of an example for explaining the function of the search terminal applicable to the embodiment. FIG. 9 is a block diagram showing a configuration of an example of an image search application in a search terminal, which is applicable to the embodiment. FIG. 10 is an exemplary functional block diagram for explaining the function of the image search module applicable to the embodiment. FIG. 11 is a block diagram showing a configuration of an example of an image search application in a search terminal, which is applicable to the embodiment. FIG. 12 is an example flowchart showing each registration process applicable to the embodiment. FIG. 13 is a diagram showing an example of a login screen applicable to the embodiment. FIG. 14 is a diagram showing an example of a client list screen applicable to the embodiment. FIG. 15 is a diagram showing an example of a client registration/editing screen applicable to the embodiment. FIG. 16 is a diagram showing an example of a contract list screen applicable to the embodiment. FIG. 17 is a diagram showing an example of a module registration/edit screen applicable to the embodiment. FIG. 18 is a diagram showing an example of a registration information list screen applicable to the embodiment. FIG. 19 is a diagram showing an example of a disclosure setting screen applicable to the embodiment. FIG. 20 is a diagram showing an example of a campaign registration screen applicable to the embodiment. FIG. 21 is a flowchart showing an example of a method of designating a DB to which an image is to be registered, which is applicable to the embodiment. 22 is a flowchart of an example of a search process from the customer terminal applicable to the embodiment. FIG. 23 is a flowchart of an example showing a process related to a search from a customer terminal by the management server applicable to the embodiment. FIG. 24 is a diagram showing an example in which the application ID is registered in the contract information, which is applicable to the embodiment. FIG. 25 is a diagram showing an example in which an evaluation contract is set in the contract information, which is applicable to the embodiment. FIG. 26 is a diagram showing an example in which this contract is set in the contract information, which is applicable to the embodiment. FIG. 27 is a flowchart of an example of a process related to a search from a search terminal by the management server applicable to the embodiment. FIG. 28 is a diagram showing an example of the information processing system according to the embodiment including the configuration of the periphery thereof. FIG. 29 is a diagram for explaining an example of a usage form in the first contract form. FIG. 30 is a diagram for explaining an example of a usage form in the second contract form.

Hereinafter, with reference to the accompanying drawings, an information processing system, an embodiment of the information processing method and an image retrieval system in detail.

(Information processing system applicable to the embodiment)
FIG. 1 schematically shows the configuration of an example of an information processing system applicable to the embodiment. In FIG. 1, the information processing system includes an image search system 10, a registration terminal 20, a search terminal 30, and customer terminals 40a and 40b. The image search system 10 includes a search server 100 and a management server 101. The search server 100 is capable of communicating with the registration terminal 20, the search terminal 30, and the customer terminals 40a and 40b via a network. Further, the management server 101 can communicate with the registration terminal 20 and the customer terminals 40a and 40b via a network.

The search server 100 and the management server 101 are operated and managed by a service provider that provides an image search function of the image search system 10. Each of the search server 100 and the management server 101 may be configured by one information processing device, or may be configured by a plurality of information processing devices connected to each other with the functions distributed. It is also possible to configure the search server 100 and the management server 101 on a single information processing device. The search server 100 includes a plurality of image search databases (DB).

The registration terminal 20 acquires the image and the cooperation information for associating with the image, and transmits the image and the cooperation information to the image search system 10. The image search system 10 associates the image transmitted from the registration terminal 20 with the cooperation information and registers the image in a predetermined image search DB among the plurality of image search DBs included in the search server 100. The cooperation information can include, for example, a URL (Uniform Resource Locator) of the website 52a or the website 52b on the Internet 51.

In the example of FIG. 1, the registration terminal 20 uses the captured image of the subject 50 as an image for registering in the image search DB. This is not limited to this example, and the registration terminal 20 may use an image supplied from the outside or an image created inside the registration terminal 20 as an image to be registered in the image search DB.

In the information processing system of FIG. 1, the service provider of the image search system 10 permits a person or an organization having a specific contract to register an image and cooperation information in the search server 100. Hereinafter, a person or an organization having a specific contract with the service provider is referred to as a customer. The service provider registers the image and cooperation information provided by the customer in the search server 100 from the registration terminal 20 in response to the customer's request. Depending on the content of the contract, the customer himself/herself may register the image and the cooperation information in the search server 100 by operating the registration terminal 20. That is, the registration terminal 20 is a terminal device used by a service provider or a customer.

The customer terminals 40a and 40b are terminals used by customers, and can confirm images and cooperation information registered in the search server 100, for example. Moreover, in the information processing system applicable to the embodiment, the customer can customize the image search application to be installed in the search terminal 30. Since the customer terminals 40a and 40b have, for example, equivalent functions, the customer terminals 40a and 40b will be representatively described as the customer terminals 40a, unless otherwise specified.

For example, the service provider specifies the image search module for realizing the function of the image search application necessary for the terminals (customer terminals 40a, 40b, the search terminal 30) to use the search function of the search server 100. Provide to customers who have signed the contract. This image search module is provided to the customer by the service provider as, for example, an SDK (Software Development Kit). The customer can incorporate the provided image search module into another application program developed by the customer, for example. Thereby, for example, it becomes possible to configure a customized application in which the image search application function is added to the customer application for providing the service by the customer. By distributing the customized application that incorporates the image search module to general users, the customer can allow the general users to use the image search function according to the customer's intention and provide the services provided by the customers to the general users. Become.

This customization application is installed in the customer terminal 40a. For example, the customer sends a search request to the image search system 10 using the customer terminal 40a equipped with this customization application, and confirms whether or not the search result intended by the customer can be obtained. The search request includes an image to be an image search target, a module ID for identifying the image search module, and type information indicating a search form. The module ID and type information will be described later.

In the image search system 10, the search server 100 performs an image search according to the search request sent from the customer terminal 40a, and sends the search result to the customer terminal 40a as a response to the search request. Based on this search result, the customer confirms the operation of the customized application, the image registered in the search server 100 and the cooperation information, and when it is determined that there is no problem, the customer uses the customized application or the image search function. Provide services to general users.

The search terminal 30 is a terminal device used by general users and has an imaging function. Not limited to this, the search terminal 30 may store an image desired to be an image search target without having an imaging function. Of course, the search terminal 30 may be provided with a unit that has an imaging function and that stores an image that is the target of image search.

Further, the search terminal 30 is equipped with an image search application which is an application program for utilizing image search by the image search system 10. As a method of installing the image search application on the search terminal 30, for example, the image search application is designated and downloaded as a application program that a general user wants to install from a predetermined download site on a network such as the Internet 51, and the search terminal 30 is downloaded. There is a way to install.

The image search application provided as a customized application in which the image search module is incorporated is customized by the customer, is given a module ID, and is distributed to general users. On the other hand, the image search application distributed by the service provider is not provided with a module ID, or is provided with a module ID indicating distribution by the service provider. That is, the search system 10 can not only identify each customer and each customized application based on the module ID, but also identify the customer and the service provider.

Hereinafter, unless otherwise specified, the image search application will be described as a customized application that is customized by a customer, is given a module ID according to the customization, and is distributed.

By executing the image search application, the search terminal 30 performs an image capturing process of capturing the subject 50 by using the image capturing function, and transmits the image captured of the subject 50 to the image search system 10 via the network. You can The search terminal 30 activates an image capturing function in response to a user operation, captures an image of the subject 50, and transmits a search request requesting a search for an image similar to the captured image to the image search system 10. The search request includes the captured image and the module ID given to the image search application. The transmitted search request is received by the search server 100 in the image search system 10.

It should be noted that the customer can set various items such as leaflets, posters, signboards, signage, promotional photographs, specific landscapes, products, etc. as subjects, in other words, within the range in which the search system 10 functions, the customer decides. Any object can be a subject. This is because the customer may notify the general user of the subject, the user may image the subject, and use the image search system 10.

In the image search system 10, the search server 100 searches the image search DB for an image similar to the image in response to the search request transmitted from the search terminal 30, and identifies the searched image (hereinafter referred to as image identification). Information) is obtained as a search result. At this time, the search server 100 can select a search target image search DB according to the module ID included in the search request. The search server 100 transmits the cooperation information associated with the searched image to the search terminal 30.

For example, when the cooperation information includes the URL, the search terminal 30 causes the website 52a or the website via the Internet 51 according to the cooperation information searched by the search server 100 based on the captured image of the subject 50 and transmitted. 52b can be accessed. Hereinafter, a person who operates the search terminal 30 is referred to as a general user.

FIG. 2 is a functional block diagram of an example for explaining the function of the search server 100 according to the embodiment. The search server 100 includes an image search DB 11, an analysis unit 12, and a search unit 13, and executes search processing based on the captured image transmitted from the search terminal 30. The image search DB 11 includes an image DB 14 and a cooperation information DB 15. The image DB 14 registers images so that they can be searched. In the cooperation information DB 15, the cooperation information for cooperating with the image registered in the image DB 14 is registered in association with the image.

That is, a service provider is a user who operates the image search system 10 and provides a search service (search function), and a customer stores images or other information registered in the image search system 10 when using the search service. Is a user who decides an image pickup medium (subject 50) to be picked up by the general user's search terminal 30, and the general user takes an image of the image pickup medium decided by the customer and transmits the picked-up image to use the image search system 10. It can be said that it is a user who does. The users mentioned here include individuals and corporations.

Here, a specific example of the association between the image and the cooperation information will be described. In the embodiment, one or more areas can be designated in the image, and one or more pieces of cooperation information can be associated with each designated area. The area specified in the image for associating the cooperation information is hereinafter referred to as a target area.

The information indicating the target area is stored in the cooperation information DB 15 and registered in association with the image identification information. In the embodiment, the information indicating the target area is described using, for example, XML (Extensible Markup Language), which is a kind of markup language that defines and describes the meaning and structure of data using tags. In the cooperation information DB 15, for example, the file name of a file storing an XML code in which the information indicating the target area is stored and the image identification information are stored in association with each other.

The image registration processing by the search server 100 is generally performed as follows. The search server 100 analyzes the image to be registered by the analysis unit 12 and extracts the characteristic information indicating the characteristic of the image. The search server 100 stores the extracted characteristic information in the image DB 14 in association with the image identification information for identifying the image. The search server 100 also stores the cooperation information to be provided to the user in the cooperation information DB 15 in association with the image identification information. The image (feature information) and the cooperation information are respectively associated with the image identification information and stored in the image DB 14 and the cooperation information DB 15, so that the image is registered in the image search DB 11.

The image search processing by the search server 100 is generally performed as follows. For example, the search server 100 receives the image transmitted from the search terminal 30, and passes the received image to the analysis unit 12 via the search unit 13. The analysis unit 12 analyzes the passed image, extracts feature information from the image, and passes the extracted feature information to the search unit 13. The search unit 13 searches the image DB 14 for feature information having a high degree of similarity with the feature information based on the feature information passed from the analysis unit 12. The search unit 13 acquires the cooperation information associated with the image identification information corresponding to the searched characteristic information from the cooperation information DB 15. The search server 100 transmits the cooperation information acquired from the cooperation information DB 15 to the search terminal 30 as a search result.

FIG. 3 schematically shows a configuration of an example of an information processing system applicable to the embodiment. In FIG. 3, parts common to those in FIGS. 1 and 2 described above are designated by the same reference numerals, and detailed description thereof will be omitted.

3, the information processing system includes an image search system 10, a registration terminal 20, search terminals 30, 30,..., Customer terminals 40a, 40b,. A user DB 106 in which user information is registered is connected to the user management server 105. The image search system 10 also includes a search server 100, a management server 101, and a registration server 104. Note that, in FIG. 3, for the sake of explanation, the image search DB 112 b corresponding to the image search DB 11 of FIG. 2 is illustrated as being connected to the outside of the search server 100.

The image search DB 112b includes a normal DB 111b including an image DB 14 and a cooperation information DB 15, and a plurality of DBs including dedicated DBs 110b ₁ , 110b ₂ ,. The search server 100 performs an image search by using a DB selected by the switch unit (SW) 120b according to DB designation information from the management server 101, which will be described later, from a plurality of DBs included in the image search DB 112b as a search target DB. ..

As described above, the search server 100 analyzes the image (captured image) transmitted from the search terminal 30 via the Internet 51 by the analysis unit 12 to extract the characteristic information, and the search unit 13 extracts the extracted characteristic information. The image DB 14 is searched for similar feature information. Then, the search server 100 acquires, from the cooperation information DB 15, the cooperation information corresponding to the image identification information associated with the characteristic information searched from the image DB 14, and transmits it to the search terminal 30.

The registration server 104 includes an image search DB 112a corresponding to the image search DB 112b, and, like the search server 100, an image search function including the analysis unit 12 and the search unit 13. Similar to the image search DB 112b, the image search DB 112a includes a normal DB 111a including an image DB 14 and a cooperation information DB 15, and a plurality of DBs including dedicated DBs 110a ₁ , 110a ₂ ,. The normal DB 111a and the dedicated DBs 110a ₁ , 110a ₂ ,... Correspond to the normal DB 111b and the dedicated DBs 110b ₁ , 110b ₂ ,... Included in the image search DB 112b, respectively.

The normal DBs 111a and 111b can be commonly used by a plurality of different customers as search targets. On the other hand, the dedicated DBs 110a ₁ and 110b ₁ , 110a ₂ and 110b ₂ ,... Are search targets associated with a unique module ID for each set. Here, the module ID is given to one specific customer based on the contract with the customer. That is, the module ID is a unique ID provided to one customer. Therefore, each set of the dedicated DBs 110a ₁ and 110b ₁ , 110a ₂ and 110b ₂ ,... Is a search target of one particular customer.

The registration server 104 performs an image search by using a DB selected by the switch unit (SW) 120a from a plurality of DBs included in the image search DB 112a according to DB designation information from the management server 101, which will be described later, as a search target DB. ..

The contract information DB 16 is connected to the management server 101. The contract information DB 16 stores contract information, which is information regarding a contract between the service provider and the customer. Regarding the contract with the customer, the contract information is contract form information indicating the form of the contract, and DB designation information indicating which of the plurality of DBs included in the image search DBs 112a and 112b is the search target DB. And are included.

The management server 101 determines the DB selected by the switch units 120a and 120b based on the contract form information and the DB designation information included in the contract information and the search form information included in the search request. Further, the management server 101 switches the switch unit (SW) 121 based on the contract form information and the search form information, and selects which of the search server 100 and the registration server 104 is connected to access via the Internet 51. That is, the management server 101 also functions as a control unit that controls the switch units 120a, 120b, and 121 to determine the search target DB.

The registration terminal 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a storage device such as a hard disk drive, an input device such as a keyboard or a pointing device, and an LCD (Liquid Liquid). It is configured as an information processing device including a display such as a Crystal Display). The registration terminal 20 includes a registration tool 21.

The registration tool 21 is realized by a program that operates on the CPU of the registration terminal 20. The program for realizing the registration tool 21 is provided by the registration server 104 when the registration terminal 20 connects to the registration server 104, for example.

For example, the registration terminal 20 has a browser application (hereinafter, referred to as a browser) equivalent to that installed in a general computer. The browser operates on the CPU, reads a file described according to, for example, HTML (HyperText Markup Language), and performs a predetermined operation. By accessing the registration server 104 using a browser in the registration terminal 20, a predetermined information processing program on the registration server 104 is read by the browser, and the information processing program read by the browser causes registration on the registration terminal 20. The tool 21 is formed.

The registration terminal 20 is provided with images and cooperation information for associating with the images from the customers 43a, 43b, 43c,. The registration terminal 20 uses the registration tool 21 to associate the cooperation information with each image provided by the customers 43a, 43b, 43c,... Further, the registration terminal 20 can also transmit the contract information regarding each customer 43a, 43b, 43c,... To the registration server 104 by the registration tool 21. Each customer 43a, 43b, 43c,... Introduces the registration terminal 20 into its own system according to the contract with the service provider, and the customer himself/herself transmits the image and cooperation information to the registration server 104. You can

FIG. 4 conceptually shows the configuration of the image search DBs 112a and 112b applicable to the embodiment. The normal DB 111a, the dedicated DB 110a ₁ , the dedicated DB 110a ₂ and the dedicated DB 110a ₃ included in the image search DB 112a are private DBs (second storage unit) in which images at the stage of not being disclosed to general users are registered. By registering the image in this private DB, the customer can search and confirm the image using the customer terminal 40a before the service using this image is disclosed to general users (before being provided). You can That is, the customer can specify the private DB as a search target when confirming the image.

On the other hand, the normal DB 111b, the dedicated DB 110b ₁ , the dedicated DB 110b ₂ and the dedicated DB 110b ₃ included in the image search DB 112b are public DBs in which images at the stage of being published to general users are registered, and are used by general users. The search terminal 30 and the customer terminal 40a used by the customer can be designated as search targets. The customer can move the images registered in the private DB to this public DB. The present invention is not limited to this, and the customer may directly register the image in the public DB.

In each pair of normal DBs 111a and 111b, dedicated DBs 110a ₁ and 110b ₁ , dedicated DBs 110a ₂ and 110b ₂ , and dedicated DBs 110a ₃ and 110b ₃ , the same DB number is given to each DB included in the pair. In the example of FIG. 4, the DB numbers "SP001" are given to the dedicated DBs 110a ₁ and 110b ₁ forming one pair, respectively. Similarly, DB numbers “SP002” and “SP003” are given to the dedicated DBs 110a ₂ and 110b ₂ and the dedicated DBs 110a ₃ and 110b ₃ , respectively, which form one pair. The DB number “PU001” is given to the pair of normal DBs 111a and 111b.

Each pair of the normal DBs 111a and 111b, the dedicated DBs 110a ₁ and 110b ₁ , the dedicated DBs 110a ₂ and 110b ₂ , and the dedicated DBs 110a ₃ and 110b ₃ is processed by the publication/nondisclosure process to generate an image to be published and an image to be published. Are moved between each other. In the example of the pair of the dedicated DB 110a ₁ and the dedicated DB 110b ₁ , in the disclosure process, the image designated as the disclosure target among the non-disclosure target images (non-disclosure images) stored in the dedicated DB 110a ₁ that is the non-disclosure DB. Is moved to the dedicated DB 110b ₁ which is a public DB. In the non-disclosure process, among the images to be disclosed (public images) stored in the dedicated DB 110b ₁ , images designated as non-disclosure targets are moved to the dedicated DB 110a ₁ .

In other words, the image to be disclosed, which has been stored in the dedicated DB 110a ₁ and is not disclosed, is moved to the dedicated DB 110b ₁ by the disclosure process and can be searched by the customer terminal 40a and the search terminal 30. On the other hand, private target image that has been stored in a dedicated DB110b ₁ is transferred to a dedicated DB110a ₁ by closed treatment, although from the customer terminal 40a is searchable (can be specified as a search target), The search is not possible from the search terminal 30 (it is not specified as the search target).

The movement between the DBs of the image to be disclosed and the image to be disclosed by this disclosure/non-disclosure processing is performed by another pair, the normal DBs 111a and 111b, the dedicated DBs 110a ₂ and 110b ₂ in the example of FIG. 4, and the dedicated DBs 110a ₃ and 110b. _The same applies to ₃ .

In the example of FIG. 4, the image search DBs 112a and 112b are shown to include three dedicated DBs, respectively, but this is not limited to this example. For example, the image search DBs 112a and 112b are provided with dedicated DBs in a number corresponding to the number of contracts of each customer.

FIG. 5 shows an example of a hardware configuration of the management server 101 applicable to the embodiment. In FIG. 5, the management server 101 is connected to a bus 1010 with a CPU 1011, a ROM 1012, a RAM 1013, a storage 1014, and a communication I/F 1015. The storage 1014 is a storage medium capable of storing data in a nonvolatile manner, and is, for example, a hard disk drive. The storage 1014 is not limited to this, and a nonvolatile semiconductor memory such as a flash memory may be used.

The CPU 1011 controls the entire management server 101 using the RAM 1013 as a work memory according to the programs stored in the ROM 1012 and the storage 1014.

The storage 1014 stores programs to be executed by the CPU 1011 and various data. Further, the contract information DB 16 described above is configured using the storage area on the storage 1014. In FIG. 5, the storage 1014 is shown to be configured by one piece of hardware, but this is not limited to this example, and for example, a plurality of storage devices may be managed integrally as one storage 1014. You may

The communication I/F 1015 performs communication via the network under the control of the CPU 1011.

In addition, in FIG. 5, the management server 101 is shown to be configured by one piece of hardware, but this is not limited to this example, and the management server 101 is integrated with a plurality of server devices having an equivalent configuration. You may comprise by controlling physically. Further, since the search server 100 and the registration server 104 can be realized with the same hardware configuration as the management server 101, the description thereof will be omitted here.

FIG. 6 is an exemplary functional block diagram for explaining the functions of the management server 101 applicable to the embodiment. The management server 101 includes a communication unit 1101, a control unit 1102, a management unit 1103, and a setting unit 1104. The communication unit 1101, the control unit 1102, the management unit 1103, and the setting unit 1104 are realized by a program operating on the CPU 1011. Not limited to this, part or all of the communication unit 1101, the control unit 1102, the management unit 1103, and the setting unit 1104 may be configured using hardware circuits that operate in cooperation with each other.

The communication unit 1101 controls communication via the network by the communication I/F 1015. The control unit 1102 controls the search path using the switch units 120a, 120b and 121. The control unit 1102 also controls the above-described public/private processing. The management unit 1103 manages the contract information stored in the contract information DB 16. The setting unit 1104 sets contract information and module ID.

FIG. 7 shows a hardware configuration of an example of the search terminal 30 applicable to the embodiment. In the search terminal 30 shown in FIG. 7, a CPU 301, a ROM 302, a RAM 303, and a display control unit 304 are connected to a bus 300. Further, a storage 306, a data I/F 307, an input device 308, a wireless communication I/F 309, and an imaging unit 310 are connected to the bus 300. As described above, the search terminal 30 is an information processing device equipped with a computer including the CPU 301, the ROM 302, and the RAM 303.

The storage 306 is a storage medium capable of storing data in a nonvolatile manner, and is a nonvolatile semiconductor memory such as a flash memory. Not limited to this, a hard disk drive may be used as the storage 306. The storage 306 stores programs and various data to be executed by the CPU 301. The storage 306 and the ROM 302 may share, for example, one rewritable nonvolatile semiconductor memory.

The CPU 301 controls the entire search terminal 30 using the RAM 303 as a work memory according to the programs stored in the ROM 302 and the storage 306. The display control unit 304 converts the display control signal generated by the CPU 301 into a signal that can be displayed by the display device 305 and outputs the signal. The display device 305 includes, for example, an LCD (Liquid Crystal Display), is driven by a signal output from the display control unit 304, and performs display according to the display control signal.

The data I/F 307 inputs/outputs data to/from an external device. As the data I/F 307, for example, an interface such as USB (Universal Serial Bus) or Bluetooth (registered trademark) can be applied.

The input device 308 receives user input. The user can give an instruction to the search terminal 30 by operating the input device 308 according to the display on the display device 305, for example. It is preferable that the input device 308 and the display device 305 are integrally configured to output a control signal according to the pressed position and be configured as a touch panel that transmits the image of the display device 305.

The wireless communication I/F 309 performs communication via a network by wireless communication under the control of the CPU 301.

The image pickup unit 310 includes an optical system, an image pickup element, and a control drive circuit for the optical system and the image pickup element, performs predetermined processing on the image pickup signal output from the image pickup element, and outputs the image pickup image as a digital signal. The captured image output from the image capturing unit 310 and subjected to image processing can be stored in, for example, the storage 306. Further, the CPU 301 can read a captured image from the storage 306 and transmit it to the network by the wireless communication I/F 309.

FIG. 8 is a functional block diagram of an example for explaining the function of the search terminal 30 applicable to the embodiment. The search terminal 30 includes an image search unit 3001, a storage unit 3002, a communication unit 3003, a control unit 3004, an input unit 3005, a display unit 3006, and an imaging control unit 3007. The image search unit 3001, the storage unit 3002, the communication unit 3003, the control unit 3004, the input unit 3005, the display unit 3006, and the imaging control unit 3007 are realized by a program operating on the CPU 301. Not limited to this, part or all of the image search unit 3001, the storage unit 3002, the communication unit 3003, the control unit 3004, the input unit 3005, the display unit 3006, and the imaging control unit 3007 except for the image search unit 3001 cooperate with each other. You may comprise using the hardware circuit which works and operates.

The image search unit 3001 executes image search processing in the search terminal 30 applicable to the embodiment. The image search unit 3001 is configured on the search terminal 30 by installing the image search application distributed by the service provider to the customer who has made a specific contract with the search terminal 30.

The storage unit 3002 controls storage of data in the storage 306 and the RAM 303. The communication unit 3003 controls communication by the wireless communication I/F 309. The control unit 3004 controls the entire operation of the search terminal 30. The input unit 3005 outputs input information according to an input operation performed on the input device 308. The display unit 3006 generates a display control signal to be supplied to the display control unit 304. The imaging control unit 3007 controls the imaging operation of the imaging unit 310.

FIG. 9 shows an example of the configuration of an image search application for configuring the image search unit 3001 applicable to the embodiment. In FIG. 9, the image search application 3001a includes an application ID 3010 and an image search module 3020. The image search module 3020 includes a module ID 3021 that is identification information for identifying the image search module 3020.

The image search application 3001a is the above-described customized application, and is configured, for example, by incorporating the image search module 3020 provided by the service provider in a predetermined application provided by the customer. The application ID 3010 is, for example, unique identification information incorporated in the image search application 3001a for each image search module 3020 provided to the customer, and identifies one customized application created by the customer. Therefore, when one customer creates a plurality of customized applications, each customized application has a different application ID. One application ID may be given to a plurality of customized applications of the same customer. The application ID 3010 is given from the management server 101 when the image search application 3001a is first executed, for example. By using the application ID 3010, the image search application 3001a that has transmitted the search request can be specified.

FIG. 10 is a functional block diagram of an example for explaining the function of the image search module 3020 applicable to the embodiment. In FIG. 10, the image search module 3020 includes a captured image acquisition unit 3022, a module ID storage unit 3023, a search request transmission unit 3024, a search result reception unit 3025, a display information generation unit 3026, and an input reception unit 3027. including.

The captured image acquisition unit 3022 acquires the captured image captured by the image capturing unit 310 from the image capturing control unit 3007. The module ID storage unit 3023 controls storage of the module ID 3021 in the RAM 303 or the storage 306 and control of reading from the RAM 303 or the storage 306. The search request transmission unit 3024 creates a search request for requesting the image search system 10 to perform image search based on the captured image acquired by the captured image acquisition unit 3022. The search request includes the captured image, the module ID 3021, and the type information 3030. The search request transmission unit 3024 transmits the created search request to the image search system 10 via the wireless communication I/F 309.

The search result receiving unit 3025 receives the search result transmitted from the image search system 10 in response to the search request transmitted by the search request transmitting unit 3024. The display information generation unit 3026 generates display information to be displayed on the display device 305. For example, the display information generating unit 3026 generates display information for performing display according to the search result received by the search result receiving unit 3025. The input receiving unit 3027 receives an input operation performed on the input device 308.

Here, the image search module 3020 is composed of each unit that is a core for performing an image search in cooperation with the image search system 10. The service provider provides the image search module 3020 to the contracted customer, so that the customer can easily incorporate the image search module 3020 into a unique application program. Incorporating the image search module 3020 into an original application program is called customization by the image search module 3020. The application program in which the image search module 3020 is incorporated by customization is the above-described customization application.

The information processing program for realizing each function by the image search module 3020 is a file (CD) (Compact Disk), a flexible disk (FD), a DVD (Digital Versatile Disk) in an installable format or an executable format together with the module ID 3021. ) Or the like and is provided by being recorded in a computer-readable recording medium. Not limited to this, the information processing program and the module ID 3021 may be provided by being stored in a computer connected to a network such as the Internet and being downloaded via the network. Further, the information processing program and the module ID 3021 may be provided or distributed via a network such as the Internet.

The information processing program has a module configuration including the above-described units (captured image acquisition unit 3022, module ID storage unit 3023, search request transmission unit 3024, search result reception unit 3025, display information generation unit 3026, and input reception unit 3027). ing. As actual hardware, the CPU 301 reads the information processing program from a storage medium such as the storage 306 and executes the program so that the above-described units are loaded onto the main storage device such as the RAM 303, and the captured image acquisition unit 3022 and the module The ID storage unit 3023, the search request transmission unit 3024, the search result reception unit 3025, the display information generation unit 3026, and the input reception unit 3027 are generated on the main storage device.

As described above, the information processing program for configuring the image search module 3020 is executed on, for example, the terminal device (the search terminal 30 or the customer terminal 40a), so that the search request can be transmitted from the terminal device 30, The image search module 3020 functions as a search unit that executes a search by the search server 100.

Since the customer terminal 40a can be realized by a hardware configuration and a functional configuration that are substantially the same as those of the search terminal 30 described above, detailed description thereof will be omitted here. The customer terminal 40a corresponds to each function of the image search unit 3001, the storage unit 3002, the communication unit 3003, the control unit 3004, the input unit 3005, the display unit 3006, and the imaging control unit 3007 included in the search terminal 30 described above. Including the function to do.

FIG. 11 shows an example of a configuration of an image search application for configuring an image search unit corresponding to the image search unit 3001 included in the search terminal 30 described above in the customer terminal 40a. In FIG. 11, the image search application 4001a includes an application ID 4010, an image search module 4020, and type information 4030. Among these, the application ID 4010 and the image search module 4020 correspond to the application ID 3010 and the image search module 4020 included in the image search application 3001 included in the search terminal 30 described with reference to FIG. 9, respectively. The image search module 4020 also includes a module ID 4021 corresponding to the module ID 3021 described with reference to FIG. 9.

In FIG. 11, the type information 4030 is information indicating whether the search form of the image search application 4001a incorporating the image search module 4020 is the “trial version” or the “main use version”. The "trial version" is the image search DB 112a whose search target of the image search application 4001a is a private DB, and the "main use version" is an image search DB 112b whose search target is a public DB. It is said that

(registration process)
Next, each registration process applicable to the embodiment will be described. FIG. 12 is an exemplary flowchart showing each registration process executed by the registration tool 21 in the registration terminal 20 applicable to the embodiment. Note that, prior to the processing of the flowchart in FIG. 12, it is assumed that the user information (user ID and password) of the user who uses the registration tool 21 is registered in the user DB 106 by the user management server 105. In addition, hereinafter, it is assumed that the image is registered in units of campaigns and is registered in association with the campaign designated by the registrant.

Here, the campaign will be briefly described. A campaign is identified by a campaign ID and includes one or more images, metadata, and related campaign information. The name “campaign” is a word for customers and does not limit the scope of rights. When a customer provides a general user with some service using the image search function, a unit called a campaign is prepared so that images, cooperation information, and various attribute information can be easily managed for each service.

Each image in page units included in the campaign is called a page and includes one or more pieces of cooperation information. The metadata includes campaign attribute information. The campaign attribute information includes, for example, a campaign ID, a campaign name, the name of a client who requested registration, an update date and time, and information indicating a state indicating whether the campaign is open or closed. The related campaign information is information indicating another campaign related to this campaign. Information indicating this campaign is stored in the contract information DB 16 by the management server 101, for example.

When the registration tool 21 is activated in the registration terminal 20, the registration tool 21 performs a login process for the user in step S100. For example, the registration tool 21 displays the login screen 500 shown in FIG. 13 on the display device of the registration terminal 20. In the example of FIG. 13, the login screen 500 has an input unit 5001 for inputting user information (user ID and password), a button 5002 for instructing login, and a button 5003 for requesting reissue of a password. And are arranged.

For example, when the user ID and password are input to the input unit 5001, the registration tool 21 transmits the input user ID and password to the user management server 105 and requests authentication of the user ID. When the registration tool 21 receives the information indicating that the user ID authentication is successful from the user management server 105, the registration tool 21 shifts the processing to step S101.

In step S101, the registration tool 21 displays a screen including a menu area on the display of the registration terminal 20. FIG. 14 shows an example of a client list screen 550 including a menu area 5500 applicable to the embodiment. In the following, displaying a screen on the display of the registration terminal 20 is simply described as “displaying”. In the example of FIG. 14, the client list screen 550 has a menu area 5500 including tabs 5501a, 5501b, 5501c, and 5501d, a button group 5502, a search input section 5503, a list display area 5504, and an end button 5505. To be done.

Tabs 5501a, 5501b, 5501c and 5501d included in the menu area 5500 are tabs for selecting a menu item and determining the operation mode of the registration tool 21. Tabs 5501a and 5501b are tabs for shifting to the user management mode, and when operated, an administrator list and a client list are displayed, respectively. The tab 5501c is a tab for shifting to the image registration mode, and a campaign list is displayed by operating the tab. Also, the tab 5501d is a tab for shifting to the module information registration mode, and a list of contracts made between the service provider and the customer is displayed.

The list display area 5504 displays a list corresponding to the menu item selected by the tabs 5501a, 5501b, 5501c, and 5501d. The example of FIG. 14 shows a state where the tab 5501b is operated and the client list is selected. Below, each row of the list is called a record, and each column is called an item.

A button group 5502 selects processing for the list displayed in the list display area 5504. In the example of FIG. 14, the button group 5502 includes four buttons, and each button is assigned the functions of “new registration”, “edit”, “delete”, and “CSV output” from the left. The “new registration” button newly adds a record to the list displayed in the list display area 5504. The “Edit” button edits the information of the record selected in the list displayed in the list display area 5504. The “delete” button deletes the information of the record selected in the list displayed in the list display area 5504. The "CSV output" outputs the information of the list displayed in the list display area 5504 as a CSV (Comma-Separated Values) format text file.

The search input unit 5503 selects a record from the list displayed in the list display area 5504 based on the selected or input search key. The end button 5505 ends the processing by the registration tool 21.

Note that in the example of FIG. 14, the client information is recorded in the records as “client ID”, “client name”, “password”, “email address (Email)”, “last updated date”, “number of published pages”, It includes each item of "Number of pages used" and "Number of contract pages". The client information may include more items.

Referring back to FIG. 12, when the menu is displayed in step S101, the process proceeds to the next step S102, and the registration tool 21 determines whether any of the tabs 5501a, 5501b, 5501c and 5501d, and the end button 5505. Wait for operation and selection of process. If the end button 5505 is operated, the registration tool 21 moves the process to step S103, performs the user logout process, and ends the operation of the registration tool 21.

When the tab 5501a or the tab 5501b is operated to select the user management mode in step S102, the registration tool 21 shifts the processing to step S104. Then, in step S104, the registration tool 21 displays one of the administrator list screen and the client list screen (see FIG. 14) according to which of the tabs 5501a and 5501b is operated in step S102. .. Here, it is assumed that the tab 5501b is operated and the client list screen 550 shown in FIG. 14 is displayed.

When the “new registration” or “edit” button included in the button group 5502 is operated on the client list screen 550, a client registration/edit screen 510 applicable to the embodiment illustrated in FIG. 15 is displayed. .. In FIG. 15, client registration/edit screen 510 has input areas 5101 to 5108, an “OK” button 5109, and a “cancel” button 5110.

The name of the client (customer) to be registered is input to the input area 5101. In the input area 5102, the upper limit value of the number of pages that can be used by the client is input. In the input area 5103, the contact information (e-mail address in this example) of the client is input. A client ID for identifying the client is input to the input area 5104. A password used for authentication when the client uses the image search system 10 is input to the input area 5105. The input area 5106 is a button for automatically generating the initial value of the password input in the input area 5105. Remarks are input to the input area 5107.

The module ID 4021 associated with the client ID of the client is input to the input area 5108. The module ID 4021 can be input to the input area 5108 manually. Not limited to this, when the module ID 4021 is already associated with the client ID, the module ID 4021 may be input by selecting from the associated module ID 4021.

The “OK” button 5109 confirms the content input in each of the input areas 5101 to 5108. For example, when the “OK” button 5109 is operated, the registration tool 21 sends each piece of information input in each of the input areas 5101 to 5108 to the management server 101. The management server 101 receives each piece of information transmitted from the registration tool 21, and stores each piece of received information in the contract information DB 16. The “cancel” button 5110 discards the information input in each of the input areas 5101 to 5108 and displays the client list screen 550.

The registration tool 21 returns the process to step S101 and displays a screen including the menu area 5500 when an operation indicating that the process on the administrator list screen or the client list screen 550 is completed is performed.

When the tab 5501d is operated and the module information registration mode is selected in step S102, the registration tool 21 shifts the processing to step S106. In step S106, the registration tool 21 displays a contract list screen 540 applicable to the embodiment as illustrated in FIG. In FIG. 16, a contract list screen 540 includes a button group 5401, a search input unit 5402, a list display area 5403, and an end button 5404. When the end button 5404 is operated, the registration tool 21 returns the processing to step S101 and displays the screen including the menu area 5500.

The list display area 5403 displays a list of contract information registered in the management server 101 (contract information DB 16). In the example of FIG. 16, in the list displayed in the list display area 5403, each record has a “client ID”, “contract type”, “use start date”, “use end date”, “DB (database)”, Each item of "DB number", "module ID", "application ID", "package name", "application name", and "remarks" is included. The record information is stored in the contract information DB 16 by the management server 101. The registration tool 21 communicates with the management server 101, acquires the contract information stored in the contract information DB 16, and displays the acquired contract information in the list display area 5403.

The button group 5401 includes four buttons, and each button is assigned the functions of “new registration”, “edit”, “delete”, and “CSV output” from the left. The “new registration” button newly adds a record to the list displayed in the list display area 5403. The “Edit” button edits the information of the record selected in the list displayed in the list display area 5403. The “delete” button deletes the information of the record selected in the list displayed in the list display area 5403. "CSV output" outputs the information of the list displayed in the list display area 5403 as a CSV-format text file.

When the “new registration” button or “edit” button included in the button group 5401 is operated, as a screen for newly registering or editing contract information, for example, a module applicable to the embodiment illustrated in FIG. A registration/edit screen 520 is displayed. In FIG. 17, the module registration/editing screen 520 has input areas 5201 to 5211, an “OK” button 5212, and a “cancel” button 5213.

In the input area 5201, the module ID 4021 of the image search module 4020 provided by the service provider to the customer is input. As the module ID 4021, a unique value is used in each image search module 4020 provided by the image search system 10. For example, the module ID 4021 is uniquely generated by the management server 101. The management server 101 sends the generated module ID 4021 to the registration tool 21. Upon receiving the module ID 4021 transmitted from the management server 101, the registration tool 21 inputs the received module ID 4021 into the input area 5201. Not limited to this, the module ID 4021 may be manually input. For example, a contract with a customer is made for each module ID 4021.

A contract form (contract type) is input to the input area 5202. In this example, the contract form includes two forms, an evaluation contract and a main contract. The evaluation contract is a contract form for the customer to evaluate the image search system 10. The image can be registered in the image search DB 112a, which is a private DB, and the disclosure process cannot be performed. This contract has a wider authority than the evaluation contract, and images can be registered in the image search DB 112a, which is a private DB, and the image search DB 112b, which is a public DB. In addition, this contract allows for public processing and private processing. In the input area 5202, the evaluation contract and the main contract are exclusively input.

The module ID 4021 input to the input area 5201, that is, the use start date and the use end date of the image search module 4020 corresponding to the module ID 4021 are input to the input areas 5203 and 5204, respectively. The image search module 4020 can be used within a period from the date input in the input area 5203 to the date input in the input area 5204, and cannot be used outside the period. The use start date and use end date correspond to the start date and end date of the contract for the image search module 4020.

Input areas 5205 and 5206 specify databases used by the image search module 4020 corresponding to the module ID 4021 input in the input area 5201 for image search. The input area 5205 specifies which of the normal DBs 111a and 111b, the dedicated DBs 110a _{1 to} 110a ₃ and the dedicated DBs 110b _{1 to} 110b ₃ is used. When "normal" is input, the normal DBs 111a and 111b are designated.

On the other hand, when “dedicated” is input, _{one of the} pairs of the dedicated DBs 110a _{1 to} 110a ₃ and the dedicated DBs 110b _{1 to} 110b ₃ is designated. When “dedicated” is input, it is necessary to further input the DB number in the input area 5206. For example, referring to FIG. 4, when “dedicated” is input in the input area 5205 and “SP002” is input in the input area 5206, the pair of dedicated DBs 110a ₂ and 110b ₂ is designated as the database to be used. As the DB number, a different number for each customer is provided from the service provider to the customer according to the contract.

In the input area 5207, the client ID for identifying the customer related to this contract information is input.

The application ID 4010 is input to the input area 5208. The input area 5208 may be blank. By inputting the application ID 4010 of the image search application 4001a in the input area 5208, the image search application 4001a corresponding to the input application ID 4010 can be filtered.

The input areas 5209 to 5211 are used for inputting optional information and can be omitted. In the input area 5209, for example, the package name of the image search application 4001a in which the image search module 4020 including the module ID 4021 input in the input area 5201 is incorporated is input. In the input area 5211, the name or remark of the image search application 4001a is input. The input area 5210 is an “add” button and adds the input area 5211.

The “OK” button 5212 confirms the content input in each of the input areas 5201 to 5211. For example, when the “OK” button 5212 is operated, the registration tool 21 sends each piece of information input in each of the input areas 5201 to 5211 to the management server 101 as contract information. The management server 101 receives the contract information transmitted from the registration tool 21, and stores the received contract information in the contract information DB 16. The “cancel” button 5213 discards each piece of information input to each input area 5201 to 5211, returns the process to step S101, and displays a screen including the menu area 5500.

Returning to FIG. 12, when the tab 5501c is operated and the image registration mode is selected in step S102, the registration tool 21 shifts the processing to step S105. In step S105, the registration tool 21 causes the display to display a registration information list screen showing information about registered campaigns.

FIG. 18 shows an example of the registration information list screen 560 applicable in the embodiment, which is displayed in step S105. 18, a registration information list screen 560 has a new registration button 5601a, an edit button 5601b, a delete button 5601c and a disclosure setting button 5601d, a search input section 5602, a list display area 5603, and an end button 5604. ..

The list display area 5603 displays a list of campaign information registered in the management server 101 (contract information DB 16). In the example of FIG. 18, in the list displayed in the list display area 5603, each record has a “campaign name”, a “client name”, a “client ID”, a “public page number”, a “used page number”, and a “final page”. It includes each item of “update date”, “state”, “module ID”, and “remark”. The record information is stored in the contract information DB 16 by the management server 101. The registration tool 21 communicates with the management server 101, acquires the campaign information stored in the contract information DB 16, and displays the acquired campaign information in the list display area 5603.

The new registration button 5601a newly adds a record to the list displayed in the list display area 5603. The edit button 5601b edits the information of the record selected in the list displayed in the list display area 5603. The delete button 5601c deletes the information of the record selected in the list displayed in the list display area 5603. The disclosure setting button 5601d sets the state of the selected record in the list displayed in the list display area 5603 to either public or private.

When the registration information list screen 560 is displayed in step S105, the registration tool 21 shifts the processing to the next step S110 and waits for an operation on the buttons 5601a to 5601d and the end button 5604. Hereinafter, processing according to the operation on each button will be described according to the following items (1) to (5).

(1) When the end button 5604 is operated in step S110, the registration tool 21 returns the process to step S101, for example, and displays the screen including the menu area 5500.

(2) In step S110, the registration tool 21 moves the process to step S119 when the disclosure setting button 5601d is operated with the record selected in the list display area 5603. In step S119, the registration tool 21 determines whether or not the campaign of the selected record can be disclosed, based on the module ID included in the record.

For example, the registration tool 21 requests the management server 101 for contract information in which the module ID matches the module ID included in the selected record among the contract information registered in the contract information DB 16. According to the contract information transmitted from the management server 101 in response to the request, the registration tool 21 determines that the disclosure is possible when the contract form is the main contract and the current date is within the contract period. In addition, the registration tool 21 determines that disclosure is not possible when the contract form is an evaluation contract or the current date is outside the contract period.

When the registration tool 21 determines in step S119 that the disclosure is not possible, the process returns to step S101 and the screen including the menu area 5500 is displayed. On the other hand, if the registration tool 21 determines in step S119 that the disclosure is possible, the process proceeds to step S120.

In step S120, the registration tool 21 displays a disclosure setting screen for setting disclosure or non-disclosure of the campaign shown in the selected record.

FIG. 19 shows an example of a disclosure setting screen applicable to the embodiment. In FIG. 19, the disclosure setting screen 530 has an input area 5301, an “OK” button 5302, and a “cancel” button 5303. In the input area 5301, public and private are exclusively input. Here, in the input area 5301, the value of the item “state” of the selected record is set as an initial value. The “OK” button 5302 confirms the value input to the input area 5301.

For example, in the registration tool 21, when the “OK” button 5302 is operated, the disclosure state set to either public or private is set for the record according to the input in the input area 5301. The image included in the campaign shown in the record whose publication status is set to public is the image to be published, and the image included in the campaign shown in the record whose publication status is set to private is the image to be published. To be done. When the open state is set, the registration tool 21 updates the display in the list display area 5603 and returns the process to step S105. Further, when the “Cancel” button 5303 is operated, the registration tool 21 sets the disclosure state of the record to the state before the disclosure setting screen 530 is displayed, and returns the process to step S105.

(3) When the delete button 5601c is operated with the record selected in the list display area 5603 in step S110, the registration tool 21 shifts the processing to step S121. In step S121, the registration tool 21 deletes the information of the selected record. At this time, it is preferable that the registration tool 21 displays a confirmation screen as to whether or not the record is to be deleted, and whether or not to delete the record including the information of the image associated with the record. When the record is deleted, the registration tool 21 updates the display in the list display area 5603 and returns the process to step S105.

(4) The registration tool 21 moves the process to step S122 when the edit button 5601b is operated in step S110. In step S122, the registration tool 21 acquires from the registration server 104 the image included in the campaign shown in the record selected in the list displayed in the list display area 5603 of the registration information list screen 560. When the registration information is associated with the acquired image, the registration tool 21 also acquires this cooperation information. Upon acquiring the image and the cooperation information, the registration tool 21 shifts the processing to step S124.

(5) When the new registration button 5601a is operated in step S110, the registration tool 21 shifts the processing to step S123 and executes the new campaign registration processing. In step S123, the registration tool 21 displays a campaign registration screen for newly registering a campaign.

FIG. 20 shows an example of a campaign registration screen applicable to the embodiment. 20, in the campaign registration screen 570, input areas 5701 to 5703, an “OK” button 5704, and a “cancel” button 5705 are arranged. A campaign name is entered in the input area 5701. In the input area 5702, a client ID for identifying a person (customer) who implements the newly registered campaign is input. The respective values input in the input areas 5701 and 5702 become the values of the item “campaign name” and the item “client ID” in the record, respectively.

The module ID 4021 is input to the input area 5703. In this case, the module ID 4021 associated with the client ID input to the input area 5702 is input to the input area 5703. For example, when the module ID 4021 is already associated with the client ID, the input area 5703 can be selected and input from the associated module ID 4021.

When the “OK” button 5704 is operated, the registration tool 21 finalizes each value input in the input areas 5701 to 5703 on the campaign registration screen 570, and uses the finalized values to register information list screen 560. A record is added to the list display area 5603. Then, the process proceeds to step S124. On the other hand, when the “Cancel” button 5705 is operated, the registration tool 21 discards each value input in the input areas 5701 to 5703, and returns the process to step S105, for example.

In step S124, the registration tool 21 displays an edit screen for editing the campaign information. The registration tool 21 can set and edit an image to be registered in a campaign, set a target area for the image, and set cooperation information (link) and function for the target area in response to an input on the edit screen. Further, the registration tool 21 can upload the image to be registered in the campaign to the registration server 104 according to the input on the edit screen. Further, the registration tool 21 can set other related campaigns according to the input on the editing screen. Furthermore, the registration tool 21 can also check whether or not an image similar to the image to be registered has already been registered in the registration server 104 according to the input on the edit screen.

When the saving of the edited campaign information is designated on the editing screen, the registration tool 21 moves the process to step S125 and starts the campaign information saving process.

In the next step S126, the registration tool 21 transmits the campaign information to the registration server 104 and requests the registration server 104 to update the registered information. For example, the registration tool 21 transmits each image included in the campaign, each cooperation information associated with each image, and the metadata of the campaign to the registration server 104. The registration server 104 updates the image search DB 112a based on each information transmitted from the registration terminal 20 in response to a request from the registration tool 21.

After transmitting the information update request to the registration server 104 in step S126, the registration tool 21 returns the process to step S105.

(DB specification method)
Next, a method that is applicable to the embodiment and specifies a DB as a target of image registration will be schematically described with reference to the flowchart of FIG. The process according to the flowchart of FIG. 21 is executed by, for example, a service provider. It is assumed that a contract for using the image search system 10 has been exchanged in advance between the client client and the service provider in writing.

In step S200, the service provider determines whether the client ID of the contract target customer is registered. For example, the service provider makes an inquiry from the registration terminal 20 to the management server 101 as to whether or not the contract information including the client name of the customer who made the contract is registered in the contract information DB 16, and the inquiry result is displayed. This determination can be made based on this. If it is determined that the client ID of the contract target customer is already registered, the process proceeds to step S202.

On the other hand, when it is determined that the client ID of the contract target customer is not registered, the process proceeds to step S201. In step S201, the service provider registers a client ID for identifying the customer. For example, the service provider causes the registration terminal 20 to display the client registration/edit screen 510 shown in FIG. 15, inputs each piece of information including the client ID of the customer in the input area 5104, and operates the “OK” button 5109. .. As a result, each piece of information including the client ID of the customer is registered in the contract information DB 16.

When the client ID is registered in step S201, the process proceeds to step S202. In step S202, the service provider determines whether or not the contract target customer incorporates the image search module 4020 into another application program (abbreviated as application). This determination is performed, for example, according to a contract previously entered into between the service provider and the customer. The other application is, for example, a customer application provided by the customer.

When it is determined in step S202 that the image search module 4020 is not incorporated in another application (step S202, “none”), the process proceeds to step S203, and the contract with the contract target customer is a normal contract. Is said to be. Then, the process proceeds to step S212.

When it is determined in step S202 described above that the image search module 4020 is to be incorporated in another application (step S202, “Yes”), the process proceeds to step S210, and the contract with the contract target customer is a dedicated contract. To be done. Then, in the next step S211, it is determined whether or not the dedicated DB is used. When determining not to use, the service provider specifies the registration target normal DBs 111a and 111b in which the contract target customer registers the image (step S212).

On the other hand, when it is determined that the dedicated DB is to be used, the service provider selects the DB for registration among the pairs of the dedicated DBs 110a ₁ and 110b ₁ , the dedicated DBs 110a ₂ and 110b ₂ ,... The DB number of the DB is designated (step S213).

(Search process)
Next, a search process applicable to the embodiment will be described. First, the search process from the customer terminal 40a applicable to the embodiment will be described with reference to the flowchart of FIG. In the following, it is assumed that the customer terminal 40a is used by the customer 43a, and the image search application 4001a, which is a customized application customized by the customer 43a, is installed.

In step S300, the customer terminal 40a performs an imaging process according to a user operation. The captured image is stored in a storage such as a non-volatile semiconductor memory or a hard disk drive provided in the customer terminal 40a, for example. In the next step S301, the customer terminal 40a transmits a search request including the captured image and the application ID 4010, the module ID 4021 and the type information 4030 included in the image search application 4001a to the image search system 10. The search request is received by the management server 101 in the image search system 10.

In the next step S302, the customer terminal 40a waits for a notification from the image search system 10. If there is no notification, the process returns to step S302. Upon receiving the notification from the image search system 10, the customer terminal 40a moves the process to step S303, and determines whether or not the received notification is an error notification. When the customer terminal 40a determines that the received notification is not an error notification (step S303, “No”), the customer terminal 40a moves the process to step S304 and displays the search result. On the other hand, when it is determined that the received notification is an error notification (step S303, “Yes”), the process proceeds to step S305 and the error content is displayed.

When the process of step S304 or step S305 ends, the series of search processes by the customer terminal 40a ends.

(Search processing according to the search request from the customer terminal)
Next, the processing relating to the search in response to the search request from the customer terminal 40a by the management server 101 applicable to the embodiment will be described with reference to the flowchart of FIG. 23 and FIGS. 24 to 26, the same parts as those in FIGS. 11 and 17 described above are designated by the same reference numerals, and detailed description thereof will be omitted.

The management server 101 determines in step S400 whether or not a search request from the customer terminal 40a has been received. When it is determined that it has not been received (step S400, “No”), the process returns to step S400. On the other hand, when the management server 101 determines that the search request has been received from the customer terminal 40a (step S400, "Yes"), the process proceeds to step S401.

In step S401, the management server 101 acquires the contract information corresponding to the module ID 4021 included in the received search request from the contract information DB 16. In the next step S402, it is determined whether or not the application ID 4010 is registered in the contract information. When the management server 101 determines that the application ID 4010 is not registered in the contract information (step S402, “none”), the process proceeds to step S404. On the other hand, when the management server 101 determines that the application ID 4010 is registered in the contract information (step S402, “Yes”), the management server 101 shifts the processing to step S403.

FIG. 24 shows an example in which the application ID 4010 is registered in the contract information. 24A and 24B show an image search application 4001a installed in the customer terminal 40a and a module registration/edit screen 520 in which a module ID 4021 that matches the module ID 4021 included in the image search application 4001a is registered. Here is an example: As shown in FIG. 24A, the image search application 4001a is given an application ID 4010 at the first activation, and is embedded in the image search application 4001a.

On the other hand, in the module registration/edit screen 520 shown in FIG. 24B, the application ID 4010 has been input in the input area 5208. In this case, the application ID 4010 is registered in the contract information. On the other hand, if the input area 5208 is blank, the application ID 4010 is not registered in the contract information.

In step S403, the management server 101 determines whether the application ID 4010 included in the contract information and the application ID 4010 included in the image search application 4001a installed in the customer terminal 40a match. When the management server 101 determines that they do not match (step S403, “mismatch”), the management server 101 shifts the processing to step S420 and transmits an error notification indicating that the application IDs 4010 do not match to the customer terminal 40a.

On the other hand, when the management server 101 determines in step S403 that the application IDs 4010 match (step S403, “match”), the process proceeds to step S404.

In step S404, the management server 101 determines whether or not the current date is within the contract period based on the use start date and the use end date included in the contract information acquired in step S401. When the management server 101 determines that the current date is outside the contract period (step S404, "outside period"), the management server 101 shifts the processing to step S420, and notifies the customer terminal 40a of an error notification indicating that the contract period is out. Send.

On the other hand, when the management server 101 determines in step S404 that the current date is within the contract period (step S404, "within period"), the process proceeds to step S405. In step S405, the management server 101 publishes the search target for the search request based on the contract form included in the contract information acquired in step S401 and the type information 4030 included in the search request received from the customer terminal 40a. It is determined whether the DB is a private DB or a private DB.

Classification of search targets based on contract form and type information is as follows. First, the type information 4030 indicates two types of “trial version” and “main use version” as described above. When the type information 4030 indicates “trial version”, the private DB is selected as the search target. The image search application 4001a whose type information 4030 indicates "trial version" is installed in the customer terminal 40a and used.

On the other hand, when the type information 4030 indicates “this use version”, the public DB is selected as the search target. The image search application 4001a in which the type information 4030 indicates “this used version” is available on the customer terminal 40a and is also distributed to general users and installed on the search terminal 30 for use.

When the contract form is “evaluation contract”, the image can be registered in the image search system 10, but the disclosure process is not possible. Therefore, in the case of an evaluation contract, only the private DB is searched. On the other hand, when the contract form is “main contract”, the image can be registered in the image search system 10, and further, public/private processing can be performed. Therefore, in the case of this contract, the private DB and the public DB are to be searched.

From the above, the determination condition of whether the search target is a public DB or a private DB is as follows. That is, when the contract form is “evaluation contract” or the contract form is “main contract” and the type information is “trial version”, the private DB is to be searched. On the other hand, when the contract type is “main contract” and the type information is “main use version”, the public DB is searched. The type information of the image search application 4001a included in the search terminal 30 used by the general user is fixed to “this use version”.

In step S405, when the management server 101 determines that the private DB is the search target based on the above-described determination conditions (step S405, “private DB”), the management server 101 shifts the processing to step S406. As shown in FIGS. 25A and 25B, when the “evaluation contract” is input in the input area 5202 on the module registration/edit screen 520 of FIG. 25B, it is input in the input area 5201. The search target of the image search application 4001a shown in FIG. 25A, which includes the module ID 4021 that matches the module ID 4021 that is created, is the private DB.

In step S406, the management server 101 sets the search target of the customer terminal 40a that has transmitted the search request to the private DB, and normally searches the search target DB based on the contract information corresponding to the module ID 4021 included in the search request. The switch units 121 and 120a are switched so as to select from the DB 111a and the dedicated DBs 110a ₁ , 110a ₂ ,.... The registration server 104 performs an image search on the selected search target DB. The search request may be passed from the management server 101 to the registration server 104, or may be held in the switch unit 121, for example.

In the setting example of FIG. 25B, in the management server 101, since “dedicated” is input in the input area 5205 and the DB number “SP002” is specified in the input area 5206, the dedicated DBs 110a ₁ , 110a ₂ ,... Of these, the DB with the DB number “SP002” is selected as the search target DB.

The registration server 104 notifies the customer terminal 40a that has transmitted the search request of the search result in the next step S407.

On the other hand, in step S405, when the management server 101 determines that the public DB is the search target based on the above-described determination conditions (step S405, “public DB”), the process proceeds to step S410. For example, as shown in FIGS. 26A and 26B, when “main contract” is input in the input area 5202 on the module registration/edit screen 520 of FIG. 26B, the input area 5201 The search target of the image search application 4001a shown in FIG. 26A, which includes the module ID 4021 that matches the module ID 4021 input to, is the public DB.

In step S410, the management server 101 sets the search target of the customer terminal 40a that transmitted the search request to the public DB, and based on the contract information corresponding to the module ID 4021 included in the search request, sets the search target DB to the normal DB 111b. , And the dedicated DBs 110b ₁ , 110b ₂ ,... To switch between the switch units 121 and 120b. The search server 100 performs an image search on the selected search target DB. The search request may be passed from the management server 101 to the search server 100, or may be held in the switch unit 121, for example.

In the setting example of FIG. 26B, in the management server 101, since “dedicated” is input in the input area 5205 and the DB number “SP002” is specified in the input area 5206, the dedicated DBs 110b ₁ , 110b ₂ ,... Of these, the DB with the DB number “SP002” is selected as the search target DB.

The search server 100 notifies the customer terminal 40a which transmitted the search request of the search result in the next step S411.

In step S401, when the contract information corresponding to the module ID 4021 cannot be acquired from the contract information DB 16, the normal DB 111a or the normal DB 111b can be set as the search target DB. For example, when the contract information corresponding to the module ID 4021 cannot be acquired, if the type information indicates “trial version”, the non-public normal DB 111a is set as the search target DB, and the type information indicates “this use version”. In the case shown, it is conceivable to set the public normal DB 111a as the search target DB.

As described above, in the embodiment, the DB to be searched can be selected using the information specified based on the module ID 4021 included in the image search module 4020. Therefore, it is possible to control the search processing for the registered image for each person (for example, a customer) who has registered the image.

(Search processing according to the search request from the search terminal)
Next, the processing relating to the search in response to the search request from the search terminal 30 by the management server 101 applicable to the embodiment will be described with reference to the flowchart of FIG.

Here, it is assumed that the search terminal 30 is installed with an image search application 3001a customized by the customer 43a and corresponding to the image search application 4001a installed in the customer terminal 40a described above. The image search application 3001a includes a module ID 3021 having the same value as the module ID 4021 included in the image search application 4001a described above.

As an example, the customer 43a attempts a search by the image search application 4001a using the customer terminal 40a, and determines whether or not the search operation by the image search application 4001a is satisfactory. If the customer 43a determines that the search operation by the image search application 4001a is satisfactory, the customer 43a changes the information indicated by the type information 4030 of the image search application 4001a from "trial version" to "this use version" The application 4001a is configured as an image search application 3001a for installing on the search terminal 30 used by general users.

Then, the customer 43a creates, for example, an application program incorporating the image search application 3001a, and distributes the application program to general users using the customer side system operated by the customer 43a. A general user installs the distributed application program in a terminal device that he or she owns and sets the terminal device as the search terminal 30 according to the embodiment.

First, the search terminal 30 performs an imaging process according to a user operation according to the process of the flowchart of FIG. 22 described above (step S300 of FIG. 22). The captured image is stored in the storage 306 included in the search terminal 30. The search terminal 30 transmits a search request including the captured image and the application ID 3010 and the module ID 3021 included in the image search application 3001a to the image search system 10 (step S301 in FIG. 22). The search request is received by the management server 101 in the image search system 10.

The search terminal 30 waits for a notification from the image search system 10 (step S302 in FIG. 22). Upon receiving the notification from the image search system 10, the search terminal 30 determines whether or not the received notification is an error notification (step S303 in FIG. 22). When the search terminal 30 determines that the received notification is not an error notification, the search terminal 30 displays the search result. On the other hand, when it is determined that the received notification is an error notification, the error content is displayed.

27, in step S500, the management server 101 determines whether or not a search request from the search terminal 30 has been received. If it is determined that it has not been received (step S500, “No”), the process returns to step S500. On the other hand, when the management server 101 determines that the search request from the search terminal 30 has been received (step S500, “Yes”), the management server 101 shifts the processing to step S501.

In step S501, the management server 101 acquires the contract information corresponding to the module ID included in the received search request from the contract information DB 16. In the next step S502, it is determined whether or not the application ID 3010 is registered in the contract information. When the management server 101 determines that the application ID 3010 is not registered in the contract information (step S502, “none”), the process proceeds to step S504. On the other hand, when the management server 101 determines that the application ID 3010 is registered in the contract information (step S502, “Yes”), the management server 101 shifts the processing to step S503.

In step S503, the management server 101 determines whether the application ID 3010 included in the contract information and the application ID 3010 included in the image search application 3001a installed in the search terminal 30 match. When the management server 101 determines that they do not match (step S503, “mismatch”), the management server 101 shifts the processing to step S507 and transmits an error notification indicating that the application IDs do not match to the search terminal 30.

On the other hand, when the management server 101 determines in step S503 that the application IDs match (step S503, “match”), the management server 101 shifts the processing to step S504.

In step S504, the management server 101 determines whether the current date is within the contract period based on the use start date and the use end date included in the contract information acquired in step S501. When the management server 101 determines that the current date is out of the contract period (step S504, “out of period”), the management server 101 shifts the processing to step S507, and notifies the search terminal 30 of an error notification indicating that the contract period is out of date. Send.

On the other hand, when the management server 101 determines in step S504 that the current date is within the contract period (step S504, “within period”), the process proceeds to step S505. In step S505, the management server 101 sets the search target of the search terminal 30 that has transmitted the search request to the public DB and sets the search target DB to the normal DB 111b based on the contract information corresponding to the module ID 3021 included in the search request. , And the dedicated DBs 110b ₁ , 110b ₂ ,... To switch between the switch units 121 and 120b. The search server 100 performs an image search on the selected search target DB. The search request may be passed from the management server 101 to the search server 100, or may be held in the switch unit 121, for example.

In the next step S506, the search server 100 notifies the search result transmitted to the search terminal 30 that has transmitted the search request, and terminates the search process corresponding to one search request from the search terminal 30.

In step S501, when the contract information corresponding to the module ID 3021 cannot be acquired from the contract information DB 16, the normal DB 111b can be set as the search target DB.

(Embodiment)
Next, an embodiment will be described. The embodiment relates to efficient operation of the above-described information processing system, and in particular, a service provider who provides a service by the image search system 10 and customers 43a, 43b,... A structure capable of increasing the height will be described.

FIG. 28 shows an example of the information processing system according to the embodiment including its peripheral configuration, and an example of the flow of processing in the information processing system will be described. In FIG. 28, portions common to those in FIGS. 1 and 3 described above are designated by the same reference numerals, and detailed description thereof will be omitted.

In FIG. 28, the providing service 1 schematically shows the service provided by the search service provider 602 that provides the image search service by the image search system described above. The providing service 1 includes an image search service by the image search system 10, a search module distribution service 600, and a medium generation service 601.

The image search system 10 includes the search server 100 and the registration server 104 as described above, and the registration server 104 is connected to the normal DB 111a and a plurality of dedicated DBs 110a ₁ , 110a ₂ ,. Further, the search server 100 is connected with a normal DB 111a and a normal DB 111b corresponding to the plurality of dedicated DBs 110a ₁ , 110a ₂ ,... And a plurality of dedicated DBs 110b ₁ , 110b ₂ ,.

The search module distribution service 600 is a module distribution that distributes image search modules (MDL) 3020 ₁ , 3020 ₂ , 3020 ₃ ,... Corresponding to the above-described image search module 3020, for example, by a system including one or more information processing devices. Function as a department. A unique module ID 3021 is given to each of the image search modules 3020 ₁ , 3020 ₂ , 3020 ₃ ,...

Further, the search module distribution service 600 distributes the image search application 610 incorporating the image search module 3020 by the system. The image search application 610 can be independently operated on, for example, an OS (Operating System) and can be generally used, and a fixed value is used as the module ID 3021. The image search application 610 may not include the module ID 3021.

The medium generation service 601 generates an advertising medium such as a poster or a magazine article using a print medium 810 from the provided content (image) by a system including one or more information processing devices and a printing device, for example. The medium generation service 601 is not limited to this, and may generate an advertisement medium by electronic medium 811 such as signage or image information on the Internet from the content.

Further, the providing service 1 includes the registration terminal 20a, and performs registration of the content (image) with respect to the registration server 104 in response to a request from the customer.

The flow of processing relating to the above-described providing service 1 will be described. On the customer side, the customer (for example, the customer 43a) prepares content (image) 720 to be used as an advertisement, and registers this content 720 in the registration server 104. The customer 43a can request the search service provider 602 to register the content 720 in the registration server 104, for example (step S1). In response to this request, the search service provider 602 uses the registration terminal 20a to register the content 720 in the registration server 104 (step S2).

The search service provider 602 can charge the customer 43a, for example, as a consideration for registering the content 720 in the registration server 104. Further, the search service provider 602 can charge the customer 43a for maintenance of the content 720 registered in the registration server 104, movement of the content 720 to the search server 100, and the like.

On the other hand, for example, the customer 43a receives the loan of the registration terminal 20b from the side of the providing service 1 and operates the loaned registration terminal 20b (step S3) to register the content 720 in the registration server 104 by itself. (Step S4). Not limited to this, the customer 43a receives the registration tool 21 provided from the providing service 1 side, introduces the registration tool 21 provided to the information processing apparatus that can be used by the customer 43a, and the registration tool 21 is introduced. Using the information processing device (step S3), the registration server of the content 720 can perform registration in 104 (step S4).

The search service provider 602 can charge the customer 43a for the loan of the registration terminal 20b and the provision of the registration tool 21 from the providing service 1 side to the customer 43a.

Further, the customer 43a can request the search service provider 602 to perform a process of generating an advertisement medium from the content 720. The search service provider 602 can charge for this request, and passes the content 720 to the medium generation service 601 in response to the request (step S5). The medium generation service 601 generates an advertisement medium as a print medium 810 or an electronic medium 811 based on the content 720 passed from the search service provider 602 (step S6).

However, the present invention is not limited to this, and the customer 43a can also request the medium generation service 620 outside the provision service 1 to generate the advertisement medium. In this case, the customer 43a passes the content 720 whose advertisement medium is desired to be generated to the medium generation service 620 outside the providing service 1 and requests the medium generation service 620 to generate the advertisement medium (step S7). The medium generation service 620 generates an advertisement medium (print medium 810, electronic medium 811, etc.) based on the content 720 in response to a request from the customer 43a (step S8).

Customers 43a and 43b are assumed to have customer side systems 700a and 700b, respectively. The customer-side systems 700a and 700b may be configured by connecting a plurality of information processing devices via a network, or may be configured by one information processing device.

For example, the customer-side system 700a receives the image search module 3020 ₁ distributed from the search module distribution service 600 of the providing service 1 (step S10), incorporates the received image search module 3020 ₁ into the application program of the customer 43a, A customer application 710a is generated as a customized application (step S11). Similarly, the customer system 700b, receives the search module distribution service 600 image retrieval module 3020 ₂ distributed by (step S12), the customize image retrieval module 3020 ₂ received, incorporated in customer 43b application program customers The application 710b is generated (step S13).

In the example of FIG. 28, the customer systems 700a and 700b upload the generated customer applications 710a and 710b, respectively, to the application server 800 (steps S20 and S21). In addition, the search module distribution service 600 uploads the image search application 610 to the application server 800 (step S22).

The general users 31a and 31b download the image search application 610 and the customer application 710 such as the customer applications 710a and 710b from the application server 800 to their own terminal devices (steps S23 and S24). The general users 31a and 31b then install the downloaded image search application 610 and customer application 710 in their respective terminal devices, so that the image search of the respective terminal devices can be performed using the search server 100. It can be used as the search terminals 30a and 30b.

For example, the print medium 810 is imaged using the search terminal 30a in which the customer application 710 is installed (step S30), and the captured image and the module ID included in the customer application 710 (for example, the customer application 710a by the customer 43a) are included. A search request is transmitted to the search server 100 (step S31).

In accordance with the search request transmitted from the search terminal 30a, the search server 100 selects a DB corresponding to the module ID included in the search request from the normal DB 111b and the dedicated DBs 110b ₁ , 110b ₂ ,... And searches for similar images. Then, as the search result, the cooperation information associated with the similar image is transmitted to the search terminal 30a. The customer 43a can receive the consideration depending on the reaction of the general user 31a to the cooperation information transmitted to the search terminal 30a.

Here, in the information processing system according to the embodiment, in the search module distribution service 600, the image search modules 3020 ₁ , 3020 ₂ , 3020 ₃ ,... Are given to the customer side systems 700a and 700b by assigning unique module IDs to them. It is distributed. The search server 100, the module ID is assigned, according to the module ID included in the transmitted search request, for example, from the image search module 3020 ₁ search terminal 30a of the image search application 610 is installed that contains, The search target DB is selected from the normal DB 111b and the dedicated DBs 110b ₁ , 110b ₂ ,....

According to such a configuration of the information processing system according to the embodiment, the customers 43a and 43b search for the DB in which the content 720 is registered by the search terminal among the normal DB 111b and the dedicated DBs 110b ₁ , 110b ₂ ,. 30a can be set as a search target. Therefore, in the image search based on the advertising medium generated from the content 720, the search result according to the advertising intention of the customers 43a and 43b can be more accurately obtained, and the consideration can be efficiently acquired by the customers 43a and 43b. ..

Further, the search module distribution service 600 can distribute a plurality of image search modules 3020 ₁ and 3020 ₂ having different module IDs to one customer system 700a. In this case, the customer 43a who operates the customer-side system 700a can perform an image search on the plurality of dedicated DBs 110b ₁ and 110b ₂ .

(Usage mode of the information processing system according to the embodiment)
Here, a usage pattern of the information processing system according to the embodiment will be considered. Customer 43a, 43b, by exchanging a search service provider 602 and a predetermined contract, usually DB111b, and, dedicated DB110b _1, 110b _2, ... registration of content 720 to, dedicated DB110b _1, 110b _2, ... use of , Image search modules 3020 ₁ , 3020 ₂ ,... Can be used.

Below, the usage pattern of the information processing system according to the contract format (contract format) will be described. Note that the contract form mentioned here relates to registration of the content 720 in the public DB (normal DB 111b and dedicated DBs 110b ₁ , 110b ₂ ,...) And use of the image search module 3020. Is different. Further, in the following description, unless otherwise stated, the customers 43a and 43b are represented by the customer 43a.

There are three possible contract types for the information processing system, which are the following first to third contract types.

(1) In the first contract form, registration of the content 720 in the public DB and use of the image search module 3020 are allowed, and the normal DB 111b and the dedicated DB 110b among the dedicated DBs 110b ₁ , 110b ₂ ,... It is a contract form in which ₁ , 110b ₂ ,... Can be used. In the first contract form, the customer 43a can register the content 720 in each of the dedicated DBs 110b ₁ , 110b ₂ ,... Further, for example, each module ID 3021 unique to each of the plurality of image search modules 3020 ₁ , 3020 ₂ ,... Is associated with each dedicated DB 110b ₁ , 110b ₂ ,.

(2) In the second contract form, the content 720 can be registered in the public DB and the image search module 3020 can be used, and the normal DB 111b and the special DBs 110b ₁ , 110b ₂ ,... It is a contract form that can be used only. In the second contract form, the customer 43a can register the content 720 only in the normal DB 111b. The module ID 3021 included in the image search module 3020 is associated with the normal DB 111b, for example.

(3) The third contract form is a contract form in which the content 720 cannot be registered in the public DB or is charged for each registration, and the image search module 3020 can be used. The third contract form is an example in which the customer 43a has not contracted with the search service provider 602. The image search module 3020 does not include the module ID 3021 or includes the module ID 3021 having a value indicating non-contract.

Next, an example of a usage pattern of the information processing system according to the embodiment based on the above-mentioned (1) first contract mode, (2) second contract mode, and (3) third contract mode will be described.

(Example of usage form according to the first contract form)
An example of (1) usage form in the first contract form will be described with reference to FIG. 29. 29, the same parts as those in FIG. 28 described above are designated by the same reference numerals, and detailed description thereof will be omitted.

In FIG. 29, the customer 43a is assumed to operate the websites 730a-a, 730a-b, and 730a-c on the Internet 51 by the customer-side system 700a. These websites 730a-a, 730a-b and 730a-c provide the users who have accessed the contents 731a-a, 731a-b and 731a-c, respectively.

Here, it is assumed that the customer 43a manages a music production having singer a, singer b, and singer c. The customer 43a causes fans of the singer a, the singer b, and the singer c to access the websites 730a-a, 730a-b, and 730a-c of the singer a, the singer b, and the singer c, respectively. Suppose that singer c wants to provide different contents 731a-a, 731a-b, and 731a-c, respectively.

The customer 43a has the private DBs 110a-a, 110a-b and 110a-c, which are private DBs, and the private DBs 110b-a, 110b-b and 110b, which are public DBs according to the contract of the first contract form. -C and are available. The customer 43a sends the advertising contents 720a-a, 720a-b and 720a-c corresponding to the singer a, singer b and singer c to the registration server 104, and the respective contents 720a-a, 720a-b and 720a-. The URLs of the respective websites 730a-a, 730a-b and 730a-c are associated with c as association information and registered in the dedicated DBs 110a-a, 110a-b and 110a-c.

The registered contents of the dedicated DBs 110a-a, 110a-b, and 110a-c are passed to the search server 100 at a predetermined timing, moved to the dedicated DBs 110b-a, 110b-b, and 110b-c, and made open.

Further, the customer 43a creates respective advertising media based on the contents 720a-a, 720a-b and 720a-c.

Furthermore, for the customer-side system 700a operated by the customer 43a, the module IDs 3021a-a and 3021a-corresponding to the dedicated DBs 110b-a, 110b-b and 110b-c, respectively, from the search module distribution service 600 (see FIG. 28). The image search modules 3020a-a, 3020a-b and 3020a-c including b and 3021a-c, respectively, are distributed. The customer 43a creates customer applications 710a-a, 710a-b, and 710a-c in which the image search modules 3020a-a, 3020a-b, and 3020a-c are incorporated by the customer-side system 700a. These customer applications 710a-a, 710a-b and 710a-c are customized applications for singer a, singer b and singer c, respectively.

The customer 43a sends the customer applications 710a-a, 710a-b, and 710a-c from the customer-side system 700a to the fans of the singer a, the singer b, and the singer c, respectively, via the application server 800 (see FIG. 28). To distribute. For example, the customer 43a distributes the customer application 710a-a for singer a to a general user 31a who is a fan of singer a, and the customer application 710a-b for singer b is a general user 31b who is a fan of singer b. Distribute to.

The general user 31a installs the distributed customer application 710a-a in the terminal device possessed by the general user 31a, for example. As a result, the terminal device becomes the search terminal 30a for performing the image search by the search server 100. Similarly, the general user 31b also installs the distributed customer application 710a-b on his/her own terminal device, and sets the terminal device as a search terminal 30b for performing image search by the search server 100.

For example, the general user 31a captures an image of the advertisement medium including the content 720a-a' related to the singer a by using the search terminal 30a (step S40). The search terminal 30a transmits a search request including the captured image including the content 720a-a' and the module ID 3021a-a included in the customer application 710a-a installed in the search terminal 30a to the search server 100 (step S41). ).

The search server 100 selects the corresponding dedicated DB 110b-a as the search target DB according to the module ID 3021a-a included in the search request, and searches for a similar image similar to the captured image. As a result, it is assumed that the registered content 720a-a is similar to the captured image, and the cooperation information associated with the content 720a-a, that is, the URL of the website 730a-a is transmitted to the search terminal 30a (step S42). .. Accordingly, the general user 31a can access the website 730a-a from the search terminal 30a and acquire the content 731a-a.

Similarly, for the search terminal 30b, a search request including the captured image and the module ID 3021a-b included in the customer application 710a-b installed in the search terminal 30b is transmitted to the search server 100. As a result, in the search server 100, the dedicated DB 110b-b corresponding to the module ID 3021a-b is selected as the search target DB, and as the search result, the registered content 720a-b is similar to the captured image, and the content 720a- The URL of the website 730a-b associated with b as the cooperation information is transmitted to the search terminal 30b. Accordingly, the general user 31b can access the websites 730a-b from the search terminal 30b and acquire the contents 731a-b.

As described above, according to the first contract mode, the customer application 710a including the plurality of module IDs 3021a-a, 3021a-b, and 3021a-c corresponding to the plurality of dedicated DBs 110b-a, 110b-b, and 110b-c, respectively. -A, 710a-b and 710a-c can be distributed to each general user 31a, 31b. Therefore, the general users 31a and 31b can respectively obtain desired contents 731a-a and 731a-b based on the captured image.

Further, in the first contract form, it is possible to specify each search terminal 30a, 30b by using the application ID 3010 uniquely given to each customer application 710a-a, 710a-b and 710a-c. Become. The search service provider 602 can also charge the customers 43a and 43b for the use of this application ID 3010.

(Example of usage form according to the second contract form)
An example of (2) usage form in the second contract form will be described with reference to FIG. In FIG. 30, parts common to those in FIG. 28 described above are denoted by the same reference numerals, and detailed description thereof will be omitted.

In FIG. 30, the customer 43b is assumed to operate an SNS (Social Networking Service) by the customer side system 700b or a separately provided system. The customer 43b prepares a customer application 710b as an application program corresponding to this SNS. Each member who participates in this SNS installs the customer application 710b in his/her own terminal device, and executes the installed customer application 710b on the terminal device. This allows each member to exchange messages and images between members on the SNS.

An example message display screen 7100 displayed on the terminal device by the customer application 710b is shown in the upper left of FIG. In this example, on the message display screen 7100, the messages 7101 ₁ , 7101 ₂ ,... And images 7102 ₁ , 7102 ₂ ,... Sent by members of the SNS are sequentially displayed in chronological order.

The customer 43b can use the normal DB 111a, which is a private DB, and the normal DB 111b, which is a public DB, according to the contract of the second contract form. The customer 43b sends the desired content 720b to the registration server 104, associates the URL of the website 710b operated by the customer 43b, for example, as cooperation information, and registers it in the normal DB 111a. The registered contents of the normal DB 111a are passed to the search server 100 at a predetermined timing, moved to the normal DB 111b, and made public.

The normal DB 111a is also used to register the contents 720c, 720d,... By other customers 43c, 43d,. The contents 720c, 720d,... Registered in the normal DB 111a are moved to the public DB 111b, which is a public DB, at a predetermined timing and made public. That is, in the normal DB 111b, not only the content 720b of the customer 43b but also the content 720c, 720d,... Of the other customers 43c, 43d,.

Further, the image retrieval module (MDL) 3020b including the module ID 3021b corresponding to the normal DB 111b is distributed from the retrieval module distribution service 600 (see FIG. 28) to the customer side system 700b operated by the customer 43b. The image search module 3020b is distributed as a plug-in program for the customer application 710b prepared by the customer 43b, for example, via the application server 800 (see FIG. 28), and is embedded in the customer application 710b and executed on the terminal device. It The terminal device possessed by the participating member 32, in which the customer application 710b is installed, becomes the search terminal 30c for performing the image search by the search server 100 by incorporating the image search module 3020b.

For example, the participating member 32 designates the image 7102 ₁ indicated by the dotted frame in FIG. 30 by a predetermined method on the message display screen 7100 displayed on the search terminal 30c by the customer application 710b. The customer application 710b passes the designated image 7102 ₁ to the image search module 3020b. The image search module 3020b transmits a search request including the passed image 7102 ₁ and the module ID 3021b included in the image search module 3020b to the search server 100 (step S50).

The search server 100 selects the normal DB 111b as the search target DB according to the module ID 3021b included in the search request, and searches for a similar image similar to the image 7102 ₁ . As a result, an image 7102 _1, when the content 720b customer 43b has registered are to be similar, the search server 100, link information associated with the content 720b, i.e., the URL of the Web site 710b, search It transmits to the terminal 30c (step S51). Thereby, the participating member 32 can access the website 710b from the search terminal 30c and acquire the content 731b provided by the website 710b, for example.

Of course, when the image 7102 ₁ is similar to the content 720c and content 720d other than the content 720b, the search server 100 transmits the link information associated with these content 720c and content 720d to the search terminal 30c.

In this way, the image search module 3020b can be used by incorporating it into a general-purpose application program such as an application program corresponding to SNS. In this case, a general-purpose application program that can incorporate the image search module 3020b is considered to have a higher added value than a non-embeddable general-purpose application program, and the customer 43b who provides the general-purpose application program that can incorporate the image search module 3020b is It is possible to raise the profit according to.

Further, the customer 43b associates the normal DB 111b with the module ID 3021b included in the image search module 3020b according to the second contract form. As a result, the participating member 32 acquires the cooperation information associated with the contents 720c, 720d,... Registered by the other customers 43c, 43d,... In addition to the cooperation information associated with the content 720b registered by the customer 43b. Therefore, it is possible to expect that the participating members 32 can enjoy the image search more.

(Example of usage form according to the third contract form)
Next, (3) an example of a usage form in the third contract form will be described. In the third contract form, as described above, the image search module 3020b is allowed to be used, and the content 720b cannot be registered in the public DB or is charged for each registration. This is because, for example, in the use form according to the second contract form described using FIG. 30, the customer 43b uses the image search module 3020b, that is, only incorporates the image search module 3020b into the customer application 710b, and the content It is possible to correspond to an example in which 720b is not registered in the registration server 104 or charging is performed for each registration.

Even in this case, the participating member 32 can perform an image search based on the image 7032 ₁ in the message display screen 7100 by the SNS displayed by the customer application 710b, and acquire the cooperation information as the search result. You can Further, the customer 43b can increase the profit according to the added value of the fact that the customer application 710b can incorporate the image search module 3020b.

The above-described embodiment is a preferred embodiment of the present invention, but the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.

1 Provided Service 10 Image Search System 20, 20a, 20b Registration Terminal 21 Registration Tool 30, 30a, 30b, 30c Search Terminal 40a, 40b Customer Terminal 43a, 43b, 43c, 43d Customer 100 Search Server 101 Management Server 104 Registration Server 110a ₁ , 110a ₂ , 110a ₃ , 110b ₁ , 110b ₂ , 110b ₃ dedicated DB
111a, 111b Normal DB
120a, 120b, 121 Switch section 600 Search module distribution services 601 and 620 Medium generation service 602 Search service provider 610 Image search application 700a and 700b Customer side systems 710, 710a, 710a-a, 710a-b, 710a-c and 710b Customer application 720, 720a-a, 720a-b, 720a-c, 731a-a, 731a-b, 731a-c Content 3001 Image search unit 3001a, 4001a Image search application 3010, 4010 Application ID
_{3020,3020 1, 3020 2, 3020 3} , 3020a-a, 3020a-b, 3020a-c, 3020b, 4020 image search module 3021,3021a, 3021a-a, 3021a- b, 3021a-c, 3021b, 4021 module ID
4030 type information

JP, 2014-010723, A

Claims (9)

From the database in which the searched image and the cooperation information are associated and registered, the searched image is searched based on the degree of similarity to the search target image according to the search request, and the cooperation associated with the searched searched image. An information processing system including an image search system for transmitting information to a sender of the search request, and a customer side system operated by a customer of the image search system,
The image search system,
A search module for causing the terminal device to execute the transmission of the search request, and a module distribution section for associating the module identification information for identifying the search module and distributing the search module to the customer system.
A search unit that executes the search on the database according to the module identification information included in the search request transmitted from the terminal device by executing the search module on the terminal device,
The module distribution unit
Distributing a plurality of the search modules respectively associated with different module identification information to the customer side system ,
The database is
A first database for performing a search corresponding to each of the plurality of module identification information, and a second database for performing a search common to the plurality of module identification information,
The search unit is
An information processing system for selecting which of the first database and the second database is to be searched based on the module identification information included in the search request . The search unit is
The search when the module identification information in the request is not included, the information processing system according to claim 1 to be searched for the second database. The customer side system is
The information processing system according to claim 1 or 2 comprising program distributing unit for distributing an application program created containing the search module and the module identification information distributed by the module distribution unit to the terminal device. The program distribution unit
The information processing system according to claim 3 , wherein the application program created so as to be independently executable is distributed to the terminal device. The program distribution unit
The information processing system according to claim 3 , wherein the application program created to be embedded in another application program and executed is distributed to the terminal device. The image search system,
The information processing system according to any one of claims 1 to 5 , further comprising a medium generation unit that generates a medium for presenting an image including the searched image. The image search system,
Further comprising a registration unit for registering the searched image and the cooperation information in the database,
The registration unit is
The information processing system according to any one of claims 1 to 6 , which is available from the customer side system. From the database in which the searched image and the cooperation information are associated and registered, the searched image is searched based on the degree of similarity to the search target image according to the search request, and the cooperation associated with the searched searched image. An information processing method of an information processing system including an image search system including an image search device that transmits information to a transmission source of the search request, and a customer side system operated by a customer of the image search system,
A module distribution step of associating a search module for causing the terminal device to execute the transmission of the search request and module identification information for identifying the search module, and distributing the module to the customer side system;
A search step of executing the search for the database according to the module identification information included in the search request transmitted from the terminal device by executing the search module on the terminal device;
Equipped with
The module distribution step is
Distributing a plurality of the search modules respectively associated with different module identification information to the customer side system ,
The database is
A first database for performing a search corresponding to each of the plurality of module identification information, and a second database for performing a search common to the plurality of module identification information,
The search step is
An information processing method for selecting which of the first database and the second database is to be searched based on the module identification information included in the search request . According to the search request transmitted from the terminal device in which the application program distributed by the customer side system is installed, the target image is searched from the database in which the searched image and the cooperation information are associated and registered, and based on the similarity to the searched image. An image search system comprising one or more information processing devices for searching a search image and transmitting the cooperation information associated with the searched search image to the terminal device,
A search module for causing the terminal device to execute the transmission of the search request, and a module distribution unit for associating the module identification information for identifying the search module and distributing the search module to the customer system.
A search unit that executes the search for the database according to the module identification information included in the search request transmitted from the terminal device by executing the application program including the search module on the terminal device. With and
The module distribution unit
Distributing a plurality of the search modules respectively associated with different module identification information to the customer side system ,
The database is
A first database for performing a search corresponding to each of the plurality of module identification information, and a second database for performing a search common to the plurality of module identification information,
The search unit is
An image search system for selecting which of the first database and the second database is to be searched based on the module identification information included in the search request .

Images