JP2011129146A - Information search system for automatically searching information on network, information search device, information search method, recording medium and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To search information disclosed on a network in real time. <P>SOLUTION: A search server SS is configured to collect information actually disclosed at sites on the network NW by a site data acquisition unit 45, to temporarily store the information in an internal RAM 23, to select, based on a search condition designated by search object information related to a registered search request, the collected and temporarily stored information by a determination processing unit 47, and to store only the selected information in a site data storage unit 48 constituted by an external storage device 24. Accordingly to this, when a search is requested, the information actually disclosed at sites on the network can be searched, and processing related to the search is executed in a state where the information acquired from the sites is developed in the RAM 23, whereby search processing can be performed at high speed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an information search system, an information search apparatus, an information search method, a recording medium, and a program for automatically searching for information on a network, and more particularly to a search technique for information published on a network such as the Internet.

  In recent years, with the spread of networks such as the Internet, the number of websites and the like has increased, and various information has been released through the networks. There are a wide variety of websites on the network, and there is an information search system called a search engine as an information search system for searching for desired information from a vast amount of information published by these websites.

  In a conventional information retrieval system, a server visits a website on a network by software (application software) and collects information (data) and writes the collected information to a hard disk such as a data center. As a result, information published on each website is stored and accumulated in the hard disk on the server side (system operation side) constituting the information search system.

  When a search condition such as a keyword is input from a user using the system and a search for information is requested, the server (more specifically, the server CPU) searches the hard disk in which the information is stored and stored according to the search condition. Search for. Specifically, based on the search condition input from the user side, the information stored in the hard disk is selected and searched. The server returns the search result to the user as a response to the search request.

  However, a conventional information retrieval system requires a great amount of time to collect information published on each website on the network and store it on the hard disk. It may take one month to make a round after collecting and accumulating. Therefore, even if the information published on the website is updated (changed, added, deleted, etc.), the updated contents are hardly reflected immediately in the information stored on the hard disk. It takes time to

  Therefore, the search result returned to the user in the conventional information search system is based on information stored in the hard disk that does not necessarily match the latest information that is actually published on each website at the time of the search request. . That is, the search result is not based on the latest information actually disclosed at the time of the search request, but based on the information disclosed at the time of collecting the past information.

  The present invention has been made in view of such circumstances, and an object thereof is to make it possible to search information published on a network in real time.

An information retrieval system of the present invention is an information retrieval system for retrieving information published on a network based on an information retrieval request, and acquires information published on a site on the network to obtain a semiconductor memory An acquisition unit stored in the apparatus; a determination unit that determines whether to store the information based on a search condition specified by the search target information related to the search request and information stored in the semiconductor memory device; And a storage means for storing information held in the semiconductor storage device in the magnetic storage device in accordance with a determination result in the determination means.
An information search apparatus according to the present invention is an information search apparatus for searching for information published on a network, and obtains information published on a site on the network and stores it in a semiconductor storage device; A determination unit that determines whether or not to save the information based on a search condition specified by the search target information related to the information search request and the information held in the semiconductor memory device; and a determination by the determination unit According to a result, the information processing apparatus includes storage means for storing information held in the semiconductor storage device in the magnetic storage device.
The information search apparatus of the present invention is an information search apparatus that searches information according to an information search request from a user from information published on a network, and the search related to the information search request Information registration means for registering and storing target information; acquisition means for acquiring information published on a site on the network and storing it in a semiconductor storage device; search conditions specified by the stored search target information; and The information stored in the semiconductor memory device is collated with information stored in the semiconductor memory device as a result of the determination performed by the information stored in the semiconductor memory device to determine whether the information satisfies the search condition. Storage means for storing the information in the magnetic storage device and information held in the semiconductor storage device is stored in the magnetic storage device when the search condition is satisfied. As a condition, and an outputting means for outputting the search result information for the information retrieval request.
The information search device of the present invention is an information search device for searching information published on the network, and includes information registration means for registering and storing search target information related to the information to be searched, Based on the acquisition means that automatically circulates the site, acquires the information published in each site and holds it in the semiconductor memory device, the stored search target information and the information held in the semiconductor memory device, The determination means for determining the risk level of the site that publishes the information, and if the risk level of the site is within a predetermined range as a result of the determination, the information is stored in the site information of the site and the semiconductor storage device. Storage means for storing the stored information in a magnetic storage device, and output means for outputting search result information relating to the determination result.
The information search method of the present invention is an information search method for searching information published on the network, and includes an information registration step for registering and storing search target information related to information to be searched, and a site on the network. Based on the acquisition process of acquiring public information and holding it in the semiconductor memory device, the search condition specified by the search target information stored in the information registration process, and the information held in the semiconductor memory device, The method includes a determination step for determining whether or not to save information, and a storage step for storing information held in the semiconductor storage device in the magnetic storage device in accordance with a result of the determination.
The program of the present invention is a program for performing a search process of information published on a network, and registers and stores search target information related to information to be searched, and a site on the network. Based on the acquisition step of acquiring public information and holding it in the semiconductor memory device, the search condition specified by the search target information stored in the information registration step, and the information held in the semiconductor memory device, Causing a computer to execute a determination step of determining whether or not to save information, and a storage step of storing information held in the semiconductor storage device in the magnetic storage device according to a result of the determination step It is characterized by.
The computer-readable recording medium of the present invention records the above program.

  According to the present invention, based on a search request for information, information published on a site on a network is acquired, held in a semiconductor storage device, and it is determined whether or not to store the information, and the determination result Accordingly, the information stored in the semiconductor memory device is stored in the magnetic memory device. As a result, it is possible to search for information that is actually disclosed at a site on the network at the time of a search request, and to store the acquired information in a semiconductor memory device and execute the actual processing related to the search at high speed. Search processing can be performed. Therefore, information published on the network can be searched in real time, and optimum information based on the latest information can be provided as a search result.

It is a block diagram which shows the example of 1 structure of the information search system by embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of a search server. It is a block diagram which shows an example of the hardware constitutions of a user terminal. It is a block diagram which shows an example of a functional structure of a search server. It is a flowchart which shows operation | movement of the information search system by this embodiment. It is a flowchart which shows operation | movement of the real-time search system to which the information search system by this embodiment is applied. It is a figure which shows an example of the screen display in a real-time search system. It is a block diagram which shows the functional structure of the net patrol system to which the information search system by this embodiment is applied. It is a flowchart which shows the operation | movement of the search process in a net patrol system. It is a flowchart which shows the operation | movement of the monitoring process in a net patrol system.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration example of an information search system according to an embodiment of the present invention.
In FIG. 1, SSi is a server (search server), PCj is a user terminal, and WSAk and WSBl are web servers. Here, “i”, “j”, “k”, and “l” in each code are subscripts and are arbitrary natural numbers. That is, in FIG. 1, three search servers SS1 to SS3, two user terminals PC1 and PC2, and four web servers WSA1, WSA2, WSB1, and WSB2 are illustrated, but not limited thereto. The number of search servers, user terminals, and web servers is arbitrary.

  The search server SSi, the user terminal PCj, and the web servers WSAk and WSBl are connected to each other through a network NW such as the Internet so that they can communicate with each other via a network interface provided therein. Although not shown, the search server SSi and the user terminal PCj may be connected so as to be able to communicate with each other via an individual line.

  The search server SSi searches information published on the sites provided by the web servers WSAk and WSBl based on a search request for information from the user terminal PCj. The search server SSi returns a search result in response to a request from the user terminal PCj.

  The user terminal PCj is for a user to request a search for information from the search server SSi or to display a search result supplied from the search server SSi. The web servers WSAk and WSBl provide sites on the network NW, and provide information published on the sites in response to external requests via the network NW.

  As will be described later, when a plurality of search servers SSi are provided in the information search system according to the present embodiment, the search servers SSi mutually exchange information related to information search requests from the user terminal PCj. , Search for different sites. That is, each search server SSi shares information related to the search request and divides the search range (separates search sites of each search server SSi) and performs a search. In addition, information on the search result is also exchanged and reflected between the search servers SSi. In this way, the information related to the search request and the search result are shared by the search server SS, and the search for a plurality of sites on the network NW is divided and performed in parallel by each search server SS. Can be distributed and reduced, and the search process can be performed at high speed.

  For example, the search server SS1 searches a site provided by each web server WSAK of the web server group SGA, and the search server SS2 searches for a site provided by each web server WSBl of the web server group SGB. I do. Similarly, other search servers also perform searches so that search target sites are different from each other.

  A plurality of search servers SSi controls the search server SSi in a centralized manner, and distributes information related to information search requests to the search server SSi on the controlled side. The retrieved search results may be collected, distributed to other search servers SSi, and reflected.

FIG. 2 is a block diagram illustrating a hardware configuration example of the search server SS in the present embodiment.
As shown in FIG. 2, the search server SS includes a CPU 21, a ROM (read only memory) 22, a RAM 23, an external storage device 24 such as a hard disk, and a network interface 25. In FIG. 2, the configuration of the search server SS is illustrated so that the flow of data in the search processing in the present embodiment, which will be described in detail later, is easy to understand, but the CPU 21, ROM 22, RAM 23, external storage device 24, The network interface 25 is connected to be communicable with each other via a bus (not shown). The address signals, control signals, and various data are transferred between the various components (devices) connected to the bus via this bus.

  The CPU 21 comprehensively controls various components in the search server SS in order to transmit / receive data, combine data, compare and collate data, and the like. This control is performed in advance by storing the control procedure (computer program, software) of the CPU 21 in the ROM 22 (or the external storage device 24), and this control procedure is executed by the CPU 21 to transfer and combine data. It is possible to execute processing such as comparison and verification.

  The RAM 23 is used as a work memory for data transmission / reception, combination, comparison, comparison, etc., and temporary storage for control of various components. Further, in the search process in the present embodiment, when the information published on the site on the network NW is acquired, the acquired information is temporarily stored in the RAM 23.

  In the present embodiment, functions such as an acquisition unit, a determination unit, and a storage unit of the present invention are realized by a program stored in the CPU 21 and the ROM 22 (or the external storage device 24).

  The external storage device 24 is a storage magnetic storage device such as a hard disk. The network interface 25 connects the search server SSi and the network NW and exchanges data with other devices connected to the network NW.

FIG. 3 is a block diagram illustrating a hardware configuration example of each user terminal PCj in the present embodiment.
As shown in FIG. 3, the user terminal PCj includes a CPU 31, a ROM (Read Only Memory) 32, a RAM 33, an external storage device 34 such as a hard disk, a network interface 35, an input device 36, and an output device 37. However, they are configured to be communicably connected to each other via a bus 38. Via this bus 38, address signals, control signals, and various data are transferred between the various components (devices) connected to the bus 38.

  The CPU 31 controls various components connected via the bus 38 in order to input / output data and transmit / receive data. When the CPU 31 executes a control procedure (computer program) stored in advance in the ROM 32, processing such as data input / output and data transmission / reception can be executed. The control procedure (computer program) may be stored in advance in the external storage device 34 such as a hard disk and executed. The RAM 33 is used as a work memory for data input / output, transmission / reception, and temporary storage for control of various components. When the control procedure (computer program) of the CPU 31 is stored in the ROM 32, the program may be loaded from the ROM 32 to the RAM 33 and the program loaded in the RAM 33 may be executed.

The external storage device 34 is a storage external storage device such as a hard disk. The network interface 35 connects each user terminal PCj and the network NW in order to exchange data with other devices connected to the network NW. The input device 36 is an input device such as a keyboard or a mouse, and is used for a user to input search target information related to an information search request. The output device 37 is an output device such as a display, for example, and is used to display a search target information input screen or a search result display screen.
Note that the configuration of the web servers WSAk and WSB1 is the same as that of a known web server, and thus the description thereof is omitted.

  FIG. 4 is a functional block diagram showing a functional configuration of the search server SS in the present embodiment, and each functional unit in the search server SS is comprehensively controlled by the control unit 41.

  The information registration unit 42 includes a registration information setting unit 43 and a registration information storage unit 44, and registers and stores search target information related to a search request for information from the user terminal PCj supplied via the network NW. Here, the search target information indicates a search condition for searching information published on a site on the network NW, and includes a keyword used for the search. Further, as the search target information, for example, other information such as a site to be searched or a site to be preferentially searched may be included.

  The registration information setting unit 43 receives search target information from the user terminal PCj or collects the search target information and supplies the search target information to the registration information storage unit 44. Further, the registration information storage unit 44 stores supplied search target information.

  The site data acquisition unit 45 corresponds to a so-called crawler (also called a robot or a spider), and automatically circulates the sites on the network NW to collect data of the contents constituting the sites and is released on the sites. Get information. Further, the site data acquisition unit 45 temporarily holds the acquired information. The storage area of the RAM 23 shown in FIG. 2 is used for temporary storage of the acquired information.

  Further, the site data acquisition unit 45 includes an optimization processing unit 46. The optimization processing unit 46 optimizes the patrol order and the patrol range of the site when acquiring public information. The site data acquisition unit 45 circulates the sites on the network NW according to the circulation order and the circulation range of the sites optimized by the optimization processing unit 46.

  Here, the optimization processing unit 46 has a learning function, and based on at least one of search target information stored in the registration information storage unit 44 and a determination result in a determination processing unit 47 described later, the network NW Prioritize the top sites and change the site's order and range. For example, when the search target information stored in the registered information storage unit 44 specifies a site to be searched or a site to be searched preferentially, the information published on the specified site is displayed as the site. The optimization processing unit 46 increases the priority (cyclic order) of the designated site so that the data acquisition unit 45 acquires the highest priority. Also, for example, the frequency of updating the information published on the site is increased by giving higher priority to the site that has a higher frequency of updating information published than other sites so that new information can be easily obtained. The priority (cyclic order) may be changed according to the above.

  The determination processing unit 47 acquires from the site based on the information that the site data acquisition unit 45 acquires from the site and temporarily holds and the search conditions specified by the search target information stored in the registration information storage unit 44. It is determined whether the selected information satisfies a search condition specified by the user. As a result of the determination, when the information acquired from the site satisfies the search condition (for example, the number of matches with the keyword included in the search target information is a predetermined number or more), the site data acquisition unit 45 temporarily holds the information. The information is stored in the site data storage unit 48. If not, the information temporarily stored in the site data acquisition unit 45 is discarded without being stored.

In other words, the determination processing unit 47 is based on the information acquired by the site data acquisition unit 45 from the site and temporarily held, and the search condition specified by the search target information stored in the registration information storage unit 44. It is determined whether or not the information temporarily stored in the site data acquisition unit 45 is stored in the site data storage unit 48. Further, the determination processing unit 47 causes the site data storage unit 48 to store the information temporarily held by the site data acquisition unit 45 according to the determination result.
The site data storage unit 48 is configured using the external storage device 24 shown in FIG.

  Note that the determination processing in the determination processing unit 47 may be performed in units of sites or may be performed in units of pages constituting the site. Further, in the determination process in the determination processing unit 47, a keyword or the like included in the search target information is weighted to determine whether or not the information acquired from the site is stored in the site data storage unit 48. good.

  The result processing unit 49 generates search result information based on the determination result in the determination processing unit 47 and information published on the site stored in the site data storage unit 48. The generated search result information is output as a response to the information search request from the user.

  The information exchange processing unit 50 transmits / receives information related to the search processing to / from other search servers SS in order to mutually reflect and share information related to the search processing possessed by each search server SS. Specifically, the information exchange processing unit 50 relates to a search process including the search target information stored in the registration information storage unit 44, the determination result in the determination processing unit 47, and the information stored in the site data storage unit 48. Information is exchanged with other search servers SS.

  In the present embodiment, the search server SS has a search engine (site data acquisition unit 45, determination processing unit 47, etc.), and information related to the search (information related to the search request and information related to the search result) is stored in the search server. The SSs are mutually exchanged and shared. However, the present invention is not limited to this. A search engine is installed in each user terminal PC, and information related to the search between the user terminal PCs is mutually exchanged in a peer-to-peer type communication form. The information search system may be configured so as to be exchanged and shared.

Next, the operation will be described.
FIG. 5 is a flowchart showing the search processing operation of the information search system according to this embodiment.

  First, in step S1, the registration information setting unit 43 in the information registration unit 42 obtains search target information related to a search request from the user terminal PCj, and the obtained search target information is stored in the registration information storage unit 44. Registered and memorized. When the information search system is configured by a plurality of search servers SSi, in addition to the above processing, the information to be searched stored in the registration information storage unit 44 is further updated by the information exchange processing unit 50 in step S1. The information is transmitted to all other search servers SSi, and the search target information is shared by all the search servers SSi constituting the information search system.

  Next, in step S2, the site data acquisition unit 45 accesses the site on the network according to the cyclic order and the cyclic range determined by the internal optimization processing unit 46, and collects the data of the contents constituting the site. Hold. As a result, information published at a certain site on the network is acquired, and stored and held in the RAM 23 in the search server SSi.

  In step S3, the determination processing unit 47 refers to the search condition specified by the search target information registered in step S1, and the content data acquired and held by the site data acquisition unit 45 from the site in step S2 is stored in the site. It is determined whether or not to save in the data storage unit 48.

As a result of the determination, if it is determined that the content data is to be stored in the site data storage unit 48 (YES in step S4), the content data held by the site data acquisition unit 45 is stored in the site data storage in step S5. It is written and stored in the unit 48. On the other hand, as a result of the determination, if it is determined that the content data is not stored in the site data storage unit 48 (NO in step S4), step S5 is skipped.
Thereafter, in step S6, the above-described steps S2 to S5 are repeated until the control unit 41 determines that the search result is output in response to the search request from the user.

  When the control unit 41 determines in step S6 that a search result is output in response to a search request from the user (YES in step S6), the result processing unit 49 performs a result process in step S7. In this result processing, search result information to be output as a response to the user terminal PCj is generated based on the determination result of the determination processing unit 47 and the content data stored in the site data storage unit 48.

  Next, in step S8, the result processing unit 49 outputs the search result information generated in step S7 to the user terminal PCj via the network NW and ends the process. In the present embodiment, the search result information is output to the user terminal PCj and the processing is terminated. You may make it complete | finish a process. In this case, for example, search result information that has been prepared for output to the user terminal PCj is stored in a predetermined storage unit, and the search result information is provided in response to a result output request from the user. You can do it.

  As described above, according to the present embodiment, when searching for information published on a site on a network, a search is not performed based on information collected and accumulated in advance as in the past, but a user is searched. After the search request is made from the side and the information registration unit 42 registers and stores the search target information related to the search request, the information published on the site on the network is collected by the site data acquisition unit 45 to search for information I do.

  In the search for this information, first, the site data acquisition unit 45 collects information currently disclosed on the site and temporarily stores it in the RAM 23 in the search server SS. Whether the determination processing unit 47 stores the information temporarily stored in the RAM 23 in the site data storage unit 48 configured by the external storage device 24 based on the search target information registered and stored in the information registration unit 42. Determine whether. As a result of the determination, when the information temporarily stored in the RAM 23 satisfies the search condition specified by the search target information, the information temporarily stored in the RAM 23 is written in the site data storage unit 48 that is the external storage device 24. Otherwise, it is discarded.

  In other words, in the information search system according to the present embodiment, when searching for information, after receiving a search request from the user side, the information that is actually made public on the site is collected, specified by the user side and determined in advance. Select information collected based on search conditions (keywords, etc.). This processing is not performed by storing all of the collected information in the external storage device 24 as in the prior art, but is performed by expanding the collected information in the RAM 23 in the search server SS and storing only the selected information in the external storage. Write to the device 24 and save.

As a result, it is possible to search for information that is actually disclosed on a site on the network at the time of a search request, and since the actual processing related to the search is executed using the CPU 21 and the RAM 23 in the search server SS, it is possible to search at high speed. Search processing can be performed. Therefore, information published on the network can be searched in real time, and optimum information based on the latest information can be provided as a search result.
Further, based on the search target information and the determination result in the determination processing unit 47, the traveling order and the traveling range of the site from which the information published by the optimization processing unit 46 having a learning function is optimized are optimized, and the information By performing a search, the search process can be performed efficiently.

  In this optimization process, keyword classification may be performed using Bayesian theory based on search results obtained by searching information published on a site on the network, and used for subsequent determination or the like. . For a site that falls within the search result, the search interval may be adjusted from the next time, and the search may be concentrated on the site.

  Next, a real-time search system and a net patrol system will be described as examples of a specific system to which the information search system according to the present embodiment is applied.

(Real-time search system)
First, a real-time search system will be described. The real-time search system described below performs real-time matching processing between search target information related to registered search requests and results (information published on the site) obtained by visiting sites on the network. Thus, the latest and optimum information that is actually disclosed on the site on the network is provided to the registrant of the search target information (the person who made the search request).

FIG. 6 is a flowchart showing the operation of the real-time search system to which the information search system according to this embodiment is applied.
First, in step S11, the information registration unit 42 collects search target information related to a search request from the user terminal PC, and registers and stores the collected search target information. When the real-time search system is configured by a plurality of search servers SS, the search target information is shared by all the search servers SS in the same manner as the operation shown in FIG.

  Here, the search target information is collected by providing an information registration site on the search server SS side to display an information registration screen as shown in FIG. 7A on the output device 37 of the user terminal PC. Then, the user inputs search object information (for example, a preference, a region, a keyword for specifying information to be obtained, etc.) using the input device 36 or the like, and the search server SS circulates and enters the information registration site. This is done by collecting the search target information. The search target information may be transmitted from the user terminal PC to the search server SS. Further, for example, when making it possible for other users to browse an information registration site for a certain user, the search server SS can divide the search target information into public information that may be disclosed and private information that is not. Information may be collected by itself, and non-public information may be transmitted from the user terminal PC.

  Next, in step S12, the site data acquisition unit 45 accesses the site on the network NW according to the cyclic order and the cyclic range optimized by the optimization processing unit 46, and collects and holds content data. As a result, information published on the site on the network NW is acquired, and stored and held in the RAM 23 in the search server SS.

Subsequently, in step S13, the determination processing unit 47 matches the search condition specified by the search target information registered in step S11 with the content data acquired and held from the site on the network NW in step S12. Perform processing (collation).
As a result, if the search condition specified by the search target information and the content data acquired and held from the site do not satisfy a predetermined condition (for example, the degree of matching is not less than a predetermined level), the content data is discarded. Then, it determines (NO of step S14) and returns to step S12 mentioned above.

  On the other hand, as a result of the matching process in step S13, if the search condition specified by the search target information and the content data acquired and held from the site satisfy a predetermined condition, the content data is stored in the site data storage unit. In step S15, the content data stored in the site data acquisition unit 45 is written and stored in the site data storage unit 48.

  In this way, when the content data acquired from the site and stored in the site data acquisition unit 45 is stored in the site data storage unit 48, the result processing unit 49 of the determination processing unit 47 in step S16. Based on the determination result and content data stored in the site data storage unit 48, search result information to be provided to the user is generated.

In step S17, the result processing unit 49 notifies the user of the search result by outputting the search result information generated in step S16 to the user terminal PC via the network NW. The information notified to the user as a search result includes the URL of the site where the information is disclosed, the data of the content, the date of discovery of the site, and the like.
Here, any notification method can be applied to notify the search result to the user. For example, as shown in FIG. 7B, an image 71 showing the search result is popped up on the screen displayed on the user terminal PC. You may make it display. Further, the user may be notified of the search result by e-mail, electronic message or the like.

  As described above, by applying the information search system according to the present embodiment, the search target information from the registered user side, and the information published on the site obtained by automatically visiting the site on the network, By performing the matching process in real time, it is possible to search for information that is actually disclosed on the site on the network at high speed, and to provide the latest and optimum information to the registrant of the search target information.

  Further, in the above-described real-time search system, matching processing between demand information and supply information, that is, search for public information that establishes a supply-demand relationship between search target information may be performed. Here, the demand information and the supply information include recruitment / application information, sales information, and the like. For example, when recruitment information is registered as search target information, job information that matches (matches) the recruitment information is retrieved and collected. Further, for example, when job posting information is registered as search target information, recruitment information that matches the job posting information is searched and collected. At this time, even for similar items such as “name”, “name”, “name”, etc., the item names may differ depending on the site. It is desirable to perform synonym unification processing that is handled as the same term (for example, all “names” in the above-described example) as necessary.

(Net patrol system)
Next, the net patrol system will be described. The net patrol system described below uses the information search system according to the present embodiment capable of searching information published on a site on the network NW in real time, and automatically patrols the site on the network NW (for example, the Internet). In order to search and track unauthorized content scattered in real time, the results are provided to the user as appropriate. For example, it is suitable for use in a system for monitoring sites (contents) that are disadvantageous to the user, such as illegal exhibition at an auction site on the network NW and copyright infringement by using copyright images / videos on personal sites. is there.

  Note that the hardware configuration of the system server SS in the net patrol system to which the information search system according to the present embodiment is applied is the same as that of the search server SS shown in FIG.

  FIG. 8 is a functional block diagram showing a functional configuration of the system server SS in the net patrol system to which the information search system according to the present embodiment is applied. In FIG. 8, blocks having the same functions as those shown in FIG. 4 are denoted by the same reference numerals, and redundant description is omitted. Although the functions are not the same, the risk determination processing unit 81 shown in FIG. 8 corresponds to the determination processing unit 47 shown in FIG. Further, the site data storage unit 83 and the result processing unit 86 shown in FIG. 8 respectively correspond to the site data storage unit 48 and the result processing unit 49 shown in FIG.

  The risk determination processing unit 81 includes a determination condition storage unit 82, and the search target information stored in the registration information storage unit 44 and the site data acquisition unit 45 circulates a site on the network NW automatically. Based on the acquired and temporarily stored information, the risk level of the site that publishes the temporarily stored information is determined.

  Specifically, the degree-of-risk determination processing unit 81 obtains the degree of risk of the site that publishes the temporarily held information from the search target information and the information temporarily held by the site data acquisition unit 45. Further, the risk level determination processing unit 81 determines whether or not the calculated site risk level is within a predetermined range set in advance as a determination condition in the determination condition storage unit 82. It is determined whether or not there is. The determination of the degree of risk may be made by determining whether or not it is dangerous alternatively by setting a certain threshold value, or setting a plurality of different threshold values, etc. Therefore, the degree of danger may be determined by ranking the risk into a plurality of ranks.

The site data storage unit 83 is configured using the external storage device 24 illustrated in FIG. 2 and includes a monitoring target database (monitoring target DB) 84.
The monitoring target DB 84 includes monitoring target data of sites determined to be dangerous by the risk determination processing unit 81 (HTML data and various files of content published on the site temporarily held by the site data acquisition unit 45, and This is a database for storing URLs related to the site and site information such as discovery date and time. The monitoring target data stored in the monitoring target DB 84 includes, for example, content data including the URL, title, HTML data and various files of the site, owner, discovery date / time, risk level, date / time, status , Whether or not a page exists, a keyword, and information such as a survey object are included.

  The result processing unit 86 includes a warning processing unit 87 and a result information output unit 88, and is based on the determination result in the risk determination processing unit 81 and information published on the site stored in the site data storage unit 83. Then, predetermined result processing is performed.

  The warning processing unit 87 issues a warning notification to the dangerous site based on the determination result in the risk determination processing unit 81 and the information published on the site stored in the site data storage unit 83. For example, the warning processor 87 configures a site determined to be dangerous by the risk determination processor 81, and the mail of the administrator of the site or the like from the content data stored in the site data storage unit 83. The address is extracted, and a warning mail is sent to the extracted mail address. Whether or not to issue a warning notification to a dangerous site by the warning processing unit 87 can be arbitrarily set for each site by an operator of the net patrol system or a user who requests monitoring.

  The result information output unit 88 generates search result information based on the determination result in the risk determination processing unit 81 and information published on the site stored in the site data storage unit 83, and the generated search result information To the user. The search result information includes information on the monitoring target data of the site determined to be dangerous by the risk determination processing unit 81. Further, the search result information may include information such as the status (state) of the site determined to be dangerous, and the presence or absence of a response to the notification when a warning notification is given to the dangerous site. .

Next, the operation of the net patrol system will be described.
FIG. 9 is a flowchart showing the search processing operation in the net patrol system.

  First, in step S21, the information registration unit 42 obtains search target information related to a search request from the user terminal PC (the user who requests monitoring), and registers and stores the obtained search target information. When a plurality of system servers SS are provided, search target information to be registered is transmitted and received between the system servers SS, and the search target information is shared by all the system servers SS.

  Here, for example, the search target information includes a keyword, a monitoring site (a site set in advance as a target for collecting and acquiring information), a search target file setting, a warning notification sender email address, a transmission server setting, a survey target, This includes the patrol (search) start date, risk judgment conditions, and the like. Note that the present invention is not limited to this, and the items and contents of the search target information are arbitrary.

  Moreover, the keywords included in the search target information may be divided into a plurality of types. In this example, the keyword is “default keyword” as a keyword representing illegal words (recalling illegal things), “target keyword” as a keyword for each target object, and keyword that can be set for each genre of target object Are divided into four types: “sub-keywords” and “category keywords” as status keywords. When the keywords are divided into a plurality of types as described above, the risk determination processing described later may be performed by weighting each keyword type.

  Next, in step S22, the site data acquisition unit 45 accesses a site on the network NW and collects and holds data of contents constituting the site. As a result, information published at a site on the network is acquired, and stored and held in the RAM 23 in the system server SS. Here, as a method for acquiring information published on the site in the net patrol system, the first method for acquiring information from a site preset in advance by the monitoring site of the search target information and the optimization processing unit 46 There is a second method in which information is acquired by automatically visiting sites on the network NW according to an optimized tour order and tour range. The first method and the second method may be appropriately switched over time, or may be executed in parallel by a plurality of system servers SS.

  Subsequently, in step S23, the risk determination processing unit 81, based on the search target information registered in step S11 and the content data of the site held in the site data acquisition unit 45 in step S2, Find the risk. Further, the risk level determination processing unit 81 compares the calculated risk level of the site with the determination condition input as the risk level determination condition of the search target information and set in the determination condition storage unit 82, and the risk level of the site. Determine.

  As a result of the determination, if it is determined that the site where the content data is stored in the site data acquisition unit 45 is dangerous (YES in step S24), the site data acquisition unit 45 stores it in step S25. Monitoring target data including the content data being stored is stored in the monitoring target DB 84 of the site data storage unit 83.

On the other hand, as a result of the risk determination process in step S23, if it is determined that the site is not a dangerous site (NO in step S24), the data held in the site data acquisition unit 45 is discarded and the process returns to step S22. .
Note that the above-described risk determination may be performed in units of content constituting the site, or a plurality of linked contents may be performed as one unit.

Next, in step S26, the control unit 41 confirms whether or not there is a result output request from the user who has requested monitoring, and if there is a result output request from the user, the process proceeds to step S27. If there is no, the process returns to step S22.
In step S27, the result information output unit 88 performs an aggregation process related to the search result based on the determination result in the risk determination processing unit 81 and the information published on the site stored in the site data storage unit 83. To generate search result information. In step S28, the result information output unit 88 provides the search result information generated in step S27 to the user and returns to step S22.

  On the user side that has received the search result information output from the result information output unit 88 in the system server SS, the search / monitoring result is confirmed by displaying the search result information on the screen of the output device 37 provided in the user terminal PC. it can. The search result display form that can be displayed on the output device 37 of the user terminal PC based on the search result information output from the system server SS includes, for example, a list display of sites (pages) determined to be dangerous, There are detailed display of the site (page), narrowed display that narrows down the items of information to be displayed, and the like.

  FIG. 10 is a flowchart showing the operation of the monitoring process in the net patrol system. This monitoring process is a process that is executed after the risk determination processing unit 81 determines that the site is dangerous and the monitoring target data related to the site is stored in the monitoring target DB 84 in the site data storage unit 83. Yes, it is continuously executed from time to time.

First, in step S <b> 31, the control unit 41 transmits a warning mail to a site determined to be dangerous by the risk determination processing unit 81 based on the determination result in the risk determination processing unit 81. Determine whether or not.
As a result, if it is determined by the control unit 41 that a warning mail is to be transmitted, the warning processing unit 87 in step S32 determines the relevant data from the dangerous site content data stored in the site data storage unit 83. Extract the email address of the site administrator. Then, the warning processing unit 87 transmits a warning mail to the extracted mail address.

Subsequently, in step S33, the warning processing unit 87 determines whether or not there is a reply mail to the warning mail transmitted in step S32. If there is a reply mail, the site monitoring status is changed in step S34. In step S35, the reply mail is transferred to the user who has requested monitoring. Here, the monitoring status is information indicating a response status to the site determined to be dangerous, and includes, for example, “already warned”, “warning”, “not yet supported”, and the like. This monitoring status changes according to the process on the user side and the process on the site side.
On the other hand, if the result of determination in step S33 is that there is no reply mail, steps S34 and S35 are skipped.

  As described above, by using the information search system according to the present embodiment, the risk determination is performed in real time based on the registered search target information and the information published on the site on the network NW. It is possible to search for illegal contents existing on the network NW at high speed and provide the result to the user side, and to easily detect and track a dangerous site to be monitored. For example, because of frequent updates, information is updated in a short period of time, and this is also implemented for illegal exhibitions at auction sites that were difficult to deal with when it was discovered by conventional information retrieval systems. Since the net patrol system to which the information search system according to the form is applied, the search is performed in real time.

  In addition, by notifying a warning to a site determined to be dangerous, the administrator of the site can be urged to improve. For example, for illegal exhibition on an auction site or copyright infringement due to the use of copyright images / videos on a personal site, it is possible to prompt the user to take measures such as deleting the information (data).

(Other embodiments of the present invention)
When the function of the above-described embodiment is realized by recording a program that causes the computer to perform the function of the above-described embodiment on a recording medium such as a CD-ROM and causing the computer to read the program. In addition, a recording medium on which such a program is recorded is included in the embodiment of the present invention. As a recording medium for recording the program, a flexible disk, a hard disk, a magnetic tape, a magneto-optical disk, a nonvolatile memory card, and the like can be used in addition to the CD-ROM.
In addition, the functions of the above-described embodiments are realized by executing a program supplied by a computer, and the program is used in cooperation with an OS (operating system) or other application software running on the computer. When the functions of the above-described embodiment are realized, or when all or part of the processing of the supplied program is performed by a function expansion board or a function expansion unit of the computer, the function of the above-described embodiment is realized. Such a program is included in the embodiment of the present invention. Also, some programs may be executed on other computers.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

SS server PC user terminal WSA, WSB Web server NW network 21 CPU
22 ROM
23 RAM
24 external storage device 25 network interface 41 control unit 42 information registration unit 43 registration information setting unit 44 registration information storage unit 45 site data acquisition unit 46 optimization processing unit 47 determination processing unit 48 site data storage unit 49 result processing unit 50 information exchange Processing part

Claims (10)

An information search system for searching information published on a network based on an information search request,
Information registration means for registering and storing search target information related to an information search request;
In response to the information search request, acquisition means for acquiring information published on the site on the network and temporarily holding it in the semiconductor storage device;
Whether to store the information in the magnetic storage device is determined based on the number of matches between the search condition keyword specified by the search target information related to the search request and the information temporarily held in the semiconductor storage device. A determination means;
Storage means for storing information temporarily held in the semiconductor storage device in the magnetic storage device according to a result of determining that the number of matches in the determination means is a predetermined number or more;
An information search system comprising: output means for outputting a search result related to the search request based on information stored in the magnetic storage device stored in the storage means. Optimization means for optimizing the site order for obtaining the published information based on the determination result in the determination means or the search target information,
2. The information search system according to claim 1, wherein the optimization unit further optimizes the site order according to the update frequency of information published on the site. A plurality of information retrieval devices including the acquisition unit, the determination unit, and the storage unit;
The plurality of information search devices share the search target information and search different sites between the plurality of information search devices, and the plurality of information search devices search for information related to the search with peer-to-peer information. The information retrieval system according to claim 2, wherein the information is exchanged and shared by peer-type communication. An information search device for searching information published on a network,
Information registration means for registering and storing search target information related to an information search request;
In response to the information retrieval request, an acquisition unit that automatically circulates the sites on the network, acquires information published in each site, and temporarily holds the information in the semiconductor storage device;
Determining means for determining a risk level of a site that publishes the information based on the number of matches between the keyword of the search condition specified by the stored search target information and the information temporarily stored in the semiconductor memory device; ,
As a result of the determination, if the risk level of the site is within a predetermined range, storage means for storing the site information of the site and information temporarily held in the semiconductor storage device in the magnetic storage device;
An information search apparatus comprising: output means for outputting search result information related to the determination result based on information stored in the magnetic storage device stored in the storage means. Optimization means for optimizing the site order for obtaining the published information based on the determination result in the determination means or the search target information,
5. The information search apparatus according to claim 4, wherein the optimization unit further optimizes the site order according to the update frequency of information published on the site.   As a result of the determination, it further comprises warning means capable of selectively transmitting a warning notification to a site determined that the degree of risk is within a predetermined range based on the information held temporarily. The information search device according to claim 5.   A determination is made as to whether or not there has been a reply to the warning notice in response to the warning notice from the warning means, and if there is a reply, the warning status included in the site information of the site is changed. 6. The information search device according to 6. An information search method for searching information published on a network,
An information registration step of registering and storing search target information related to the information search request;
In response to the information search request, an acquisition step of acquiring information published on a site on the network and temporarily holding it in a semiconductor storage device;
Determining whether to save the information based on the number of matches between the search condition keyword specified by the search target information stored in the information registration step and the information temporarily stored in the semiconductor memory device Process,
A storage step of storing information temporarily held in the semiconductor storage device in the magnetic storage device according to the result of the determination;
An output step of outputting a search result related to the search request based on the information stored in the magnetic storage device stored in the storage step. An optimization step of optimizing the site order for acquiring the published information based on the determination result in the determination step or the search target information,
9. The information search method according to claim 8, wherein the optimization step further optimizes the site order according to the update frequency of information published on the site. A program for searching information published on the network,
An information registration step of registering and storing search target information related to the information search request;
In response to the information search request, an acquisition step of acquiring information published on a site on the network and temporarily holding it in a semiconductor storage device;
Whether to store the information in the magnetic storage device based on the number of matches between the search condition keyword specified by the search target information stored in the information registration step and the information temporarily held in the semiconductor storage device A determination step for determining
A storage step of storing information temporarily held in the semiconductor storage device in the magnetic storage device according to a result in the determination step;
A program for causing a computer to execute an output step of outputting a search result related to the search request based on the information stored in the magnetic storage device stored in the storage step.

Images