JP2006215689A - Information providing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information providing system permitting recognition of the newness of information on the web, namely the freshness of the information. <P>SOLUTION: The information providing system is provided with an information reading part 2, a history information storage part 3, a processing part 11 and an output part 9. The processing part 11 is provided with a function for comparing information read with the information reading part 2 at the latest timing with information read at the preceding timing to extract differential contents, a function for identifying additional contents in the extracted differential contents, a function for extracting a predetermined keyword from the identified additional contents, a function for identifying timing when the keyword has been generated on a web page, and a function for preparing freshness information obtained by grouping information including the keyword by the freshness according to the generation timing on the web page. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information providing system for providing freshness information indicating the newness of specific information displayed on a web.

For example, a user who searches for information for a specific use such as job offer information of a company or property information of a real estate searches a web page every day in order to obtain useful information. However, most of the information searched every day has been seen in the past. What the user really wants to know is what has not yet been seen, that is, new information, but it is difficult for the user to determine for himself which information has been recently updated.
For this reason, some web pages display a “new” mark to indicate new information. By attaching such a “new” mark, the user can know that the information is new information.
JP 2002-157162 A

As described above, when the “new” mark is added to the updated information, the user can determine that the information is new information. However, since the “new” mark is attached by the administrator of the website, it is not certain whether it is really new information.
In other words, even when a “new” mark is added at the time of newly posting on the web, when the mark is removed differs depending on the site. For this reason, the “new” mark may remain attached even though it is not so new.
On the other hand, at sites that do not have a “new” mark at the time of update, new information cannot be determined by the mark.
In other words, in a system in which a “new” mark is given on a site-by-site basis, the user may not be able to correctly determine the freshness of information.

Further, there is a method of periodically monitoring a database as in Patent Document 1 to detect difference information changed between the current time and the previous time. Even if such a method is applied to the web search and the difference information is acquired, it is difficult for the user to determine how much the necessary information is new from the difference information. From the difference information, it can be seen that the information is new when the information is updated, but it is not known how much time has passed until it is deleted.
An object of the present invention is to provide an information providing system that enables information on a web, which is necessary for a user, to know the newness of the information, that is, the freshness of the information.

  The first invention makes it possible to connect to a specific web page set in advance, an information reading unit for reading the information on the web page at a predetermined timing, and the information read by the information reading unit corresponding to the reading timing And a history information storage unit for storing the history information, a processing unit for creating freshness information in which the freshness of the information is associated with information related to a preset keyword among the history information, and the processing unit An output unit that outputs the created freshness information, and the processing unit extracts a function of extracting the difference contents by comparing the information read by the information reading unit at the latest timing with the information read last time. Among the difference contents, a function for identifying additional contents, a function for extracting a preset keyword from the identified additional contents, and an extracted key A function for identifying the occurrence timing of a word on the web page, a function for grouping information including the extracted keywords according to the freshness according to the occurrence timing on the web page, and a freshness by associating each group with a freshness It has a feature in that it has a function of creating information.

  2nd invention presupposes 1st invention, The said process part is a function which specifies the deletion content among the extracted difference content, The function which extracts the keyword preset from the specified deletion content, It is characterized in that it has a function of specifying the deletion timing when the extracted keyword is deleted from the web page, and a function of adding the specified deletion timing to the freshness information.

  3rd invention presupposes the said 2nd invention, and the said output part produces | generates the said generation | occurrence | production into the information which arranged the said freshness information in order of freshness as display data displayed on the user terminal which enabled connection via communication. It is characterized in that it has a function of creating a table in which timings and deletion timings are associated with each other and posting them on a web page.

According to the 1st-3rd invention, required information can be extracted from a web page and the freshness information showing the freshness can be provided.
The freshness information makes it easier for the user to evaluate the value of information on which freshness is important.
In addition, the user does not need to access various web pages or search for information by himself / herself, and can easily obtain the desired information as the freshness information.

Furthermore, according to the second aspect, the user can easily grasp the information update cycle. For example, when applied to job offer information and real estate property information, it becomes possible to grasp popular occupation types and popular properties.
In addition, according to the third invention, a large number of users can acquire freshness information in an easy-to-understand manner at a necessary timing.

1 to 8 show an embodiment of the present invention. This system provides necessary information from a web page so that its freshness can be understood. An example in which the necessary information is job information will be described.
FIG. 1 shows the overall configuration of this system.
The information providing system 1 of the present invention enables connection to job information pages 10a, 10b, 10c,... Of each company via the Internet N1, and acquires information created by this system via the communication means N2. The user terminals 20a, 20b, 20c,... On the user side can be connected. The communication means N2 for connecting the system 1 and the user terminals 20a, 20b, 20c,... May be anything such as the Internet.
In addition, the user of this system is a user who needs job offer information, such as a staffing agency, but may be an individual who is seeking a job.

  The system 1 includes an information reading unit 2 that reads information from the job information pages 10a, 10b, 10c,... The keyword extraction unit 5 includes a keyword storage unit 7 that stores keywords used in a keyword extraction process, which will be described later, and the difference information created by the difference information creation unit 11. A difference information storage unit 8 to be stored is connected. A freshness information creation unit 6 that creates freshness information based on the difference information is connected to the difference information storage unit 8, and an output unit 9 is connected to the freshness information creation unit 6.

  Here, the difference detected by the difference detection unit 4 is distinguished from the difference information. As will be described in detail later, the above difference is a difference on the surface between the contrasted information, and the difference information is information that is meaningful in terms of content provided by this system. It is a difference. For example, in this embodiment, since it is applied to the job information, there is a case where it is necessary to know the name of the recruiting job type as the content of the job, and the modifiers added before and after the job name are not necessary. A difference only in the necessary part excluding such an unnecessary part is defined as a difference here.

The information reading unit 2 has a function of connecting to a specific web page at a predetermined reading timing, reading the information on the page, and storing the information in the history information storage unit 3 together with the read date.
As the predetermined reading timing, for example, a reading timing such as a specific time every day or 9 o'clock every Monday is set in the information reading unit 2 in advance, and information can be automatically read. However, the operator may input a command for reading information at a predetermined timing.

Further, the specific web page from which the information reading unit 2 reads information is a predetermined page. In this embodiment, the job reading information of each company is described, and the URL of each web page is monitored. The URL is set in the information reading unit 2 as a URL list. The information reading unit 2 has a function of reading the set URL information at the set read timing.
Note that the reading timing can be set separately for each URL. For example, it can be said that the job offer information of company A is read every day, but the information of company B is read only on Monday and Thursday.

The information reading unit 2 stores the read information in the history information storage unit 3 in association with the reading timing.
In this embodiment, it is assumed that the information reading unit 2 automatically reads information on a predetermined web page once a day. Here, today is January 20, 2005.
Further, since the information reading unit 2 reads the web page once a day, the history information storage unit 3 associates the read information with the date as the reading timing as shown in FIG. I remember. Then, the information read from the page specified by each URL accessed by the information reading unit 2 is stored with the files F1, F2, F3,. ing.

  In this embodiment, the page accessed by the reading unit 2 is a company job information page. For example, the file F1 is job information of company A, the file F2 is job information of company B, and the file F3 is This is job posting information for company C. These files F1, F2, F3,... Are associated with both the folder on January 20, 2005 (2005/1/20) and the folder on January 19, 2005. Similarly, each time the information reading unit 2 accesses the page and reads the information, a folder and an individual file for that date are created.

The procedure for extracting job posting information from a web page, creating freshness information, and outputting it will be described in detail below.
First, the information reading unit 2 accesses all the web pages corresponding to the preset monitoring URL list at a predetermined time every day, and stores the information in the history information storage unit 3.
Next, the difference detection unit 4 detects a difference between the information read this time and the previous information. The procedure will be described with reference to the flowchart of FIG.

In step S1, based on the information stored in the history information storage unit 3, detection of a difference between the information read this time and the information read last time is started. But after reading all the information. The information reading unit 2 activates the difference detecting unit 4 by outputting a reading end signal or the like.
In step S2, it is determined whether all of the current and previous information has been read out. If not all of the information has been read out, the process proceeds to step S3 and the remaining information is read out.

For example, if today is January 20, 2005, the files F1, F2, F3,... In the folder shown in FIG. The files F1, F2, F3,...
The file information is read in order and compared in step S4. The files to be compared are files with the same name. That is, the current file F1 and the previous file F1 are compared, and then the file F2 and the file F2 are compared. In step S2, it is determined whether all the files stored in the history information storage unit 3 have been read.

If it is determined in step S4 that there is a difference, the process proceeds to step S5, and the content of the difference is sent to the keyword extraction unit 5 together with the company name and URL.
Here, the difference information sent to the keyword extraction unit 5 is as shown in FIG. 4 and includes the URL and company name corresponding to the file compared in step S4 and the difference contents. The difference contents are added or deleted. In the current information, the content not included in the previous information is the content added this time, and in the previous information, the content not included in the current information is the deleted content.
The method for detecting the difference in step S4 is not particularly limited. For example, if all the data of the web page is taken and the HTML document is compared except for the tag, all the differences on the surface can be detected. it can.

The difference detection unit 4 detects the difference between the case where there is an addition and the case where there is a deletion at the current reading timing. Each difference content is referred to as one difference record R1, R2, R3,.
As described above, the difference detection unit 4 identifies the difference content for each company name and sends the data to the keyword extraction unit 5. When the processes of steps S3 to S5 are completed for all the files, the process proceeds from step S2 to step S6, the keyword extraction unit 5 is activated, and the difference detection is completed (step S7).

Next, the keyword extraction unit 5 performs a process of extracting a keyword from the difference information detected by the difference detection unit 4. This keyword is for specifying information to be provided by this system. When the information to be provided is job information, it is a job type, a business type, or the like. The keyword storage unit 7 stores this keyword.
In other words, it is necessary for the user who is seeking job information to know which company's job type exists, but the difference information detected by the difference detection unit 4 is simply a difference from the previous time, so the job type, etc. May contain information that is not directly related. Therefore, it is necessary to identify the keyword and extract necessary information as job information.

  The keywords as job types stored in the keyword storage unit 7 include “sales”, “personnel”, “technical”, etc., but the keywords are also extracted with other characters added to the front and back. Include regular expressions so that you can. For example, the words “XX sales” and “sales XX” can be extracted efficiently.

Therefore, the keyword extraction unit 5 extracts a keyword from the difference information and creates difference information regarding the job offer information. This procedure will be described with reference to the flowchart of FIG.
The keyword extraction unit 5 temporarily stores the difference information sent from the difference detection unit 4 and starts processing based on the signal from the difference detection unit 4 in step S11. Until it is determined that all the records have been read, the difference records of the difference information are read one by one and keyword extraction is performed.

  If it is determined in step S12 that all the difference records have not been read, the process proceeds to step S13, and one difference record is read. In step S14, it is determined whether the difference is addition or deletion. If the difference is added, the process proceeds to step S15. If the difference is deleted, the process proceeds to step S18. That is, the added content and the deleted content are processed separately. However, the step of discriminating between addition and deletion may not be step S14 such as after keyword extraction.

In step S15, the content of the difference is compared with all keywords related to the job information stored in the keyword storage unit 8, and in step S16, it is determined whether there is a match. If there is no match, the difference record read out here does not contain the required information, and the process directly returns to step S12.
If there is a matched keyword in step S16, the process proceeds to step S17, where the keyword, company name, URL, and the fact that this information is “added” are stored as difference information records of today as difference information records. Store in the unit 8. The company name and URL are data output from the difference detection unit 4 together with the difference record.

If it is determined in step S14 that the difference record read in step S13 is deleted information, the process proceeds to step S18, where the difference content is compared with all the keywords related to the employment information, and in step S19, Determine if there is a match. These steps S18 and S19 are the same as the processing steps S15 and S16 for the additional record.
If there is a matching keyword in step S19, the process proceeds to step S20, where the keyword, company name, URL, and the fact that this information is “deleted” are recorded as a difference information record for today. The information is stored in the information storage unit 8.

The above process is repeated for all the difference records, and when it is completed, the process proceeds from step S12 to step S21, the freshness information creation unit is activated, and the keyword extraction is completed (step S22).
By the keyword extraction process, difference information of the present invention is created, and the difference information storage unit 8 stores the information. As described above, the difference information is the difference between the current time (today) and the previous time (yesterday) regarding the target information, here, the job information. For example, as shown in FIG. 6, as the difference information for today, the job types of today added and deleted jobs are stored in the difference information storage unit 8. Here, the job type to be stored is determined by the keyword stored in the keyword storage unit 7, and can be selected as necessary.
The difference information storage unit 8 stores daily difference information before that as well as today's difference information.

When today's difference information is created by the above steps, the freshness information creation unit 6 starts processing. This process will be described with reference to the flowchart of FIG.
In step S101, the freshness information creation unit 6 starts freshness information creation processing based on the difference information stored in the difference information storage unit 8.
In step S102, the records of the difference information are sorted using the date of occurrence as a key, and are rearranged in order of date of occurrence. The occurrence date is the date when the information appears on the web, and corresponds to the occurrence timing defined in the present invention. This occurrence date is the date when the information is added to the freshness information.

  Next, in step S103, the rearranged records are grouped according to the freshness in order of occurrence date. The “freshness” is the degree of newness of information, and for example, the occurrence date is grouped into those within one week, those within two weeks, and those within one month from today. At this time, the freshness is “within 1 week”, “within 2 weeks”, and “within 1 month”. In this example, three levels of “within 1 week”, “within 2 weeks”, and “within 1 month” are set as the freshness.

As a result, the three freshness groups include records corresponding to additional information that can specify the date of occurrence.
Note that information that is not included in the above three groups and has an old occurrence date may be output as old information. However, information that is too fresh may not be output because it is often not requested by the user.

  On the other hand, when information is deleted from the web page, the information is stored as difference information. In step S104, the deletion date of the record is specified from the deletion record. Next, in step S105, a record corresponding to the deletion date is searched retroactively from the deletion date. For example, the difference information deletion record R4 shown in FIG. 6 has a deletion date of today (January 20, 2005), but this information should have occurred before the previous day. Therefore, from January 19th, the additional records corresponding to this record are retrieved in order. The additional record is searched using the company name, URL, and job type as search conditions.

For example, in the case of the record R4, an additional record including “Company A” and “Accounting” is searched for the latest occurrence date on January 20, and the record corresponds to the record R4. Identify that it is. Then, the previous deletion date is associated with the identified additional record. In other words, the information on “Accounting for Company A” that occurred before January 19 was deleted on January 20.
As described above, the deleted information is associated with the deletion date, and in step S107, the freshness is associated with the previously grouped group and the list is sent to the output unit 9.

The output unit 9 processes the freshness information for the user and registers it in a web server (not shown) as a web page accessible from the user terminals 20a, 20b, 20c,. 20c, and so on.
As a result, the table shown in FIG. 8 is displayed as the freshness information on the user terminals 20a, 20b, 20c,. In this table, job offer information is displayed for each freshness, and the job start date and job end date are also displayed. The job offer start date displayed here is the occurrence date of the information, and the job offer end date is the deletion date of the information. The recruiting job category is information specified by the keyword.

  Note that, as shown in FIG. 8, the information indicating that the job has been completed is displayed in order to make it easier for the user to understand that the information has been deleted from the web page. Moreover, the user can predict the popularity of the job type by presenting the job offer start date and the end date in association with each other. In other words, it is possible to predict that a job with a short time from the job offer start date to the job finish date is highly popular and will be decided immediately.

  As described above, by using the information providing system of the present invention, it is possible to automatically evaluate the freshness of various information on the web and provide the information. In particular, even if the information to be monitored is created by a method different for each company, a necessary portion can be extracted by a keyword. Furthermore, in this system, the freshness of all information is evaluated based on the same standard of the date of occurrence of the information. As in the past, the web page creator side has a “new” mark for each speculation. Compared with the case of attaching, the correct freshness can be grasped.

  In the above embodiment, the difference information creation unit 11 and the freshness information creation unit 6 constitute the processing unit of the present invention. However, each component of the system 1 shown in FIG. 1 shows a function, and is not separate as hardware. The system 1 is a computer system including one or a plurality of computers, and each function may be executed by any device. For example, a reading computer having a reading function for the web pages 10a, 10b, 10c,... And a freshness information creation computer for creating freshness information may be used, or all processing is performed by one computer. It doesn't matter.

Moreover, in the said embodiment, the output part 9 may be connected to the difference information storage part 8, and the output part 9 may output not only the said freshness information but difference information.
Furthermore, although the above embodiment describes an example in which job posting information is monitored, this system is not limited to job posting information but can be applied to various information. In particular, it is useful to apply to real estate information or the like as information in which the freshness of the information is regarded as important.
When applied to real estate information, keywords such as “apartment”, “heights”, “city”, “prefecture”, “city”, “county”, etc., that specify the building or address are considered.

It is a system configuration figure of an embodiment. It is the schematic diagram which showed the data structure of the log | history information storage part. It is the flowchart which showed the procedure of difference detection. It is the table | surface which showed the example of difference information. It is the flowchart which showed the creation procedure of difference information. It is the table | surface which showed the example of difference information. It is the flowchart which showed the preparation procedure of freshness information. It is the table | surface which showed the example of a display of freshness information.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information provision system 2 Information reading part 3 History information storage part 4 Difference detection part 5 Keyword extraction part 6 Freshness information creation part 9 Output part 10a, 10b, 10c ... Web page 11 Difference information creation part 20a, 20b, 20c, ... User terminal N1 Internet N2 communication means

Claims (3)

  It is possible to connect to a specific web page set in advance, and an information reading unit that reads information on the web page at a predetermined timing, and information read by the information reading unit is associated with the reading timing as history information A history information storage unit that stores information, a processing unit that creates freshness information in which the freshness of the information is associated with information related to a preset keyword among the history information, and freshness information created by the processing unit. An output unit for outputting, and the processing unit compares the information read by the information reading unit at the latest timing with the information read last time, and extracts the difference content, and among the extracted difference content , A function for identifying additional content, a function for extracting a preset keyword from the identified additional content, and an extracted keyword A function for identifying the occurrence timing that occurred on the web page, a function for grouping information including the extracted keywords according to the freshness according to the occurrence timing on the web page, and associating each group with freshness information An information provision system with functions to create.   The processing unit includes a function for identifying the deletion content, a function for extracting a preset keyword from the identified deletion content, and a deletion in which the extracted keyword is deleted from the web page. The information providing system according to claim 1, further comprising a function for specifying timing and a function for adding the specified deletion timing to the freshness information.   The output unit creates a table in which the generation timing and the deletion timing are associated with information in which the freshness information is arranged in order of freshness as display data to be displayed on a user terminal that can be connected via communication, The information providing system according to claim 2, further comprising a function for posting on a web page.

Images