JP2018190030A - Information processing server, control method for the same, and program, and information processing system, control method for the same, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly correct a correction character string included in a character string received from a user, and to search document data.SOLUTION: An information processing server is provided that can search proper document data from a plurality of document data on the basis of a character string received from a user. The information processing server is configured to: store the plurality of document data; receive a plurality of character strings for retrieving the document data, and including at least a correction character string targeted for correction; search a plurality of document data to be stored, using the received character string; correct the correction character string on the basis of the character string included in the searched document data; and search the plurality of document data to be stored, using the character string including the corrected correction character string.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing server that can appropriately correct a corrected character string included in a character string received from a user and retrieve document data, a control method thereof, a program, and an information processing system, The present invention relates to a control method and program technology.

  In recent years, personal computers have become widespread in businesses and homes, and the Internet has become familiar, so there are many opportunities for inputting character strings from a keyboard.

  However, considerable skill is required to master the keyboard, and even a skilled person often makes an erroneous input (spelling mistake).

In recent years, a technique for converting a human voice into a character string by a computer software without using a keyboard has been widely used. However, since the accuracy of speech recognition is not 100%, spelling errors occur. Various techniques have been developed to efficiently deal with spelling mistakes.
In Patent Document 1, a dictionary that is stored electronically in advance is prepared, a misrecognized portion of a character string received by speech recognition is specified, and a character string that is misrecognized from the dictionary is identified. Thus, a technique for calculating the correction candidate character string and the similarity between the erroneously recognized character string and the correction candidate character string is described.

  In Patent Document 2, in the search system, a query (character string) input by the user in the past is stored as a log, and when the user newly inputs, a spelling check is performed based on the query log. Is described.

JP 2012-063545 A JP 2005-267638 A

  However, in Patent Document 1, it is necessary to prepare a dictionary in advance. The words contained in this dictionary are general and must be made applicable to any field. In that case, the man-hours for preparing the dictionary in advance and the maintenance man-hours for updating the dictionary such as adding new words are required. In addition, even if the character string newly input by the user is in a specific field, there are a large number of correction candidates and the similarity between the character strings is searched for a character string to be corrected from a general-purpose dictionary. Even if the above calculation is calculated with high accuracy, there is a problem that irrelevant candidates are presented to the user with high priority.

  Further, in Patent Document 2, although a query log of a specific user is stored and used for spelling check, it is used for general purposes only if the user frequently uses only a specific query. In such a case, it takes a long time to collect so many spelling check logs, and because of its versatility, it is necessary to present irrelevant candidates to the user with high priority as in Patent Document 1. There is a problem of becoming.

  An object of the present invention is to provide a technique capable of appropriately correcting a corrected character string included in a character string received from a user and searching document data.

  In order to achieve the above object, the present invention provides an information processing server capable of retrieving appropriate document data from a plurality of document data based on a character string received from a user, wherein the plurality of documents Storage means for storing data, a plurality of character strings for searching the document data, receiving means for receiving a character string including at least a correction character string to be corrected, and the character string received by the receiving means Using the search means for searching the plurality of document data stored in the storage means, and the correction for correcting the correction character string based on the character string included in the document data searched by the search means And the search means searches the plurality of document data stored in the storage means using the character string including the corrected character string corrected by the correction means. It is characterized in.

  According to the present invention, it is possible to appropriately correct a corrected character string included in a character string received from a user and search document data.

It is a figure which shows an example of the function structure which concerns on embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the information processing apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the flowchart of the search process which concerns on embodiment of this invention. It is a figure which shows an example of the flowchart of the process of a spelling check which concerns on embodiment of this invention. It is a figure which shows an example of the document used as the search object which concerns on embodiment of this invention. It is a figure for demonstrating an example of the memory | storage part regarding the extracted word memory | storage part which concerns on embodiment of this invention, and the information on the co-occurrence relation of the word contained in a search condition, and an extracted word. It is a figure for showing an example of the candidate word list relevant to a spelling mistake among the word dictionary memory | storage parts which concern on embodiment of this invention. It is a figure for demonstrating an example of the correction candidate memory | storage part which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a functional configuration according to an embodiment of the present invention.

The input character string receiving unit 101 receives an input character string serving as a search condition for searching for a text document (corresponding to document data). In the present embodiment, an example of document data is a text document. However, the document data is not limited to a text document as long as the document is included, and may be document data such as a PDF file. When the information processing apparatus according to the present invention is a computer that functions as a client device, the input character string may be a functional unit that directly receives an input from a user who uses the computer. Moreover, the function part received from the other application program etc. which operate | move with the said computer may be sufficient. Moreover, when the information processing apparatus in this embodiment is a server on a network, it may be a functional unit that receives communication information from another information processing apparatus via the network.
The document search unit 102 searches for a text document stored in the document storage unit 121 based on the input character string acquired in the above procedure. The search may be performed not on the text document itself but on an index generated in advance from the text document. Since the technique relating to the search and generation of the index of the text document is a well-known technique, the details are omitted.

  The word extraction unit 103 analyzes a character string included in the text document from the text document that is a result of the search by the document search unit 102, and extracts a word.

  The dictionary search unit 104 receives an input received by the input character string reception unit 101 from a word dictionary storage unit 122 (corresponding to a management unit) that stores and manages information (corresponding to correction data) of words prepared in advance. A part of the character string (partial character string), that is, an input character string is analyzed, and a word is searched based on a word (which may include a spelling error). However, since it is not known in advance whether the character string of the word to be searched is correct or incorrect, it does not search only for a word that exactly matches the character string, and is similar in consideration of spelling mistakes. The character string determined to be is searched. Since dictionary search for spell check is a well-known technique, the details are omitted.

  The similarity determination unit 105 has a possibility that the word extracted by the word extraction unit 103 or the word searched by the dictionary search unit 104 is a partial character string of the input character string and includes a spelling error. It is determined how similar to (character string). The result is calculated as a numerical value.

  The correction candidate storage unit 106 temporarily stores, in the storage unit, a word that is considered to be similar to the word that is a partial character string of the input character string, together with the similarity. The correction candidate is presented to the user or an application using the system of the present invention by the correction candidate presenting unit 107, and the selection result of the user or application is received by the correction result receiving unit 108 and obtained from the input character string. Correct the word. The corrected result becomes a new search condition, and the document storage unit 121 searches the document storage unit 121 again.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing apparatus (corresponding to an information processing server) included in the information processing system of the present invention.

  As shown in FIG. 2, the information processing apparatus 100 and the application server 140 include a central processing unit (CPU) 201, a random access memory (RAM) 202, a read only memory (ROM) 203, and an input controller 205 via a system bus 204. The video controller 206, the memory controller 207, the communication I / F controller 208, etc. are connected. The CPU 201 comprehensively controls each device and controller connected to the system bus 204.

  Further, the ROM 203 or the external memory 211 will be described later, which is necessary for realizing the functions executed by each server or each PC, such as BIOS (Basic Input / Output System) and OS (Operating System) which are control programs of the CPU 201. Various programs are stored. Further, information necessary for carrying out the present invention is stored. The external memory may be a database.

  The RAM 202 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program or the like necessary for executing the processing from the ROM 203 or the external memory 211 to the RAM 202 and executing the loaded program.

  The input controller 205 controls input from a keyboard (KB) 209 or a pointing device such as a mouse (not shown).

  The video controller 206 controls display on a display device such as the display 210. The display device may be a display device such as a liquid crystal display. These are used by the administrator as needed.

  The memory controller 207 is an external storage device (hard disk (HD)), flexible disk (FD), or PCMCIA (Personal Computer) that stores a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 211 (corresponding to storage means) such as a CompactFlash (registered trademark) memory connected to a memory card international association (Card) card slot via an adapter.

  The communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP (Transmission Control Protocol / Internet Protocol) is possible.

  Note that the CPU 201 can display on the display 210 by executing an outline font rasterization process on a display information area in the RAM 202, for example. Further, the CPU 201 enables a user instruction using a mouse cursor (not shown) on the display 210.

Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 202 as necessary.
FIG. 3 is a diagram showing an example of a flowchart of search processing according to the embodiment of the present invention. Each step of the flowchart of FIG. 3 is executed by the CPU 201 on the information processing apparatus 100.

  In step S301, the input character string receiving unit 101 receives an input character string as a condition for searching the text document by the document search unit 102 (corresponding to a receiving unit). As an example for explaining the present invention, it is assumed that a character string “artificial intelligence, machine learning, big day?” Is accepted. The last “?” Is a spelling mistake in the input of the word “big data” (corresponding to a corrected character string) and is a correction target. For example, it is assumed that “Big Day” is insufficient for one character, or “Big Dayra” is entered when an incorrect character is input.

  In step S302, the document search unit 102 acquires (searches) a list of text documents that match the conditions from the document storage unit 121 using the above-described input character string as a search condition (corresponding to a search unit). An example of the document storage unit 121 will be described with reference to FIG.

  In FIG. 5, reference numeral 501 denotes a text document to be searched. In the example of FIG. 5, there are text documents 501a to 501n. Among these text documents 501, documents including the aforementioned search conditions “artificial intelligence” and “machine learning” are the search results. In the example of FIG. 5, there are four documents 501 a to 501 d. The word that matches the search criteria is underlined. For example, in the text document 501a, “artificial intelligence” and “machine learning” match.

  The word “big data” is also included, but it is not considered a match because the search condition is a spelling mistake with “Big Day?”.

  In step S303, the word extraction unit 103 analyzes the above-described text document that is a search result, and extracts words included in any of the text documents.

  The extracted words are represented as a list, for example, as in the extracted word storage unit 311 (vertical column from “big data” to “digital”) in FIG. Here, FIG. 6 will be described.

  FIG. 6 is a two-dimensional table of the list in the extracted word storage unit 311 and the part (601 in the horizontal column) where the search condition words are arranged for each document as described above. Weighting is described in the weighting column 602 where the extracted word storage unit 311 and each document 601 intersect.

  For example, in the upper left column, since the text document 501 includes the word “big data”, “2” is described in the right column of the extracted word “big data”. This is because two words of “artificial intelligence” and “machine learning” in the search condition appear in the text document, that is, “big data” is two words among the words included in the search condition. It means that they co-occur.

  This weighting is only an example. For example, in a search system, each word appearing in a text document is usually given a “weight”. A word that appears more than once in one text document has a higher weight, while a word that appears more than once in a different text document has a lower weight. Considering these weights, the value in the weighting column 602 in FIG. 6 may be calculated.

  In FIG. 6, there are only two search condition words appearing in each text document. When there are more words, for example, when there are four words A1, A2, B1, and B2, the words A1 and A2 are co-occurrence frequencies. Therefore, the weight of the extracted word that co-occurs with the words A1 and A2 is also increased, while the co-occurrence frequency of the words B1 and B2 is low, so that the weight of the extracted word that co-occurs with the words B1 and B2 is decreased. And so on. Therefore, the method for calculating the value in the weighting column 602 is arbitrary and is a design matter. In the present invention, an arbitrary calculation method is included.

  Further, the extracted word storage unit 311 does not include two words “artificial intelligence” and “machine learning”, but this is because it is treated as having no spelling error in the following description. If the determination is not possible, the extracted word storage unit 311 may temporarily include the determination.

  Similarly, all words appearing in each text document are described in the extracted word storage unit 311 in FIG. 6 except for “artificial intelligence” and “machine learning”. In this example, “Big Day?” The extracted word storage unit 311 does not necessarily include the character string that can be determined in advance as not being a candidate for the spelling check.

  Return to the description of the flowchart. In step S304, a spelling check is performed on the words included in the input character string serving as a search condition. The spelling check is a well-known technique. However, the parts related to the features of the present invention will be described in detail with reference to the flowchart of FIG.

  Steps S401 to S406 are processes that are repeatedly performed while paying attention to each of the words (including those with spelling mistakes) extracted from the input character string of the search condition.

  In step S402, it is determined whether or not the extracted word storage unit 311 has the same word as the focused word. For example, it is determined whether there is “Big Day?”. If there is a matching character string (YES), the process proceeds to step S406, and the next attention is shifted to the next word. If there is no match (NO), the process proceeds to step S403.

  In step S <b> 403, the similarity determination unit 105 selects a word being focused on from the words included in the text document of the search result stored in the extracted word storage unit 311 and the words included in the word dictionary storage unit 122. A similar thing is selected and the similarity is calculated. The similarity is calculated based on, for example, the degree of coincidence of two words as a character string. The spelling check and similarity calculation processing is a well-known technique and will not be described in detail. FIG. 7 will be described as an example of the word dictionary storage unit.

  In FIG. 7, only words having a headline similar to “Big Day?” Are displayed, but other words are also actually registered. This is a state where words having a similar heading (702) are listed with respect to the word 701 under consideration.

  Moreover, although the problem of using a dictionary like patent document 1 was described above, this is a case where a general-purpose dictionary is prepared, for example, a company develops a question answering system about a specific product. In this case, if you register only specific technical terms related to the product, there are few words that are mistakenly similar to the word you are interested in, and there are fewer maintenance steps, so it can be used as well. It is possible to prevent this problem.

  Further, an example of a word list determined to be similar will be described with reference to FIG. FIG. 8 illustrates the correction candidate storage unit 312. The result of step S403 is stored in the correction candidate storage unit 312.

  The correction candidate storage unit 312 stores a word notation 802 determined to be similar to the spelling error candidate 801 and its similarity 803. Further, the source 804 may be stored so that the user or application can determine that the correction candidate acquired from the word dictionary storage unit 122 is not used. When the search system does not determine by default but presents it to the user or application, information on the source 804 may be presented together with the correction candidate as a basis for determination.

  In step S404, it is determined whether a character string similar to the focused word can be found from the extracted word storage unit 311 and the word dictionary storage unit 122 (if necessary). Specifically, a similarity threshold is set and stored in a storage unit such as a program code or a setting file. For example, “0.5” may be set as the threshold value, and a similarity lower than that value may be determined not to be a spelling error correction candidate.

  If it is determined that there is something similar to the word being noticed (YES), the process proceeds to step S405. If it is determined that there is no similarity (NO), the process proceeds to step S406, and the next attention is shifted to the next word.

  In step S405, the similarity is changed for a word that is similar to the word of interest.

  An example will be described. 6, the co-occurrence degree of the extracted word and the word included in the search condition (referring to the number of occurrences in a linguistic environment such as speech, sentence, context, etc., in which the language is the same) is calculated (corresponding to a calculation means). ) Explained the weighting table. For example, “big data” having a similarity degree of 0.8 co-occurs with a total of four search conditions in three text documents from the table of FIG. Since there is only one “bit data” with a modified degree of similarity of 0.6, it may be “0.6” without change. This co-occurrence calculation method is merely an example, and any calculation method may be used. In the present invention, these arbitrary calculation methods are also included.

  This completes the description of the flowchart of FIG. 4 and returns to the description of the flowchart of FIG. 3.

  In step S305, the correction candidate presenting unit 107 presents correction candidates for words in the search condition determined to have a spelling error. For example, among the notations 802 shown in FIG. 8, only those that are described as “extracted” in the source 804 are presented, or only those whose similarity 803 is “0.7 or more” are presented. .

  From the presented correction candidates, the user or the application that called the search system selects one appropriate one to specify the correction candidate (corresponding to the specifying means). For example, assume that “big data” is selected.

  In step S306, the correction result receiving unit 108 receives the selection result of the user or the application, and corrects the word having a spelling error in the input character string by replacing it with the selected result (corresponding to a correction means). . Specifically, “Big Day?” Is replaced with “Big Data” and corrected.

  In step S307, the document search unit 102 searches the document storage unit 121 again with the replaced search condition (corresponding to a search unit). Specifically, the search is performed again under three conditions of “artificial intelligence”, “machine learning”, and “big data”. As a result, the ranking of the text document 501b is lowered, and the ranking of the results of 501c and 501d is raised.

  Although not shown, the text document 501 including only “big data” among the three conditions is not hit in the search in step S302, but is hit in the re-search in step S307.

  In step S308, the list of the text documents 501 whose ranks have been changed or which has not been hit at the first time is presented as a result of step S307 which is re-searched based on the search conditions corrected in step S306. .

  As described above, in steps S305 and S306, it has been described that a correct spelling word is selected by a user or an application from correction candidates for a spelling error word. However, this is only an example. In the search system of the present invention, the search system having the highest similarity may be selected by default.

  For example, if the user performs a re-search without presenting the first search result or the spelling check result to the user and presents the re-search result up to step S308, the user spells in the input character string. Despite having missed words, it is possible to make it look as if you searched with the correct spelling. This completes the description of the flowchart of FIG.

  It should be noted that the configuration and contents of the various data described above are not limited to this, and it goes without saying that the various data and configurations are configured according to the application and purpose.

  According to the present invention, it is possible to appropriately correct a corrected character string included in a character string received from a user and search document data.

  Although several embodiments have been described above, the present invention can take an embodiment as, for example, a system, apparatus, method, computer program, or recording medium, and more specifically, a plurality of devices. The present invention may be applied to a system configured from the above, or may be applied to an apparatus including a single device.

  The computer program according to the present invention is a computer program capable of executing the processing method of the flowcharts shown in FIGS. 3 to 4, and the storage medium of the present invention can execute the processing method of FIGS. Various computer programs are stored. In addition, the computer program in this invention may be a computer program for every processing method of each apparatus of FIGS.

  As described above, a recording medium in which a computer program for realizing the functions of the above-described embodiments is recorded is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus is stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing a program.

  In this case, the computer program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the computer program constitutes the present invention.

  As a recording medium for supplying a computer program, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, an EEPROM, Silicon disks, solid state drives, etc. can be used.

  Further, by executing the computer program read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instructions of the computer program. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the computer program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function is based on the instructions of the computer program code. It goes without saying that the CPU or the like provided in the expansion board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to a system composed of a plurality of devices or an apparatus composed of a single device. It goes without saying that the present invention can also be applied to a case where the present invention is achieved by supplying a computer program to a system or apparatus. In this case, by reading the recording medium storing the computer program for achieving the present invention into the system or apparatus, the system or apparatus can enjoy the effects of the present invention.

  Furthermore, by downloading and reading out a computer program for achieving the present invention from a server, database, etc. on a network using a communication program, the system or apparatus can enjoy the effects of the present invention.

  In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 101 Input character string reception part 102 Document search part 103 Word extraction part 104 Dictionary search part 105 Similarity determination part 106 Correction candidate storage part 107 Correction candidate presentation part 108 Correction result reception part 121 Document storage part 122 Word dictionary storage 311 Extracted word storage unit 312 Correction candidate storage unit 600 Co-occurrence information storage unit

Claims (9)

An information processing server capable of retrieving appropriate document data from a plurality of document data based on a character string received from a user,
Storage means for storing a plurality of the document data;
A plurality of character strings for searching for the document data, and accepting means for receiving a character string including at least a correction character string to be corrected;
Search means for searching a plurality of the document data stored in the storage means using the character string received by the receiving means;
Correction means for correcting the correction character string based on a character string included in the document data searched by the search means; and
The information processing server, wherein the search unit searches the plurality of document data stored in the storage unit using the character string including the corrected character string corrected by the correction unit. Management means for managing correction data for correcting the correction character string,
The information processing server according to claim 1, wherein the correction unit corrects the corrected character string based on the correction data. A specifying means for specifying a correction candidate of the correction character string from a character string included in the document data searched by the search means;
The information processing server according to claim 1, wherein the correction unit corrects the correction character string with any one of the correction candidates specified by the specifying unit. The correction candidate specified by the specifying means further comprises a calculation means for obtaining a co-occurrence degree indicating the number of times the correction character string and the document data co-occur,
The information processing server according to claim 3, wherein the correcting unit corrects the corrected character string based on the correction candidate determined based on the co-occurrence degree calculated by the calculating unit. An information processing server comprising a storage means for storing a plurality of document data, and an information processing server control method capable of retrieving appropriate document data from a plurality of document data based on a character string received from a user There,
Receiving a plurality of character strings for searching the document data, the character string including at least a correction character string to be corrected; and
A search step for searching the plurality of document data stored in the storage unit using the character string received in the reception step;
A correction step of correcting the correction character string based on the character string included in the document data searched in the search step;
The search step includes: searching the plurality of document data stored in the storage unit using the character string including the corrected character string corrected in the correction step. Method. An information processing server having storage means for storing a plurality of document data, and can be executed by an information processing server that can retrieve appropriate document data from a plurality of document data based on a character string received from a user. A program,
Information processing server
A plurality of character strings for searching for the document data, and accepting means for receiving a character string including at least a correction character string to be corrected;
Search means for searching a plurality of the document data stored in the storage means using the character string received by the receiving means;
Based on the character string included in the document data searched by the search means, function as correction means for correcting the correction character string,
A program for causing the search means to function to search a plurality of the document data stored in the storage means using the character string including the corrected character string corrected by the correction means. An information processing system including an information processing server capable of searching appropriate document data from a plurality of document data based on a character string received from a user,
Storage means for storing a plurality of the document data;
A plurality of character strings for searching for the document data, and accepting means for receiving a character string including at least a correction character string to be corrected;
Search means for searching a plurality of the document data stored in the storage means using the character string received by the receiving means;
Correction means for correcting the correction character string based on a character string included in the document data searched by the search means; and
The information processing system, wherein the search means searches the plurality of document data stored in the storage means using the character string including the corrected character string corrected by the correction means. An information processing system comprising a storage means for storing a plurality of document data, and including an information processing server capable of retrieving appropriate document data from the plurality of document data based on a character string received from a user A system control method comprising:
Receiving a plurality of character strings for searching the document data, the character string including at least a correction character string to be corrected; and
A search step for searching the plurality of document data stored in the storage unit using the character string received in the reception step;
A correction step of correcting the correction character string based on the character string included in the document data searched in the search step;
The search step searches the plurality of document data stored in the storage means using the character string including the corrected character string corrected in the correction step. Method. An information processing system comprising a storage means for storing a plurality of document data, and including an information processing server capable of retrieving appropriate document data from the plurality of document data based on a character string received from a user A program executable on the system,
Information processing system
A plurality of character strings for searching for the document data, and accepting means for receiving a character string including at least a correction character string to be corrected;
Search means for searching a plurality of the document data stored in the storage means using the character string received by the receiving means;
Based on the character string included in the document data searched by the search means, function as correction means for correcting the correction character string,
A program for causing the search means to search the plurality of document data stored in the storage means using the character string including the corrected character string corrected by the correction means.

Images