JP2002245200A - Method/system for supporting assessment and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an assessment supporting method, etc., by which the burden of preparing work is reduced by performing high-quality assessment speedily and easily by utilizing the talent of an experienced person. SOLUTION: When the staff in charge of an organization body stores the notation of a document explaining the summary of a business in a database storage server 1 by operating a user terminal 2-j (j is a natural number), an inspector reads this and stores an answer in a data base storage server 1. When the staff, etc., of the organization body describes the summary of the business by referring to this answer, etc., and stores it in the server 1, the inspector reads this and prepares a question for evaluation to store it in the server 1. When the staff, etc., of the organization body describes the answer to the question for evaluation and stores it in the server 1, the inspector reads and examines this and prepares an evaluation report to store it in the server 1. The staff, etc., of the organization body reads this evaluation report.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an assessment support method for evaluating an object and an assessment support system for supporting an operation for evaluating an object.

[0002]

2. Description of the Related Art In order to evaluate the operation of an organization (a company or the like) and to improve the quality of the organization, an assessor may perform an assessment. Specifically, for example, as an assessment for evaluating the management quality of an organization, there is a "Japan Management Quality Award" assessment conducted by the Socio-Economic Productivity Center.

[0003] The companies that are subject to the "Japan Management Quality Award" assessment are assigned to a judge team who conducts the assessment.
Submit an application including two documents, “Business Overview” and “Management Quality Report”. The “business overview” is a document that describes the business run by the company from various viewpoints, and is a document of up to about 10 pages on A4 size paper. "Management Quality Report" is a document that contains the answers given by the companies to the questions specified in the screening criteria of the "Japan Management Quality Award" assessment, which require the companies to be assessed as a prerequisite for conducting the assessment. This is a document having a maximum of about 100 pages on A4 size paper.

[0004] The judge team starts the assessment only after receiving the application form. Each of the auditors that make up the auditor team that received the application (however, the auditor team may consist of only one auditor) is required to submit the “Business Overview” and “Management Quality Report” included in the application. ”And discuss within the panel of judges (consultation)
Will form a consensus as a team of judges and bring together a unified view. If the contents of the “Business Overview” and “Management Quality Report” alone are not sufficient as assessment materials, go to the company or the like that is subject to the assessment and conduct on-site inspection.

[0005]

However, according to the above-mentioned assessment method, the team of judges uses the contents of the “business outline” and “management quality report” and the results of the on-site examination exclusively as materials for the assessment. Therefore, the time until consensus is obtained is long (for example, about 1000 hours), which is inefficient. In addition, the skills to participate in the assessment as a judge could only be gained by gaining their own experience.

[0006] In addition, since the company or the like cannot start the assessment by the judge team without completing the preparation of most "management quality reports" in addition to the "business outline", The method puts a heavy burden on companies and the like who are going to undergo the assessment.

[0007] The present invention has been made in view of the above circumstances, and has as its object to provide an assessment support method and an assessment support system that enable an easy and quick assessment. Another object of the present invention is to provide an assessment support method and an assessment support system capable of easily performing a high-quality assessment by utilizing the wisdom of a person who has extensive experience in assessment. It is another object of the present invention to provide an assessment support method and an assessment support system that reduce the burden of preparation work to be performed by a person who is going to undergo an assessment.

[0008]

In order to achieve the above object, an assessment support method according to a first aspect of the present invention includes a plurality of explanation items, and an object is represented from the viewpoint indicated by each of the explanation items. The outline explanation data to be explained is inputted and stored, and the stored outline explanation data is output in response to a request from the outside, and is issued in order to evaluate the quality of the thing described by the outline explanation data. Inputting and storing evaluation question data representing a question about the thing, outputting the stored evaluation question data in accordance with a request from the outside, and expressing an answer to the question represented by the evaluation question data Input and store the response data for evaluation, output the stored response data for evaluation in response to an external request, and evaluate result data representing the evaluation of the quality of the thing described by the outline description data. Type and storing, the evaluation result data stored in response to an external request output, characterized in that.

According to such an assessment support method, if a person or the like who evaluates the quality of an object creates and inputs evaluation question data with reference to the summary explanation data, the quality of the object can be evaluated. A person who intends to receive the evaluation can receive the evaluation by answering only the question indicated by the evaluation question data, without preparing all the answers to the evaluation question assumed in advance. Therefore, the quality evaluation is performed easily and quickly, and the burden of the preparation work to be performed by the person who is going to receive the quality evaluation is reduced.

[0010] If the outline description method question data representing the question about the description method of the outline description data is input and stored, and the stored outline description method question data is output in response to an external request. The description of the outline explanation data can be smoothly performed, and the quality can be evaluated more quickly.

[0011] The evaluation result data may be any data as long as it evaluates, for example, the quality of the thing described by the summary description data from each of a plurality of categories.

[0012] The first showing the correspondence between the categories
And stores a score representing the quantification of the quality of the thing described by the summary description data from the viewpoint that the evaluator represents each of the categories, and the first correspondence data It is determined whether or not the scores representing the numerical value of the quality of the thing are different from each other by a predetermined amount or more from the viewpoints indicated by the plurality of categories associated with each other, and are different. If the first alarm information is output when it is determined that the categories are associated with each other, it is possible to prevent a situation in which the scores of the categories associated with each other are more than a predetermined amount and the reliability of the quality evaluation result is impaired. Therefore, high-quality evaluation can be easily performed.

[0013] The evaluator inputs and stores scores representing the quantification of the quality of the thing described by the summary explanation data from the viewpoint of each of the categories for the plurality of evaluators, and stores the scores. It is determined whether or not a plurality of scores representing the quantification of article quality from the same viewpoint are different from each other by a predetermined amount or more, and when it is determined that the scores are different, predetermined second alarm information is output. By doing so, it is possible to prevent a situation in which the scores given to the same category for the same thing are far from each other by more than a predetermined amount and the reliability of the quality evaluation result is impaired. The evaluation can be easily performed even by a shallow person.

If the second correspondence data indicating the correspondence between the explanation item and the category is stored and output in response to an external request, the correspondence between the explanation item and the category is obtained. Is clear to the evaluator, so that a high-quality evaluation can be easily performed.

The summary explanation data indicates which of the categories is classified when the matter is classified into a plurality of categories from the viewpoint of each of the explanation items, and is associated with the explanation item. The question represented by the evaluation question data includes the classification data, and the question represented by the evaluation question data is associated with the explanation item. 2 out of the outline explanation data, the classification data indicating the division substantially the same as the division indicated by the classification data of the first outline explanation data is specified, and the specified classification data is associated therewith. By extracting the question associated with the explanation item from the evaluation question data and outputting the extracted question, the evaluation question created in the past can be diverted to a newly created evaluation question. Questions with high likelihood are extracted, giving guidance on what questions to ask, and using the wisdom of those with extensive experience in quality evaluation to facilitate high-quality evaluation. become.

An assessment support system according to a second aspect of the present invention includes a plurality of explanation items, and inputs and stores outline explanation data for explaining an object from the viewpoint indicated by each of the explanation items. Summary storage means for outputting the stored summary description data in accordance with the operation of the operator, and an evaluation question representing a question about the thing issued to evaluate the quality of the thing described by the summary description data Inputting and storing data, inputting evaluation question storage means for outputting the stored evaluation question data in accordance with an operation of an operator, and inputting evaluation answer data representing an answer to the question represented by the evaluation question data. Evaluation response storage means for storing and outputting the evaluation response data according to the operation of the operator; and evaluating the quality of the thing described by the summary description data. It represents the evaluation result data inputted and stored, comprising the evaluation result storage means for outputting the evaluation result data stored in accordance with operation of an operator, and wherein the.

According to such an assessment support system, if a person or the like who evaluates the quality of an object creates and inputs evaluation question data with reference to the outline explanation data, the evaluation of the quality of the object can be performed. A person who intends to receive the evaluation can receive the evaluation by answering only the question indicated by the evaluation question data, without preparing all the answers to the evaluation question assumed in advance. Therefore, the quality evaluation is performed easily and quickly, and the burden of the preparation work to be performed by the person who is going to receive the quality evaluation is reduced.

A summary description question storage means for inputting and storing summary description question data representing a question about the description method of the summary description data, and outputting the stored summary description question data in accordance with an operation of an operator. If further provision is made, description of the summary explanation data will be smoothly performed, and quality evaluation will be performed more quickly.

The evaluation result data may be any data as long as it evaluates, for example, the quality of the thing described by the outline description data from each of a plurality of categories.

First, a correspondence between the categories is shown.
First correspondence storage means for storing the correspondence data of the items, wherein the evaluation result storage means quantifies the quality of the thing described by the outline description data from the viewpoint that the evaluator represents each of the categories. Means for storing a score representing the quality of the thing, and a plurality of the quality representing the quality of the thing from the plurality of viewpoints indicated by the plurality of categories associated with each other by the first correspondence data. Means for determining whether or not the scores differ from each other by a predetermined amount or more, and outputting predetermined first alarm information when the scores are determined to be different from each other. Is prevented from deteriorating the reliability of the quality evaluation result due to the score of the predetermined value being more than a predetermined amount, so that even a person with little experience in quality evaluation can easily perform the evaluation.

The evaluation result storage means inputs, for a plurality of the evaluators, scores representing the quality of the thing described by the summary explanation data from the viewpoint represented by each of the categories by the evaluator. Means to store and determine whether or not the scores representing the quality of the same thing digitized from the same viewpoint are different from each other by a predetermined amount or more, and when it is determined that the scores are different. Means for outputting predetermined second alarm information, the scores given for the same category for the same thing are far apart by more than a predetermined amount between evaluators, and the reliability of the quality evaluation result is improved. Since damage is prevented, high-quality evaluation can be easily performed.

If it is provided with second correspondence storage means for storing second correspondence data indicating the correspondence between the explanation item and the category and outputting the data in accordance with the operation of the operator, Since the correspondence between the category and the category becomes clear to the evaluator, high-quality evaluation can be easily performed.

The summary explanation data indicates which of the categories is classified when the matter is classified into a plurality of sections from the viewpoint of each of the explanation items, and is associated with the explanation item. The question represented by the evaluation question data includes the classification data, and the question represented by the evaluation question data is associated with the explanation item. 2 out of the outline explanation data, the classification data indicating the division substantially the same as the division indicated by the classification data of the first outline explanation data is specified, and the specified classification data is associated therewith. If it is provided with a question extracting means for extracting a question associated with the explanation item from the evaluation question data and outputting the extracted question, among the evaluation questions created in the past, a newly created evaluation question Questions that are likely to be diverted to questions are extracted, so guidance is given on what questions to ask, and high-quality evaluations can be made using the wisdom of people with extensive experience in quality evaluation. It will be easy to do.

A program according to a third aspect of the present invention stores a computer by inputting general explanation data including a plurality of explanation items and explaining a thing from the viewpoint indicated by each of the explanation items. A summary storage unit that outputs the stored summary description data in accordance with an operation of an operator, and an evaluation unit that represents a question about the thing issued to evaluate the quality of the thing described by the summary description data. Inputting and storing question data, evaluation question storage means for outputting the stored evaluation question data in accordance with the operation of the operator, and evaluation answer data representing an answer to the question represented by the evaluation question data. An evaluation response storage means for inputting and storing the response data for evaluation and outputting the stored response data for evaluation in accordance with an operation of an operator; Type and stores the evaluation result data representing, characterized in that the evaluation result storage means for outputting the evaluation result data stored in accordance with operation of the operator, is intended to function with.

According to the computer that executes such a program, if a person or the like who evaluates the quality of an object creates and inputs evaluation question data with reference to the outline explanation data, the quality of the object can be improved. A person who intends to receive the evaluation can receive the evaluation by answering only the question indicated by the evaluation question data without preparing all the answers to the evaluation questions that are assumed in advance. Therefore, the quality evaluation is performed easily and quickly, and the burden of the preparation work to be performed by the person who is going to receive the quality evaluation is reduced.

[0026]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an assessment support method and an assessment support system according to an embodiment of the present invention will be described using a VRA (Virtual Remote Assessment) system for performing an assessment of management quality of an organization as an example. .

FIG. 1 is a diagram showing a V according to an embodiment of the present invention.
FIG. 1 is a diagram illustrating a configuration of an RA system. As shown
This VRA system includes a database storage server 1,
User terminals 2-1 to 2-n (n is the total number of user terminals)
And a database management terminal 3.
Database storage server 1, user terminals 2-1 to 2-n
The database management terminal 3 is connected to each other via a network N such as the Internet.

The database storage server 1 is composed of a server computer or the like, and has a program for controlling processing to be described later, which is executed by itself, a master database 11, a business summary FAQ database 12, a business summary database 13, , Evaluation Question Database 14
, Answer database 15 and evaluation result database 1
6 is stored. Then, in accordance with a program stored by itself, reading and updating of data stored in these databases and other processes described later are performed.

The master database 11 includes a business outline description essential point 101, a category-based examination item table 102,
Scoring table 103 by category and scoring guideline 1
04, the inter-category association table 105, and the business outline-
Category association table 106 and organization list 107
And a judge list 108.

The business outline description essential point 101 is data for explaining a format of a “business outline” which is data stored in the business outline database 13 by a process described later. The “business outline” is data that describes the business operated by the organization from a plurality of viewpoints (for example, the location of the organization, the number of members, the type of business, the main customer class, etc.), and is schematically shown in FIG. As shown in the above, the contents of the “business outline” are organized for each of these viewpoints.

Each item of the “business outline” is classified into one of a plurality of categories according to the viewpoint represented by the item. Contains data indicating Specifically, as shown in FIG. 2, the item indicating the location of the organization includes, for example, which regional block the location belongs to when the location is classified into one of a plurality of regional blocks. Data is included. Note that, in FIG. 2, the hatched ones of the categories of the “business outline” are schematically represented as the categories to which this organization belongs. Therefore, for example, the organization ID
Is “001”, the “business development target area” is “Japan”, and the “number of employees” is “several hundred”.

The examination item table 102 for each category includes a “category” representing a viewpoint for evaluating the management quality of the organization.
And a list of examination items to be examined by the organization according to the viewpoint represented by this category in a form associated with each other.

The category-based score table 103 includes the above-described categories and data indicating a range of values to be given to the organization to be examined as a result of the examination according to the viewpoint represented by the category. Are associated with each other.

The rating guideline 104 is data describing points to be considered when the judge decides a score to be given to the organization.

The inter-category association table 105 is data indicating correspondence between a plurality of categories. The categories associated with each other by the inter-category association table 105 are, for example, because the viewpoints are similar, etc., between the scores given to the same organization as a result of the examination along the viewpoints represented by these categories. It is expected that the difference will not exceed a predetermined amount.

Business Overview-Category Related Table 106
Is data indicating the correspondence between the above-described category and the items included in the “business outline”. As for the category and the item of the “business summary” associated with each other in the business summary-category association table 106, for example, the content of the item of the “business summary” can be used as a material for examination along the category. It is shown that.

The organization list 107 includes an organization ID (IDentification) for identifying an organization permitted to undergo the assessment using the VRA system, an e-mail address of the organization, and a name of the organization. This is a list stored in association with each other.

The judge list 108 is a list for storing the judge ID for identifying the judge performing the assessment using the VRA system, the e-mail address of the judge, and the name of the judge in association with each other. . In addition,
It is assumed that the e-mail address is also assigned to the “judge team” which is an organization composed of all the judges identified by these judge IDs. (However, the judge team may consist of only one judge.)

Business Overview FAQ (Frequently Asked Quest
The ions 12) The database 12 stores data representing the text of a question issued to the judge by the organization subject to the assessment regarding the description method of the “business outline” and the organization ID of the organization that issued the question. These are databases that are stored in association with each other.

The business summary database 13 schematically shows the above-mentioned “business summary” submitted by the organization to the judge and the organization ID of the organization that submitted the “business summary” as shown in FIG. Are stored in association with each other.

The evaluation question database 14 includes data representing text including question items of questions (evaluation questions) issued by the judge who has received the “business outline” for performing the assessment, and the evaluation questions. This is a database that stores the organization IDs of the organizations that are the other party in association with each other as schematically shown in FIG. Note that each question item included in the evaluation question is, as schematically shown in FIG.
It is associated with any of the above-mentioned items in the “business outline”.

The answer database 15 is a database that stores data representing the text of a response issued to the judge by the organization as a response to the evaluation question and the organization ID of the organization in association with each other.

The evaluation result database 16 is a document “evaluation report” which is a document created by a panel of judges (a judge team) as a conclusion of the assessment of the organization that has submitted the “business outline” and the answers to the questions for evaluation. And the organization ID of the organization in association with each other.
The evaluation report includes the above-described scores determined by evaluating the quality of management of the organization from the viewpoints indicated by the above categories,
And evaluation comments that discuss the results of the evaluation.

The user terminals 2-1 to 2-n have substantially the same configuration as each other, and are each composed of a personal computer or the like. User terminal 2-x (x
Is an integer of 1 or more and n or less) includes an input device such as a keyboard and a mouse, and a display device such as a liquid crystal display.

The user terminal 2-x stores a program for controlling a process to be described later, which is executed by the user terminal 2-x, and a mail client program for sending and receiving electronic mail. The user terminal 2-x that executes the mail client program is an SMTP (Simple Mail Transf
network N according to a protocol such as
, And receives the e-mail via the network N.

The database management terminal 3 has substantially the same configuration as the user terminal 2-x, for example, and is composed of a personal computer or the like. The database management terminal 3 includes an input device such as a keyboard and a mouse, and a display device such as a liquid crystal display.

(Operation) Next, the operation of the VRA system will be described. 4 and 5 are flowcharts showing the procedure of the assessment. FIG. 6 is a flowchart showing the procedure of the operation and the like during the evaluation period. FIG. 7 is a flowchart showing the procedure for updating the examination criteria. FIG. 8 is a flowchart showing the procedure for newly registering an organization / judge.

(Procedure of the assessment) The person in charge of the organization who is going to undergo the assessment firstly enters the “business overview”
It is examined whether there is any unclear point regarding the description method (step S101). Then, if it is determined that there is no unclear point, the operation proceeds to step S105.

On the other hand, if it is determined that there is any unclear point in the description method of the “business outline”, the person in charge, etc., enters the user terminal 2-j (j
Is an arbitrary integer from 1 to n) to instruct the user terminal 2-j to browse the business overview FAQ database 12. In response to this instruction, the user terminal 2-j accesses the business outline FAQ database 12 stored in the database storage server 1, reads out the data stored in the business outline FAQ database 12, and displays its own display unit. (Step S102).

Next, the person in charge prepares a question to the judge regarding the description method of the “business outline”, the text of the prepared question, and the organization ID for specifying the organization that issues this question.
Is input to the user terminal 2-j by operating the input unit of the user terminal 2-j. And user terminal 2-
By operating j, the user terminal 2-j is instructed to register the entered question. The user terminal 2-j accesses the business outline FAQ database 12 in response to this instruction, and stores the input question text and organization ID in the business outline FAQ database 12 in association with each other (step S103). ). In step S103, the user terminal 2-
j also sends an e-mail to the e-mail address of the judge team to the effect that the question to the judge regarding the description method of the "business outline" has been registered. The sender of this e-mail transmitted in step S103 is, for example, the organization ID input to the user terminal 2-j in step S103.
Organization.

On the other hand, the judge or the like has the user terminal 2-k (k
Is an integer from 1 to n) to receive an e-mail addressed to the judge team. And that they have registered a question for the judge regarding the description method of the "business summary"
When the user terminal 2-k receives an e-mail addressed to the judge team from the organization (step S201), the judge operates the user terminal 2-k and operates the user terminal 2-k.
Is instructed to view the questions asked by this organization. The user terminal 2-k accesses the business outline FAQ database 12 in response to this instruction, and reads out the text of the question stored in the business outline FAQ database 12 in association with the organization ID of this organization. Then, it is displayed on the display screen of its own display unit (step S202). The organization ID of this organization is obtained, for example, by operating the user terminal 2-k, causing the user terminal 2-k to search the organization list 107 of the master database 11, and receiving the e-mail received in step S201. The identification may be made by searching for the organization ID associated with the e-mail address or name of the sender.

Next, the judge or the like prepares an answer to the question whose text is displayed by the user terminal 2-k in step S202, and the text of the prepared answer and the organization (ie, the partner of the answer) And the organization ID of the organization which is the sender of the question displayed in step S202) and the user terminal 2
By operating the input section of -k, input is made to the user terminal 2-k. Then, the user terminal 2-k is operated to instruct the user terminal 2-j to register the input answer. The user terminal 2-k accesses the business outline FAQ database 12 in response to this instruction, and stores the input response text and organization ID in the business outline FAQ database 12 in association with each other (step S203). ). Also,
In step S203, the user terminal 2-k performs step S2.
03, it is addressed to the mail address of the organization indicated by the organization ID input to the user terminal 2-k, and the response to the question regarding the description method of the “business outline” issued by this organization is registered. It also sends e-mail.

The person in charge of the organization that has issued a question regarding the description method of the “business outline” operates the user terminal 2-j,
An e-mail addressed to this organization is received. And
When the user terminal 2-j receives the e-mail indicating that the answer to the question about the description method of the “business outline” has been registered, the person in charge operates the user terminal 2-j and operates the user terminal 2-j.
-J accesses the business overview FAQ database 12 and displays the answer stored in the business overview FAQ database 12 (step S104).

Next, the person in charge creates a “business outline”. When the process of step S104 is performed and the answer to the question about the description method of the “business outline” is displayed, it is naturally desirable to consider the contents of the answer when creating the “business outline”. Then, the person in charge, etc., writes the text of the created “business outline” and the organization ID identifying the organization that created the “business outline” to the user terminal 2-
j, and instructs the user terminal 2-j to register the input “business outline”. The user terminal 2-j accesses the business outline database 13 in response to the instruction, and stores the input “business outline” text and the organization ID in the business outline database 13 in association with each other (step). S105). Also, in step S105, the user terminal 2-j addresses the e-mail address of the judge team,
An e-mail to the effect that the "business outline" has been registered is also sent.
The sender of this e-mail is, for example, the value in step S10
It is assumed that the organization indicated by the organization ID input to the user terminal 2-j in step 5.

When the user terminal 2-k receives the e-mail indicating that the "business outline" has been registered (step S204), the judge operates the user terminal 2-k and operates the user terminal 2-k. Instruct −k to browse the “business outline” created by the organization that is the sender of this e-mail. User terminal 2-
k accesses the business outline database 13 in response to this instruction, reads out the text of the “business outline” stored in the business outline database 13 in association with the organization ID of this organization, and displays the self. It is displayed on the display screen of the unit (step S205).

Next, the judge or the like operates the user terminal 2-k so that the business outline-category association table 106 is stored in the user terminal 2-k as a reference for preparing an evaluation question.
To browse In response to this instruction, the user terminal 2-k accesses the master database 11 stored in the database storage server 1, and
Summary-category association table 10 stored in
6 is read and displayed (step S206A).

In addition, the judge or the like may ask the judge (not limited to the incumbent judge) for an evaluation question previously issued to the organization (not limited to the organization currently under assessment). If it is desired to refer to the example, the user terminal 2-k is operated in step S206A to input the organization ID of the organization in which the “business outline” is registered, and instruct browsing of past evaluation questions. In response to this instruction, the user terminal 2-k first accesses the business outline database 13 and registers the “business outline” (that is, the “business outline”) registered by an organization other than the organization that is the partner of the evaluation question to be created. , At least one of the “business outline” associated with an organization ID of an organization other than the organization that is the counterpart of the evaluation question)
The classification of each item is specified that matches the classification of the item in the “business outline” registered by the organization that is the partner of the evaluation question. Then, for each of the identified "business outlines", the classification of any item of the "business outline" matches the classification of the corresponding item of the "business outline" registered by the organization that is the counterpart of the evaluation question. Also identify. Next, the user terminal 2-k accesses the evaluation question database 14 and, among the evaluation questions stored in the evaluation question database 14, the evaluation question associated with the specified “business outline”. A question is specified, and from among the question items of the specified evaluation question, a question item associated with the item specified as having a classification in the “business outline” is read and displayed.

Then, the judge or the like determines in step S206A
With reference to the business summary-category-related table 106 and the question items displayed in the above, select which category should be examined for the organization in which the “business summary” is registered,
Create an evaluation question to be sent to the organization that has registered the “business overview” for the selected category. Then, the text of the created evaluation question and the organization I that specifies this organization
D is input to the user terminal 2-k by operating the input unit of the user terminal 2-k, and the user terminal 2-k is instructed to register the input evaluation question. User terminal 2-k
Accesses the evaluation question database 14 in response to this instruction, and enters the text of the input evaluation question and the organization I
D are stored in the evaluation question database 14 in association with each other (step S206B). Step S2
At 06B, the user terminal 2-k also sends an e-mail to the mail address of the organization that is the other party of the question to the effect that the evaluation question has been registered to this organization.

On the other hand, the person in charge of the organization that has registered the "business outline" operates the user terminal 2-j to receive an electronic mail addressed to this organization. Then, when the user terminal 2-j receives an e-mail indicating that the evaluation question about the “business outline” newly registered by the organization is registered (step S106), the person in charge, etc., enters the user terminal 2
-J is operated to allow the user terminal 2-j to access the evaluation question database 14, and the evaluation question stored in the evaluation question database 14 (that is, the "newly registered" (Evaluation question) associated with the "business outline" (step S10).
7).

Next, the person in charge prepares an answer to the evaluation question displayed in step S107, the text of the created answer, and the organization I that specifies the organization that created the answer.
D is input to the user terminal 2-j, and the user terminal 2-j
Is instructed to register the entered answer. User terminal 2-j
Accesses the answer database 15 in response to this instruction, and stores the text of the input answer and the organization ID in the answer database 15 in association with each other (step S108). Also, in step S108, the user terminal 2-
j also sends an e-mail to the e-mail address of the judge team to the effect that the response to the evaluation question has been registered.

When the judge receives the e-mail indicating that the user terminal 2-k has registered the answer to the evaluation question,
By operating the user terminal 2-k, the organization ID of the organization that is the sender of the e-mail is input, and the user terminal 2-k is input.
Is instructed to view this answer. The user terminal 2-k is
The response database 15 is accessed in response to the instruction, and the response database 15 has the organization ID of the organization.
Read out the text of the answer stored in association with
It is displayed on the display screen of its own display unit (step S20
7).

Next, the judge examines whether or not to further issue an evaluation question to the organization in which the evaluation question has been registered (step S208). If it is determined that the evaluation question should be further issued, the process returns to step S206A.

On the other hand, if it is determined that the evaluation question is not to be issued, the judge operates the user terminal 2-k and sends it to the e-mail address of the organization that has input the answer to the evaluation question in step S108. Then, an e-mail is sent to the effect that the question for evaluation to this organization is ended (step S2).
09).

The person in charge of the organization that has registered the answer to the evaluation question has an e-mail indicating that questioning of the evaluation question to this organization has been completed, or an evaluation question to this organization has been registered. The user terminal 2-j is operated to repeatedly receive the e-mail addressed to the organization until one of the e-mails indicating the arrival of the e-mail arrives. When the user terminal 2-j receives one of the two types of e-mails, it determines which type of e-mail the user terminal 2-j has received (step S109). When it is determined that the e-mail indicating that the evaluation question has been registered to this organization has arrived again, the process returns to step S106. On the other hand, if it is determined that an e-mail has been received indicating that the question for evaluation to this organization has been completed, the person in charge of this organization will receive an e-mail indicating that the evaluation report for this organization has been registered. Until it arrives, the user terminal 2-j is operated to continuously and repeatedly receive the e-mail addressed to this organization.

On the other hand, when the judge sends an e-mail to the effect that the question for evaluation is to be ended in step S209, the operation of the evaluation period shown in FIG. 6 is started (step S210).

When entering the work of the evaluation period, each judge judges each of the categories selected in step S206B.
From the viewpoint indicated by this category, an evaluation comment for discussing the result of evaluating the organization to be assessed is provisionally determined (step S301). In provisionally determining the evaluation comment, for example, the user terminal 2-k is operated and the category-based examination item table 102 of the master database 11 is operated.
To display the contents of the category-specific examination item table 102, and refer to the displayed contents.

Next, each judge tentatively determines, for each of the categories selected in step S206B, a score to be given to the organization to be assessed from the viewpoint indicated by this category. In tentatively determining the score, for example, the user terminal 2-k is operated and the category-based score table 103 and the score guideline 104 of the master database 11 are operated.
To display the contents of the category-specific score table 103 and the rating guideline 104, and refer to the displayed contents.

Then, each judge, etc., enters the user terminal 2-k
To input the scores provisionally determined by each of them, the judge ID for identifying each of them, and the organization ID indicating the organization to be evaluated to the user terminal 2-k. It is instructed to store the score in the evaluation result database 16 (step S302). The user terminal 2-k accesses the evaluation result database 16 in response to the instruction,
In the evaluation result database 16, the input scores, organization IDs, and judge IDs are stored in association with each other.
In addition, the user terminal 2-k outputs each score, for example,
The category is stored with data indicating which category the score is for.

When each score temporarily determined by each judge is stored in the evaluation result database 16, the database storage server 1 determines in step S 302 that the evaluation result database 1
Based on the scores newly stored in No. 6, it is determined whether or not there is a category having a score difference of a predetermined amount or more among a plurality of judges for the same category (step S30).
3).

If it is determined in step S303 that there is no corresponding category, the database storage server 1 shifts the processing to step S305. On the other hand, step S30
If the database storage server 1 determines that there is a corresponding category in step 3, the database storage server 1 issues an alarm indicating that there is a category having a score difference of a predetermined amount or more among the judges in the same category (step S304). Step S
Move on to the processing of 305. A specific method of issuing an alarm in step S304 is, for example, a method of sending an e-mail addressed to each judge, or a method in which a score of a predetermined amount or more among judges in the same category is sent to the database management terminal 3. Any method may be used as long as a message indicating that there is a category having a difference is supplied, and the database management terminal 3 displays an image representing the message.

In step S305, the database storage server 1 accesses the master database 11 and, based on the contents of the inter-category association table 105 stored in the master database 11, selects one of the categories selected in step S206B from each other. Identify the set of attached categories. Then, for each of the identified pairs, between the categories associated with each other,
It is determined based on the score newly stored in the evaluation result database 16 in step S302 whether or not the score temporarily determined by the same judge has a difference equal to or more than a predetermined amount.

If it is determined that there is no difference between the categories of the scores in each of the sets by a predetermined amount or more, each examiner proceeds to step S307. On the other hand, if the database storage server 1 determines that there is a set having a difference of a predetermined amount or more between the categories, the database storage server 1 issues an alarm indicating the corresponding set (step S306), and then each judge performs the work of step S307. Move on to Step S3
A specific method of issuing an alarm in 06 is, for example, a method of sending an e-mail to a judge who has tentatively determined a score that causes a difference of a predetermined amount or more between categories associated with each other, Any method may be used as long as it supplies a message to the effect that there is a corresponding set to the database management terminal 3 and the database management terminal 3 displays an image representing this message.

In step S307, each judge mutually confirms the evaluation comment and the score provisionally determined by one another. When alarms are issued in steps S304 and S306, these alarms are also referred to. Then, each judge decides whether or not the evaluation comment and the score provisionally determined by each examiner are finalized (step S308). Then, when it is determined not to be determined, the process returns to the step S301. On the other hand, when it is determined to be finalized, the judge team edits the finalized evaluation comment and score and creates an evaluation report (step S309), and ends the operation of the evaluation period.

After completing the work for the evaluation period, the judge
The user inputs the evaluation report created in step S309 and the organization ID of the organization that presents the evaluation report to the user terminal 2-k by operating the input unit of the user terminal 2-k. . Then, the user terminal 2-k
To instruct the user terminal 2-k to register the input evaluation report. The user terminal 2-k accesses the evaluation result database 16 in response to this instruction, and stores the input evaluation report and organization ID in the evaluation result database 16 in association with each other (step S2).
11). Also, in step S211 the user terminal 2-k
Also sends an e-mail to the e-mail address of the organization to which this evaluation report is presented to the effect that the assessment has been completed.

On the other hand, the person in charge of the organization receiving the e-mail indicating the end of the question transmitted in step S209,
The user operates the user terminal 2-j to receive an electronic mail addressed to the organization. When the user terminal 2-j receives the e-mail indicating the completion of the assessment (step S110), the person in charge operates the user terminal 2-j and stores the evaluation result database in the user terminal 2-j. 16 and download or display the evaluation report associated with the organization ID of this organization (step S111).

Steps S101 to S11 described above
1. Steps S201 to S211 and step S301
As a result of following steps S309 to S309, an assessment of the management quality of the organization is performed, and an evaluation report indicating the result of the assessment is created and presented to the organization to be assessed.

(Procedure for Updating Examination Criteria) The administrator of the VRA system, among the data stored in the master database 11 at the timing when the examination criteria document is obtained, (That is, the business outline description essential point 101, the examination item table 1 by category.
02, it is determined whether or not the category-based score table 103 and the rating guideline 104) need to be updated (step S401). If it is determined that there is no need to update, the business outline description essential point 101, the category-based examination item table 102, the category-based score table 103,
Finish the work without updating the scoring guideline 104.

On the other hand, if it is determined that updating is necessary,
The administrator or the like operates the database management terminal 3 to enter the business outline description essential point 101 and the category-specific examination item table 1.
02, data that constitutes a part to be updated in the category-based score table 103 and the rating guideline 104 is input. Then, the user operates the database management terminal 3 to access the master database 11, and the business outline description essential point 101, the category-based examination item table 102, the category-based score table 103, and the rating guideline 104 stored in the master database 11. Then, the part to be updated with the data input by the administrator or the like is updated as indicated by the data (step S402), and the operation is completed.

(Procedure for Registering Organization / Judge) This VRA
The system administrator or the like operates the database management terminal 3 when the organization list 107 of the master database 11 needs to be updated because a new organization has applied for an assessment or the like. Data to be added to the list 107 include the email address of the new organization,
The organization ID of this organization and the name of this organization are input. Then, the user operates the database management terminal 3 to access the master database 11, and stores the mail address, the organization ID, and the name of the organization input by the administrator or the like in the organization list 107 stored in the master database 11. The work is completed by associating (step S501).

Also, the administrator of the VRA system
When it is necessary to update the judge list 108 in the master database 11 because of the appointment or exclusion of the judge, the database management terminal 3 is operated and the judge is set as data representing the new judge. Enter the e-mail address, the judge's ID of this judge and the name of this judge,
Alternatively, as the data indicating the resigning judge, the judge ID of the resigning judge, the e-mail address of the judge, or the name of the judge is input. Then, the user operates the database management terminal 3 to access the master database 11, and enters the e-mail address and the judge ID of the newly appointed judge entered by the manager or the like in the judge list 108 stored in the master database 11. And the name are added in association with each other, or the data input as the data indicating the retired judge and the data associated with the data are deleted (step S501), and the operation is completed.

The configuration of this VRA system is not limited to the above. For example, the same server computer may perform the functions of the database storage server 1 and the database management terminal 3, or the database management terminal 3
May perform the function of the user terminal 2-x. Further, the user terminal 2-x may include a printing device such as a printer that prints data (for example, “business outline” or “evaluation report”) read from the database storage server 1. The object to be evaluated using the VRA system is not limited to the quality of management, but may be arbitrary. For example, it may be used for assessment of product quality or manufacturing process, or a specific business plan or business progress. It may be used for assessment of the situation.

The user terminals operated in steps S102 to S111 may be different from each other. Steps S201 to S205, S20
The user terminals operated in the respective steps of 6A, S206B, S207 to S209 and S211 may be different user terminals. On the other hand, steps S102 to S1
11, user terminals operated in each step, and steps S201 to S205, S206A, S206B, S20
The user terminals operated in each of steps 7 to S209 and S211 may be the same user terminal.

Although the embodiments of the present invention have been described above, the assessment support system according to the present invention can be realized by using a general computer system without using a dedicated system. For example, a single computer,
Alternatively, a program for executing the operations of the database storage server 1, the user terminals 2-1 to 2-n, and the database management terminal 3 on a plurality of computers each having a DSU or a terminal adapter and connected to each other. By installing these programs from a medium (CD-ROM, magnetic tape, or the like) storing the VRA, a VRA system that executes the above-described processing can be configured.

Further, for example, a bulletin board (BB) of a communication line
These programs may be posted on S) and distributed via a communication line. Alternatively, a carrier wave is modulated by a signal representing these programs, the obtained modulated wave is transmitted, and this modulated wave is transmitted. The receiving device may restore the program by demodulating the modulated wave. Then, by starting this program and executing it in the same manner as other application programs under the control of the OS, the above-described processing can be executed.

When the OS shares a part of the processing,
Alternatively, when the OS constitutes a part of one component of the present invention, the recording medium may store a program excluding the part. Also in this case, in the present invention, it is assumed that the recording medium stores a program for executing each function or step executed by the computer.

[0086]

As described above, according to the present invention, an assessment support method and an assessment support system capable of performing assessment easily and quickly are realized. Further, according to the present invention, an assessment support method and an assessment support system that can easily perform a high-quality assessment by utilizing the wisdom of a person who is experienced in the assessment are realized. Further, according to the present invention, an assessment support method and an assessment support system that reduce the burden of preparation work to be performed by a person who is going to undergo an assessment are realized.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a VRA system according to an embodiment of the present invention.

FIG. 2 is a diagram schematically illustrating a data structure of a “business outline”;

FIG. 3 is a diagram schematically showing a data structure of an evaluation question.

FIG. 4 is a flowchart showing a procedure of an assessment.

FIG. 5 is a flowchart showing a continuation of an assessment procedure.

FIG. 6 is a flowchart illustrating a procedure of work and the like during an evaluation period.

FIG. 7 is a flowchart showing a procedure for updating the examination criteria.

FIG. 8 is a flowchart showing a procedure for registering an organization / judge.

[Explanation of symbols]

 1 Database Storage Server 2-1 to 2-n User Terminal 3 Database Management Terminal N Network 11 Master Database 12 Business Summary FAQ Database 13 Business Summary Database 14 Evaluation Question Database 15 Answer Database 16 Evaluation Result Database 101 Business Summary Description 102 Judgment item table by category 103 Scoring table by category 104 Rating guideline 105 Inter-category relation table 106 Business overview-Category relation table 107 Organization list 108 Judge list

Claims (15)

[Claims] 1. A system including a plurality of explanation items, inputting and explaining outline explanation data for explaining a thing from the viewpoint indicated by each of the explanation items, and responding to the request from the outside with the stored outline explanation data. The evaluation question data representing the question about the thing issued to evaluate the quality of the thing described by the summary explanation data is input and stored, and the stored evaluation question data is stored. In response to an external request, input and store evaluation response data indicating an answer to the question represented by the evaluation question data, and store the stored evaluation response data in response to an external request. Outputting and storing evaluation result data representing the evaluation of the quality of the thing described by the outline description data, and outputting the stored evaluation result data in response to a request from the outside. Special Assessment support method to be considered. 2. An outline description method question data representing a question about a description method of the outline description data is inputted and stored, and the stored outline description method question data is output in response to an external request. The assessment support method according to claim 1, wherein: 3. The evaluation result data according to claim 1, wherein the quality of the thing described by the summary explanation data is evaluated from a viewpoint represented by each of a plurality of categories. Assessment support method described. 4. A first data indicating a correspondence between the categories.
Storing a score representing the quality of the thing described by the summary description data which is quantified by an evaluator from a viewpoint represented by each of the categories; and the first correspondence data It is determined whether or not the scores representing the numerical value of the quality of the thing are different from each other by a predetermined amount or more from the viewpoints indicated by the plurality of categories associated with each other, and are different. 4. The assessment support method according to claim 3, wherein predetermined first alarm information is output when the judgment is made. 5. An evaluator inputs and stores scores representing a numerical value of the quality of the thing described by the outline explanation data from a viewpoint represented by each of the categories for a plurality of the evaluators. It is determined whether or not a plurality of scores representing the quality of the thing from the same viewpoint in terms of numerical values are different from each other by a predetermined amount or more, and when it is determined that the scores are different, predetermined second alarm information The assessment support method according to claim 3 or 4, wherein: 6. The apparatus according to claim 3, wherein second correspondence data indicating the correspondence between the explanation item and the category is stored and output in response to an external request. 5. The assessment support method according to 5. 7. The summary description data indicates which of the categories is classified when the object is classified into a plurality of categories from the viewpoint indicated by each of the description items, and corresponds to the description item. The question represented by the evaluation question data is associated with the explanation item, and is other than the first outline explanation data for explaining an object whose quality is to be newly evaluated. Out of the second summary explanation data, classifying data indicating a category substantially the same as the category indicated by the classification data of the first summary explanation data,
The question associated with the item for explanation to which the specified classification data is associated is extracted from the question data for evaluation and output. Assessment support method described in. 8. An outline explanation data including a plurality of explanation items, and explaining a thing from the viewpoint indicated by each of the explanation items is inputted and stored, and the stored outline explanation data is outputted in accordance with an operation of an operator. Summary storage means, input and store evaluation question data representing a question about the thing issued to evaluate the quality of the thing described by the summary explanation data, and store and store the evaluation question Evaluation question storage means for outputting data in accordance with the operation of the operator; inputting and storing evaluation response data representing an answer to the question represented by the evaluation question data, and operating the stored evaluation response data Evaluation response storage means for outputting in accordance with a user's operation, and inputting and storing evaluation result data representing the evaluation of the quality of the thing described by the outline description data, and storing and storing the evaluation result Assessment support system comprising a evaluation result storage means for output according to operator's operation of the over data, and characterized in that. 9. An outline description method question storage for inputting and storing outline description method question data representing a question about the description method of the outline description data, and outputting the stored outline description method question data in accordance with an operation of an operator. The assessment support system according to claim 8, further comprising: means. 10. The evaluation result data according to claim 8, wherein the evaluation result data evaluates the quality of the thing described by the outline description data from a viewpoint represented by each of a plurality of categories. The assessment support system described. 11. An apparatus according to claim 1, further comprising: first correspondence storage means for storing first correspondence data indicating a correspondence relationship between the categories, wherein the evaluation result storage means comprises: Means for storing a score representing the quality of the quantification from the viewpoint represented by each of the categories by the evaluator; and the plurality of viewpoints indicated by the plurality of categories associated with each other by the first correspondence data. Means for judging whether or not the scores representing the numerical value of the quality of the thing are different from each other by a predetermined amount or more, and outputting predetermined first alarm information when it is determined that the scores are different from each other; The assessment support system according to claim 10, comprising: 12. The evaluation result storage means stores, for a plurality of the evaluators, a score representing the quality of the thing described by the outline explanation data which is quantified from the viewpoint of each of the categories by the evaluator. Means for inputting and storing, and judging whether or not a plurality of scores representing the quality of the same thing quantified from the same viewpoint are different from each other by a predetermined amount or more, and judging that the scores are different. A means for outputting predetermined second alarm information when the alarm is issued, The assessment support system according to claim 10 or 11, further comprising: 13. A second correspondence storage means for storing second correspondence data indicating a correspondence between the explanatory item and the category, and outputting the data in accordance with an operation of an operator. The assessment support system according to claim 10, 11 or 12. 14. The summary explanation data indicates which of the categories is classified when the thing is classified into a plurality of categories from the viewpoint indicated by each of the explanation items, and corresponds to the explanation item. A question represented by the evaluation question data is associated with the explanation item, and is other than the first outline explanation data for explaining an object whose quality is to be newly evaluated. Out of the second summary explanation data, classifying data indicating a category substantially the same as the category indicated by the classification data of the first summary explanation data,
14. A question extracting means for extracting a question associated with the explanation item associated with the specified classification data from the evaluation question data and outputting the extracted question. The assessment support system according to any one of the above. 15. A computer comprising: a plurality of explanation items; and input and store outline explanation data for explaining a thing from a viewpoint indicated by each of the explanation items;
A summary storage unit that outputs the stored summary description data in accordance with an operation of an operator; and an evaluation question representing a question about the thing issued to evaluate the quality of the thing described by the summary description data. Inputting and storing data, and evaluating question storage means for outputting the stored question data for evaluation in accordance with an operation of an operator; and inputting answer data for evaluation representing an answer to the question represented by the question data for evaluation. Evaluation response storage means for outputting the response data for evaluation stored in accordance with the operation of the operator; and inputting evaluation result data representing the evaluation of the quality of the thing described by the outline description data. Evaluation result storage means for storing and outputting the evaluation result data according to the operation of the operator;