KR20150089699A - Apparatus for evaluating of e-discovery solution - Google Patents

Abstract

Disclosed is an apparatus for evaluating an e-discovery solution. The apparatus for evaluating en e-discovery solution comprises: an evaluation target managing unit which identifies a driving environment for the e-discovery solution; an evaluation item creating unit which creates functions required for each procedure of e-discovery as evaluation items using the driving environment of the e-discovery solution; an evaluation preparing unit which identifies whether the e-discovery solution provides the functions using the created evaluation items and generates a query of the e-discovery solution referring to an experimental data set; a search executing unit which performs a search via the e-discovery solution with the generated query, and obtains information including one among time consumed in the search, a retrieved word, the number of retrieved documents; and an evaluation scale calculating unit which evaluates information search performance of the e-discovery solution by comparing the obtained information with a reference data set.

Description

[0001] APPARATUS FOR EVALUATION OF E-DISCOVERY SOLUTION [0002]

The present invention relates to a device for evaluating an electronic evidence (E-Discovery) tool, and more particularly, to an electronic evidence disclosure tool that provides a function of presenting evidence in electronic form in various lawsuits And to a device for evaluating the same.

Discovery is a concept that collectively collects evidence related to litigation from the other party or a third party. It is the concept of discovery, in which a party can request each other without a court intervention in civil or criminal proceedings. Is a legal system that discloses information related to litigation.

The object of this conventional commissioning system has been limited to offline evidence such as paper documents and evidence. However, in recent years, the proportion of digital evidence extracted from digital devices having various driving methods has been increasing. In other words, evidence-based procedures for online and network evidence are wider than offline evidence.

Accordingly, in recent years, there has been a proliferation of electronic documents (ESI, Electrically Stored Information) between parties involved in the litigation by expanding the limitation of existing documents to paper documents, which is a discovery of Electrically Stored Information ) Have been used.

The Electronic Evidence Initiation Tool is a solution that supports these electronic evidence initiation procedures. It is a software that provides functions such as identification, collection, processing, review, and production of data in preparation of various lawsuits in which electronic data must be submitted as evidence. ). In addition, various data management companies are currently developing software related to electronic evidence disclosure.

1 is a conceptual diagram of an electronic evidence disclosure tool provided by a conventional CommVault corporation.

As shown in FIG. 1, CommVault is a data management solution provider based on SIMPANA (10), a data management software capable of analyzing, copying, protecting, archiving and searching data on a single platform. And provides software that adds search and analysis capabilities to existing archiving and data protection features.

However, existing electronic evidence-based tools provided by vendors such as CommVault differ in the features provided by each tool. That is, since most electronic evidence-initiating tools provide only partial identification, conservation, collection, processing, review and production functions of electronic evidence-initiating procedures, it is important for users to compare and evaluate the performance of electronic evidence- There is a difficult problem.

Therefore, there is a need for an evaluation method that evaluates whether various electronic evidence commissioning tools accurately collect and analyze the electronic data required for litigation, and finds a common evaluation criterion and determines the performance of the tool.

It is therefore an object of the present invention to provide a method and apparatus for evaluating a search function provided by an electronic evidence disclosure tool in order to solve the above-mentioned problems.

It is also an object of the present invention to provide an evaluation method and apparatus for comparing the retrieval results of data using the retrieval function of various electronic evidence opening tools and determining the performance of the electronic evidence opening tool using the comparison results.

According to an aspect of the present invention, there is provided an apparatus for evaluating an electronic evidence starting tool, including an evaluation object management unit for identifying information and a driving environment of the electronic evidence start tool, An evaluation item creation unit that creates a function for each procedure of electronic evidence initiation as an evaluation item, a function of determining whether or not the function of the electronic evidence start tool is provided using the generated evaluation item, An evaluation preparation unit for generating a search statement of the electronic evidence, a search execution unit for performing a search through the electronic evidence start tool using the generated search statement, obtaining a search time, a searched word, And an evaluation scale for evaluating the information retrieval performance of the electronic evidence start tool by comparing the acquired information with a reference dataset And a calculation unit.

According to the present invention, it is possible to evaluate whether the function of identifying, collecting, processing, reviewing and producing electronic data for litigation is in the electronic evidence disclosure tool. Also, it is possible to compare the performance of various electronic evidence initiation tools, and it can be used as a selection criterion of electronic evidence commencement tool to be introduced in the enterprise. There is an effect of greatly reducing the cost required for the evaluation.

1 is a conceptual diagram of an electronic evidence disclosure tool provided by a conventional CommVault corporation.
2 is a block diagram illustrating a configuration of an electronic evidence initiation tool evaluation apparatus according to an embodiment of the present invention.
FIG. 3 is a diagram showing a preliminary evaluation item for each electronic evidence initiation procedure.
4 is a flow chart for examining the suitability of a reference data set according to an embodiment of the present invention.
5 is a flowchart illustrating an evaluation method of an electronic evidence initiation tool according to an embodiment of the present invention.
6 is a block diagram illustrating a computer system to which an embodiment of the invention may be applied.

The present invention provides an apparatus and method for evaluating a data retrieval function of a tool using an experimental data set generated in a file format that can be searched by an electronic evidence opening tool (E-DISCOVERY SOLUTION) and a pre-stored reference data set.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. The scope of the present invention is defined by the description of the claims, since it is only provided to fully inform the owner of the scope of the invention.

It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular forms herein include plural forms unless the context clearly dictates otherwise. &Quot; comprises " and / or "comprising" when used in this specification is taken to specify the presence or absence of one or more other components, steps, operations and / Or add-ons.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 2 is a block diagram illustrating a configuration of an evaluation apparatus for evaluating an electronic evidence according to an exemplary embodiment of the present invention. FIG. To facilitate understanding of the description, FIG. 2 and FIG. 3 will be described together.

2, the evaluation apparatus 200 for evaluating the electronic evidence provision tool according to an exemplary embodiment of the present invention includes an assessment object management unit 210, an evaluation item creation unit 210, An evaluation preparation unit 230, a search execution unit 240 and an evaluation scale calculation unit 250. [

The evaluation object management section 210 grasps the basic information of the tool such as the name of the electronic evidence start tool (E-DISCOVERY SOLUTION) to be evaluated (hereinafter collectively referred to as a tool) and the maker, To prepare a driving environment. Once the operating environment is ready, you can use tool tips, manuals, and white papers to identify the features of the tool, or use the tools and understand the features.

The evaluation item creation unit 220 refers to the preliminary evaluation item 224, which is a list of functions required in the identification, collection, processing, review, and production procedures of the electronic evidence commencement, And generates an evaluation item based on the identified function. For example, as shown in Fig. 3, among the procedures of electronic evidence initiation, the identification procedure includes a pre-evaluation item 224 for evaluating the function of providing the tool, and a pre-evaluation item 224 for evaluating the function of the identification procedure There are items related to the collection function and items related to the pre-analysis function of the case. The collection procedure includes the function of collecting and storing data (224). The evaluation item creation unit 220 grasps the functions provided by the tool in the procedure of starting the electronic evidence, and generates evaluation items based on the identified functions.

The evaluation preparation unit 230 determines whether the tool to be evaluated provides a data search function. If the tool provides a data search function, the evaluation preparation unit 230 collects the types and data of the documents to be applied to the tool's data search function evaluation, (260). Further, the modified search data is generated by modifying the search statement for evaluating the data search function according to the search method provided by the tool using the generated experimental data set 260.

Specifically, the experiment data set 260 is a set of data generated by the evaluation preparation unit 230 using the file format information that can be read by the tool, which is the information acquired by the evaluation object management unit 204. For example, when only the image file and the word file can be provided to the user to be evaluated in the raw data including the image file, the audio file, the word file, and the Korean file, the evaluation preparation unit 230 may store the image file and the word And generates an experimental data set 260 consisting only of files.

The search execution unit 240 performs a search operation using the search function of the tool using the search statement data generated by the evaluation preparation unit 230, and calculates the time spent for the tool to operate for the search operation, Using the same information as the searched document, the number of suitable documents is obtained as evidence.

The evaluation scale calculation unit 250 evaluates the data search function of the tool by comparing the number information of the document acquired by the search execution unit 240 with the previously stored evaluation reference number information.

Herein, the evaluation reference number information is information that is generated using the pre-stored reference data set 214 by using data data that has been submitted to a specific litigation that is disclosed on-line, for example, Enron litigation. Reference data sets will now be described in detail with reference to FIG.

4 is a flow chart for examining the suitability of a reference data set according to an embodiment of the present invention

Unless specifically stated otherwise, the performing entity in FIG. 4 means the evaluation preparation section 230 of the evaluation apparatus 200 of the electronic evidence start-up tool.

As shown in FIG. 4, a search is made for a document that has been submitted to a specific litigation, e.

In step S400, a predetermined number of thresholds, for example, 5000 documents, are randomly collected from the retrieved document.

Among the collected documents, common documents are merged (S402). Here, the merge means merging documents corresponding to a predetermined number of thresholds or more. For example, in the case of a document that is commonly retrieved by a plurality of tools, 100 documents are retrieved, 50 documents retrieved by only one tool, It is a method to merge 50 randomly selected documents.

In order to grasp the function provided by the tool using the merged document, the selected evaluation item is re-evaluated again (S404). The reference data set is generated using the merged document (S406).

The data retrieval function of the tool is evaluated using the generated reference dataset (S408)

5 is a flowchart illustrating an evaluation method of an electronic evidence initiation tool according to an embodiment of the present invention.

As shown in FIG. 5, the evaluation method of the electronic evidence initiation tool according to an embodiment of the present invention is a method of evaluating the electronic evidence initiation tool according to an embodiment of the present invention, Based on the disclosed information, the detailed information such as the name of the tool and the manufacturer is collected (S500).

In addition, the evaluation object management unit installs a library and an execution file necessary for driving the tool for the evaluation experiment (S502). In addition, the functions provided by the tool are grasped using the installed library and executable file information or using the usage guide, manual, and white paper provided with the tool (S504).

The evaluation item creation section refers to the preliminary evaluation item data of the procedure of the electronic evidence initiation among the functions of the identified tools, and selects the item provided by the tool as the evaluation item (S506).

The evaluation preparation department identifies whether the tool has a data search function, and generates an experimental data set by collecting the types and data of the documents that can be applied to the evaluation of the information search function of the tool. In step S508, a search query for evaluation is prepared using the generated test data set by modifying the search query according to the search method provided by the tool.

The search execution unit executes a search operation using the search function of the tool using the modified search statement (S510). After the search operation of the tool, the search execution unit searches the document for the time spent for the tool operation, Obtain a search result containing the appropriate number of documents as evidence.

The evaluation scale calculation unit calculates the obtained search result according to a predetermined evaluation scale (S512), compares the evaluation result of the evaluation target with the performance of other existing tools, and analyzes the evaluated result (S514).

6 is a block diagram illustrating a computer system to which an embodiment of the invention may be applied.

An embodiment of the present invention can be applied to a computer system such as a computer-recordable medium.

As shown in FIG. 6, the computer system 600 can be implemented in, for example, a computer readable medium.

Specifically, the computer system 600 comprises one or more processors 610, a memory 620, an input device 630 and an output device 640 via a user interface, and a storage unit 650, The device communicates using a data bus 660 within the computer system 600. In addition, the computer system 600 may also include a network interface 670 that is coupled to a network 672.

 The processor 610 may be a central processing unit (CPU) or a semiconductor device that executes processing instructions stored in the memory 620 or the storage 650.

 The memory 620 and the storage unit 650 may include various types of volatile or non-volatile storage media. For example, the memory may include a read-only memory (ROM) 622 and a random access memory (RAM)

The foregoing description is merely illustrative of the technical idea of the present invention and various changes and modifications may be made without departing from the essential characteristics of the present invention.

Therefore, the embodiments of the present invention are not intended to limit the scope of the present invention, and the scope of the present invention is not limited by these embodiments. It is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents, which fall within the scope of the present invention as claimed.

200: electronic evidence start tool evaluation device 210: evaluation subject management part
220: Evaluation item creation unit 230: Evaluation preparation unit
240: Search execution unit 250: Evaluation scale calculation unit
260: Experimental dataset 270: Reference dataset

Claims (1)

1. An apparatus for evaluating an electronic evidence commissioning tool that provides electronic data necessary for litigation,
An evaluation subject management unit for grasping a driving environment of the electronic evidence commencement tool;
An evaluation item preparation unit for generating a necessary function for each procedure of the electronic evidence start as an evaluation item using the detected driving environment of the electronic evidence start tool;
An evaluation preparation unit for determining whether or not the function of the electronic evidence start tool is provided using the generated evaluation item and generating a search statement of the electronic evidence start tool with reference to an experimental data set;
A search execution unit that performs a search through the electronic evidence start tool using the generated search statement and acquires information including any one of a search time, a searched word, and a number of searched documents as a result of the search; And
And an evaluation scale calculator for evaluating the information search performance of the electronic evidence start tool by comparing the acquired information with a reference data set,
And an electronic evidence initiating tool evaluation device.

Images