JP2024039064A - Information processing system, information processing method, and information processing program - Google Patents

Abstract

[Problem] To provide an information processing system, method, and program that ease the level of data science expertise required of a user when converting unstructured data into structured data. [Solution] In the information processing system, the information processing device has a processor capable of executing a program to perform the following steps. In an acquisition step A4, input data is acquired. The input data includes at least one of a plurality of types of unstructured data. In a type identification step A6, a type of at least one of the unstructured data included in the input data is identified based on the format of the acquired input data. In a generation step A12, a conversion process is performed on the acquired input data according to the identified type of unstructured data, thereby generating first structured data having a predetermined data structure. [Selected Figure] Figure 5

Description

The present invention relates to an information processing system, an information processing method, and an information processing program.

U.S. Pat. No. 5,300,300 discloses system architecture, components, and search techniques for an unstructured information management system (UIMS).

UIMS can serve as middleware for the effective management and exchange of unstructured information on a wide array of information sources. This architecture typically includes a search engine, data storage, an analysis engine including pipelined document annotators, and various adapters. This search technique utilizes a two-level search technique. A search query includes a search operator consisting of multiple search subexpressions, each having an associated weight value. The search engine returns one or more documents that have a total weight value that exceeds a threshold total weight value. Search operators are implemented as Boolean predicates that function as weighted ANDs (WANDs).

Japanese Patent Application Publication No. 2004-362563

By the way, unstructured data is more difficult to handle than structured data. In addition to text data, there are various types of unstructured data such as images, videos, and audio. In order to process such a variety of unstructured data as structured data, appropriate processing is required depending on the type of unstructured data. However, identifying appropriate processing for unstructured data has required a high level of expertise in data science.

According to one aspect of the present invention, an information processing system is provided. This information processing system includes a processor capable of executing programs to perform the following steps. In the acquisition step, input data is acquired. The input data includes at least one of multiple types of unstructured data. In the type identifying step, at least one type of unstructured data included in the input data is identified based on the format of the acquired input data. In the generation step, first structured data having a predetermined data structure is generated by performing a conversion process on the acquired input data according to the specified type of unstructured data.

According to such an information processing system, when converting unstructured data into structured data, it is possible to reduce the level of expertise required of the user in data science.

1 is a configuration diagram showing an information processing system 1. FIG. 2 is a block diagram showing the hardware configuration of an information processing device 2. FIG. 3 is a block diagram showing the hardware configuration of a user terminal 3. FIG. 2 is a diagram showing an example of a functional unit included in a processor 23. FIG. 2 is an activity diagram showing an example of the flow of information processing executed in the information processing system 1. FIG. 3 is a diagram showing an example of a first image IM1 displayed on a display unit 34. FIG. 3 is a diagram showing an example of a second image IM2 displayed on the display unit 34. FIG. 3 is a diagram showing an example of a third image IM3 displayed on a display unit 34. FIG. FIG. 4 is a diagram showing an example of a fourth image IM4 displayed on the display unit 34. FIG.

Embodiments of the present invention will be described below with reference to the drawings. Various features shown in the embodiments described below can be combined with each other.

By the way, the program for implementing the software appearing in this embodiment may be provided as a non-transitory computer-readable recording medium, or may be downloaded from an external server. The program may be provided in a manner that allows the program to be started on an external computer and the function thereof is realized on the client terminal (so-called cloud computing).

Furthermore, in this embodiment, the term "unit" may include, for example, a combination of hardware resources implemented by circuits in a broad sense and software information processing that can be concretely implemented by these hardware resources. . In addition, various types of information are handled in this embodiment, and these information include, for example, the physical value of a signal value representing voltage and current, and the signal value as a binary bit collection consisting of 0 or 1. It is expressed by high and low levels or quantum superposition (so-called quantum bits), and communication and calculations can be performed on circuits in a broad sense.

Further, a circuit in a broad sense is a circuit realized by at least appropriately combining a circuit, a circuit, a processor, a memory, and the like. That is, Application Specific Integrated Circuit (ASIC), programmable logic device (for example, Simple Programmable Logic Device (SPLD)), Complex Programmable Logic Device (Complex Pr) ogrammable Logic Device: CPLD), and field This includes a field programmable gate array (FPGA) and the like.

1. Hardware configuration This section explains the hardware configuration.

<Information processing system 1>
FIG. 1 is a configuration diagram showing an information processing system 1. As shown in FIG. The information processing system 1 includes an information processing device 2, a user terminal 3, a first database DB1, and a second database DB2. The information processing device 2, the user terminal 3, the first database DB1, and the second database DB2 are configured to be able to communicate through a telecommunications line. In one embodiment, the information processing system 1 is comprised of one or more devices or components. For example, if the information processing system 1 is composed of only the information processing device 2, the information processing system 1 can be the information processing device 2. These components will be explained below.

<Information processing device 2>
FIG. 2 is a block diagram showing the hardware configuration of the information processing device 2. As shown in FIG. The information processing device 2 includes a communication bus 20, a communication section 21, a storage section 22, and a processor 23. The communication unit 21, the storage unit 22, and the processor 23 are electrically connected via the communication bus 20 inside the information processing device 2.

<Communication Department 21>
Although the communication unit 21 is preferably a wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), wired LAN network communication, etc., it is also suitable for wireless LAN network communication, mobile communication such as 3G/LTE/5G, and BLUETOOTH (registered trademark). Communication etc. may be included as necessary. That is, it is more preferable to implement it as a set of these plurality of communication means. That is, the information processing device 2 may communicate various information from the outside via the communication unit 21 and the network.

<Storage unit 22>
The storage unit 22 stores various information defined by the above description. This may be used, for example, as a storage device such as a solid state drive (SSD) that stores various programs related to the information processing device 2 executed by the processor 23, or as a temporary storage device related to program calculations. It can be implemented as a memory such as a random access memory (RAM) that stores necessary information (arguments, arrays, etc.). The storage unit 22 stores various programs, variables, etc. related to the information processing device 2 executed by the processor 23.

<Processor 23>
The processor 23 processes and controls overall operations related to the information processing device 2 . The processor 23 is, for example, a central processing unit (CPU) not shown. The processor 23 implements various functions related to the information processing device 2 by reading predetermined programs stored in the storage unit 22. That is, information processing by software stored in the storage unit 22 is specifically implemented by the processor 23, which is an example of hardware, and can be executed as each functional unit included in the processor 23. These will be explained in more detail in the next section. Note that the processor 23 is not limited to a single processor, and may be implemented so as to have a plurality of processors 23 for each function. It may also be a combination thereof.

<User terminal 3>
FIG. 3 is a block diagram showing the hardware configuration of the user terminal 3. The user terminal 3 includes a communication bus 30, a communication section 31, a storage section 32, a processor 33, a display section 34, and an input section 35. The communication section 31 , the storage section 32 , the processor 33 , the display section 34 , and the input section 35 are electrically connected via the communication bus 30 inside the user terminal 3 . Descriptions of the communication unit 31, storage unit 32, and processor 33 are the same as those of each unit in the information processing device 2, and will therefore be omitted.

<Display section 34>
The display unit 34 displays a graphical user interface (GUI) screen that can be operated by the user. The display unit 34 may be included in the user terminal 3 housing, or may be externally attached. Specifically, the display unit 34 may be implemented as a display device such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display. It is preferable that these display devices be used differently depending on the type of user terminal 3.

<Input section 35>
The input unit 35 receives operational inputs made by the user. The operation input is transferred to the processor 33 via the communication bus 30 as a command signal. The processor 33 can perform predetermined control and calculations based on the transferred command signal as necessary. The input unit 35 may be included in the housing of the user terminal 3 or may be externally attached. For example, the input section 35 may be integrated with the display section 34 and implemented as a touch panel. When the input unit 35 is implemented as a touch panel, the user can input a tap operation, a swipe operation, etc. to the input unit 35. As the input unit 35, a switch button, a mouse, a QWERTY keyboard, etc. can be used instead of a touch panel.

<First database DB1, second database DB2>
As shown in FIG. 1, the first database DB1 is configured to be able to store various data including reference data D0. The reference data D0 may include arbitrary data, such as so-called open data that is generally available free of charge, and limited provision data that is available when predetermined conditions such as obtaining usage permission are met. The reference data D0 may include, for example, human flow data, traffic data, weather data, SNS transmission data, POS data, satellite observation data, document data published on the Internet, image data, audio data, and the like. Further, the first database DB1 may store information managed by the user or the organization to which the user belongs. The information is configured so that only users authorized by the organization can access it. Although the specific aspect of the first database DB1 is arbitrary, it may be implemented as a storage device such as a solid state drive (SSD), for example. The number of first databases DB1 is arbitrary and may be one or more. In addition to the above-mentioned data, the first database DB1 may store various programs that are executed by arbitrary devices such as the information processing device 2 and the user terminal 3.

The second database DB2 is configured to be able to store various data output by the information processing device 2. The specific aspect of the second database DB2 is arbitrary and can be implemented in the same manner as the first database DB1. In this embodiment, the second database DB2 includes a first storage area DB21 and a second storage area DB22. Input data D1 input to the information processing device 2 is stored in the first storage area DB21. The second storage area DB22 stores data output from the information processing device 2.

2. Functional Configuration of Information Processing Device 2 FIG. 4 is a diagram illustrating an example of functional units included in the processor 23. As shown in FIG. 4, the processor 23 includes an acquisition section 231, a specification section 232, a generation section 233, and a display processing section 234.

<Acquisition unit 231>
The acquisition unit 231 is configured to be able to execute the acquisition step. The acquisition unit 231 is configured to be able to acquire information from the user terminal 3 or other devices. For example, the acquisition unit 231 is configured to be able to acquire input data D1 input from the user terminal 3 or the first database DB1. The acquisition unit 231 reads various data stored in a storage area that is at least a part of the storage unit 22 and writes the read data to a work area that is at least a part of the storage unit 22. It is configured so that data can be obtained. The storage area is, for example, an area of the storage unit 22 that is implemented as a storage device such as an SSD. The work area is, for example, an area implemented as a memory such as a RAM. The acquisition unit 231 retrieves various data stored in devices other than the information processing apparatus 2, such as the storage unit 32, the first database DB1, and the second database DB2, from the storage area of the storage unit 22. It is configured so that it can be obtained in the same way as various other information.

<Specific part 232>
The specifying unit 232 is configured to be able to execute various specifying steps such as a type specifying step, a candidate specifying step, and a process specifying step based on the various acquired information. The identifying unit 232 is configured to be able to identify candidates, information, conditions, etc. used in information processing based on various information regarding the data acquired by the acquiring unit 231.

<Generation unit 233>
The generation unit 233 is configured to be able to execute the generation step. The generation unit 233 is configured to be able to generate various data, particularly structured data D2. For example, the generation unit 233 generates various data by performing predetermined arithmetic processing based on various acquired or specified information.

<Display processing unit 234>
The display processing unit 234 is configured to be able to execute display processing steps. The display processing unit 234 is configured to be able to display various information based on received or generated data. The information can be presented to the user via the display unit 34 of the user terminal 3 or another device. In such a case, for example, the display processing unit 234 controls the display unit 34 of the user terminal 3 to display visual information such as a screen, an image including a still image or a moving image, an icon, a message, and the like. The display processing unit 234 may generate only rendering information for displaying visual information on the user terminal 3. Note that the display processing unit 234 may present the output information to the user without going through the user terminal 3 or other device users.

3. About Information Processing In this section, information processing executed in the information processing system 1 will be explained.

3.1. About the flow of information processing FIG. 5 is an activity diagram showing an example of the flow of information processing executed in the information processing system 1. As shown in FIG. Note that the information processing may include any exception processing not shown. Exception handling includes interruption of the information processing and omission of each process. The selection or input performed in the information processing may be based on a user's operation, or may be automatically performed without depending on a user's operation.

[Activity A1]
First, in activity A1, the processor 33 of the user terminal 3 transmits an access request to the information processing device 2 based on a user's operation. The access request may include information indicating whether the user has access authority to the information processing device 2, such as a user account name and password owned by the user.

[Activity A2]
When the information processing device 2 receives an access request from the user terminal 3, the information processing device 2 processes activity A2 and performs user authentication. The information processing device 2 checks the information included in the access request indicating whether the user has access authority to the information processing device 2 with pre-registered user information, thereby allowing the user to access the information processing device 2. Determine whether or not it is possible. The user information is stored in the storage unit 22, for example. The user information may include any information regarding the user, such as the user's name, position, authority, and the like. As a result of the user authentication, if it is determined that the user is unable to access the information processing device 2, the information processing is ended and the input of the access request is accepted again via the user terminal 3.

[Activity A3]
On the other hand, if it is determined that the user can access the information processing device 2 as a result of user authentication, the process proceeds to activity A3. In activity A3, the user terminal 3 outputs a data transmission command to the information processing device 2 in response to a user's operation. For example, when the user terminal 3 receives data input by the user, it outputs a transmission command to transmit the data to the information processing device 2, and transmits the data to the information processing device 2. The transmission command may include a request to obtain data stored in the first database DB1 that is accessible by the user, for example, reference data D0. Whether or not the user can access is determined based on user information.

[Activity A4]
Next, the process proceeds to activity A4, and the acquisition unit 231 acquires input data from various information sources such as the storage unit 22, the storage unit 32, and the first database DB1 based on the transmission command received in the activity A3. Get D1. For example, the acquisition unit 231 acquires data transmitted from the user terminal 3. Furthermore, when the transmission command includes a request to acquire the reference data D0, the acquisition unit 231 acquires the reference data D0 from the first database DB1. Hereinafter, for convenience of explanation, the data acquired in activity A4 will be collectively referred to as input data D1. The unit of the input data D1 is arbitrary, such as a file unit or a folder unit.

The input data D1 of this embodiment includes at least one of multiple types of unstructured data. Unstructured data is any type of data that does not have a standardized, predetermined data structure like structured data. In other words, structured data is data that has a predetermined data structure, and unstructured data is data other than structured data. The predetermined data structure is a predetermined rule for managing data. Data structures may be structured in any format such as arrays, structures, etc., tree structures, etc. The data structure may be based on existing standards or may be constructed by a user, a provider of the information processing system 1, or the like. The information processing device 2 is configured to be able to refer to the format of the data structure constructed in this way. By referring to the format of the data structure, the information processing device 2 can convert unstructured data into structured data having a data structure according to the format. Note that the format may be stored in the storage unit 22 or in a storage medium other than the information processing device 2, such as the first database DB1.

The structured data in this embodiment may include semi-structured data. Semi-structured data consists of a combination of unstructured data and a tag (in other words, an annotation) that can identify the unstructured data. Semi-structured data can also be said to be structured data that is structured by a data structure constructed using identifiable tags. The format of semi-structured data is, for example, graph type, key value type, document type, column type, etc. Further, the format of semi-structured data includes a format expressed using a predetermined computer language, such as a data description language (eg, JSON format) and a markup language (eg, XML format). For example, the type of unstructured data includes at least one of images, moving images, audio, three-dimensional spatial data, and time series data. Note that the types of unstructured data are not limited to these, and may include document data without a data structure, two-dimensional drawing data, and the like.

[Activity A5]
Next, the process proceeds to activity A5, and the acquisition unit 231 stores the acquired input data D1 in the first storage area DB21 of the second database DB2. The first storage area DB21 can function as a so-called data lake that stores acquired raw data. The acquisition unit 231 also acquires information regarding the stored input data D1. The information includes, for example, where the input data D1 is stored in the first storage area DB21 (for example, a file path), and the timing at which the input data D1 was stored in the first storage area DB21 (for example, a timestamp). , version information of the input data D1, etc. The information processing device 2 can access the input data D1 stored in the first storage area DB21 based on this information.

[Activity A6]
Next, the process proceeds to activity A6, where the identifying unit 232 identifies at least one type of unstructured data included in the input data D1 based on the format of the input data D1. The format of the input data D1 includes the extension of the input data D1. For example, the identifying unit 232 uses the correspondence relationship between a predetermined extension and the type of unstructured data to identify the type of unstructured data included in the input data D1 based on the extension of the input data D1. Identify. Thereby, the processing load when the information processing system 1 identifies the type of unstructured data can be reduced. Note that the method for specifying the type of unstructured data is not limited to this and is arbitrary. For example, the identifying unit 232 may identify the type of unstructured data based on whether software that can process a specific type of unstructured data can process it.

[Activity A7]
Next, the process proceeds to activity A7, and the identifying unit 232 identifies candidates for category C to which the conversion process to be performed on the input data D1 belongs, based on the identified type of unstructured data.

<Conversion process>
The conversion process is a series of processes for converting unstructured data into structured data. The information processing device 2 can convert the input data D1 including unstructured data into structured data by executing the conversion process. The conversion processing includes any processing that can extract feature amounts from unstructured data, such as image recognition processing, speech recognition processing, time series processing, and natural language processing. As the conversion process, any algorithm such as supervised learning, unsupervised learning, and reinforcement learning can be used.

The conversion process may include an analysis process. The analysis process is a process that outputs a predetermined analysis result by inputting extracted feature quantities, statistical distribution of the feature quantities, and the like. The analysis processing may include, for example, classification analysis, regression analysis, time series analysis, recommendation analysis, anomaly detection, clustering, image analysis, text analysis, and the like. The information processing device 2 may acquire the analysis result of the analysis process as a feature amount characterizing the input data D1.

<Category C>
Category C includes a designated category C1, a usage category C2, a collection category C3, and the like.

<Specified category C1>
The designated category C1 is defined by the type of unstructured data, such as images, moving images, audio, documents, and three-dimensional data. If the user knows in advance the type of unstructured data included in the input data D1, the user directly specifies the type of unstructured data included in the input data D1 by specifying the specified category C1. be able to. Thereby, user convenience can be achieved.

<Application category C2>
The usage category C2 is defined by the usage of the input data D1. The input data D1 can be used, for example, to construct an ID platform using the input data D1 (for example, resumes, reports, etc.) containing unstructured data including employee information, or to store accounting materials such as invoices. Examples include the financial analysis used. Thereby, it becomes easy to specify the conversion process according to the manner in which the input data D1 is used by the user.

<Category C3>
Collection category C3 is defined by the collection mode of input data D1. The collection category C3 is classified, for example, depending on whether natural conversation is included or not, and the collection means and information source of the input data D1. As a result, when the user knows the manner in which the input data D1 is collected, the user can specify an appropriate collection category according to the input data D1, thereby improving the identification accuracy of the conversion process. The means for collecting input data D1 is specified by, for example, the type of sensor, the standard of the sensor, the object to be measured by the sensor, and the like. The information source is specified by, for example, the information provider, the time of provision, the website used for collection (for example, URL or SNS type), and the like.

Note that the correspondence between the plurality of categories C1, C2, and C3 and the conversion processes belonging to each of the plurality of categories C1, C2, and C3 is stored in the storage unit 22, for example. The correspondence relationship may be set by the user, by the provider of the information processing system 1, or by classification derived using machine learning or the like. The identifying unit 232 uses this correspondence to identify candidates for category C to which the conversion process belongs.

[Activity A8]
Next, the process proceeds to activity A8, and the user terminal 3 causes the display unit 34 to display information regarding the identified category C candidates.

[Activity A9]
Next, the process proceeds to activity A9, and the user terminal 3 accepts the designation of category C by the user. Next, the user terminal 3 transmits the received designation of category C to the information processing device 2.

[Activity A10]
Next, the process proceeds to activity A10, and the acquisition unit 231 acquires the transmitted designation of category C from the user.

[Activity A11]
Next, the process proceeds to activity A11, and the identifying unit 232 identifies the conversion process that belongs to the designated category C based on the acquired designation. The specifying unit 232 specifies at least part of the conversion processes belonging to the specified category C as conversion processes to be performed on the input data D1. Specifying a conversion process is not limited to specifying which conversion process to use among a plurality of conversion processes, but may also include the order of conversion processes to be performed on the input data D1.

[Activity A12]
Next, the process proceeds to activity A12, where the generation unit 233 performs a conversion process on the acquired input data D1 according to the identified type of unstructured data. Thereby, the generation unit 233 generates first structured data D21 having a predetermined data structure. In this embodiment, at least one piece of first structured data D21 is generated for each piece of input data D1 (for example, input data D1 for each file or folder). The generation unit 233 stores the generated first structured data D21 and input data D1 in the second storage area DB22 of the second database DB2. The second storage area DB22 can function as a so-called data warehouse (DWH) that stores generated structured data. The acquisition unit 231 also acquires information regarding the stored first structured data D21. The information includes, for example, where the first structured data D21 is stored in the second storage area DB22 (for example, a file path), and where the first structured data D21 is stored in the second storage area DB22. The information may include timing (for example, time stamp), version information of the first structured data D21, and the like. The acquisition unit 231 can access the first structured data D21 stored in the second storage area DB22 based on this information. Further, the generation unit 233 generates a correspondence between the input data D1 and the first structured data D21, and stores it in the second storage area DB22, for example. This speeds up the reference of the information source of the first structured data D21 by the information processing device 2. Hereinafter, for convenience of explanation, the structured data generated by the generation unit 233 and the structured data stored in the second storage area DB22 will be collectively referred to as "structured data D2."

[Activity A13]
Next, if a plurality of input data D1 are generated and a plurality of generated first structured data D21 exist, the process proceeds to activity A13, and the generation unit 233 generates a plurality of first structured data D21. Perform the join process to join. Thereby, the generation unit 233 generates the second structured data D22. Note that if there is not a plurality of first structured data D21, for example, if there is a single number of first structured data D21, the generation unit 233 may omit the combining process. Furthermore, even if there are a plurality of generated first structured data D21, the generation unit 233 may decide whether to perform the combination process according to the user's operation. Thereby, it is possible to prevent the first structured data D21 from being combined against the user's will.

The case where there is a plurality of generated first structured data D21 is not limited to the case where there is a plurality of first structured data D21 generated by one conversion process. For example, even when there is a plurality of first structured data D21 generated by past conversion processing and stored in the second storage area DB22, or when these are combined, the generated first structured data This may apply when there are multiple D21s.

The number of second structured data D22 is smaller than the number of first structured data D21 on which the combination process is performed. For example, the generation unit 233 performs a combination process to generate a single second structured data D22 in which all the first structured data D21 are combined. Note that there is a correspondence between the data structure of the first structured data D21 and the data structure of the second structured data D22. Preferably, the data structure of the second structured data D22 includes the data structure of the plurality of first structured data D21 to be combined.

As a specific example, the first structured data D21 to be subjected to the combination processing has the data structure as an array (first component, second component) that is composed of a first component and a second component. A1, B1), and the other first structured data D21 to be subjected to the combination processing is an array (second component, third A case represented by (components of ) = (B2, C2) will be explained. In this case, the generation unit 233 performs a combination process on these first structured data D21 to create a structure including the first component, second component, and third component as a data structure. The second structured data D22 having the following structure is generated. The expression format of the second structured data D22 is arbitrary, but for example, as (first component, second component, third component), an array (A1, B1, 0) and an array (0, B2 , C2) as row or column components.

The generation unit 233 stores the second structured data D22 generated by the combination process in the second storage area DB22 along with the correspondence between the input data D1 and the second structured data D22. The specific storage manner of the second structured data D22 and the corresponding relationship is, for example, the same as the storage manner of the first structured data D21 and the like. Note that even if the generation unit 233 stores the second structured data D22 in the second storage area DB22 separately from the first structured data D21, the generation unit 233 may store the second structured data D22 in place of the first structured data D21. The structured data D22 may be stored in the second storage area DB22. The second structured data D22 is one aspect of the structured data D2.

[Activity A14]
Next, the process proceeds to activity A14, and the display processing unit 234 executes display processing. Thereby, the display processing unit 234 causes the display unit 34 to display an image including the editing area R1 in which the elements of the structured data can be edited by the user. Note that the structured data that can be edited using the editing area R1 may be the first structured data D21 or the second structured data D22. Preferably, the structured data D2 that can be edited by the editing area R1 is the latest structured data D2 stored in the second storage area DB22, and if the combination processing is performed, the structured data D2 is the latest structured data D2 stored in the second storage area DB22. It is D22. Hereinafter, for convenience of explanation, the structured data edited by the editing area R1 will be treated as the second structured data D22. Even if each element of the second structured data D22 is configured to be editable by the visible editing visual information IF1, the editing area R1 can be edited by inputting a command defined by a character string or the like. The elements of D22 may be configured to be editable. The generation unit 233 generates an editing command that instructs the editing mode of the structured data (specifically, the second structured data D22) in response to the operation on the editing area R1.

[Activity A15]
Next, the process proceeds to activity A15, and the acquisition unit 231 performs editing processing on the second structured data D22 in accordance with the generated editing command. Thereby, the generation unit 233 generates third structured data D23 in which the elements of the second structured data D22 are edited. The third structured data D23 is one aspect of the structured data D2.

The generation unit 233 stores the third structured data D23 generated by the editing process in the second storage area DB22 along with the correspondence between the input data D1 and the third structured data D23. The specific storage manner of the third structured data D23 and the corresponding relationship is, for example, the same as the storage manner of the first structured data D21 and the like. Note that even if the generation unit 233 stores the second structured data D22 in the second storage area DB22 separately from the first structured data D21, the generation unit 233 may store the second structured data D22 in place of the first structured data D21. The structured data D22 may be stored in the second storage area DB22.

After the editing process ends, the information processing system 1 ends the information processing.

3.2. About images displayed as a result of information processing In this section, images displayed on the display section 34 as a result of the above information processing will be explained. The images include a first image IM1, a second image IM2, a third image IM3, and a fourth image IM4.

<First image IM1>
FIG. 6 is a diagram showing an example of the first image IM1 displayed on the display unit 34. The first image IM1 is displayed on the display unit 34, for example, during processing of activity A3. The first image IM1 includes a first window 4 and a second window 5.

<First window 4>
The first window 4 is configured to be able to display information regarding the input data D1 to be subjected to conversion processing. The information regarding the input data D1 is, for example, the name of the input data D1 (so-called file name), the first window 4 has an input data search area 41, an input data list display area 42, a first operation area 43, etc. ,including.

<Input data search area 41>
The input data search area 41 is configured to be able to search the input data D1 by inputting search conditions. Furthermore, the input data search area 41 is configured such that information regarding the input data D1 can be specified as a search item. Thereby, when a plurality of input data D1 are input, it becomes easy to specify the input data D1 to be subjected to the above information processing. Note that the input data search area 41 may be configured to be searchable using whether or not the reference data D0 is included in the search target as a search condition. This makes it easy to utilize the reference data D0 according to the purpose.

<Input data list display area 42>
In the input data list display area 42, candidates for the input data D1 to be subjected to the conversion process are displayed in a viewable manner. When a search is being performed using the input data search area 41, the input data list display area 42 displays input data D1 that match the search conditions among the candidates for the input data D1. The input data list display area 42 is configured to be able to accept a user's designation of input data D1 for information processing. The information processing system 1 generates first structured data D21 and the like by performing conversion processing and the like on the input data D1 specified in the input data list display area 42.

<First operation area 43>
The first operation area 43 is a UI for adding input data D1 to be converted, and is, for example, a button-shaped object as illustrated. For the first operation area 43, a text hyperlink may be used instead of a button-shaped object. The second window 5 is displayed by operating the first operation area 43.

<Second window 5>
The second window 5 is configured to be able to add input data D1 to be subjected to conversion processing. The second window 5 includes a format specification area 51 , at least one first input data display area 52 , and a second operation area 53 .

<Format specification area 51>
The format designation area 51 is configured to allow the user to designate the format of the input data D1 to be added. For example, when the input data D1 to be added is image data representing a bill, the format of the input data D1 can be specified as the bill format. The specifying unit 232 may specify candidates for the category to which the conversion process performed on the input data D1 belongs, according to the specified format of the input data D1. Further, for example, when adding an annotation as a conversion process, the specifying unit 232 may specify an annotation candidate corresponding to a specified bill format as a category candidate. Further, the specifying unit 232 may add information that the added input data D1 represents a bill as an annotation.

<First input data display area 52>
One of the first input data display areas 52 is configured to be able to specify input data D1 to be added. For example, the user specifies input data D1 to be added by operating the first input data display area 52. Further, one of the first input data display areas 52 is configured to be able to display an image that visually represents the specified input data D1 as a preview image. Further, the first input data display area 52 is configured to be able to specify a storage destination within the first storage area DB21 of the input data D1 to be added. Further, one of the first input data display areas 52 is configured such that the name of the input data D1 stored in the first storage area DB21 can be specified.

<Second operation area 53>
The second operation area 53 is a UI configured to be able to specify whether or not to add specified input data D1, and is, for example, a button-shaped object as illustrated. For the second operation area 53, a text hyperlink may be used instead of a button-shaped object.

<Second image IM2>
FIG. 7 is a diagram showing an example of the second image IM2 displayed on the display unit 34. The second image IM2 is an image for specifying category C by the user. The second image IM2 is displayed during the processing of activity A8. The second image IM2 includes at least one category designation area 6.

<Category specification area 6>
Category designation area 6 is a UI that allows the user to designate category C. Specifically, the category designation area 6 is configured to be able to designate any one of images, moving images, audio, and three-dimensional spatial data as the designated category C1. Further, the category designation area 6 is configured to be able to designate any one of ID platform, geospatial, and OCR processing as the usage category C2. The category designation area 6 is configured to be able to specify any one of collection by sensors, collection from SNS, and collection targeting natural conversation as the collection category C3. The display mode of the category designation area 6 corresponding to the category C recommended according to the type of unstructured data included in the input data D1 is different from the display mode of the category designation area 6 corresponding to other categories C. Specifically, the outline of the category designation area 6 corresponding to the recommended category C is configured to be more visible to the user than other category designation areas 6 due to the highlighted display L1. Note that the difference in the display mode is not limited to the outline, but may be realized by color, size, etc. After category C is designated, activities A10 to A12 are processed, and input data D1 is generated. Thereafter, the third image IM3 is displayed on the display unit 34 after the conversion process.

<Third image IM3>
FIG. 8 is a diagram showing an example of the third image IM3 displayed on the display section 34. The third image IM3 is configured to be able to display information regarding the second structured data D22. The third image IM3 includes a second input data display area 7, a structured data display area 8, and a first storage operation area 9.

<Second input data display area 7>
In the second input data display area 7, information regarding the generated input data D1 is displayed. In this embodiment, the image of the bill included in the input data D1 is displayed in the second input data display area 7.

<Structured data display area 8>
In the structured data display area 8, information regarding the generated structured data D2 is displayed. Specifically, in the structured data display area 8, the elements included in the generated structured data D2 are displayed in a viewable manner. The display mode may be determined depending on the data structure, such as a graph format, a tree structure format, or a table format. In this embodiment, the elements of the structured data D2 are displayed in a two-dimensional table format so that they can be viewed at a glance.

When the combining process of activity A13 is performed, structured data display area 8 includes a first area 81 and a second area 82. In each of the first area 81 and the second area 82, different elements of the input data D1 of the second structured data D22 generated by the combination process are displayed. In particular, in the first area 81, elements of the first structured data D21 generated by the latest conversion process are displayed. The display mode of the first area 81 and the display mode of the second area 82 are different from each other. Thereby, the first area 81 and the second area 82 are configured to be visually distinguishable. For example, the color of the first region 81 is different from the color of the second region 82. Note that if the combining process of activity A13 is not performed, first structured data D21 corresponding to input data D1 is displayed in structured data display area 8. In this case, the structured data display area 8 may include only one of the first area 81 and the second area 82.

The structured data display area 8 of this embodiment can also function as an editing area R1. For example, the third structured data D23 can be generated by the user performing an editing operation on the elements of the second structured data D22 displayed in the structured data display area 8. In this case, the structured data display area 8 functions as edited visual information IF1 in which each element of the second structured data D22 can be visually recognized.

<First save operation area 9>
The first save operation area 9 is a UI for instructing to save structured data D2 corresponding to input data D1, and is, for example, a button-shaped object as shown in the figure. For the second operation area 53, a text hyperlink may be used instead of a button-shaped object. The processing of activity A13 is performed by operating the first storage operation area 9. As a result, the structured data D2 (eg, second structured data D22) displayed in the structured data display area 8 is stored in the second storage area DB22. After that, the fourth image IM4 is displayed on the display section 34.

<Fourth image IM4>
FIG. 9 is a diagram showing an example of the fourth image IM4 displayed on the display unit 34. The fourth image IM4 is an image for editing the generated structured data D2 (for example, the second structured data D22). The fourth image IM4 includes a structured data search area 10, a structured data editing area 11, an editing result display area 12, and a second storage operation area 13.

<Structured data search area 10>
The structured data search area 10 includes a search condition input area 101, a search result display area 102, and a dataset addition area 103.

<Search condition input area 101>
The search condition input area 101 is configured such that search conditions for searching the structured data D2 stored in the second storage area DB22 can be input. The search condition may be specified by a character string, or by the capacity, generation date, etc. of the structured data D2.

<Search result display area 102>
The search result display area 102 is configured to be able to display a list of structured data D2 that match the search conditions input in the search condition input area 101. The search result display area 102 is configured to be able to accept designation of the structured data D2 displayed in the search results.

<Dataset addition area 103>
The dataset addition area 103 is a UI for starting editing of the structured data D2 specified in the search result display area 102, and is, for example, a button-shaped object as illustrated. The data set addition area 103 may employ a text hyperlink instead of a button-shaped object.

<Structured data editing area 11>
The structured data editing area 11 is configured to be able to edit the structured data D2 started by operating the dataset addition area 103. The structured data editing area 11 includes a command input area 111, a command storage area 112, and a command execution area 113.

<Command input area 111>
The command input area 111 is an area for inputting information related to editing the structured data D2, and is one aspect of the editing area R1. The command input area 111 is configured to be able to receive editing-related input from the user as a command. The command may be any command, such as selecting structured data D2, selecting an element of structured data D2, changing an element of structured data D2, deleting an element of structured data D2, or combining multiple structured data D2. May include those related to editing.

<Command storage area 112>
The command storage area 112 is a UI for storing commands input into the command input area 111. When the command storage area 112 is operated by the user, a log of the command is generated.

<Command execution area 113>
The command execution area 113 is a UI for executing commands input into the command input area 111. Third structured data D23 is generated by operating the command execution area 113.

<Editing result display area 12>
The editing result display area 12 is configured to be able to display information regarding the structured data D2 edited by the operation of the command execution area 113, that is, the third structured data D23. In this embodiment, the editing result display area 12 is configured to be able to list the elements of the third structured data D23. In particular, the editing result display area 12 is displayed in such a manner that it can be viewed together with the structured data editing area 11. This makes it easier to understand the correspondence between the editing operations in the structured data editing area 11 and the results of the editing operations. Therefore, convenience for the user is improved.

<Second save operation area 13>
The second storage operation area 13 is a UI for saving the third structured data D23 generated by the editing operation input to the structured data editing area 11. By operating the second storage operation area 13, the generated third structured data D23 is stored in the second storage area DB22.

4. Others The above information processing mode is just an example, and is not limited to this. For example, the display process (activity A14) shown in FIG. 5 may be incorporated into the combination process (activity A13). For example, the elements represented in the structured data display area 8 shown in FIG. 8 may be configured to be editable by the user. In this case, there is no need to distinguish between the second structured data D22 and the third structured data D23. Further, the editing process may include a combining process performed by a user's operation.

The information processing system 1 may generate a data flow based on a process performed on the input data D1 in the past. The data flow includes at least one of a conversion process, a combination process, and an editing process performed on the input data D1 obtained from the same information source. This reduces the effort required to convert input data D1 that can be obtained from the same information source into structured data D2. The data flow may be configured to be changeable by the user. This makes it easier to construct an optimal data flow according to the manner in which the user's input data D1 is handled.

The information processing system 1 may be configured to be able to specify the timing for executing processing based on the data flow. In other words, the information processing system 1 may be configured to be able to specify a schedule for executing the above data flow. This eliminates the need for the user to sequentially operate the user terminal 3 when performing the processing, making it easier to manage the structured data D2 generated by the processing based on the data flow.

The specifying unit 232 does not need to specify the conversion process to be performed on the input data D1 from among the conversion processes belonging to the specified category C. For example, the specifying unit 232 may specify a conversion process to be performed on the input data D1 from among all executable conversion processes based on the type of unstructured data included in the input data D1.

The distinction between the designated category C1, the usage category C2, and the collection category C3 is for convenience and is not limited to this. For example, there may be conversion processes that belong to both the designated category C1 and the usage category C2.

The above information processing specifies a conversion process in activity A11, and generates structured data D2 (specifically, first structured data D21) by executing the specified conversion process in activity A12. good. Therefore, the above-mentioned information processing does not need to include the combining process of the activity A13, the display process of the activity A14, the editing process of the activity A15, and the like. Note that generating the first structured data D21 by the generation unit 233 performing the conversion process means that the information processing device 2 including the generation unit 233 generates the first structured data D21 by performing the conversion process itself. It is not limited to generating. For example, generating the first structured data D21 by the generation unit 233 performing the conversion process means that the information processing device 2 transmits information regarding the specified conversion process to another device. This includes generating the first structured data D21 by causing the device to execute the conversion process.

The information processing device 2 may be in an on-premises form or may be in a cloud form. The cloud-based information processing device 2 may provide the above-mentioned functions and processing, for example, in the form of SaaS (Software as a Service) or cloud computing.

In the embodiment described above, the information processing device 2 performs various storage and control operations, but instead of the information processing device 2, a plurality of external devices may be used. That is, various information and programs may be distributed and stored in a plurality of external devices using blockchain technology or the like.

Aspects of this embodiment are not limited to the information processing system 1, and may be an information processing method or an information processing program. The information processing method includes each step of the information processing system 1. The information processing program causes at least one computer to execute each step of the information processing system 1.

The information processing system 1 and the like may be provided in each of the following aspects.

(1) An information processing system, comprising a processor capable of executing a program to perform each of the following steps, and in the acquisition step, input data is acquired, where the input data is of a plurality of types. At least one of the structured data is included, and in the type identifying step, the type of at least one of the unstructured data included in the input data is identified and generated based on the format of the acquired input data. In the step, first structured data having a predetermined data structure is generated by performing a conversion process on the acquired input data according to the specified type of the unstructured data. .

According to such a configuration, when the information processing system generates structured data from unstructured data, appropriate conversion processing is performed according to the unstructured data included in the input data. Therefore, even if the appropriate conversion process differs depending on the type of unstructured data, it is possible to reduce the level of expertise required of the user in data science when converting unstructured data to structured data.

(2) In the information processing system according to (1) above, further, in the candidate identification step, a category to which the conversion process to be performed on the input data belongs is determined based on the identified type of the unstructured data. A candidate is specified, and in the acquisition step, the specification of the category by the user is obtained, and in the process specification step, the conversion process belonging to the specified category is specified based on the specification.

According to such a configuration, the information processing system uses the user's category designation when specifying the conversion process, thereby making it easier to specify the appropriate conversion process that meets the user's request. Therefore, convenience can be improved.

(3) In the information processing system according to (2) above, the category includes a collection category defined by a collection mode of the input data.

According to such a configuration, when the user knows the collection mode of input data, the user can improve the identification accuracy of the conversion process by specifying an appropriate collection category according to the input data. can.

(4) In the information processing system according to any one of (1) to (3) above, in the generation step, when there is a plurality of generated first structured data, a plurality of first structured data that generates second structured data by combining at least part of the structured data of the second structured data.

According to such a configuration, since the plurality of first structured data are grouped together, the burden of managing the structured data is reduced.

(5) In the information processing system according to any one of (1) to (4) above, the display processing step further includes displaying an editing area in which the elements of the structured data can be edited by the user. .

According to such a configuration, it is possible to correct noise that may occur due to conversion of unstructured data by editing structured data. Therefore, convenience can be improved.

(6) In the information processing system according to any one of (1) to (5) above, the format of the input data includes an extension of the input data.

According to such a configuration, the type of unstructured data is specified from a relatively small amount of information called the extension of input data. Therefore, the processing load when the information processing system executes the type identification step can be reduced.

(7) In the information processing system according to any one of (1) to (6) above, the type of unstructured data is one of images, videos, audio, three-dimensional spatial data, and time series data. A thing containing at least one of the following.

According to such a configuration, input data, which accounts for most of the unstructured data, can be converted into structured data, so that it is possible to further improve convenience.

(8) An information processing method, the method comprising each step of the information processing system described in any one of (1) to (7) above.

(9) An information processing program that causes at least one computer to execute each step of the information processing system described in any one of (1) to (7) above.
Of course, this is not the case.

Furthermore, please note the following points.

With the invention and spread of computers, and the invention and development of the Internet and communication technology, large amounts of data have continued to accumulate, and the total amount of data in the world has increased more than tenfold in the past ten years. Furthermore, as many databases are being used, it has become difficult to know which database has the data you need.

There are other challenges to leveraging increased data. In other words, there is a lot of unstructured data. Here, unstructured data refers to text data whose format and meaning are undefined or incompletely defined, such as audio data, image data, video data, and sensor data. It is said that 80% of corporate data is unstructured data. Voice data is a typical example of unstructured data, but in order to process it as meaningful data on a computer, it is necessary to use not only voice recognition and natural language processing, which have been rapidly developed in recent years, but also symbolization. It is necessary to give meaning to data.

At present, information processing technologies related to the meaning of data, such as data collection, data extraction from unstructured data, normalization, meaning, correlation, and classification, are immature and require work by experts. .

In view of the current situation, the present invention provides an information processing device that collects, converts, processes, and utilizes data, including collecting data and converting unstructured data into structured data without relying on experts. , a system, a method, a program, and a recording medium on which the program is stored.

The present invention provides technology for collecting, storing, processing, analyzing, and utilizing all data accessible on the Internet without the intervention of experts. That is, the information processing method according to a typical aspect of the present invention includes a step of connecting to data including external data, a step of collecting data, a step of converting the data, and a step of preprocessing the data. An integrated technology is provided that includes the steps in which data is processed, the steps in which tasks are managed, the steps in which data is displayed for use, and the overall management of data. The use of templates tailored to business characteristics enables execution without relying on experts, and in the conversion of unstructured data to structured data, data attribute estimation based on file extensions, text mining, natural The method includes steps in which language processing, image analysis, video analysis, annotation, meta information, and the like are performed.

The present invention provides an integrated technology that includes connection to data, including external data, data collection, data conversion, data preprocessing, data processing, task management, data utilization, and overall data management.

Connecting and collecting data requires specialized knowledge to know where the data that each company or organization needs is located and how to collect it. In the present invention, in order to enable anyone to do this, a base template is prepared in advance according to the business characteristics, and the user of this technology can select this template to transfer data within the company/organization and outside the company/outside the organization. Connect and collect information. Furthermore, the connection may be made not only automatically but also by reflecting the user's intention.

When connecting data, data to be connected is connected based on a template selected by the user. At this time, it is not necessary to explicitly specify the database or file, but it is also within the scope of the present invention for the user to explicitly specify the database or file by selecting from a presented list or inputting a URL.

Generally, multiple types of data are stored at the connection destination. Which data to connect from among these is also determined based on the above template. Furthermore, the user may select from a list.

The data collected after the above connection includes all or part of connectable internal/organizational data and external data. Moreover, not only structured data, but also audio data and images. Includes unstructured data such as video data and chat data.

Data conversion includes, but is not limited to, text mining, natural language processing, image analysis, video analysis, annotation, meta information, etc.

Data processing first uses the file extension as a clue to estimate and classify whether the file is a video, audio, document, sensor, etc. Next, data processing is performed based on the template selected by the user. Here, in order to realize more reliable and accurate processing, a system in which data desired by the user is specified is also within the scope of the present invention.

The data processing includes, but is not limited to, data selection, combination, division, aggregation, and filtering.

Data selection selects the collected and transformed data needed for the migration process. This selection may be defined by the template without the user's intervention, or may be made with the user's intervention and/or either.

In data combination and division, selected data is processed to be combined or divided. For example, if sales data for multiple stores is selected, it may be combined (organized) by region, or data for one store may be divided by time or day of the week.

Data combinations range from simple data such as combining sales from multiple stores to data combinations using complex logical formulas tailored to the user's purpose. The type of connection method to be performed includes cases in which it is defined by the template and does not involve the user's intervention, and cases in which the user intervenes.

Data filtering extracts only those that meet specific conditions. This includes extracting data from a set of data based on specific conditions.

The above-mentioned filtering is not limited to the conditional expressions formed by data fields in the same database, but the present invention also includes methods of filtering in combination with other databases.

Generally, data collected from different databases, whether internal or external to an organization, is in different formats. Data preprocessing prepares them for subsequent processing.

The above preprocessing is a simple example, but in natural language, for example, there are multiple expressions for the same meaning. It also includes complex preprocessing to treat these as semantically the same.

Data utilization includes data connection, data collection, data conversion, data preprocessing, display of data that has been processed as described above, and a system for users to utilize and examine the data.

In addition to the above, this information processing device has a task management function. For example, some databases have update cycles and timings, so it is necessary to collect data in accordance with that, and on the other hand, when it comes to data utilization, there are periodic and timed accelerators by users. Task management manages the information processing system by taking into account the time factors required in the information processing system.

Overall data management involves managing the security of data and software handled by this information processing system, data backup, data protection, access control, and infrastructure operations.

In this information processing device, machine learning methods including AI and deep learning are used in each subsystem of data connection, data collection, data conversion, data preprocessing, data processing, task management, data utilization, and overall data management. It is also within the scope of the present invention to use

Therefore, in order to solve the above problems, an information processing method according to a first aspect of the present invention determines a database to be connected to based on the user's attributes and/or purpose without the intervention of an expert. a step in which a connection is made to the selected database; a step in which data is collected from the connected database according to the user's attributes and/or purpose; and a step in which the collected data is / or a step of converting the data according to the purpose; a step of preprocessing the converted data according to the user's attributes and/or the purpose; and a step of converting the preprocessed data according to the user's attributes and/or the purpose. The method is characterized by comprising a step of processing the data according to the user's attributes and/or a step of displaying the processed data according to the user's attributes and/or purpose.

As a second aspect of the present invention, the first aspect may include a function for overall management of the data, and a task management function and/or a scheduling function for managing the steps. can.

As a third aspect of the present invention, in the first aspect, the steps include determining the database to be connected, connecting to the selected database, and collecting data from the connected database. In the step, the step in which the collected data is converted, the step in which the converted data is preprocessed, the step in which the preprocessed data is processed, and the step in which the processed data is displayed, In addition to structured data with defined meanings, unstructured data includes raw data such as text data, audio data, image data, video data, and sensor data that have undefined or incomplete definitions. It is also possible to adopt a configuration that may include.

As a fourth aspect of the present invention, in the first aspect, a template prepared in advance is used to execute the plurality of steps based on the user's attributes and/or purpose without the intervention of the expert. , and/or the user may modify the template.

As a fifth aspect of the present invention, in the first aspect, by the user making modifications to the template and/or template according to the user's attributes and/or purpose, Connection to the database and necessary data collection may be performed without specifying the database.

As a sixth aspect of the present invention, in the first aspect, the user can explicitly specify the Data conversion including text mining, natural language processing, image analysis, video analysis, addition of annotations, and addition of meta information may be performed without any specification.

As a seventh aspect of the present invention, in the first aspect, the type of data, for example, video, audio, document, sensor, etc., is estimated and/or used based on the file extension. The data may be pre-processed based on the template selected by the user and/or by the user making modifications to the template.

As an eighth aspect of the present invention, in the first aspect, the user can explicitly specify the Data processing including data selection, combination, division, aggregation, and filtering may be performed without any specification.

As a ninth aspect of the present invention, in the first aspect, it is possible to determine whether the data is structured data or unstructured data without explicit designation by the user, using a template according to the user's attributes and/or purpose. Alternatively, collected, converted, preprocessed, and processed data may be displayed.

In order to solve the above problems, a program according to a tenth aspect of the present invention provides a connection database that determines a database to which a computer should be connected based on user attributes and/or purpose without the intervention of an expert. a determination unit, a connection unit that connects to the selected database, a data collection unit that collects data from the connected database according to user attributes and/or purposes, and uses the collected data. a data conversion unit that converts the converted data according to the user's attributes and/or purpose; a data preprocessing unit that preprocesses the converted data according to the user's attributes and/or purpose; A data processing unit that processes the data according to the user's attributes and/or purpose, a display unit that displays the processed data according to the user's attribute and/or purpose, and an overall management unit that performs overall data management. and a task management unit and/or a scheduling unit.

As an eleventh aspect of the present invention, in the tenth aspect, the connection database determination section, the connection section, the data collection section, the data conversion section, the data preprocessing section, the data processing section, and the display section. In at least one of them, machine learning means including AI and deep learning may be used.

A twelfth aspect of the present invention may be realized as a recording medium in which the program according to the tenth or eleventh aspect is stored.

In order to solve the above problems, an information processing system according to a thirteenth aspect of the present invention provides a connection database determination system that determines a database to be connected to based on the user's attributes and/or purpose without the intervention of an expert. a connection unit that connects to the selected database; a data collection unit that collects data from the connected database according to user attributes and/or purposes; a data conversion unit that converts the data according to the attributes and/or purpose of the user; a data preprocessing unit that preprocesses the converted data according to the attributes and/or purpose of the user; and a data preprocessing unit that uses the preprocessed data. The present invention is characterized by comprising a data processing section that processes the data according to the user's attributes and/or purpose, and a display section that displays the processed data according to the user's attribute and/or purpose.

According to each aspect of the present invention, connection to data, data collection, data conversion, data preprocessing, data processing, task management, data utilization, and overall data management are performed without relying on experts, and data is unstructured. An information processing system that can utilize a wide variety of data including data is realized.

Finally, although various embodiments according to the present disclosure have been described, these are presented as examples and are not intended to limit the scope of the invention. The new embodiment can be implemented in various other forms, and various omissions, substitutions, and changes can be made without departing from the gist of the invention. The embodiment and its modifications are included within the scope and gist of the invention, and are included within the scope of the invention described in the claims and its equivalents.

1: Information processing system 2: Information processing device 3: User terminal 4: First window 5: Second window 6: Category specification area 7: Second input data display area 8: Structured data display area 9: First window 1 storage operation area 10: structured data search area 11: structured data editing area 12: editing result display area 13: second storage operation area 20: communication bus 21: communication unit 22: storage unit 23: processor 30: Communication bus 31: Communication section 32: Storage section 33: Processor 34: Display section 35: Input section 41: Input data search area 42: Input data list display area 43: First operation area 51: Format specification area 52: First Input data display area 53 : Second operation area 81 : First area 82 : Second area 101 : Search condition input area 102 : Search result display area 103 : Data set addition area 111 : Command input area 112 : Command Storage area 113: Command execution area 231: Acquisition unit 232: Specification unit 233: Generation unit 234: Display processing unit A1: Activity A2: Activity A3: Activity A4: Activity A5: Activity A6: Activity A7: Activity A8: Activity A9: Activity A10 : Activity A11 : Activity A12 : Activity A13 : Activity A14 : Activity A15 : Activity C : Category C1 : Specified category C2 : Usage category C3 : Collection category D1 : Input data D2 : Structured data D21 : First structured Data D22: Second structured data D23: Third structured data DB1: First database DB2: Second database DB21: First storage area DB22: Second storage area IM1: First image IM2 :Second image IM3 :Third image IM4 :Fourth image L1 :Highlight R1 :Edit area

Claims (9)

An information processing system,
Equipped with a processor capable of executing a program to perform each of the following steps,
In the acquisition step, input data is acquired, where the input data includes at least one of a plurality of types of unstructured data,
The type identifying step identifies at least one type of the unstructured data included in the input data based on the format of the acquired input data;
In the generation step, first structured data having a predetermined data structure is generated by performing a conversion process on the acquired input data according to the specified type of the unstructured data. thing. The information processing system according to claim 1,
Furthermore, in the candidate identification step, based on the identified type of the unstructured data, identify candidates for the category to which the conversion process to be performed on the input data belongs;
In the acquisition step, the user's specification of the category is acquired;
Furthermore, in the process specifying step, the conversion process belonging to the specified category is specified based on the specification. The information processing system according to claim 2,
The category includes a collection category defined by a collection mode of the input data. The information processing system according to claim 1,
In the generation step, when there is a plurality of generated first structured data, second structured data is generated by combining at least a part of the plurality of first structured data. . The information processing system according to claim 1,
Furthermore, the display processing step displays an editing area in which the elements of the structured data can be edited by the user. The information processing system according to claim 1,
The format of the input data includes an extension of the input data. The information processing system according to claim 1,
The type of unstructured data includes at least one of images, moving images, audio, three-dimensional spatial data, and time series data. An information processing method,
A method comprising each step of the information processing system according to any one of claims 1 to 7. An information processing program,
A device that causes at least one computer to execute each step of the information processing system according to any one of claims 1 to 7.