JP2005222494A - Integrated file generation device and integrated file generation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate an integrated file by editing fragmentary information, generated by using various input devices at different times in different places, based upon a user's context. <P>SOLUTION: The user's context is estimated based upon user information measured by a plurality sensors 11 by referring to a context definition table 13 by a context estimating means 12, and a context information generating means 14 generates context information based upon the estimation result. When fragmentary information is inputted from various input means 10, a fragmentary data generating means 15 generates fragmentary data based upon the fragmentary information and the latest context information. When an integrated file is generated, an integrated file generating means 17 edits the fragmentary data based upon the context information by referring to an editing rule table 20 to generate the integrated file. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an integrated file creation apparatus and an integrated file creation system that edit a plurality of pieces of fragmented information to create an integrated file, and more specifically, created by various media at different times and locations of users. Even for information, the present invention relates to an integrated file creation apparatus and an integrated file creation system that edit these information to create an integrated file.

  Conventionally, information handled on a computer includes various media such as characters, images (including moving images), and voices. The type of media to which the information belongs depends mainly on the type of input device (input device). Information input from a character input device such as a keyboard is converted into character information as an image such as a scanner or a camera. Information input from the input device is handled as image information, and information input from a sound input device such as a microphone is processed as sound information on the computer. Such a computer capable of handling various types of media information is generally called a multimedia device.

  Each time information is input by a user, the information input from each input device is fragmented information in a predetermined media format (hereinafter, referred to as “information”) in the input device or a computer connected to the input device. Fragment information). On the other hand, depending on the user, there is a case where it is desired to handle fragment information from these plural media as one integrated file. In that case, collect multiple pieces of fragment information that exist in different input devices and computers in one computer and combine them into a single integrated file. It was. The integrated file does not indicate only document data, but digital data including multimedia information such as document data, image data such as still images and moving images, spreadsheet data, and audio data.

  By the way, when creating a single integrated file by editing multiple pieces of fragment information, it is up to the user to edit the pieces of fragment information in what order and in what order to create the integrated file. is there. However, the user usually creates an integrated file in consideration of the contents of each piece of fragment information and related information such as the date and time added to the piece of fragment information.

As a technique for adding related information to fragment information created by the user using an input device, the camera is equipped with a GPS receiver, azimuth / tilt sensor, temperature / humidity / atmospheric pressure sensor, and shooting is performed with the camera. When image data is created, a camera with an information recording function is known in which related information such as a shooting position and a shooting situation is stored in association with the image data (see, for example, Patent Document 1).
JP-A-8-184892

  However, when a plurality of pieces of fragment information existing in different input devices and computers are collected into one integrated file, it is necessary for the user to collect the pieces of fragment information in one computer, and the medium of each piece of fragment information. In some cases, it was necessary to convert the type and data format. Furthermore, it is necessary for the user himself to perform integrated file editing work such as joining these pieces of information and arranging the appearance, which places a heavy burden on the user and takes a lot of time to create one integrated file. It had been.

  Further, when a single integrated file is created by editing a plurality of pieces of fragment information, it is necessary to determine in what form and in what order the pieces of fragment information are to be edited. At that time, there is a case where it is desired to determine the appearance of the integrated file based on the user's atmosphere and emotion at the time of creating the fragment information. In this case, the user needs to memorize the situation and feeling at the time of creating each piece of fragment information.

  Note that an abstract concept such as atmosphere, emotion, importance, etc. that indicates the context of the event and the context of the situation, and that cannot be grasped only by facts and evidence is called a context. That is, conventionally, an integrated file could not be created based on a context unless the context when the user created fragment information was stored.

  In the invention described in Patent Document 1, related information such as a shooting position and a shooting situation is added to the fragment information. This related information is information measured by a GPS receiver, each sensor, and the like. With these specific facts, it was difficult to know the atmosphere and feelings at the time of shooting. In the invention described in Patent Document 1, fragment information existing in input devices and computers with different users must be collected, and a user must edit fragment information to create an integrated file. Is not a solution.

  The present invention has been made to solve the above-described problem, and creates an integrated file by editing fragment information created using various input devices at different times and places based on a user's context. It is an object of the present invention to provide an integrated file creation device and an integrated file creation system that can reduce the burden and effort of creating an integrated file for a user and create an integrated file in a form and order that matches the user's needs. .

  To achieve the above object, an integrated file creation apparatus according to claim 1 stores a plurality of pieces of fragment data obtained by adding additional information to fragment information including at least one of character information, image information, and audio information. Fragment data storage means, and integrated file creation means for editing a plurality of the fragment data and creating an integrated file based on the additional information added to the fragment data stored in the fragment data storage means ing. The integrated file does not indicate only document data, but digital data including multimedia information such as document data, image data such as still images and moving images, spreadsheet data, and audio data.

  An integrated file creation apparatus according to a second aspect of the invention includes an edit rule table for defining an edit rule for creating an integrated file by editing the fragment data in addition to the configuration of the invention according to the first aspect. The integrated file creation means includes a plurality of pieces of the fragment data based on the edit rules defined in the edit rule table and the additional information added to the fragment data stored in the fragment data storage means. To create the integrated file.

  According to a third aspect of the present invention, there is provided an integrated file creation device, wherein, in addition to the configuration of the second aspect of the invention, the editing rule is stored in the fragment data based on the additional information added to the fragment data. It is characterized in that it determines the joining order of the fragment information included.

  According to a fourth aspect of the present invention, there is provided an integrated file creation device that converts the data format of the fragment data in accordance with the type of the fragment data in addition to the configuration of the invention according to any one of the first to third aspects. And a media conversion means for converting the data format of the fragment data created by the fragment data creation means based on the media conversion table.

  According to a fifth aspect of the present invention, there is provided an integrated file creation apparatus that inputs fragment information including at least one of character information, image information, and audio information in addition to the configuration of the invention according to any one of the first to fourth aspects. A context for indicating at least one of emotion, atmosphere, and state of the user based on the user information measured by the sensor; Based on the context estimated by the context estimation unit, context estimation unit for creating context information based on the context estimation unit, and the fragment information input by the input unit by the context information creation unit Fragment data is created by adding the created context information as the additional information. And a fragment data creation means that. Note that an abstract concept such as atmosphere, emotion, importance, etc. that indicates the context of the event and the context of the situation, and that cannot be grasped only by facts and evidence is called a context.

  According to a sixth aspect of the present invention, there is provided an integrated file creation device including a context definition table defining a correspondence between the user information and the context in addition to the configuration of the invention according to the fifth aspect, wherein the context estimation means includes: The context corresponding to the user information measured from the sensor is estimated based on the context definition table.

  In addition to the configuration of the invention described in claim 5 or 6, the integrated file creation device of the invention according to claim 7 is characterized in that the context information creation means includes the estimated type of the context and the strength of the context. The context information indicating is generated.

  In addition to the configuration of the invention according to any one of claims 5 to 7, the integrated file creation device according to the invention according to an eighth aspect is characterized in that the sensor includes the user's body temperature, heart rate, sweating, breathing, and It is characterized by measuring at least one of accelerations.

  In addition to the configuration of the invention according to any one of claims 5 to 8, the integrated file creation device according to the invention according to claim 9 is characterized in that the input means includes a keyboard or a touch panel for inputting the character information, It comprises at least one of a microphone for inputting audio information, a camera or a scanner for inputting the image information.

  According to a tenth aspect of the present invention, there is provided an integrated file creating apparatus including a fragment data receiving means for receiving the fragment data via a network in addition to the configuration of the invention according to any one of the first to ninth aspects. The data storage means stores the fragment data received by the fragment data receiving means.

  In addition to the configuration of the invention according to claim 10, the integrated file creation device of the invention according to claim 11 includes the fragment data received by the receiving means including user authentication information, and the fragment data is included in the fragment data. Authentication execution means for authenticating whether or not the fragment data belongs to a legitimate user based on the added authentication information is provided, and the fragment data storage means includes that of a legitimate user by the authentication execution means. The fragment data authenticated to be stored is stored.

  In addition to the configuration of the invention according to claim 11, the integrated file creation device of the invention according to claim 12 is characterized in that the integrated file creation means uses the additional information based on the additional information added to the fragment data. The integrated file is created by editing a plurality of pieces of fragment data for each person.

  According to a thirteenth aspect of the present invention, there is provided an integrated file creation system including a portable terminal device to which fragment information including at least one of character information, image information, and audio information is input, and the fragment input by the portable terminal device. An integrated file creation system in which an editing device that edits information to create an integrated file is connected via a network, wherein the mobile terminal device includes an input unit for inputting the fragment information, A sensor that measures user information about the user, and a context estimation unit that estimates a context indicating at least one of emotion, atmosphere, and state of the user based on the user information measured by the sensor; Context for creating context information based on the context estimated by the context estimation means Information creation means, fragment data creation means for creating fragment data by adding the context information created by the context information creation means to the fragment information input by the input means, and fragment data creation means Fragment data transmitting means for transmitting the fragment data generated by the editing device to the editing device, wherein the editing device receives the fragment data transmitted from the mobile terminal device; and the fragment data Fragment data storage means for storing the fragment data received by the receiving means; an edit rule table for defining an edit rule for editing the fragment data to create the integrated file; and the edit rule table Added to the editing rule and the fragment data stored in the fragment data storage means Based on the serial context information, and an integrated file creating means for creating said integration file by editing the plurality of fragment data.

  According to a fourteenth aspect of the present invention, in addition to the configuration of the thirteenth aspect of the invention, the portable terminal device includes an authentication information adding unit for adding the user authentication information. The fragment data creation means adds the context information created by the context information creation means and the authentication information added by the authentication information addition means to the fragment information input by the input means, The editing device includes authentication execution means for authenticating whether or not the fragment data belongs to a legitimate user based on the authentication information added to the fragment data, and the fragment data storage The means stores the fragment data authenticated by the authentication execution means as being of a legitimate user.

  According to a fifteenth aspect of the present invention, in addition to the configuration of the fourteenth aspect of the present invention, in the editing apparatus, the integrated file preparation means is the fragment stored in the fragment data storage means. Based on the context information added to the data, the plurality of pieces of fragment data are edited for each user to create the integrated file.

  In the integrated file creation device according to the first aspect of the invention, an integrated file is created by editing a plurality of fragment data based on additional information added to the fragment data. Reduces the burden and effort of creation, and can create an integrated file in a form and order that matches the user's needs. Even if fragment data is created at different locations and times, an integrated file can be created based on the additional information.

  Further, in the integrated file creation device of the invention according to claim 2, in addition to the effect of the invention according to claim 1, an edit rule table for defining an edit rule for creating an integrated file by editing fragment data is provided, An integrated file is created based on this editing rule and additional information. Therefore, a plurality of fragment data can be edited as an integrated file according to an arbitrary editing rule.

  In addition, in the integrated file creation device of the invention according to claim 3, in addition to the effect of the invention according to claim 2, the editing rule determines the joining order of the fragment information included in the fragment data. It is possible to create an integrated file by joining the pieces of fragment information in an optimal order.

  Moreover, in the integrated file creation device of the invention according to claim 4, in addition to the effect of the invention according to any of claims 1 to 3, the data format of the fragment data can be converted based on the media conversion table. The integrated file can be edited from the fragment data converted into the optimum data format.

  Further, in the integrated file creation device of the invention according to claim 5, in addition to the effect of the invention according to any of claims 1 to 4, the context information created based on the user information from the sensor is converted to text, image Since the fragment data is created by adding to the audio fragment information, the user input information can be associated with the context of the user at the time of input. In addition, it is possible to create an integrated file by editing fragment information created using various input devices at different times and places based on the context.

  In addition, in the integrated file creation device of the invention according to claim 6, in addition to the effect of the invention according to claim 5, the context of the user is estimated based on the context definition table that defines the correspondence between the user information and the context. Therefore, the context corresponding to the user information can be accurately estimated.

  Further, in the integrated file creation device of the invention according to claim 7, in addition to the effect of the invention according to claim 5 or 6, the context information indicates the type of context and the strength of the context, so the context corresponding to the user information Can be estimated accurately.

  In addition, in the integrated file creation device of the invention according to claim 8, in addition to the effects of the invention according to claims 5 to 7, the sensor measures the body temperature, heart rate, sweating, respiration and acceleration of the user. Therefore, the context corresponding to the user information can be accurately estimated.

  Further, in the integrated file creation device of the invention according to claim 9, in addition to the effect of the invention according to any of claims 5 to 8, a keyboard, a touch panel, a microphone, a camera and a scanner can be used as input means. Fragment information can be created using various input devices at different times and places.

  In addition to the effect of the invention according to any one of claims 1 to 9, the integrated file creation device according to the invention according to claim 10 includes receiving means for receiving the fragment data via a network. Even if the creating means is separated from the integrated file creating means, the integrated file can be created based on the fragment data.

  In addition, in the integrated file creation device of the invention according to claim 11, in addition to the effect of the invention according to claim 10, authentication information is included in the fragment data, and it is determined whether or not the fragment data is an authorized user. Since it is authenticated, it is possible to create an integrated file based on fragment data that has been authenticated as an authorized user.

  In addition, in the integrated file creation device of the invention according to claim 12, in addition to the effect of the invention according to claim 11, an integrated file is created by editing a plurality of fragment data for each user. Can create an integrated file.

  In the integrated file creation system of the invention according to claim 13, the integrated file is created by editing a plurality of fragment data based on the context information added to the fragment data. Reduce the burden and effort of creating an integrated file, and create an integrated file in a form and order that meets the needs of the user. In addition, it is possible to create an integrated file by editing fragment information created using various input devices at different times and places based on the user's context.

  Further, in the integrated file creation device of the invention according to claim 14, in addition to the effect of the invention according to claim 13, authentication information is included in the fragment data, and whether or not the fragment data is an authorized user is determined. Since it is authenticated, it is possible to create an integrated file based on fragment data that has been authenticated as an authorized user.

  In addition, in the integrated file creation device of the invention according to claim 15, in addition to the effect of the invention according to claim 14, an integrated file is created by editing a plurality of fragment data for each user. Can create an integrated file.

  Hereinafter, an embodiment of the present invention will be described. In the integrated file creation device and the integrated file creation system according to the present invention, fragment information created for each input by an input device such as a camera or a scanner is acquired. On the other hand, the body temperature, sweating, heart rate, etc. of the user are measured by various sensors to estimate the context of the user's emotions and the situation surrounding the user when creating the fragment information, and the estimation result of this context is It is added to the fragment information. Then, based on the context estimation result added to each piece of fragment information, each piece of piece information is edited to create an integrated file. The integrated file does not indicate only document data, but digital data including multimedia information such as document data, image data such as still images and moving images, spreadsheet data, and audio data.

  In the first embodiment, as an example of the integrated file creation device of the present invention, an input device such as a camera and a scanner is connected to various sensors for measuring a user's body temperature, sweating, heart rate, and the like. The integrated file creating apparatus 1 having various functions for executing the estimation of the above and the creation of the integrated file and the like and having the configuration necessary for the present invention in one apparatus will be described below.

  First, the configuration of the integrated file creation apparatus 1 according to the first embodiment will be described with reference to FIGS. 1 to 3. FIG. 1 is a block diagram showing the configuration of the integrated file creation apparatus 1. FIG. 2 is a conceptual diagram showing the configuration of the storage area of the RAM 130 of the integrated file creation device 1. FIG. 3 is a conceptual diagram showing the configuration of the storage area of the HDD 140 of the integrated file creation apparatus 1.

  As shown in FIG. 1, the integrated file creating apparatus 1 is provided with a CPU 110 that controls the integrated file creating apparatus 1. The CPU 110 includes a ROM 120 that stores a program such as BIOS executed by the CPU 110, a RAM 130 that temporarily stores data, and a hard disk drive (hereinafter referred to as “HDD”) that is a data storage device. 140) is connected. Further, the RAM 130 edits a context definition table for estimating a context based on information measured from various sensors, a media conversion table for converting the data format of fragment data, and a plurality of fragment data. An edit rule table that defines edit rules for creating an integrated file is stored, details of which will be described later.

  Further, the USB interface 150 for performing communication with an external device, the display control unit 160 for performing screen display processing of the display 161 for displaying the operation screen and various information to the user, and the user performing voice input. An audio control unit 170 that performs processing for input / output control of audio information of a microphone 171 for outputting audio and a speaker 172 for outputting audio, and an input detection unit 180 that detects input from various devices are included in the bus 115. It is connected to CPU110 via. In addition, a timer 190 for counting the current date and time and the time interval is connected to the CPU 110 via the bus 115.

  The USB interface 150 includes a scanner 151 that reads images and characters to acquire image information, a camera 152 that captures images of people and landscapes and acquires image information, and a personal computer 153 that is another computer. Connected as an external device. The image information acquired by the scanner 151 and the camera 152 and various information on characters, images, and sounds stored in the personal computer 153 can be imported into the integrated file creation apparatus 1 via the USB interface 150. . In this way, the integrated file creation apparatus 1 can be connected to various external input devices, and the user can input various information from these input devices at different locations and times.

  The input detection unit 180 includes an input panel 181 including buttons and switches for the user to operate the integrated file creation device 1 and input character information, and a body temperature for measuring the user's body temperature. Sensor 182, sweat sensor 183 for measuring the user's sweat state, and heart rate sensor 184 for measuring the user's heart rate are connected. The body temperature sensor 182, the sweat sensor 183, and the heart rate sensor 184 may be any position and measurement method as long as the body temperature, sweat, and heart rate of the user can be measured effectively. When 1 is held, a reading unit for these sensors is provided at a position in the integrated file creation apparatus 1 where the palm of the user contacts. The input panel 181 is also provided with an execution button for instructing the integrated file creation apparatus 1 to execute creation of the integrated file.

  In the integrated file creation apparatus 1 according to the first embodiment, an integrated file creation program is executed as one of modules executed when context estimation, fragment data creation, and integrated file creation are performed. The integrated file creation device 1 is also provided with a CD-ROM drive, floppy (registered trademark) disk drive, various interfaces, etc., not shown, and at the time of introduction via an external storage medium such as a CD-ROM or a network. The integrated file creation program is set up and stored in the program storage area 142 and information storage area 143 (see FIG. 3) on the HDD 140 from an external storage device.

  Next, as shown in FIG. 2, the RAM 130 of the integrated file creation apparatus 1 has a work area 131 for storing temporary data during execution of the program and input information for temporarily storing various input information. A storage area 132 and an output information storage area 133 for temporarily storing various information to be output are provided. Further, the RAM 130 is provided with various storage areas not shown.

  Further, as shown in FIG. 3, the HDD 140 of the integrated file creation apparatus 1 includes an operating system (OS) storage area 141 that stores various programs executed by the CPU 110 to control the operation of the integrated file creation apparatus 1. A program storage area 142 that stores various programs executed by the integrated file creation apparatus 1 and an integrated file creation program, and an information storage area 143 that stores information such as settings, initial values, and data necessary for program execution A fragment data storage area 144 that stores fragment data created based on fragment information that is input information of images, characters, and sounds; and an integrated file storage area 145 that stores an integrated file created based on the fragment data Is provided. Various table information such as a context definition table, an editing rule table, and a media conversion table, which will be described later, are stored in the information storage area 143.

  Next, an overview of processing in the integrated file creation device 1 according to the first embodiment will be described with reference to FIGS. 4 and 5. FIG. 4 is a functional block diagram showing the configuration of the integrated file creation device 1 by function. FIG. 5 is a diagram showing the transition of the data structure in the integrated file creation apparatus 1.

  As shown in FIG. 4, the integrated file creation apparatus 1 is connected to a plurality of input means 10, and fragment information that is input information of images, characters, and sounds is input. On the other hand, a plurality of sensors 11 for measuring user information such as the user's body temperature, sweating, heart rate and the like are connected, and based on the user information measured by the sensor 11, the context estimation means 12 stores the context definition table 13. With reference to this, a context indicating the user's emotion, atmosphere and state is estimated. In the context definition table 13, the correspondence between the user information and the context is defined in advance.

  Based on the estimated context, context information including a context type and a context value indicating the strength of the context is created by the context information creating unit 14. Then, the fragment data creating means 15 adds the context information to the fragment information to create fragment data. The generated fragment data is stored in the fragment data storage means 16.

  As shown in FIG. 5, in “fragment data creation”, fragment information 200 (fragment information A) in which an image, text, and voice are input from the input means 10 is mainly composed of a header portion and a data portion. Further, the context information 300 (context information A) created by the context information creating means 14 is mainly composed of a header part and a context data part. From such fragment information 200 (fragment information A) and context information 300 (context information A), fragment data 400 a (fragment data A) is created by the fragment data creation means 15. As a result, the fragment data 400a (fragment data A) includes a data portion and a context data portion in addition to the header portion. In FIG. 5, in addition to fragment data 400a (fragment data A), fragment data 400b (fragment data B), fragment data 400c (fragment data C), and fragment data 400d (fragment data D) are created as fragment data 400. These fragment data 400 are stored in the fragment data storage means 16. In this way, the fragment information 400 is created by adding the context information 300 to all of the fragment information 200 input from the input unit 10.

  Returning to FIG. 4, “Create integrated file” is executed at a predetermined timing such as when an instruction to create an integrated file is given by the user. The integrated file creation unit 17 executes a process of creating a unified file 600 by editing a plurality of fragment data 400 stored in the fragment data storage unit 16. Further, when it is necessary to convert the data format of the fragment data 400, the media conversion table 19 defining the conversion information for converting the data format is referred to by the media conversion means 18, and the data format of the fragment data 400 is changed. Conversion is performed.

  When the fragment data 400 is edited by the integrated file creation means 17, the editing rule table 20 having editing rules that determine the appearance and order of the integrated file is referred to, and based on the context information included in the fragment data 400. An integrated file 600 is created. The integrated file 600 created by the integrated file creating unit 17 is stored in the integrated file storage unit 21.

  As shown in FIG. 5, in the “integrated file creation”, the integrated file creation means 17 edits the fragment data 400a, 400b, 400c, and 400d stored in the fragment data storage means 16 to create the integrated file 600. . At this time, the integrated file 600 is created based on an editing rule that determines the appearance and order of the integrated file 600. Details will be described later. In FIG. 5, stitching data 500 is created in the process of creating the integrated file 600. The stitching data 500e (stitching data E) obtained by combining the fragment data 400a and 400c and the stitching data 500f (stitching data F) obtained by combining the fragment data 400b and 400d are created, and the stitching data 500e and 500f are synthesized. Thus, an integrated file 600 is created. As a result, the integrated file 600 includes a data part and a context data part of each piece of fragment data 400a, 400b, 400c, and 400d in addition to the header part. As described above, the integrated file 600 is created from the plurality of fragment data 400.

  Of the integrated file creation apparatus 1 having each function as described above, in the first embodiment, the scanner 151, the camera 152, the personal computer 153, and the input panel 181 are the “input means” of the present invention. It corresponds to 10. The body temperature sensor 182, the sweat sensor 183, and the heart rate sensor 184 correspond to the “sensor” 11 of the present invention.

  Then, the CPU 110 that executes the integrated file creation program stored in the program storage area 142 and processes the flowchart described later is the “context estimation means” 12, “context information creation means” 14, “fragment data creation” of the present invention. Means 15, “integrated file creation means” 17, and “media conversion means” 18.

  Further, in the “context definition table” 13, “edit rule table” 20, and “media conversion table” 19 of the present invention, respective storage areas are secured in the information storage area 143 of the HDD 140. Further, the fragment data storage area 144 of the HDD 140 corresponds to the “fragment data storage means” 16 of the present invention, and the integrated file storage area 145 of the HDD 140 corresponds to the “integrated file storage means” 21 of the present invention (FIG. 4). reference).

  Hereinafter, the flow of processing in the integrated file creation apparatus 1 of the present invention will be described with reference to the drawings. In the integrated file creation apparatus 1 of the present invention, [1] a process for estimating context based on user information measured from various sensors and creating context information (context estimation process), [2] various input means When fragment information is input from, a process for adding context information to the fragment information to create fragment data (fragment data creation process), [3] editing a plurality of fragment data to create an integrated file Processing (integrated file creation processing) is executed as the main processing.

  Through these processes, various pieces of fragment information such as input speech, images, and characters are edited based on the context such as atmosphere, emotion, importance, etc., and one integrated file reflecting the user's context is created. The Hereinafter, as an example, it is assumed that the context is “impressed”, and a case where an integrated file is created according to the degree of “impressed” of the user at the time of inputting the fragment information will be described.

  First, [1] Context estimation processing will be described with reference to FIGS. FIG. 6 is a main flowchart of the context estimation process. FIG. 7 is a flowchart showing details of the calibration process (S14). FIG. 8 is a flowchart showing details of the measurement process (S15). FIG. 9 is a flowchart showing details of the estimation process (S16). FIG. 10 is a diagram showing an overview of the context definition table 13. FIG. 11 is a diagram showing a data configuration of the context information 300 created in S17. The context estimation process starts when the integrated file creation apparatus 1 is powered on and started.

  As shown in FIG. 6, first, various sensors for measuring user information from the user are initialized (S11). In the present embodiment, a body temperature sensor 182, a sweat sensor 183, and a heart rate sensor 184 are provided, and the user's body temperature, sweat, and heart rate are measured as user information. When the integrated file creation device 1 is activated, these sensors are initialized in S11.

  Then, a predetermined measurement interval time is set in the timer 190 (S12). The measurement interval time is a time interval at which calibration measurement is executed in a calibration process (S14) described later. In S12, a predetermined value is set as the measurement interval time, but the user or the designer may set an arbitrary value. Further, a predetermined measurement interval time is set in the timer 190 (S13). The measurement interval time is a time interval in which a measurement process (S15) described later is executed. Similarly to the measurement interval time, the user or designer may set an arbitrary value for the measurement interval time.

  Next, a calibration process for obtaining a reference value that is an average of measured values by various timers is executed (S14).

  As shown in FIG. 7, first, the number of measurements is initialized (S21), and the calibration time for executing this calibration process is set in the timer 190 (S22). In S22, a predetermined value is set as the calibration time, but the user or the designer may set an arbitrary value.

  If the calibration time has not ended (elapsed) (S23: NO) and the measurement interval time set in S12 of the context estimation process (see FIG. 6) has ended (elapsed) (S24). : YES), the output of each sensor is measured (S25). In the present embodiment, the body temperature sensor 182, the sweat sensor 183, and the heart rate sensor 184 are provided, and thus the measurement values output for the user's body temperature, sweat, and heart rate are acquired. When the measurement interval time has not ended (elapsed) (S24: NO), the process waits at S24 until the measurement interval time ends (elapses). Thereafter, the number of measurements is increased (S26), and the process returns to S23.

  If the calibration time has not ended (elapsed) in S23 (S23: NO), the output of each sensor is measured again after the measurement interval time has elapsed (S24: YES) (S25). In this way, the measurement of the output of each sensor is repeated at every measurement interval time until the calibration time set in S22 ends (elapses) (S23 to S26).

  On the other hand, after the calibration time has elapsed (S23: YES), the average value of the measured values for each sensor is calculated (S27). For example, all the measured values of a plurality of body temperatures measured at every measurement interval time by the body temperature sensor 182 are added, and the added value is divided by the number of times of measurement acquired in S26. An average value is calculated. Then, the reference value of each sensor calculated in S27 is stored in a reference value area (not shown) provided in the RAM 130 (S28).

  Thereafter, returning to FIG. 6, a measurement process is performed in which each sensor measures user information from the user (S15).

  As shown in FIG. 8, first, the number of times of measurement is initialized (S31). After the number of times of measurement is set (S32), the output of each sensor is measured (S33). Then, an increment value obtained by subtracting the reference value of each sensor stored in the reference value area provided in the RAM 130 from the measured value of each sensor in S33 is calculated (S34). For example, in S33, when the body temperature of the current user is measured by the body temperature sensor 182 as the measured value 36.5 ° C., if the body temperature sensor 182 is the reference value 36.0 ° C., the increment value 0.5 ° C. Will be calculated. Thereafter, the number of times of measurement is increased (S35), and if the number of times of measurement set in S32 has not ended (S36: NO), the measurement of the output of each sensor is repeated until the number of times of measurement ends (S33). To S36). In S34, the increment value for each measurement is added to the increment value up to the previous time each time. When the number of measurements set in S32 ends (S36: YES), the increment value is divided for each sensor by the number of measurements set in S32, and the average value of the increment values for each sensor is calculated ( S37).

  Then, returning to FIG. 6, the context estimation process for estimating the user's context is executed (S16).

  As shown in FIG. 9, first, a state variable which is a flag indicating a change in state of user information is cleared from each sensor (S41). In the present embodiment, three bits of the second bit for the body temperature measured by the body temperature sensor 182, the first bit for the sweating measured by the sweat sensor 183, and the 0th bit for the heart rate measured by the heart rate sensor 184 are in a state. As a variable. Then, the change in the user information is determined based on the average value of the increment values for each sensor calculated in the measurement process (S15).

  First, an average value of body temperature increment values (body temperature increment value) measured from the body temperature sensor 182 is compared with a reference value (body temperature threshold) related to body temperature (S42). The reference value (threshold value) is a value stored in the reference value area of each sensor in S28 of the calibration process (FIG. 7). As a result, if the body temperature increment value is larger than the body temperature threshold (S42: YES), the second bit is set to “ON” (S43). On the other hand, when the body temperature increment value is not larger than the body temperature threshold value (S42: NO), the process proceeds to the next step (S44). Similarly, with respect to perspiration measured by the perspiration sensor 183, an average value of the increments (perspiration increment value) and a reference value (perspiration threshold value) related to perspiration are compared (S44). As a result, the perspiration increment value is determined as the perspiration threshold value. If greater than (S44: YES), the first bit is set to "ON" (S45). On the other hand, when the perspiration increment value is not larger than the perspiration threshold value (S44: NO), the process proceeds to the next step (S46) as it is. For the heart rate measured by the heart rate sensor 184, the average value of the increment values (heart rate increment value) is compared with a reference value (heart rate threshold value) relating to the heart rate (S46). If the increment value is larger than the heart rate threshold value (S46: YES), the 0th bit is set to “ON” (S47). On the other hand, when the heart rate increment value is not larger than the heart rate threshold value (S46: NO), the process proceeds to the next step (S48) as it is.

  Thereafter, the context type and the context value corresponding to the pattern of the second bit, the first bit, and the 0th bit of the state variable are acquired from the context definition table 13 (S48). As shown in FIG. 10, the context definition table 13 includes a context type 13a indicating the type of context, a sensor state 13b indicating a change state of user information measured by each sensor, and a numerical value indicating the strength of the user's context. And a context value 13c shown in FIG. And the correspondence of each data item is defined in a table format. As described above, in the present embodiment, since the integrated file is created based on the user's context “impression”, the context definition table 13 referred to also relates to the context “impression”. Therefore, the context type 13a defines the type of context related to “feeling”, and there are a plurality of context types ranging from “excitement” to “no impression (normal)” depending on the strength of the user's “feeling”. doing. Also, a context value 13c that expresses the strength of the “feeling” as a numerical value is defined. For example, if the context type 13a is “excited”, the context value 13c is the maximum value “100”. Since the context definition table 13 shown in FIG. 10 relates to the context “impression”, the context value 13c is also displayed as an emotion value (E).

  In S48, since the sensor state 13b is specified by the state variables set in S42 to S47, the context type 13a and the context value 13c corresponding to the sensor state 13b are acquired. If the second bit to the 0th bit are set to “ON”, the sensor state 13b is determined to be “UP”. For example, in the case of the second bit “ON”, the first bit “ON”, and the 0th bit “OFF”, the context value 13c “10” with the context type 13a “confused” is acquired with reference to the context definition table 13.

  Then, returning to FIG. 6, based on the context type 13a and the context value 13c acquired in the estimation process (S16), context information 300 to which a predetermined header portion is added is created (S17), and the context information in the RAM 130 is obtained. It is stored in a storage area (not shown) (S18). Regarding the storage of the context information 300, the previous context information 300 may be overwritten and stored, and the context information 300 from the past to the present may be stored in the HDD 140 as a log. That is, as long as the latest context information 300 can be referred to, any storage form may be used. In the present embodiment, it is assumed that only the latest context information 300 is stored in the context information storage area of the RAM 130.

  As shown in FIG. 11, the context information 300 includes a context header portion 301 in which detailed information indicating various characteristics of data is stored, and a context data portion 304 that is a main body portion of the data. The context header portion 301 includes size information 302 of the context header portion 301 and size information 303 of the context data portion 304. In addition, the context data unit 304 includes the context type 13a and the context value 13c acquired in S48.

  Thereafter, if the measurement interval time set in S12 has ended (elapsed) (S19: YES), the process returns to S15, and the process of acquiring the latest context information 300 is repeated (S15 to S18). On the other hand, if the measurement interval time has not ended (elapsed) (S19: NO), a waiting state is entered in S19. As described above, while the integrated file creation apparatus 1 is operating, the latest user context information 300 is acquired at every measurement interval time.

  Next, [2] fragment data creation processing will be described with reference to FIGS. FIG. 12 is a diagram showing a data structure of the fragment information 200. As shown in FIG. FIG. 13 is a main flowchart of fragment data creation processing. FIG. 14 is a flowchart showing details of the fragment data creation execution process (S74). FIG. 15 is a diagram illustrating a data configuration of the fragment data 400.

  As a premise of this processing, it is assumed that information input by a user from various input devices at different locations and times is stored in the integrated file creation apparatus 1. That is, characters, images, or voices are transferred to the integrated file creating apparatus 1 by an external device such as the scanner 151, the camera 152, and the personal computer 153 connected to the integrated file creating apparatus 1 or input means such as the microphone 171 and the input panel 181. Assume that the input fragment information 200 is stored in the input information storage area 132 (see FIG. 2) of the RAM 130.

  As shown in FIG. 12, the fragment information 200 includes a header portion 201 that stores detailed information indicating various characteristics of data, and a data portion 206 that is a main body portion of the data. The header portion 201 includes size information 202 of the header portion 201, size information 203 of the data portion 206, a media type 204 of the data portion 206, and format information 205 of the data portion 206. The data portion 206 stores a data body to which characters, images, or sounds are input.

  In the fragment data creation process, the following description will be continued assuming that when the fragment information 200 is stored in the input information storage area 132, the fragment data 400 is created.

  As shown in FIG. 13, first, a predetermined monitoring interval time is set (S71). In this embodiment, when the fragment information 200 stored in the input information storage area 132 is detected at regular intervals, the monitoring interval time determines the time interval at which this detection process is executed. If the monitoring interval time set in S71 has ended (elapsed) (S72: YES), it is determined whether there is unprocessed fragment information 200 in the input information storage area 132 (S73). Whether the fragment information 200 has been processed or not is determined based on the file name of the fragment information 200. Specifically, in the processed fragment information 200, an identifier “done_” is added to the head of the file name, and in S73, the fragment information 200 of the file to which “done_” is not added to the file name. Is determined to be unprocessed.

  When it is determined that the unprocessed fragment information 200 exists in the input information storage area 132 (S73: YES), a fragment data creation execution process (S74) is executed. On the other hand, when the monitoring interval time has not ended (elapsed) (S72: NO), or when it is determined that the unprocessed fragment information 200 does not exist in the input information storage area 132 (S73: NO), monitoring is performed in S72. Waiting for the end (elapsed) of the interval time.

  As shown in FIG. 14, in the fragment data creation execution process (S74), the fragment information 200 determined as unprocessed in S73 is read (S81), and the latest context information stored in the context information storage area is read. 300 is read (S82). Then, the fragment data 400 is created based on the fragment information 200 read in S81 and the context information 300 read in S82 (S83). In S83, the header part of the fragment data 400 to be created is created so as to include the information of the header part 201 of the fragment information 200 and the information of the context header part 301 of the context information 300. Further, the data part of the fragment data 400 is created so as to include the information of the data part 206 of the fragment information 200 and the information of the context data part 304 of the context information 300.

  As a result, as shown in FIG. 15, the fragment data 400 is composed of a fragment data header portion 401 in which detailed information indicating various characteristics of the data is stored, and a fragment data data portion 404 that is the main body portion of the data. . The fragment data header section 401 includes size information 402 of the fragment data header section 401, creation time information 403 of the fragment data 400, size information 203 of the data section 2060, media type 204 of the data section 206, and data section 206. Format information 205 and size information 303 of the context data portion 304 are included. Further, the fragment data data portion 404 includes a context data portion 304 and a data portion 206. In addition, the same code | symbol is provided to the substantially same data as the above-mentioned fragment information 200 and context information 300 (refer FIG.11 and FIG.12).

  As described above, the fragment data 400 created in S83 is stored in the fragment data storage area 144 of the HDD 140 (S84). Thereafter, returning to FIG. 13, the fragment information 200 is renamed (S75). That is, for the fragment information 200 that has been subjected to the above processing, an identifier “done_” is added to the head of the file name. As a result, the fragment information 200 that has been renamed with the identification “done_” is determined to have been processed in the determination process of S73, and is not subjected to fragment data creation.

  As described above, when the fragment information 200 such as characters, sounds, and images is input from the user, even if the fragment information 200 is input at a different place or time, the latest user context information is obtained. Fragment data 400 is created based on 300 and the input fragment information 200.

  Next, [3] integrated file creation processing will be described with reference to FIGS. 16 to 22. FIG. 16 is a main flowchart of the integrated file creation process. FIG. 17 is a diagram showing a data structure of the fragment data list 900. FIG. 18 is a diagram showing an outline of the media conversion table 19. FIG. 19 is a flowchart showing details of the “X sentence” creation process (S103, S104, S105, S106). FIG. 20 is a diagram illustrating a data configuration of the editing rule table 20. FIG. 21 is a diagram illustrating a data configuration of the “X sentence” configuration list 910. FIG. 22 is a diagram showing a data configuration of the integrated file 600. As shown in FIG.

  The integrated file creation process is started when the integrated file creation apparatus 1 instructs the creation of the integrated file from the input panel 181 or the like. In the present embodiment, a case where one integrated file is created by rearranging and editing a plurality of fragment data 400 will be described. Further, in the present embodiment, as an example, a case where an integrated file composed of four sections of “introduction”, “main sentence”, “跋文”, and “supplementary sentence” is created from a plurality of fragment data 400 is taken as an example. explain.

  As shown in FIG. 16, first, a fragment data list 900 in the fragment data storage area 144 of the HDD 140 is created (S101). The fragment data list 900 is an index for displaying a list of fragment data 400 stored in the fragment data storage area 144, and the fragment data list 900 as shown in FIG. 17 is created in S101. In FIG. 17, n pieces of fragment data 400 stored in the fragment data storage area 144 are shown.

  Next, a media conversion destination is designated (S102). The data portion 206 (see FIG. 15) of the fragment data 400 includes various media types 204 such as voice, image, and character, and the format information 205 may be different even for the same media type 204. Also, the media type and format information that the user wants to use for the integrated file may differ from the media type 204 and format information 205 of the fragment data 400 (data portion 206). Therefore, before the integrated file 600 is created, what media type and format information the fragment data 400 (data portion 206) should be converted to is set by specifying the medium conversion destination in S102. This media conversion destination is specified by referring to the media conversion table 19 shown in FIG. 18. However, the user may arbitrarily specify from the input panel 181 or automatically default. May be specified.

  The media conversion table 19 is a table in which the conversion source media and the converted media are associated with each other. When the conversion source fragment data 400 (data portion 206) is a character, audio, or image media type 204, The contents of the data conversion processing when converting it into the media types of the conversion destination character, sound, and image are shown. With reference to such a media conversion table 19, for example, “character” is designated as the conversion destination when the media type 204 of the fragment data 400 (data portion 206) of the conversion source is “voice”. Then, the fragment data 400 (data portion 206) whose media type 204 is “speech” is edited as an integrated file 600 after being subjected to “speech recognition” processing and converted to “character” data. Similarly, when the media type 204 is “image” or “sound”, the conversion destination media type is designated. Further, the format information of the conversion destination is also specified for the format information 205 of the fragment data 400 of the conversion source (data portion 206).

  Next, an introductory sentence creation process (S103), a main sentence creation process (S104), a samurai sentence creation process (S105), and a supplementary sentence creation process (S106) are executed. These are the processes for creating four sections of “Introduction”, “Main sentence”, “Moon sentence”, and “Supplementary sentence”, respectively, but since the processing contents are common, the “X sentence” creation process is described below. Will be described.

  As shown in FIG. 19, in the “X sentence” creation process, first, an empty “X sentence” configuration list 910 is created (S121). If the “X sentence” creation process is the preface creation process (S103), the “X sentence” configuration list 910 becomes the preface configuration list. Next, the context value and the priority editing order of the classification “X sentence” are acquired from the editing rule table 20 (S122). The editing rule table 20 shows an editing rule indicating a rule or order in which a plurality of fragment data 400 are edited. As shown in FIG. 20, the editing rule table 20 includes, as data items, a classification 20a indicating a section of an integrated file, a context value 20b of fragment data 400, and a priority editing order 20c that defines a priority order when editing the integrated file. ing. In S122, the context value 20b and the priority editing order 20c are acquired from the editing rule table 20 based on the classification 20a corresponding to the “X sentence”. For example, when “X sentence” is an introductory sentence, “70 to less than 80” is acquired as the context value 20b, and “context value ascending order> creation time order” is acquired as the priority editing order 20c.

  Next, a lower limit threshold and an upper limit threshold are set based on the context value 20b acquired in S122 (S123). Among the context values 20b, the minimum value is set as the lower limit threshold, and the maximum value is set as the upper limit threshold. For example, when “X sentence” is an introductory sentence, the context value 20b is “70 or more and less than 80”, so that the lower limit threshold value “70” and the upper limit threshold value “80” are obtained.

  Thereafter, it is determined whether or not all files in the fragment data list 900 have been checked (S124). As a result, when it is determined that it is not checked (S124: NO), a context value is acquired from the context data portion 304 of the fragment data 400 that is not checked (S125). Then, the context value is compared with the lower threshold, and it is determined whether or not the context value is equal to or greater than the lower threshold (S126). If it is determined that the context value is equal to or greater than the lower threshold (S126: YES), Further, the context value is compared with the upper limit threshold value, and it is determined whether or not the context value is less than the upper limit threshold value (S127). That is, it is determined whether or not the context value included in the fragment data 400 is included in the value indicated by the context value 20b.

  As a result, when it is determined that the context value included in the fragment data 400 is equal to or greater than the lower threshold (S126: YES) and is less than the upper threshold (S127: YES), the fragment data from the fragment data list 900 is determined. 400 is deleted (S128), and the fragment data 400 is added to the “X statement” configuration list 910 (S129). On the other hand, when it is determined that the context value included in the fragment data 400 is less than the lower threshold (S126: NO), or when it is determined that it is greater than or equal to the upper threshold (S127: NO), the process returns to S124. Thereby, the processing of S124 to S129 is executed for all the fragment data 400 registered in the fragment data list 900.

  If it is determined that all the files in the fragment data list 900 have been checked (S124: YES), the priority editing order is set based on the priority editing order 20c acquired in S122 (S130), and according to this priority editing order. , The fragment data 400 added to the “X statement” configuration list 910 is sorted (S131). For example, when m pieces of fragment data 400 have been added to the “X sentence” configuration list 910 by the processing of S124 to S129, sorting is performed in the priority editing order “context value ascending order> creation time order”. Then, as shown in FIG. 21, the m pieces of fragment data 400 added to the fragment data file name 910c are sorted in ascending order using the context value 910a as the first key. If the context values are the same, the creation time 910b is sorted as the second key.

  Next, among the fragment data 400 stored in the fragment data storage area 144, the media conversion process is executed based on the media conversion table 19 for the data added to the “X sentence” configuration list 910 (S132). . Specifically, the media type 204 and format information 205 of the corresponding fragment data 400 (data portion 206) are acquired, and the content of the data conversion process is acquired with reference to the media conversion table 19. The fragment data 400 (data portion 206) is subjected to data conversion according to this data conversion process, and the data of the media type and format information of the conversion destination are acquired. For example, in the case of the media type 204 “sound” and the format information 205 “MPEG” of the fragment data 400 (data part 206) of the conversion source, the processing of “voice recognition” is performed based on the media conversion table 19. The data is converted into data of the conversion destination media type “character” and format information “TXT”.

  In this way, the fragment data 400 registered in the “X sentence” configuration list 910 is converted into the media designated in S102 of the integrated file creation process (FIG. 16), and then 1 according to the order sorted in S131. A stitching process edited as one stitching data is executed (S133). When the “Sentence X” creation process is the introduction creation process (S103), the introduction data is created by the stitching process of S133. Similarly, main text data is created in the main text creation process (S104), samurai text data is created in the samurai text creation process (S105), and supplementary text data is created in the supplement text creation process (S106).

  Returning to FIG. 16, when stitching data is created for each section (introductory text, main text, sentence, supplementary text) of the integrated file, a process for further stitching them is performed. First, a stitching process for editing the introductory data and the main sentence data into one stitching data is executed (S107). At this time, the order of editing is stitched so that the introductory data comes first and the main text data comes after, and (preface + main sentence) data is created. Similarly, a stitching process for editing the sentence data and supplementary sentence data into one stitching data is executed (S108), and (跋 sentence + supplementary sentence) data is created.

  Finally, a stitching process for creating one integrated file by stitching the (preface + main sentence) data and the (跋 sentence + supplementary sentence) data is executed (S109). At this time, the order of editing is such that the (preface + main sentence) data is stitched first and the (跋 sentence + supplement sentence) data is followed, and the section structure is integrated (preface + main sentence + 主 sentence + supplement sentence). A file is created. The integrated file 600 created in S109 is stored in the integrated file storage area 145 of the HDD 140 (S110).

  As shown in FIG. 22, the integrated file 600 includes an integrated file header portion 601 in which detailed information indicating various characteristics of data is stored, and an integrated file data portion 607 that is a main body portion of the data. The integrated file header part 601 includes size information 602 of the integrated file header part 601, size information 603 of the integrated data part 609, and size information 604 of the integrated context data part 608. Further, the integrated file header part 601 includes an integrated fragment data header part 605 and a number 606 of fragment data 400, and there are n pieces of fragment data header parts 401 indicated by the number 606 of fragment data 400. To do.

  The fragment data header section 401 includes creation time information 403 of the fragment data 400, size information 203 of the data section 206, media type 204 of the data section 206, format information 205 of the data section 206, and size information 303 of the context data section 304. It is included. Further, the integrated file data unit 607 includes an integrated context data unit 608 and an integrated data unit 609, each storing n context data units 304 and data units 206 of the fragment data 400. Yes. Note that substantially the same data as the above-described fragment data 400 are given the same reference numerals (see FIG. 15).

  As described above, one integrated file 600 including a plurality of fragment data 400 is created. In the integrated file 600, a plurality of pieces of fragment data 400 are edited for each section (introductory text, main text, grammar text, supplementary text) in the order sorted in the “X text” configuration list 910. That is, the integrated file 600 is obtained by editing each piece of fragment data 400 according to the order and rules corresponding to the user's context. The integrated file 600 reflects the user's context when the fragment information 200 is input. It has contents and structure.

  That is, according to the fragment data creation apparatus of the first embodiment, the latest user context information 300 is acquired at every measurement interval time while the integrated file creation apparatus 1 is operating. When the user inputs fragment information 200 such as characters, sounds, and images, fragment data 400 is created based on the latest user context information 300 and the input fragment information 200. . When the integrated file 600 is created, the integrated file 600 is created by editing a plurality of pieces of fragment data 400 based on the context information 300. Therefore, by editing the fragment information 200 created using various input devices at different times and places based on the context information 300 to create the integrated file 600, the burden and effort of creating the integrated file for the user is reduced. Thus, the integrated file 600 can be created in a form and order that meet the needs of the user.

  Next, an integrated file creation system according to the second embodiment will be described. The integrated file creation system of the second embodiment includes a portable terminal device 2 on which [1] context estimation processing and [2] fragment data creation processing in the first embodiment are executed, and [3] integrated file. The editing apparatus 3 that executes the creation process constitutes an integrated file creation system connected via a network.

  First, the configuration of the integrated file creation system according to the second embodiment will be described with reference to FIGS. FIG. 23 is a block diagram illustrating a configuration of the mobile terminal device 2. FIG. 24 is a block diagram showing the configuration of the editing apparatus 3. FIG. 25 is a functional block diagram showing functions of the integrated file creation system according to the second embodiment.

  As shown in FIG. 23, the portable terminal device 2 has basically the same configuration as the integrated file creation device 1 shown in FIG. 1 and is assigned the same reference numerals, but the created fragment data 400 is stored in the editing device 3. It is different in that a communication control unit 191 for transmitting to is provided. 24, the editing apparatus 3 includes a CPU 810, a ROM 820, a RAM 830, an HDD 840, a display control unit 860 to which a display 861 is connected, an audio control unit 870 to which a microphone 871 and a speaker 872 are connected, a mouse 881, and An input detection unit 880 to which a keyboard 882 is connected is provided via a bus 815. Since such a configuration of the editing device 3 is known as a configuration of a normal computer device, details are omitted. The editing device 3 includes a communication control unit 891 for receiving the fragment data 400 transmitted from the mobile terminal device 2.

  As shown in FIG. 25, the functional block diagram of the integrated file creation system in the second embodiment is basically the same as that of the integrated file creation device 1 (FIG. 4) in the first embodiment. The mobile terminal device 2 and the editing device 3 are different in that the entire function is configured. In addition, the mobile terminal device 2 includes a fragment data transmission unit 22 that transmits the fragment data 400 created by the fragment data creation unit 15 to the editing device 3. On the other hand, the editing apparatus 3 includes a fragment data receiving unit 23 that receives the fragment data 400 transmitted from the fragment data transmitting unit 22. The fragment data 400 received by the fragment data receiving unit 23 is stored in the fragment data storage unit 16. The communication control unit 191 corresponds to the “fragment data transmission unit” 22 of the present invention, and the communication control unit 891 corresponds to the “fragment data reception unit” 23 of the present invention.

  Of the integrated file creation program, a program for executing [1] context estimation processing and [2] fragment data creation processing in the first embodiment is stored in the mobile terminal device 2, and this program The CPU 110 that executes the process corresponds to the “context estimation means” 12, “context information creation means” 14, and “fragment data creation means” 15 of the present invention. Among the integrated file creation programs, [3] a program for executing the integrated file creation processing is stored in the editing device 3, and the CPU 810 executing this program performs “integrated file creation means” 17, “ This corresponds to “media conversion means” 18.

  In addition, the “context definition table” 13 of the present invention secures a storage area in the HDD 140 of the mobile terminal device 2. On the other hand, the “edit rule table” 20, “media conversion table” 19, and “integrated file storage means” 21 of the present invention each have a storage area in the HDD 840 of the editing apparatus 3.

  In such a configuration, in the mobile terminal device 2, as in the first embodiment, [1] context estimation processing and [2] fragment data creation processing are executed, and the fragment data 400 is stored in the HDD 140. Then, the fragment data 400 is transmitted to the editing apparatus 3 by the communication control unit 191 via the network. The editing device 3 is controlled so that the fragment data 400 transmitted from the mobile terminal device 2 is received by the communication control unit 891 and stored in a fragment data storage area (not shown) of the HDD 840. Then, in the editing apparatus 3, an integrated file 600 is created based on a plurality of fragment data 400 collected via the network.

  As described above, according to the integrated file creation system of the second embodiment, the mobile terminal device 2 that creates the fragment data 400 and the editing device 3 that creates the integrated file 600 are connected via a network. Therefore, the portable terminal device 2 and the editing device 3 can be separated from each other, and an integrated file creation system that enables a more flexible configuration can be provided.

  Next, an integrated file creation system according to the third embodiment will be described. In the integrated file creation system of the third embodiment, a plurality of mobile terminal devices 2 are connected to the editing device 3 via a network, and an integrated file 600 for each user having each mobile terminal device 2 is created. Is.

  The configuration of the integrated file creation system according to the third embodiment will be described below with reference to FIGS. 26 and 27. FIG. 26 is an overall configuration diagram of an integrated file creation system in the third embodiment. FIG. 27 is a functional block diagram showing the configuration of the integrated file creation system according to functions in the third embodiment.

  As shown in FIG. 26, the plurality of mobile terminal devices 2 a to 2 n are connected to one editing device 3 via a network 1000. The network 1000 only needs to be effectively connected regardless of wired or wireless. In the present embodiment, there is one editing device 3, but a plurality of editing devices 3 may be provided.

  As shown in FIG. 27, the functional block diagram of the integrated file creation system in the third embodiment is basically the same as that of the integrated file creation system (FIG. 25) in the second embodiment. The mobile terminal device 2 includes an authentication information adding unit 24 that adds authentication information unique to the user of each mobile terminal device 2 to the fragment data 400. Further, the editing apparatus 3 includes an authentication execution unit 25 that authenticates whether or not each piece of fragment data 400 belongs to an authorized user based on authentication information added to the piece of data 400. Furthermore, the integrated file creating means 17 in the present embodiment has a function of creating an integrated file 600 for each user based on the authentication information.

  Of the integrated file creation program, a program for adding authentication information to the fragment data 400 is stored in the mobile terminal device 2, and the CPU 110 executing this program is the “authentication information adding means” 24 of the present invention. Equivalent to. Of the integrated file creation program, a program for executing authentication based on the authentication information added to the fragment data 400 is stored in the editing apparatus 3, and the CPU 810 executing this program “authentication execution means”. "25".

  In such a configuration, the portable terminal device 2 executes [1] context estimation processing and [2] fragment data creation processing, as in the second embodiment. [2] By executing the fragment data creation process, the fragment data 400 to which authentication information unique to the user of each mobile terminal device 2 is added is created. When the fragment data 400 is stored in the HDD 140, the fragment data 400 is transmitted to the editing apparatus 3 by the communication control unit 191 via the network.

  In the editing device 3, the fragment data 400 transmitted from the mobile terminal device 2 is received by the communication control unit 891. The received fragment data 400 is authenticated based on the added authentication information as to whether or not it is a legitimate user. As a result, if the authentication is successful for a legitimate user, the fragment data 400 is stored in a fragment data storage area (not shown) of the HDD 840. If the authentication is not successful, the fragment data 400 is stored. Is destroyed. Then, an integrated file 600 is created based on a plurality of fragment data 400 collected from a plurality of mobile terminal devices 2 via a network. At this time, based on the authentication information added to the fragment data 400, an integrated file 600 is created for each user.

  As described above, according to the integrated file creation system of the third embodiment, the mobile terminal device 2 that creates the fragment data 400 and the plurality of mobile terminal devices 2 are connected to the editing device 3 via the network. Since the integrated file 600 for each authorized user is created based on the authentication information, only the authorized user's fragment data 400 can be edited, and the integrated file for each user. 600 can be created automatically.

  By the way, in the above “first embodiment” to “third embodiment”, as described above, the CPU 110 (CPU 810) that executes the integrated file creation program and processes the above flowchart is the present invention. "Context estimation means" 12, "context information creation means" 14, "fragment data creation means" 15, "integrated file creation means" 17, "media conversion means" 18, "authentication information addition means" 24, "authentication execution" It corresponds to “means” 25. More specifically, the CPU 110 that executes the context estimation process (FIG. 6) corresponds to the “context estimation means” 12, and the CPU 110 that executes S 17 and S 18 of the context estimation process (FIG. 6) "14". Further, the CPU 110 executing the fragment data creation process (FIG. 13) corresponds to the “fragment data creation means” 15. The CPU 110 (CPU 810) that executes the integrated file creation process (FIG. 16) corresponds to the “integrated file creation means” 17, and the CPU 110 (CPU 810) that executes S132 of the “X sentence” creation process (FIG. 19). , “Media conversion means” 18.

  The present invention is not limited to the “first embodiment” to the “third embodiment” described in detail above, and it goes without saying that various modifications are possible.

  For example, in the above-described embodiment, a case where the user's context is “impressed” is described as an example, but the context may be a user's emotion or a situation surrounding the user. Various contexts such as “impression”, “sadness”, “anger”, “fun”, “liveness”, “busyness”, etc. can be applied, and the context definition table corresponding to each context 13 may be set. For example, when it is desired to edit the integrated file based on the user's context “sadness”, the context definition table 13 corresponding to the context “sadness” may be set.

  In the context definition table 13, a table for an arbitrary context may be set in advance by a user or a designer, or a plurality of tables corresponding to each of a plurality of contexts are set in the context definition table 13 in advance. In the context estimation process (FIG. 6), an optimum table may be automatically selected from the context definition table 13.

  Also, in the integrated file creation process (FIG. 16), the user or designer can arbitrarily set the content and configuration of the plurality of fragment data 400 to create the integrated file 600. For example, since the context data portion 304 (see FIG. 15) included in the fragment data 400 shows the context type 13a and the context value 13c (see FIG. 10), the fragment data 400 is stored for each context type 13a. It may be edited. Further, the context values 13c may be edited so as to be sorted in ascending order or descending order.

  In the third embodiment, among the received fragment data, only the fragment data 400 authenticated by the authentication execution unit 25 as being authorized by the authorized user is stored in the editing device 3. However, all of the received fragment data 400 may be stored in the editing device 3 so that authentication is performed before the integrated file is created.

  In the calibration process (FIG. 7), the sampling value is measured and the average value is calculated as the reference value. However, the time series data of the sampling value is acquired, and the reference value is calculated based on the characteristics of the transition. May be calculated. Further, the reference value may be calculated by excluding abnormal sampling values. Further, in the comparison process (S42, S44, S46) between the increment value of each sensor and the threshold value in the estimation process (FIG. 9), a change threshold value ε is provided for each sensor, and the threshold value is corrected by the change threshold value ε The value may be compared with an incremental value.

  Needless to say, the user information measured from each sensor is not limited to body temperature, sweating and heart rate. For example, user vibration, brain waves, respiration, acceleration, inclination, biorhythm, and the like may be measured as user information.

  The integrated file creation apparatus and the integrated file creation system of the present invention can be applied to a computer device that creates an integrated file based on a user's context.

2 is a block diagram showing a configuration of an integrated file creation device 1. FIG. 3 is a conceptual diagram illustrating a configuration of a storage area of a RAM 130 of an integrated file creation device 1. 3 is a conceptual diagram showing a configuration of a storage area of an HDD 140 of an integrated file creation apparatus 1. 3 is a functional block diagram showing the configuration of an integrated file creation device 1 by function. FIG. It is a figure which shows the transition of the data structure in the integrated file creation apparatus. It is a main flowchart of a context estimation process. It is a flowchart which shows the detail of a calibration process (S14). It is a flowchart which shows the detail of a measurement process (S15). It is a flowchart which shows the detail of an estimation process (S16). It is a figure which shows the outline | summary of the context definition table. It is a figure which shows the data structure of the context information 300 produced by S17. It is a figure which shows the data structure of the fragment information 200. FIG. It is a main flowchart of a fragment data creation process. It is a flowchart which shows the detail of a fragment data creation execution process (S74). It is a figure which shows the data structure of the fragment data. It is a main flowchart of an integrated file creation process. It is a figure which shows the data structure of the fragment | piece data list 900. FIG. 6 is a diagram showing an outline of a media conversion table 19. FIG. It is a flowchart which shows the detail of a "X sentence" creation process (S103, S104, S105, S106). 3 is a diagram showing a data configuration of an editing rule table 20. FIG. 6 is a diagram showing a data configuration of an “X sentence” configuration list 910. FIG. 6 is a diagram showing a data configuration of an integrated file 600. FIG. 3 is a block diagram showing a configuration of a mobile terminal device 2. FIG. 3 is a block diagram illustrating a configuration of an editing device 3. FIG. It is a functional block diagram which shows the structure of the integrated file creation system in 2nd Embodiment according to a function. It is a whole block diagram of the integrated file creation system in 3rd Embodiment. It is a functional block diagram which shows the structure of the integrated file creation system in 3rd Embodiment according to a function.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Integrated file creation apparatus 2 Portable terminal device 3 Editing apparatus 10 Input means 11 Sensor 12 Context estimation means 13 Context definition table 14 Context information creation means 15 Fragment data creation means 16 Fragment data storage means 17 Integrated file creation means 18 Media conversion means 19 Media conversion table 20 Edit rule table 21 Integrated file storage means 22 Fragment data transmission means 23 Fragment data reception means 24 Authentication information addition means 25 Authentication execution means 110 CPU
115 bus 120 ROM
130 RAM
140 HDD
150 USB Interface 151 Scanner 152 Camera 153 Personal Computer 160 Display Control Unit 161 Display 170 Audio Control Unit 171 Microphone 172 Speaker 180 Input Detection Unit 181 Input Panel 182 Body Temperature Sensor 183 Sweating Sensor 184 Heart Rate Sensor 190 Timer 191 Communication Control Unit 200 Fragment Information 300 Context information 400 Fragment data 600 Integrated file 810 CPU
815 bus 820 ROM
830 RAM
840 HDD
860 Display control unit 861 Display 870 Audio control unit 871 Microphone 872 Speaker 880 Input detection unit 881 Mouse 882 Keyboard 891 Communication control unit 900 Fragment data list 910 “X sentence” configuration list

Claims (15)

Fragment data storage means for storing a plurality of fragment data in which additional information is added to fragment information including at least one of character information, image information, and audio information;
An integrated file creating means for creating a consolidated file by editing a plurality of the fragment data based on the additional information added to the plurality of fragment data stored in the fragment data storage means, Integrated file creation device. An edit rule table for defining an edit rule for creating the integrated file by editing the fragment data,
The integrated file creation means is configured to generate a plurality of pieces of the fragment data based on the edit rules defined in the edit rule table and the additional information added to the fragment data stored in the fragment data storage means. The integrated file creation apparatus according to claim 1, wherein the integrated file is created by editing.   3. The integrated file creation according to claim 2, wherein the editing rule determines a joining order of the fragment information included in the fragment data based on the additional information added to the fragment data. apparatus. According to the type of the fragment data, a media conversion table that defines conversion information for converting the data format of the fragment data;
The integrated file according to any one of claims 1 to 3, further comprising media conversion means for converting a data format of the fragment data created by the fragment data creation means based on the media conversion table. Creation device. An input means for inputting fragment information including at least one of character information, image information, and audio information;
A sensor that measures user information about the user;
Based on the user information measured by the sensor, context estimation means for estimating a context indicating at least one of emotion, atmosphere and state in the user;
Context information creating means for creating context information based on the context estimated by the context estimating means;
Fragment data creation means for creating fragment data by adding the context information created by the context information creation means as the additional information to the fragment information input by the input means. The integrated file creation apparatus according to claim 1. A context definition table that defines the correspondence between the user information and the context;
The integrated file creation apparatus according to claim 5, wherein the context estimation unit estimates the context corresponding to the user information measured from the sensor based on the context definition table.   The integrated file creation apparatus according to claim 5 or 6, wherein the context information creation unit creates the context information indicating the estimated type of the context and the strength of the context.   The integrated file creation apparatus according to claim 5, wherein the sensor measures at least one of a body temperature, a heart rate, sweating, breathing, and acceleration of the user.   The input means includes at least one of a keyboard or touch panel for inputting the character information, a microphone for inputting the audio information, a camera or a scanner for inputting the image information. Item 9. The integrated file creation device according to any one of Items 5 to 8. Fragment data receiving means for receiving the fragment data via a network;
10. The integrated file creation device according to claim 1, wherein the fragment data storage unit stores the fragment data received by the fragment data reception unit. The fragment data received by the fragment data receiving means includes user authentication information,
Based on the authentication information added to the fragment data, comprising authentication execution means for authenticating whether the fragment data belongs to a legitimate user;
11. The integrated file creation device according to claim 10, wherein the fragment data storage means stores the fragment data that has been authenticated by the authentication execution means as being a legitimate user.   12. The integrated file creating means creates the integrated file by editing a plurality of pieces of fragment data for each user based on the additional information added to the fragment data. The integrated file creation device described. A mobile terminal device to which fragment information including at least one of character information, image information, and audio information is input, and an editing device that edits the fragment information input by the mobile terminal device to create an integrated file An integrated file creation system connected via a network,
The portable terminal device
Input means for inputting the fragment information;
A sensor for measuring user information about the user;
Based on the user information measured by the sensor, context estimation means for estimating a context indicating at least one of emotion, atmosphere and state in the user;
Context information creating means for creating context information based on the context estimated by the context estimating means;
Fragment data creation means for creating fragment data by adding the context information created by the context information creation means to the fragment information input by the input means;
Fragment data transmission means for transmitting the fragment data created by the fragment data creation means to the editing device;
The editing device
Fragment data receiving means for receiving the fragment data transmitted from the mobile terminal device;
Fragment data storage means for storing the fragment data received by the fragment data receiving means;
An edit rule table that defines an edit rule for editing the fragment data to create the integrated file;
Based on the editing rules defined in the editing rule table and the context information added to the fragment data stored in the fragment data storage means, a plurality of the fragment data are edited to obtain the integrated file. An integrated file creation system comprising: an integrated file creation means for creating. The portable terminal device
An authentication information adding means for adding the user authentication information;
Fragment data creation means adds the context information created by the context information creation means and the authentication information added by the authentication information addition means to the fragment information input by the input means, Create
The editing device
Based on the authentication information added to the fragment data, comprising authentication execution means for authenticating whether the fragment data belongs to a legitimate user;
14. The integrated file creation system according to claim 13, wherein the fragment data storage means stores the fragment data authenticated by the authentication execution means as being of a legitimate user. In the editing device,
The integrated file creation means creates the integrated file by editing a plurality of pieces of fragment data for each user based on the context information added to the fragment data stored in the fragment data storage means. The integrated file creation system according to claim 14.

Images