JP2008046738A - Life record creation system and its control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To create a Web page by directly inputting data from such a job site as a trip destination without necessitating any knowledge about Web page creation. <P>SOLUTION: This life record creation system is provided with a server which provides a guidance to a user who wants the creation of life records such as a diary or trip records, and a user transmits characters, voices, and videos to the server by using a portable telephone set according to the guidance provided by the server. The server determines the genre and concept of information from the location information of a portable telephone set and the transmitted information or the like, and creates a Web page according to a predetermined format. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to a system that supports creation of a diary, a travel record, and a life record, and a control method thereof.

It is widely practiced to create a life record such as a diary including video or audio, a travel record, etc. as electronic data and publish it as a web page. To publish life records such as diaries as web pages, electronic data is described in HTML (hyper text markup language) and uploaded from a user's personal computer to a server on the web. Therefore, in order to publish video or audio taken at a travel destination on a web page, it is necessary to return to home, edit the video, audio and explanatory text to create a web page in HTML, Advanced skills and knowledge are required.
References related to the creation of web pages that contain video or audio information include:
JP 2003-173309 A JP 2004-32129 A

The present invention provides a system that allows a user who desires to create a life-related record, such as a diary or a travel record, to create a life record in a format that can be disclosed as a web page with a simple operation, and a control method therefor. Is.

The system according to the present invention includes a server that provides guidance, and a user transmits text, audio, and video to the server using a mobile phone (mobile terminal) according to the guidance provided by the server. The server determines the genre and outline of the recording desired by the user from the location information of the mobile phone, information transmitted by the user, etc., and creates a web page according to a predetermined format.

The system according to the present invention transmits video captured by a camera of a mobile phone or audio input from a microphone to a server in accordance with an instruction from the server at a site to be a diary target or a travel destination. The server creates necessary information from the transmitted video or audio and composes a web page. Therefore, the user does not need knowledge about the web page, and can create a web page by directly inputting data from a site such as a travel destination.

FIG. 1 is a diagram showing the functions of a server 100 and an outline of a mobile phone (mobile terminal) 110 according to the present invention. The server 100 provides guidance to a user who desires to create a life record such as a diary or a travel record. The user transmits video, audio, and text to the server 100 using the camera, microphone, or keyboard of the mobile phone 110 according to the guidance provided by the server 100. The server 100 converts the transmitted voice into text data by the voice recognition means, calculates the frequency of the included words, and determines the genre of the information transmitted by the user. The transmitted video is edited to create data for the web page.

A user who wishes to create a life record calls the server 100 from the mobile phone 110 and requests the start of the record and the creation of a web page. When a plurality of formats such as a diary and a travel diary are provided, the server 100 indicates the available formats to the user and requests the user to select. The template storage unit 101 stores a guidance template in which a guidance for instructing a user to transmit audio or video and a command for specifying a method for shaping and processing audio or video data transmitted from the user are stored. Yes.
The template reading unit 102 of the server 100 reads a guidance template in a format specified by the user from the template storage unit 101 and passes it to the template interpretation execution unit 103. The interpretation execution unit 103 extracts and executes the commands described in the passed template one by one.

When the command taken from the template and interpreted displays a guidance sentence on the display unit and requests a user to perform a key operation, the server 100 transmits a guidance sentence and a key input instruction to the mobile phone 110 via the communication control unit 104. And wait for a reply of key information. The mobile phone 110 displays the guidance text received via the communication control unit 111 on the display unit 113, and requests the user to operate the key 114.
When the command requires voice input, the server 100 requests the mobile phone 110 to input voice via the communication control units 104 and 111. Upon receiving this request, the cellular phone 110 acquires voice from the microphone 116 by the voice input control unit 115 and transmits it to the server 100. When the command requires video input, the server 100 requests the mobile phone 110 to input video. The video input control unit 117 of the mobile phone 110 controls the camera 118 and transmits the obtained video data to the server 100.
In addition, when the command extracted from the template instructs to process the video data or audio data transmitted from the user, the template interpretation execution unit 103 passes the video data or audio data to the corresponding processing means of the shaping processing unit 105 and performs processing. Instruct.
When all the commands described in the guidance template have been executed, the server 100 applies the data generated by the shaping processing unit 105 to the output format template to generate HTML data for the web page, and the data storage unit 106 To remember. The data stored in the data storage unit 106 is appropriately disclosed as a web page by the Internet output unit 107.

FIG. 2 is a schematic diagram of the server 100, and particularly shows a functional configuration of the shaping processing unit 105. The function of each part is as follows.
Communication management unit 104: exchanges data with the mobile phone (mobile terminal) 110 via the network 109.
Template interpretation execution unit 103: In response to a request from the terminal 110, a guidance template is read from a template storage unit (101 in FIG. 1) not shown, and commands described in the template are sequentially executed.
User information acquisition unit 131: a user identification unit 132, a time acquisition unit 133, and a position acquisition unit 134. The user specifying unit 132 specifies a user from information on the requesting terminal 110, a user's login ID, or the like, and acquires user information used for life records from a database. The time acquisition unit 133 acquires the current time from the time mechanism of the server 100 or the terminal 110. The position acquisition unit 134 acquires the position information of the terminal 110 from information acquired from the GPS function of the terminal 110 or an indoor or outdoor beacon. A configuration in which the time acquired by the time acquisition unit 133 based on the position information is changed to the local time is also possible.

Call information recording unit 135: This function functions when the template interpretation execution unit 103 executes a command for obtaining audio or video from the guidance template, and includes an audio recording unit 136 and a video recording unit 137. When a command for acquiring audio or video is executed, the server 100 instructs the terminal 110 to transmit audio from the microphone or video taken by the camera, and audio transmitted to the analog call record storage unit 138. Instructs recording of data or video data.
Analog call record storage unit 138: means for recording audio data and video data transmitted from terminal 110, and comprises analog audio data recording unit 139 and analog video data recording unit 140.
Call information encoding unit 141: a part for digitizing audio data and video data transmitted from the terminal 110 and recorded in the analog call record storage unit 138, an audio encoding unit 142 for digitizing the audio data, and a video It comprises a video encoding unit 143 for digitizing data.

Digital call record storage unit 145: The call information encoding unit 134 records data obtained by digitizing audio data and video data, and includes a digital audio data recording unit 146 and a digital video data recording unit 147. .
Category data unit 148: This is a part that stores data used when the category classification unit 154 estimates the category of text, and includes category definition data 149 and synonym data 150. The synonym data 150 is a database of synonyms, and is used to convert words having similar significance into unified words for analysis of appearance frequency and the like. The category definition data 149 is a database that stores information on words that have a high probability of being used in each field, and is used to determine a category to which the text belongs from the distribution or frequency of words included in the text to be analyzed. .

Media analysis unit 151: A part for acquiring data necessary for creating a life record from digital audio data and digital video data. The digital speech data is converted into text data by the speech recognition unit 152, and analysis such as morphological analysis and semantic analysis is performed by the text analysis unit 153. This analysis extracts important words such as nouns and verbs from the text. The category classification unit 154 compares the extracted word appearance frequency and the like with the word information stored in the category data unit 148 to determine the category to which the text belongs.
The media decomposing unit 155 separates the video and audio included in the video data, passes the audio data to the audio recognizing unit 152, and uses it for category determination. The separated video data is passed to the video analysis unit 156. The video analysis unit 156 detects the amount of change in the video and divides the video by regarding a time point when the change is large as a scene change point. Further, the image extraction unit 157 extracts a feature point of the video from the head part of the scene or the duration of the video and creates a still image.

Output format template 162: A template for defining a format for publishing a diary or a travel record as a web page, or a template for printing them is stored.
Output unit 158: an output format analysis unit 160 and an output shaping unit 161. The output format analysis unit 160 reads and analyzes the corresponding one from the templates stored in the output format template 162 according to the format requested by the user, for example, diary or travel record, published on the web, or printed. . For example, when it is possible to publish a travel record as a web page, the analysis allows the title sentence, summary, still image, etc. created by the shaping processing unit 105 to be described in HTML and embedded in the data, and published as a web page. Converted to format.
The converted data is stored in the output data storage unit 163 and released.

FIG. 3 shows a process in which a user accesses the server 100 of the system 301 from the mobile phone 300, registers a life record, for example, a travel record, and publishes it as a web page.
Step 302: The user accesses the server 100 of the system 301 from a mobile phone or a TV phone and requests creation of a life record. The server 100 authenticates the validity of the user from the telephone number of the caller, the user code input by the user, and the password. If you can record life in multiple formats, such as diary format, travel diary format, etc., or if there are multiple modes, such as the presence or absence of video, the presence or absence of audio, present the format available to the user, Request selection.
Step 303: A guidance template corresponding to the web page in the format selected by the user is read from the template storage unit 101 and passed to the template interpretation execution unit 103. The template interpretation execution unit 103 executes the commands described in the received guidance template one by one. The user information is acquired and stored by the user specifying unit 132, the current time is acquired by the time acquiring unit 133, and the user position information is acquired by the position acquiring unit 134. Audio data is acquired by the audio recording unit 136 and recorded in the analog audio data recording unit 139, and video data is acquired by the video recording unit 137 and recorded in the analog video data recording unit 140.

Step 304: When the execution of all the commands described in the guidance template is completed, the server 100 notifies the user of the end of communication. The user disconnects the telephone connection.
Step 305: The server 100 converts the audio data and video data recorded in the analog audio data recording unit 139 and the analog video data recording unit 140 into digital format data that can be published as a web page. The audio data is digitized by the audio encoding unit 142 and recorded in the digital audio data recording unit 146, and the video data is digitized by the video encoding unit 143 and recorded in the digital video data recording unit 147.
Step 306: The media analysis unit 151 analyzes the digitized audio data and video data. The audio data is converted into text data, and the genre, summary, etc. of the record to be released are created. In addition, a still image or the like that characterizes the video is created from the video data.
Step 307: The summary, still image, video data, etc. created in step 306 are combined with a web page template to create data that can be published as a web page.
Step 308: Register and publish the created web page data in the web page server.
In the example of FIG. 3, the audio and video are acquired from the mobile phone in step 303, the telephone connection is disconnected in step 304, and then the audio and video acquired in step 305 to step 307 are processed to obtain a web page. It is a procedure to create data for. However, if the processing of the audio and video acquired by the server 100 can be performed at high speed, a procedure for disconnecting the telephone connection when the processing of step 307 is completed can be used.

310 in FIG. 3 is an example of a published web page. Reference numeral 311 denotes the time and position acquired by the time acquisition unit 133 and the position acquisition unit 134, and title / heading information acquired by the media analysis unit 151. Reference numeral 312 denotes a summary sentence created from the user's voice data by the text analysis unit 153. Reference numeral 313 denotes a still image created by the image extraction unit 157 from video data taken by the user with the camera of the mobile phone, and is linked to the video data. 314 is a list of words that frequently appear in the text created from the user's voice data by the text analysis unit 153, and is used for web search of a homepage. Reference numeral 315 denotes a link to an audio file.

FIG. 4 is a diagram showing a flow of processing in the shaping processing unit 105.
Step 400: The template interpretation execution unit 103 reads the guidance template corresponding to the format specified by the user from the template storage unit 101, and starts executing the command described in the template.
Step 401: The user identification unit 132, time acquisition unit 133, and position acquisition unit 134 of the user information acquisition unit 131 acquire user information, time information, and position information of the terminal 110, respectively, and store them in a predetermined storage location.
Step 402: The template interpretation execution unit 103 that has executed the command for acquiring the audio data and the video data requests the user to transmit the audio and the video, and transmits the audio data and the video data transmitted by the user to the call information recording unit 132. Instruct acquisition. The call information recording unit 132 receives the audio data and the video data transmitted from the mobile phone by the audio recording unit 136 and the video recording unit 137, respectively, and the analog audio data recording unit 139 of the analog call recording storage unit 138 and the analog data Recorded in the video data recording unit 140. When the user instructs the end of audio and video, the recording operation ends.
Step 403: When the acquisition of the audio data and video data is completed, the template interpretation execution unit 103 instructs the call information encoding unit 141 to digitize the audio data and video data recorded in the analog call record storage unit 138. The audio encoding unit 142 of the call information encoding unit 141 converts the audio data recorded in the analog audio data recording unit 139 into digital data in a format that can be disclosed on the Internet web page, and similarly, the video encoding unit 143 Converts the video data recorded in the analog video data recording unit 140 into digital data in a format that can be disclosed on a web page on the Internet.

Step 404: The media analysis unit 151 converts the voice data digitized by the voice recognition unit 152 and the digital voice data extracted from the video data into text data by voice recognition means.
Step 405: The text analysis unit 153 of the media analysis unit 151 analyzes the text data generated by the speech recognition unit 152 using a form analysis method such as grammatical analysis or semantic analysis, and extracts words constituting the text. To do.
Step 406: The category data unit 148 is provided with synonym data 150 which is a database relating to words having the same meaning or very close to each other. The text analysis unit 153 refers to the synonym data 150, converts each word extracted from the text data into a unified word, and calculates the appearance frequency of each word.
Step 407: A portion including many words having a high appearance frequency calculated from the text data in step 406 is extracted and used as a summary sentence. In this embodiment, a method of creating a summary sentence based on the appearance frequency of words is used. However, many methods for creating a summary sentence from long text data have been proposed, and the method to be adopted can be selected as appropriate.
Step 408: The category data unit 148 is provided with category definition data 149 including categories such as “travel” and “Europe” and words belonging to each category. The text analysis unit 153 extracts a predetermined number of categories including many words extracted from the text data, and sets them as the category of the web page to be created. The category data section 184 shown in FIG. 2 includes, for example, a synonym database 150 that unifies “hotel”, “inn”, “cottage”, etc. into “hotel”, and “travel” as “hotel”, “airplane”, “tourism”, etc. However, it is also possible to integrate both databases into one database. Figure 5-1 shows an example of synonym definition and category definition at the same time. In the figure, for example, “travel”, which is a word representing synonyms such as “overseas travel”, “family travel”, and “honeymoon”, is directly used as a category.

Step 409: The media decomposing unit 155 extracts an audio part from the digitized video data, passes it to the audio recognizing unit 152, requests processing after step 404, and analyzes the video data. The analysis flow is shown in Fig. 5-2 (a). In this process, video data is divided into scenes by regarding a portion where the image change is large as a scene switching portion.

The outline of the flow in Fig. 5-2 (a) is as follows.
In step 521, the first pointer is set at the head of the digital video data, and in step 522, the video is advanced by one screen. In step 523, it is determined whether or not the video data has ended. When the video data has ended, the process proceeds to step 526 to end the process. If video data continues, the process proceeds to step 524. In step 524, the amount of change between the advanced screen and the previous screen is calculated, and it is determined whether the amount of change is equal to or greater than a predetermined amount. If the predetermined amount is small, it is determined that the advanced screen and the previous screen are in a continuous scene, and the process returns to step 522. When the amount of change is greater than or equal to the predetermined amount, the process proceeds to step 525. Since the current image is the head of a new scene, in step 525, the pointer value is incremented by 1, and the pointer is set at the position of the current image. Thereafter, the process returns to step 522 to continue the processing.
FIG. 5-2 (b) shows the relationship between video data and pointers. In the beginning of the video data 527, the boyer 1 is set, but in the video part having a large change, the boyer 2, the boyr 3,. The video between the pointer and the pointer is regarded as one scene.

Returning to the processing flow in the shaping processing unit 105 in FIG.
Step 410: Divide the video data for each scene determined in the process of Step 409, and generate individual files.
Step 411: The start portion of each scene is taken out as a still image, and used as a representative image of the scene.
Step 412: The web page template in which the form of the web page is described is added to the summary sentence, the category, the video file for each scene, the still image, and the user's created in step 407, 408, 410, 411. Combine digital audio files to create web pages.
Step 413: The web page data described in HTML created in step 412 is registered in the web page server, and the process ends.

FIG. 6 is an example of a dialog with the user that is performed when the template interpretation execution unit 103 executes a template for guidance. FIGS. 7-1 and 7-2 are diagrams for guidance executed by the template interpretation execution unit 103. It is an example of a template. A guidance template will be described with reference to the flow of FIG.

Step 600: When the user accesses the server 100 and determines a guidance template, the template interpretation execution unit 103 starts to read the determined guidance template from the template storage unit. In step 600, the user is requested to input a recording title.
(A) Declare the start of the template and secure and initialize variables.
(B) A command for acquiring audio and video for a title. The voice is acquired in the file “title_audio” and the video is acquired in the file “title_video” by a dialog system by voice. To finish, operate the “#” key.
As a guidance to the user, the message “Please say the title after the dial tone. Press the # button when finished” is played using the speech synthesis function (TTS).

Step 601: The user shoots the target object with the camera of the mobile phone and utters the title “First time singing”. Operate the “#” key when finished. The server collects time, position information, etc., and analyzes the title sentence input by the user.
(C) The acquired voice data is voice-recognized using a voice text function (STT), and the result is stored in a text file “user_title”.
(D) Get the time zone of local time (local) in variable “user_timel”. Also, if necessary, process +09: 00 etc. to obtain Japan time or local time.
(E) The location information of the mobile phone is acquired from the GPS, the base station, etc. in the variable “user_place”. The geodetic system and coordinate system can be specified, and acquisition by latitude and longitude can be performed. Moreover, it converts into the country and city (city) from the acquired latitude longitude as needed. The level of conversion can be specified.
(F) A category (user_category) into which the voice data is classified is determined from words included in the acquired voice data. Although it is possible to classify them into a plurality, it is assumed that the maximum number is “maxnum”.
(G) The appearance frequency of the word contained in the acquired audio | voice data is calculated, and the word (user_word) with high appearance frequency is acquired below a maximum value (maxnum).

Step 602: In this step, the user is requested to transmit the text to be recorded.
(H) A command for acquiring audio and video of the body. The voice data is acquired in the file “message_audio” and the video data is acquired in the file “message_video” by a dialog system by voice. To finish, operate the “#” key.
As a guidance for the user, the message “Please utter the text after the dial tone. Press the # button when finished.” Is played using the speech synthesis function (TTS).

Step 603: The user shoots the target object with the camera of the mobile phone and utters the text “I am in Paris…” and operates the “#” key at the end. The server parses the text entered by the user.
(I) Recognize the voice acquired using the text-to-speech function (STT) and store the result in the text file “user_message”.
(J) Extract frequently used word “user_word” from text file “user_message” and create summary sentence “user_summary” with reference to them.
(K) The video file “message_video” is analyzed, a part having a large amount of change, that is, a scene switching point is detected, and the time (scene_time) is acquired.
(L) The audio file “message_audio” is divided in accordance with the detected scene.
(M) The video file “message_video” is divided in accordance with the detected scene.
(N) A still image is created from the start position of the title video “title_video” created in step 600 and is set as the title still image “title_image”.
(O) A still image is created from the start of a video file obtained by dividing the main video by scene (imessage_div).

Step 604: The user is asked to confirm whether or not to release the created record.
(P) To confirm whether the created record is public or non-disclosure, you will receive a voice message "You have received one item. If you want to make it public, please press the * button. To be notified.

Step 605: The user operates the “*” key to make it public. Upon receiving the “*” key, the template interpretation execution unit 103 registers the created data in the web server.

Step 606: A notification that the created data has been registered in the web server and whether the process is to be continued or not are confirmed.
(Q) In order to confirm the continuation / termination of the process, a voice message “You have made it publicly available.

Step 607: The user notifies the end with the “*” key.
(R) The template interpretation execution unit 103 performs end processing such as file closing and disconnects from the mobile phone.

The guidance templates shown in FIGS. 7-1 and 7-2 are examples in which commands are executed linearly sequentially from the beginning to the end of the command. For example, by adding a control command for changing the processing order such as a conditional jump command for changing the execution order in response to the type of key input by the user or a loop command for repeatedly executing a predetermined number of times Guidance is possible.

In step 412 of FIG. 4, the output format analysis unit 160 reads the web page template from the output format template storage unit 152, information acquired by the user information acquisition unit 131 such as position information and time information, and media analysis A web page that can be made public is generated by combining with the image or text generated by the unit 151. FIG. 8 shows an example of a generated web page.
801 in FIG. 8 is a title portion, and the title converted by the command (C) in FIG. 7-1 is displayed.
Reference numeral 802 denotes a registration time, which is obtained by converting the time information acquired by the command (D) in FIG. 7-1 into Japan time (or local time).
Reference numeral 803 denotes a registration location, which is obtained by converting the location information of the mobile phone acquired by the command (C) in FIG. 7-1 into a country name or a city name.
Reference numeral 805 denotes a word that frequently appears in a message, and a word having a high appearance frequency extracted from the text file by the command (J) in FIG. 7-2 is displayed.
Reference numeral 806 denotes an outline of the message, which displays a summary sentence generated from the frequent words by the command (J) in FIG. 7-2.
Reference numeral 807 denotes a link to the voice message, in which data indicating the storage location of the voice file generated by the command (L) in FIG. 7-2 is stored together with the link tag.
Reference numeral 808 denotes a still image, and a still image generated by the command (N) in FIG. 7-2 is displayed.
Reference numeral 809 is a description of a still image, and characters in the title portion are displayed.

FIG. 9 is an example of an HTML template for generating the web page shown in FIG. The output format analysis unit 160 analyzes the HTML template and substitutes the location where the data or data file created by the media analysis unit 151 is stored as link information in the part enclosed by <# server #… # server #> To do. The outline of each part is as follows.

(A) A header part for a web page.
(B) The title data “user_title” is assigned to “<# server # print_text ($ user_title [$ num]); # server #>”, which corresponds to the title portion 801 in FIG.
(C) The part corresponding to the registration time 802 in Fig. 8, the time data "user_time" is displayed in "<# server # print_time ($ user_time," hh: mm "," local ");# server #>" in Japan Converted to time or local time and assigned.
(D) It corresponds to the registration place 803 in Fig. 8, and the location data "user_place" in "<# server # print_text ($ user_place [$ num]); # server #>" The converted version is substituted.
(E) This is the part corresponding to category 804 in Fig. 8, and the data related to category "user_category" is assigned to "<# server # print_texts ($ user_category [$ num] [],", ");# server #> Is done.
(F) This is the part corresponding to the frequent word 805 in the message of FIG. 8, and the frequency data “user_word” is stored in “<# server # print_texts ($ user_word [$ num] [],“, “); # server #>”. Is substituted.
(G) This is a part corresponding to the still image 808 in FIG. 8, and the position data in which the image file “title_image” is stored in “<# server # insert_img ($ title_image [$ num]); # server #>” Assigned.
(H) This is a part corresponding to the description 809 of the still image in FIG. 8, and the title data “user_title” is substituted into “<# server # print_text ($ user_title [$ num]); # server #>”.
(I) This is a part corresponding to the message summary 805 of FIG. 8, and the summary data “user_summary” is substituted into “<# server # print_text ($ user_summary [$ num]); # server #>”.
(J) This is the part corresponding to the audio link 807 in Fig. 8, where "<# server # print_filepath ($ message_audio [$ num]); # server #>" stores the audio file "message_audio" Information is substituted.

In the above example, web data is generated by substituting text or images into predetermined locations of the HTML template. However, depending on the number of scenes of the video data divided in step 410 in FIG. -It is also possible to change the number of images displayed on the page. In addition, the user of this embodiment is configured to input audio and video, but a configuration in which the user inputs characters or still images and uses them to create a web page is also possible. In this embodiment, the output template is an HTML template for creating a web page, but an XML or print script can be used as an output template.

The service providing system according to the present invention includes a server that provides guidance for use in which a life record such as a diary and a travel record is desired, and the user can use the mobile phone to read characters, voice, and voice according to the guidance provided by the server. , Send the video to the server. The server determines the genre and summary of information from the location information of the mobile phone and transmitted data, and creates a web page according to a predetermined format.

According to the life record creation apparatus and the control method thereof of the present invention, video captured by a camera of a mobile phone or sound input from a microphone can be obtained in accordance with an instruction from a server at a site to be a diary or a travel destination. By transmitting to the server, it is possible to easily create a web page. The server also extracts necessary information from the transmitted video or audio and creates a web page. With this configuration, the user does not need knowledge about web page creation, and can create a web page by directly inputting data from a site such as a travel destination.

Overview of the system according to the present invention Configuration diagram of server of system according to the present invention Overview diagram of processing flow of system according to the present invention Schematic diagram of the processing flow of the server of the system according to the present invention Diagram of the synonym table used in the system according to the present invention Processing flow diagram of video data in the system according to the present invention The figure which shows transfer of the data between the system which concerns on this invention, and a user Diagram of a template for controlling data exchange between a system and a user according to the present invention Diagram of a template for controlling data exchange between a system and a user according to the present invention Figure showing an example of a web page Diagram of a template for creating a web page in the system according to the present invention

Claims (18)

A guidance template storage unit for storing a guidance template;
An output template storage unit for storing an output template;
A template reading unit that reads out the guidance template in response to a request from a mobile terminal;
A template interpretation execution unit for executing the read guidance template;
A shaping processing unit for receiving and shaping audio data and video data from the mobile terminal in response to execution of the guidance template by the template interpretation execution unit;
A life record creation system comprising: an output shaping unit that generates output data based on the output template for the data shaped by the shaping processing unit. 2. The life record creation system according to claim 1, wherein the guidance template includes a command for acquiring time information and position information of the mobile terminal. 3. The life record creation system according to claim 1, wherein the guidance template includes a command for displaying a guide on a mobile terminal and acquiring a key input from the mobile terminal. 4. The life record creating system according to claim 1, wherein the shaping processing unit includes speech recognition means for recognizing speech data acquired from a mobile terminal and converting the speech data into text data. 5. The life record creating system according to claim 4, wherein the shaping processing unit includes category determining means for extracting words having a high appearance frequency from the text data and determining a category of the text data. 6. The life record creation system according to claim 4, wherein the shaping processing unit includes summary sentence generation means for generating a summary sentence from the text data. 7. The life record creating system according to claim 1, wherein the shaping processing unit includes a scene decomposing unit that extracts a change point of video data acquired from a mobile terminal and decomposes it into a scene. The life recording creation system according to claim 1, wherein the shaping processing unit includes a still image generation unit that generates a still image from video data acquired from a mobile terminal. 9. The life record creation system according to claim 1, wherein the output template is a template that generates HTML data of a web page from data shaped by the shaping processing unit. Reading a template for guidance from the template storage unit in response to a request from the mobile terminal;
A template interpretation execution step of sequentially executing the read guidance template commands;
A shaping processing unit step for receiving and shaping audio data and video data from the mobile terminal in response to execution by the template interpretation execution unit step;
A life record creating method comprising: an output shaping step for generating output data based on an output template for the data shaped by the shaping processing step. 11. The life record creation method according to claim 10, wherein the guidance template includes a command for acquiring position information and time information of a mobile terminal. 12. The method according to claim 10 or 11, wherein the guidance template includes a command for displaying a guide on a mobile terminal and acquiring a key input from the mobile terminal. 13. The method for creating a life record according to claim 10, wherein the shaping processing step includes a speech recognition step of recognizing speech data acquired from a mobile terminal and converting the speech data into text data. 14. The life record creation method according to claim 13, wherein the shaping processing step includes a category determination step of extracting words having a high appearance frequency from the text data and determining a category of the text data. 15. The life record creation method according to claim 13, wherein the shaping processing step includes a summary sentence generation step for generating a summary sentence from the text data. 16. The method of creating a life record according to claim 1, wherein the shaping processing step includes a scene decomposition step of extracting a change point of the video data acquired from the mobile terminal and disassembling it into a scene. 17. The life recording creation method according to claim 10, wherein the shaping processing step includes a still image generation step of generating a still image from video data acquired from a mobile terminal. 18. The life record creating method according to claim 10, wherein the output template is a template for generating HTML data of a web page from the data subjected to the shaping process in the shaping process step.

Images