JP2004363871A - Data storage device, its method and its program, and recording medium recording program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily retrieve target electronic data even from electronic data of a large amount of images, videos, etc., and to lighten the burden of a user deu to index addition. <P>SOLUTION: A position information acquiring means 2 and a time information acquiring means 3 acquire the location and time at the time of acquisition of electronic data acquired by an electronic data acquiring means 1. A recognizing means 9, on the other hand, performs recognition processing for the electronic data. A data recording means 4 relates the electronic data to the location information and/or time information, and/or the recognition result of the recognizing means 9, and the related electronic data, location information and/or time information, and/or the recognition result are stored in a data storing means. A retrieval index specifying means 8 determines a retrieval item according to an index that a user specifies. A retrieving means 7 retrieves the saved electronic data from the data storing means 5 according to the retrieval index determined by the retrieval item specifying means 8. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a data storage device and a method for storing electronic data such as photographed images and videos in a format that can be easily used, and particularly to characters, objects, faces, and voices included in electronic data such as images and videos. The present invention relates to a data storage device and a method for recognizing an object such as a keyword and adding such information as an index when storing data.
[0002]
[Prior art]
When saving electronic data of images, video and audio, a method of automatically adding time as index data, adding positional information, or adding other index data by a user is used. Was. In Japanese Patent Application Laid-Open No. H11-163, a method of automatically acquiring position and time information at the time of data storage and storing the information in association with electronic data such as an image and a video to facilitate the use and search of the image data.
[0003]
[Patent Document 1]
Japanese Patent Application Laid-Open No. 2003-116081, "Data storage method and device"
[0004]
[Problems to be solved by the invention]
The present invention, in order to compensate for the drawbacks in the use of the conventional system described above, by extracting information from the captured electronic data of the image, video, audio, by automatically adding the information of the shooting target as an index, It is an object of the present invention to provide a data storage device and a method capable of easily retrieving target electronic data from a large amount of electronic data such as images and videos, and reducing a burden on a user due to the addition of an index. .
[0005]
[Means for Solving the Problems]
One means for achieving the above object of the present invention is a data storage device for storing and using electronic data including at least one of an image, a video, and an audio, and acquiring the electronic data. Electronic data acquisition means, position information acquisition means for acquiring a position at the time of electronic data acquisition, time information acquisition means for acquiring a time at the time of electronic data acquisition, and recognition means for performing recognition processing on the electronic data And data recording means for associating the electronic data with the position information obtained by the position information obtaining means, and / or the time information obtained by the time information obtaining means, and / or the recognition result recognized by the recognition means, The electronic data associated with the data recording unit, the position information acquired by the position information acquisition unit, and / or the time information acquisition A data storage device, characterized in that it comprises a data storage means for storing time information obtained by the means, and / or the recognition result recognized by the recognition means.
[0006]
Alternatively, in the data storage device described above, the recognition means performs a character recognition process on the image and video data.
[0007]
Alternatively, in the data storage device described above, the recognition means performs face recognition processing on the image and video data.
[0008]
Alternatively, in the data storage device described above, the recognition unit performs an object recognition process on the image and video data.
[0009]
Alternatively, in the data storage device described above, the recognition unit performs a voice recognition process on the voice data.
[0010]
Alternatively, in the data storage device described above, the data storage means stores the electronic data in a predetermined recording device installed on the communication network via the communication network.
[0011]
Alternatively, the data storage device described above further comprises a charging unit that monitors a data amount of the electronic data recorded in a predetermined recording device installed on the communication network, and performs charging according to the data amount. Is a data storage device.
[0012]
Alternatively, in the data storage device, a search item specifying unit that determines a search item based on an index specified by a user, and a search unit that searches the electronic data based on the search item determined by the search item specifying unit A data storage device comprising:
[0013]
Alternatively, there is provided a data storage method for storing and using electronic data including at least one of an image, a video, and an audio, the electronic data obtaining step of obtaining the electronic data, and the position at the time of obtaining the electronic data. The position information obtaining step of obtaining, the time information obtaining step of obtaining the time at which the electronic data was obtained, the recognition step of performing a recognition process on the electronic data, and the electronic data obtained by the position information obtaining step A position information, and / or a time information obtained by the time information obtaining step, and / or a data recording step of associating with the recognition result recognized by the recognition step; and the electronic data associated by the data recording step; Position information obtained in the position information obtaining step, and / or time information obtained in the time information obtaining step, and / or Is a data storage method, characterized in that it comprises a data storage step of storing the recognition result recognized by the recognition process.
[0014]
Alternatively, in the above data storage method, a character recognition process is performed on the image and video data in the recognition step.
[0015]
Alternatively, in the above data storage method, in the recognition step, a face recognition process is performed on the image and video data.
[0016]
Alternatively, in the above data storage method, in the recognition step, an object recognition process is performed on the image and video data.
[0017]
Alternatively, in the data storage method described above, a voice recognition process is performed on the voice data in the recognition step.
[0018]
Alternatively, in the above data storage method, in the data storage step, the electronic data is stored in a predetermined recording device installed on the communication network via the communication network.
[0019]
Alternatively, in the data storage method described above, after the data storage process, the data amount of the electronic data recorded in a predetermined recording device installed on the communication network is monitored, and charging is performed according to the data amount. A data storage method comprising a process.
[0020]
Alternatively, in the data storage method described above, a search item specifying step of determining a search item based on an index specified by a user, and a search step of searching the electronic data based on the search item determined by the search item specifying step And a data storage method.
[0021]
Alternatively, the present invention is a data storage program, characterized in that a program for causing a computer to execute the steps in the above data storage method.
[0022]
Alternatively, the present invention is a recording medium storing a data storage program, wherein the data storage method is a program for causing a computer to execute the process in the data storage method, and the program is recorded on a recording medium readable by the computer.
[0023]
In the present invention, in adding an index to electronic data such as captured images and videos,
(1) Recognize objects from electronic data such as images and videos using existing recognition technology,
(2) By associating the recognition result obtained in (1) with a dictionary created in advance,
An index is automatically added to the electronic data of images, videos, and sounds, so that users can easily find the electronic data of images, videos, and sounds that they need. To reduce.
[0024]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0025]
[Configuration of the present invention]
The configuration described below shows what functional means and processes are necessary to realize the basic configuration of the present invention.
[0026]
The data storage device of the present invention, in order to add an index to the electronic data of the image, video, audio,
(1) electronic data acquisition means for acquiring electronic data of images, videos, and sounds;
(2) position information acquisition means for acquiring position information at the same time as acquiring image, video, and audio electronic data;
(3) time information acquisition means for acquiring time information at the same time as acquiring image, video, and audio electronic data;
(4) an index assigning means (recognizing means) for designating and assigning information recognized from the electronic data as an index as information other than the results obtained from the above (2) and (3);
(5) data storage means for storing the electronic data of images, video, and audio and the indexes obtained from (2) to (4) in association with each other;
(6) search means for searching for electronic data required by the user from the electronic data stored by the data storage means;
(7) search item designating means for inputting a search key required for searching for electronic data by the search means;
(8) Electronic data display means for displaying necessary information to the user obtained by the search means is provided.
[0027]
These configurations are incorporated in a terminal owned by the user as hardware or implemented as software.
[0028]
In the configuration of the present invention, the image, video, and audio electronic data obtained by the electronic data obtaining unit is provided with a recognition unit that performs recognition by applying an existing recognition method, and the data is stored as an index. Means for storing the image, video, and audio data in association with each other.
[0029]
At this time, the image and video data may be subjected to character recognition processing by character recognition means, and the recognition result may be used as index data. Alternatively, at this time, the image and video data may be subjected to face recognition processing by face recognition means, and the recognition result may be used as index data. Alternatively, at this time, the image and video data may be subjected to object recognition processing by an object recognition unit, and the recognition result may be used as index data. Further, at this time, the voice data may be subjected to voice recognition processing by voice recognition means, and the recognition result may be used as index data.
[0030]
When configured in this way, the image, video, the result of recognition of the electronic data of the image, video, audio acquired by the terminal owned by the user by the recognition means installed on the communication network via the communication network, It may be sent back to the user's terminal in association with the electronic voice data.
[0031]
In addition, the user can freely access the data storage means installed on the communication network, and if necessary, the electronic data of images, videos and sounds stored by the data storage means and the recognition results associated therewith. Etc. can be used.
[0032]
With the above configuration, the user can easily find necessary electronic data from necessary electronic data of images, videos, and sounds.
[0033]
[Embodiment of the present invention]
Next, a specific configuration of the data storage device according to the present invention and an embodiment of the process of the method will be described.
[0034]
FIG. 1 shows a first embodiment of the device configuration according to the present invention. In the figure, 1 is electronic data acquisition means, 2 is position information acquisition means, 3 is time information acquisition means, 4 is data recording means, 5 is data storage means, 6 is search item designation means, 7 is search means, 8 is The electronic data display means 9 is a recognition means and constitutes a portable terminal. 10 is a billing means.
[0035]
Next, a detailed operation of each of these processing means will be described. In the description of the operation here, it is assumed that all processing is realized in the user's terminal without passing through the communication network, and the case of going through the communication network will be described separately.
[0036]
In this embodiment, first, electronic data such as an image and a video is obtained by the electronic data obtaining means 1 attached to the mobile terminal. The electronic data acquisition means 1 uses a digital camera, a digital video camera, and a voice recorder.
[0037]
When the electronic data acquisition unit 1 acquires the image, video, and audio electronic data, the position information acquisition unit 2 may simultaneously acquire the position information at the time of acquiring the image, video, and audio electronic data. . As the position information acquisition means 2, a GPS (Global Positioning System) or a PHS (Personal Handy Phone System) is used.
[0038]
In addition, when the electronic data acquiring unit 1 acquires the image, video, and audio electronic data, the time information acquiring unit 3 simultaneously acquires the time information at the time of acquiring the image, video, and audio electronic data. Sometimes. As the time information acquisition means 3, a device attached to an existing portable terminal, such as a clock or a calendar, is used.
[0039]
Next, the data recording unit 4 associates the image, video, and audio electronic data with the position information and / or the time information, and transfers the associated information to the data storage unit 5. In addition, the data recording unit 4 sends one or more of the image, video and audio electronic data to the recognition unit 9, and performs a recognition process on the one or more of the image, video and audio electronic data in the recognition unit 9. In some cases, the electronic data of the image, video, and audio are associated with the recognition result, and the associated information is transferred to the data storage unit 5.
[0040]
The recognizing means 9 uses the existing recognizing technology, regardless of software or hardware, to recognize the target. As a specific recognition technique, a known technique such as a technique using a normalized cross-correlation (normalized correlation) as an evaluation function (Shin Nagao: “Digital Image Processing”, pp. 306-310, Modern Science Co., 1995) is used. Shall be used. At this time, the recognition dictionary used by the recognition means 9 is updated via a communication network or a recording medium, and includes a charging means 10 for charging at the time of updating. The data storage unit 5 is a combination of the electronic data of the image, video, and audio sent from the data recording unit 4 and position information, time information, a character recognition result, a face recognition result, an object recognition result, and a voice recognition result. Save.
[0041]
Next, a process for utilizing information stored in the data storage unit 5 will be described.
[0042]
First, the user specifies the search conditions in the search item specifying means 6 under what conditions the electronic data of the image, video, and audio are searched, and sends the specified search conditions to the search means 7. . To specify the search condition, as shown in a screen 1 of FIG. 2, the search condition is input in a text format, or the search is performed from the map information based on the position information, or the time information is used as the inspector condition. Specify whether to search from the calendar.
[0043]
Next, when performing a search from map information, for example, in accordance with a search condition specified by the user, as shown in a screen 2 in FIG. 2, the position information is narrowed down and narrowed down by inputting in a text format. Searching without knowing the exact address, such as displaying a map from the displayed location information, selecting detailed location information from the displayed map, etc., such as displaying a map of the area searched by the user And At this time, it is assumed that the position information associated with the electronic data of the image, video, and audio can be superimposed and displayed on the map. FIG. 3A shows an example of specifying time information from a calendar, and FIG. 3B shows an example of specifying position information from a map in the search item specifying means 6.
[0044]
At this time, when an input is made from a calendar, if the display indicating the presence or absence of data described in the calendar indicates that data is present, for example, if image or video data is recorded, FIG. Display images and videos like When audio data is displayed, it is assumed that the list of audio indices can be displayed and the contents of the list can be output by specifying the index from the list.
[0045]
The search means 7 searches the electronic data stored in the data storage means 5 based on the search conditions specified by the search item specification means 6, and sends the result to the electronic data display means 8. At this time, in addition to the image, video, and audio electronic data stored in the data storage unit 5 that is the search result, the electronic data display unit 8 displays the search condition used for the search, the image, video, It is assumed that any one of the position information, the time information, the character recognition result, the face recognition result, the object recognition result, and the voice recognition result associated with the voice electronic data can be displayed. The selection of the content to be displayed on the electronic data display means 8 can be specified when the search condition is specified in the search item specification means 6.
[0046]
FIG. 4 is a configuration example of an apparatus according to the present embodiment. In the figure, one or more of a digital still camera, a digital video camera, and a voice recorder 11 correspond to the electronic data acquiring means 1, the GPS or PHS 12 corresponds to the position information acquiring means 2 and the time information acquiring means 3, The position data association device 13 corresponds to the data recording means 4, the electronic data recording medium 14 corresponds to the data storage means 5, the electronic data search device 15 corresponds to the search item designation means 6, the search means 7, and the display. Reference numeral 16 corresponds to the electronic data display means 8. Although the figure does not show an equivalent to the recognizing means 9 for recognizing the electronic data such as the image and the video, the recognizing means 9 can be realized by the arithmetic unit 17 on the portable terminal of the user. .
[0047]
Next, a second embodiment for realizing the present invention via a communication network will be described.
[0048]
FIG. 5 shows the configuration of the second embodiment in a case where the present invention is realized via a communication network. In the figure, electronic data acquisition means 1a, position information acquisition means 2a, time information acquisition means 3a, search item designation means 6a, and data display means 8a are respectively electronic data acquisition means of the embodiment of FIG. 1. The configuration is the same as that of the position information acquisition unit 2, the time information acquisition unit 3, the search item designation unit 6, and the electronic data display unit 8. These constitute the mobile terminal of the present embodiment. The data recording unit 4a, the data holding unit 5a, the searching unit 7a, the recognizing unit 9a, and the billing unit 10a are installed and operated on a communication network.
[0049]
First, the user obtains the electronic data of the image, video and audio by the electronic data obtaining means 1a. When the electronic data acquisition unit 1a acquires the image, video, and audio electronic data, the position information acquisition unit 2a may simultaneously acquire the position information at the time of acquiring the image, video, and audio electronic data. . In addition, when the electronic data acquisition unit 1a acquires the image, video, and audio electronic data, the time information acquisition unit 3a also acquires the time information at the time of acquiring the image, video, and audio electronic data. Sometimes.
[0050]
Next, the electronic data of the image, the video, and the audio are sent to the data recording unit 4a installed on the communication network via the communication network, and the electronic data of the image, the video, and the audio are transmitted to the data recording unit 4a. The position information and / or the time information are associated with each other, and the associated information is transferred to the data storage unit 5a. In addition, the data recording unit 4a sends the image, video and audio electronic data to the recognition unit 9a, and the recognition unit 9a performs a recognition process on at least one of the image, video and audio electronic data, and In some cases, the electronic data of video and audio are associated with the recognition result, and the associated information is transferred to the data storage unit 5a.
[0051]
At this time, the recognizing unit 9a may perform charging in the charging unit 10a according to the data amount of the electronic data of the image, video, and audio to be used. Further, in the data storage unit 5a, charging may be performed in the charging unit 10a in accordance with the image, video, and audio electronic data and the data amount of the information associated therewith.
[0052]
Next, a process for utilizing information stored in the data storage unit 5a will be described.
[0053]
First, the user designates search conditions in the search item designating means 6a to determine under what conditions the electronic data of the image, video and audio are searched, and sends the designated search conditions to the search means 7a. . The search means 7a searches the electronic data stored in the data storage means 5a based on the search condition specified by the search item specification means 6a, and sends the result to the electronic data display means 8a.
[0054]
FIG. 6 is a configuration example of an apparatus for realizing the present embodiment via a communication network.
[0055]
In the figure, one or more devices 21 such as a digital still camera, a digital video camera, a voice recorder and the like correspond to the electronic data acquiring means 1a, GPS and PHS 22 correspond to the position information acquiring means 2a and the time information acquiring means 3a, 23 corresponds to the electronic data display means 8a, the electronic data / position data etc. associating device 24 corresponds to the data recording means 4a, the electronic data recording medium 25 corresponds to the data storage means 5a, and the electronic data search device 26 performs the search. The charging unit 27 corresponds to the charging unit 10a. As in FIG. 4, the recognition means 9a is not shown in FIG. 6, but when the present invention is realized via a communication network, the recognition means is a recognition PC (personal computer) 28 installed on the communication network. And the like. The portable terminal and these devices and means are connected via a communication network 29 by a communication device 30 on the portable terminal side and a communication device 31 on these devices and means side.
[0056]
FIG. 7 is a flowchart showing the flow of the processing of the data storage method according to the first embodiment of the present invention.
[0057]
FIG. 7 shows only the processing flow on the portable terminal owned by the user without connecting to the communication network, and FIG. 7 shows the processing flow when using the data storage device installed on the communication network. It is shown in FIG.
[0058]
In the present embodiment, first, the electronic data of the image, the video, and the sound are acquired, and at the same time, the position information and the time information at the time of the acquisition are acquired (ST1), and the acquired information is associated with the electronic data. (ST2) The associated electronic data and acquired information are stored (ST3). Next, in order to facilitate searching of the stored electronic data under different search conditions, recognition processing is performed on the electronic data (ST4 to ST13), and the result is also associated with the electronic data (ST4 to ST13). ST2) and save (ST3).
[0059]
FIG. 8 is a flowchart illustrating a flow of a process of a data search method according to the first embodiment. FIG. 8 shows only the processing flow on the portable terminal owned by the user without connecting to the communication network, and FIG. 10 shows the processing flow when using the data storage device installed on the communication network. Shown in
[0060]
In this embodiment, the user first selects which of the position information, the time information, and the recognition result is to be used as the search item (ST14). In accordance with the search item selected here, then, in the case of detailed information (search key) of the item, for example, time information, a date to be searched is given as an input (ST15), and the recorded information is searched (ST15). ST16). At this time, if the electronic data stored on the date that matches the input date (that is, related information that matches or is similar to the search key) exists (ST17), the result is output (ST18) and does not exist. In this case, a search item is specified again and a search key (such as a date) is given as an input, and the search is performed again (ST19).
[0061]
FIG. 9 is a flowchart showing a processing flow of a data storage method according to the second embodiment of the present invention when a data storage device connected to a communication network is used.
[0062]
The difference from FIG. 7 is that the input electronic data or the position information and the time information (ST20) are connected to a communication network via a communication device (ST21), transmitted (ST22), and And these pieces of acquired information are associated with each other (ST23) and recorded in a data storage device installed on the communication network (ST24). Recognition processing performed on stored electronic data is also performed in the same manner as in the first embodiment using a recognition device (configured by a PC) installed on a communication network (ST25 to ST30).
[0063]
FIG. 10 is a flowchart illustrating a flow of processing of a data search method according to the second embodiment when a data storage device connected to a communication network is used.
[0064]
8 is different from FIG. 8 in that a search item (ST35) and a search key (ST36) specified by a user are connected to a communication network via a communication device (ST37), and a search device installed on the communication network. (ST38), and information is searched from the data storage device installed on the communication network using this search device as in the first embodiment (ST39 to ST43). The search result is transmitted again to the user via the communication network (ST41) and displayed on the display device of the portable terminal owned by the user.
[0065]
A part or all of the functions of each unit in the apparatus shown in FIGS. 1, 4, 5, and 6 are configured by a computer program, and the program is executed using the computer to realize the present invention. It is needless to say that the processing steps shown in FIGS. 7 to 10 can be configured by a computer program and the program can be executed by a computer. Alternatively, a program for causing a computer to execute the process is recorded on a recording medium readable by the computer, for example, a flexible disk, an MO, a ROM, a memory card, a CD, a DVD, a removable disk, and the like. It can be saved and distributed. Further, the above program can be provided through a communication network such as the Internet or e-mail. As described above, the present invention can be implemented by installing a program provided by a recording medium or a communication network in a computer. When a computer that executes a program is present separately with a function or a process of processing, it is natural that the program is divided and executed according to the function or the process of the process.
[0066]
【The invention's effect】
According to the present invention, the index information is automatically added to the acquired electronic data, so that the user's labor for organizing data and the like is reduced, and the stored information can be easily searched. . In addition, since data storage means on a communication network is used for data storage, it is possible to store a large amount of electronic data without carrying a large-capacity data storage means.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a first embodiment of an apparatus according to the present invention.
FIG. 2 is a diagram showing an example of a screen of a search item designating unit according to the first embodiment;
FIGS. 3 (a), (b), (c), and (d) are diagrams showing another example of the screen of the search item designation means in the first embodiment.
FIG. 4 is a diagram showing a configuration example of an apparatus according to the first embodiment;
FIG. 5 is a configuration diagram showing a second embodiment example via a communication network according to the present invention.
FIG. 6 is a diagram showing a configuration example of an apparatus according to a second embodiment;
FIG. 7 is a flowchart showing a processing procedure in data storage according to the first embodiment of the present invention;
FIG. 8 is a flowchart showing a processing procedure in a data search according to the first embodiment;
FIG. 9 is a flowchart showing a processing procedure in data storage when via a communication network according to a second embodiment of the present invention;
FIG. 10 is a flowchart showing a processing procedure in a data search through a communication network according to the second embodiment;
[Explanation of symbols]
1, 1a ... electronic data acquisition means
2, 2a ... location information acquisition means
3, 3a: time information acquisition means
4, 4a ... data recording means
5,5a ... Data storage means
6, 6a ... search item designation means
7, 7a ... search means
8, 8a: electronic data display means
9, 9a ... recognition means
10, 10a ... Billing means
11 Digital still camera, digital video camera, voice recorder
12 ... GPS, PHS
13. Electronic data / position data association device
14. Electronic data recording medium
15 Electronic data retrieval device
16 ... Display
17 arithmetic unit (recognition means)
21: Digital still camera, digital video camera, voice recorder
22 ... GPS, PHS
23 ... Display
24 ... Electronic data / position data association device
25 ... Electronic data recording medium
26 ... Electronic data search device
27 ... Billing means
28 ... PC for recognition
29 ... Communication network
30 Communication device
31 ... Communication device

Claims (18)

A data storage device for storing and using electronic data including at least one of an image, a video, and an audio,
Electronic data acquisition means for acquiring the electronic data,
Position information acquisition means for acquiring the position at the time of electronic data acquisition,
Time information acquisition means for acquiring the time at the time of electronic data acquisition,
A recognition unit that performs a recognition process on the electronic data,
Data recording means for associating the electronic data with the position information obtained by the position information obtaining means, and / or the time information obtained by the time information obtaining means, and / or the recognition result recognized by the recognition means;
The electronic data associated with the data recording unit, the position information obtained by the position information obtaining unit, and / or the time information obtained by the time information obtaining unit, and / or a recognition result recognized by the recognition unit And a data storage means for storing data. The data storage device according to claim 1,
The data storage device is characterized in that the recognition means performs a character recognition process on the image and video data. The data storage device according to claim 1,
A data storage device, wherein the recognition means performs face recognition processing on the image and video data. The data storage device according to claim 1,
The data storage device, wherein the recognition means performs an object recognition process on the image and video data. The data storage device according to claim 1,
A data storage device, wherein the recognition means performs a voice recognition process on the voice data. The data storage device according to any one of claims 1 to 5,
The data storage device stores the electronic data in a predetermined recording device installed on the communication network via the communication network. The data storage device according to claim 6,
A data storage device, comprising: a charging unit that monitors a data amount of the electronic data recorded on a predetermined recording device installed on the communication network, and performs charging according to the data amount. The data storage device according to any one of claims 1 to 7,
A search item specifying means for determining a search item based on an index specified by a user;
A data storage device comprising: a search unit configured to search the electronic data based on the search item determined by the search item designating unit. A data storage method for storing and using electronic data including at least one of an image, a video, and an audio,
An electronic data acquisition step of acquiring the electronic data,
A position information obtaining step of obtaining a position at the time of obtaining the electronic data,
A time information obtaining step of obtaining a time at the time of obtaining the electronic data,
A recognition process of performing a recognition process on the electronic data,
A data recording step of associating the electronic data with the position information obtained by the position information obtaining step, and / or the time information obtained by the time information obtaining step, and / or a recognition result recognized by the recognition step;
The electronic data associated with the data recording process, the position information obtained in the position information obtaining process, and / or the time information obtained in the time information obtaining process, and / or the recognition result recognized in the recognition process And a data storing step of storing the data. The data storage method according to claim 9,
In the recognition step, a character recognition process is performed on the image and video data. The data storage method according to claim 9,
In the recognition step, a face recognition process is performed on the image and video data. The data storage method according to claim 9,
In the recognition step, an object recognition process is performed on the image and video data. The data storage method according to claim 9,
In the recognition step, a voice recognition process is performed on the voice data. The data storage method according to any one of claims 9 to 13,
In the data storage step, the electronic data is stored in a predetermined recording device installed on the communication network via the communication network. The data storage method according to claim 14,
After the data storing step, the data processing method includes a charging step of monitoring a data amount of the electronic data recorded in a predetermined recording device installed on the communication network, and performing charging in accordance with the data amount. Preservation method. The data storage method according to any one of claims 9 to 15,
A search item specification process for determining a search item based on an index specified by a user;
A search step of searching the electronic data based on the search item determined in the search item designation step. 17. A data storage program, wherein the data storage method according to claim 9 is a program for causing a computer to execute the process. A program for causing a computer to execute the steps in the data storage method according to any one of claims 9 to 16,
A recording medium recording a data storage program, wherein the program is recorded on a recording medium readable by the computer.

Images