JP2006115011A - Action history recorder, action history management system, action history recording method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an action history recorder and an action history management system in which the total volume of data is reduced while sustaining high quality of high importance image data. <P>SOLUTION: In an action history recorder 101, an image data/user data acquisition means 201 acquires image data on the periphery of a user and user data characterizing the situation of the user at the time of acquiring image data, and an action history data generation means 202 generates action history data based on both data thus acquired. A record object importance judgment means 203 judges the importance of user data in the action hystory data, and calculates the importance of image data based on the importance thus judged, and an image data compression means 204 compresses image data in the action history data depending on the importance of image data. Compressed action history data is stored temporarily in a storage means 205 and transmitted by an action history data transmission means 206 to the action history storage of an action history management system through a network 104. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an apparatus and method for automatically recording a user's behavior history.

  Conventionally, many attempts have been made to record the general daily life of a specific person and to create a database. For this reason, many devices and methods for recording and storing the action history of the specific person have been proposed. For example, a specific person wears an action history recording device equipped with a small portable computer, an imaging device that captures the front direction of the face, and various devices that acquire information on the action history of the specific person, and is specified as the portable computer An apparatus for recording a human action is known (for example, see Non-Patent Document 1). In this case, a specific person (hereinafter simply referred to as “user”) who is a user of the apparatus always wears or carries a portable computer such as a wearable computer in his / her daily life, A PHS (Personal Handyphone System) for wearing a hat equipped with a small imaging device that can automatically shoot the direction of the front of the face, taking a picture of the direction of view to form image data, and acquiring position information ) And GPS, such as gyroscopes and accelerometers to acquire motion information, and EEG meters, blood pressure monitors, and pulse meters to acquire biological information such as brain waves, blood pressure, and pulse rate are worn on the body. For image data obtained by periodically capturing and acquiring, position information, operation information, biometric information, and the like are associated and stored as information related to the user's behavior history. By using this device, information on when and what the user was watching can be rubbed as a history. Here, “attached to the body” means holding in close contact with or close to the user's body, and “attached to the body” in this specification means all such meanings.

  In addition, there is also known a technique for making it possible to appropriately search for data that records all the details about the user's behavior (see, for example, Non-Patent Document 2 and Non-Patent Document 3). This allows the user to view this photo at a later date, which can be used as a diary substitute or as a means of recollecting past events.

Aizawa Kiyoharu et al. “Digital Life Media” University of Tokyo Aizawa Laboratory [online] [searched September 29, 2004], Internet, <URL: http://www.hal.tu-tokyo.ac.jp/research/ DLM.html> “DALPA Information Processing Technology Office” The Defense Advanced Research Projects Agency (DARPA) [online] [searched September 29, 2004], Internet, <URL: http: // www. darpa.mil/ipto/Programs/lifelog/ ＞ San Francisco Bay Area Research Center, Media Presence Group “My Life Bits Project” Microsoft Corporation [online] [searched September 29, 2004], Internet, <URL: http://research.microsoft. com / barc / mediapresence / MyLifeBits.aspx>

  However, when the image data is automatically acquired by the methods described in Non-Patent Documents 1 to 3, the quality of the image data is set to a fixed value by the setting of the imaging device or the computer and cannot be adjusted. Only manual adjustment means were provided.

  When the quality adjustment of the image data is impossible, the image data recorded as the action history is always recorded with the same quality regardless of the importance level and the surrounding situation of the user. Here, since the amount of image data is generally very large, a large-capacity recording medium or communication line is required when a large amount of image data is recorded or transmitted as it is. This is not a problem when the action history recording apparatus itself has a sufficient storage capacity or when the action record data is transmitted via a network having a sufficient bandwidth. Since the device for acquiring and recording the action history described up to now has a user's carrying as a front bank, a sufficient environment regarding the storage capacity and network environment of the device is not often provided. For this reason, it is conceivable to reduce the amount of data by compressing image data or the like, but there is a problem that the quality of the image is reduced and the value as a recording is reduced.

  On the other hand, when a means for manually adjusting the quality of image data is provided, the user himself / herself manually switches the settings of the imaging device or the computer at an arbitrary timing even if switching is performed. There is also a problem that it is practically impossible for a user wearing the apparatus described up to 3 to adjust the quality of image data manually throughout the daily life.

  In view of the above problems, the present invention provides an action history recording apparatus and method and program for reducing the overall data amount while maintaining the quality of image data having important information, and an action history management system. With the goal.

  The solution of the above-mentioned problem according to the present invention is an action history recording apparatus in which a user wears or carries it on his / her body and automatically records the action history of the user, and the use along the user's action path. At least one of image data obtained by photographing a scene around the user, time data obtained by acquiring the image data, and the user's biometric information and the user's surrounding state information at the time of obtaining the image data Image data / user data acquisition means for acquiring user data characterizing either one, and action history data for generating the action history data of the user by associating the time data and the user data with the image data Generating means and determining the importance of the user data in the behavior history data, and calculating the importance of the image data based on the importance A recording object importance determination unit, an image data compression unit that compresses the image data in the action history data by a data size that depends on the importance of the image data calculated by the recording target importance determination unit, and This is achieved by an action history recording device comprising storage means for recording the action history data including the image data.

  Then, an action history recording device comprising image data / user data acquisition means, action history data generation means, recording target importance determination means, image data compression means, and action history recording means allows the user's User data consisting of the user's surroundings and user's own information can be recorded as part of the action history data, and the importance of the image data can be determined depending on the user data it can.

  Also, the solution of the above-mentioned problem according to the present invention is that the above-described behavior history recording devices, which are each connected to be able to communicate with each other via a network, and the behavior history storing the behavior history data acquired by the behavior history recording device. Achieved by an action history management system comprising: a storage device; and the action history browsing device according to claim 9 or 10 that displays the action history data stored by the action history storage device in a state that can be browsed by a user. Is done.

  Then, the behavior history management system in which the behavior history recording device, the behavior history storage device, and the behavior history browsing device are connected via a network distributes the functions of the system, thereby reducing the size and weight of the behavior history recording device. While being planned, it is possible to store a large amount of data in the action history storage device, and in addition to acquisition and storage of the action history, the action history browsing device displays the action history data in a state that can be viewed by the user It becomes possible to do.

  According to the present invention, in an action history recording apparatus that adds and saves action history data to image data automatically captured at a fixed period, the importance of the image is automatically determined, and the importance is assumed not to be relatively high. By reducing the data size of the image data to be saved, while maintaining the quality of important image data, the overall amount of data is reduced and database resources for saving image data as action history are made effective It can be used, and the amount of data communication when transmitting through the network can be reduced.

  Hereinafter, an embodiment of an action history recording apparatus of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration example of an action history management system according to the present invention. The behavior history management system 100 acquires a behavior history of a user and converts it into storage data, a behavior history recording device 101 according to the present invention, a behavior history storage device 102 that stores a behavior history, and a saved behavior. An action history browsing device 103 for displaying history data so that the user can view the history data. All of these apparatuses are connected to the network 104 and communicate with each other.

  FIG. 2 is a block diagram showing a configuration example of the action history recording apparatus 101 according to the present invention. The action history recording apparatus 101 includes an image data / user data acquisition unit 201, an action history data generation unit 202, a recording target importance determination unit 203, an image data compression unit 204, a storage unit 205, and an action history. The data transmission means 206 is included.

  The image data / user data acquisition means 201 is an action history recording device such as image data obtained by photographing a landscape seen by the user, user data including the user's own biometric information, the environment around the user, and the like. Data relating to the behavior of the user wearing 101 is acquired.

  The action history data generation unit 202 generates action history data based on the image data and user data acquired from the image data / user data acquisition unit 201.

  Further, the recording object importance level determination unit 203 determines the compression level of the image data by determining the importance level of the image data acquired by the image data / user data acquisition unit 201, and stores it in the action history data as image quality information. save. The determination of the importance will be described later.

  The image data compression unit 204 compresses the image data based on the value of the image quality information of the action history data and reduces the data size. As a specific method of reducing the data size, for example, there is a method of reducing the image data by reducing the quality value of the JPEG image. Note that the image data subjected to this processing does not change the vertical and horizontal sizes, but the image quality deteriorates, and it becomes difficult to see the object shown in the image.

  The storage unit 205 is various data storage media, and temporarily stores action history data in which the quality of image data is changed according to the importance of the recording target.

  The action history data transmission unit 206 reads out the action history data held in the storage unit 205 and performs a transmission process in order to save it in the action history storage device 102 connected via the network. Then, the action history data subjected to the transmission process is deleted from the storage unit 205.

  FIG. 3 is a block diagram showing a configuration example of the image data / user data acquisition unit 201 used in the action history recording apparatus 101 according to the present invention. The image data / user data acquisition unit 201 includes an image acquisition unit 301, a biological information acquisition unit 302, a surrounding situation information acquisition unit 303, and an image data / user data processing unit 304.

  The image acquisition unit 301 includes a camera unit 305 formed by a digital camera such as a small CCD camera. When requested by the image data / user data processing unit 304, the camera unit 305 captures a scene in the user's line-of-sight direction, captures the captured digital photograph as image data into the apparatus, and stores the image data / user data. The data is passed to the processing unit 304. However, if the scenery that forms the image data is a scenery in the vicinity of the direction in which the user's line of sight is directed, the purpose as the action history data is achieved. Therefore, the line of sight refers to the direction of the user's line of sight (the direction of the pupil) The direction need not be completely coincident with the direction, and may be in the direction of the line of sight or in the vicinity of the direction of the line of sight.

  The biometric information acquisition unit 302 includes a heart rate acquisition unit 306 such as a pulse rate measuring device or a heart rate measuring device (note that since the human pulse rate and the heart rate are usually the same, this embodiment In this case, all measuring instruments shall be used for heart rate measurement.) In response to a request from the image data / user data processing unit 304, the heart rate acquisition unit 306 measures the user's heart rate, calculates the heart rate per minute, and calculates the image data / user data processing unit 304. To pass.

  The surrounding situation information acquisition unit 303 includes a microphone unit 307 and a position information acquisition unit 308.

  The microphone unit 307 is a small microphone and is provided in a part of the main body of the image data / user data acquisition unit 201. When requested by the image data / user data processing unit 304, the microphone unit 307 The ambient environmental sound is taken in, converted into a sound pressure level, and passed to the image data / user data processing unit 304.

  The position information acquisition unit 308 has a wireless communication function with the GPS satellites 309 orbiting around the earth. When requested by the image data / user data processing unit 304, the position information acquisition unit 308 receives from the four GPS satellites 309 in the sky. Based on the provided position measurement function and time measurement function, the user's current position information (latitude, longitude, height) and current time information are acquired and passed to the user data processing unit 304. The image data / user data processing unit 304 transmits the information acquired from the image acquisition unit 301, the biometric information acquisition unit 302, and the surrounding situation information acquisition unit 303 to the action history data generation unit 202.

  FIG. 4 shows a schematic diagram of action history data 400 generated in the present embodiment. The action history data 400 is formed by adding a header section 401 as header information to image data 405 captured and acquired by the camera section 305 of the image acquisition section 301. The header unit 401 includes time information 402 obtained data, current position information indicating the current position of the user as user data 403, and image quality information 404 of captured image data as data. Is forming.

  In the time information 402, time information obtained by photographing the image data 405 based on the data acquired by the position information acquisition unit 308 from the GPS satellite 309 is formed and held as information in units of year / month / day / hour / minute / second. For example, if it is 12:34:56 on January 1, 2003, it is stored as data 20030101123456.

  The user data 403 includes user information formed based on information acquired by the biological information acquisition unit 302 and the surrounding situation information acquisition unit 303, and is recorded by the recording target importance level determination unit 203. Holds information used to determine importance. If the position information acquired by the position information acquisition unit 308 of the surrounding situation information acquisition unit 303 is used for determining the importance, the image data 405 is based on the data acquired by the position information acquisition unit 308 from the GPS satellite 309. The location information where the image is taken is stored as longitude information and latitude information. For example, 35 degrees 13.1847 minutes north latitude and 139 degrees 40.7581 minutes east longitude are stored as 3513.1847, N, 13940.7581, E data. Alternatively, when the change in the biological information acquired by the biological information acquisition unit 302 is used to determine the importance, the biological information is input instead of the current position information, and the change in the environmental sound acquired by the microphone unit 307 is used. In this case, the volume information is input instead of the current position information and the distance information is used. When the distance information is used, the latitude information and longitude information acquired by the position information acquisition unit 308 (or image data / user based on these information) Distance information formed by the data processing unit 304) is input, and when two or more of these pieces of information are used in combination, a plurality of pieces of information to be used are input.

  The image quality information 404 holds quality information of the captured image data 405 as a percentage value of JPEG quality. Note that the percentage value in this case takes a value between 0 and 100, and the specific value is determined by the processing in the recording target importance determination unit 203 (therefore, generated by the action history data generation unit 202). In the state, the image quality information 404 remains empty data). Then, the image data 405 with the header portion 401 added is held as JPEG data.

  FIG. 5 is a block diagram showing a configuration example of the recording target importance level determination unit 203 used in the action history recording apparatus 101 according to the present invention. The recording target importance level determination unit 203 includes a recording target importance level processing unit 501 and a user data storage unit 502.

  The recording target importance level processing unit 501 acquires the action history data 400 from the action history data generating unit 202. The user data storage unit 502 is a database in which user data 403 group collected from the header part 401 of the past action history data 400 is accumulated, and this user data 403 group forms importance reference data. ing. Then, the recording target importance processing unit 501 uses the importance reference data stored in the user data storage unit 502 and the information recorded in the user data 403 of the header part 401 of the acquired action history data 400. Based on the importance of the image data 405 determined by comparison, image quality information 404 is formed and stored in the header portion 401. The user data 403 used for the conversion is newly accumulated in the user data storage unit 502, and the user data storage unit 502 is updated to data reflecting the user data 403.

  FIG. 6 is a block diagram showing a configuration of the action history storage apparatus 102 used in the action history recording apparatus 101 according to the present invention. The action history storage device 102 includes data receiving means 701, action history data management means 702, action history data storage database 703, action history data search means 704, and data transmission means 705.

  The data receiving unit 701 acquires the action history data 400 transmitted from the action history storage device 102 via the network 104. The action history data 400 is sent to the action history data management means 702, and forms management information for storing and managing the acquired action history data 400 in the database. Then, the action history data 400 in which the management information is formed is stored in the action history data storage database 703. The action history data storage database 703 is a large-capacity storage medium formed by a hard disk or the like, and stores the received action history data 400. On the other hand, the action history data search means 704 is a database search means. When the data reception means 701 receives an acquisition request for the action history data 400 via the network 104, the management information formed in the action history data management means 702 is updated. Based on this, data stored in the action history data storage database 703 is searched to find action history data 400 that matches the request. Then, the data transmission unit 705 transmits the found action history data 400 to the data reception unit 701 that satisfies the request.

  FIG. 7 is a block diagram showing the configuration of the action history browsing apparatus 103 used in the action history recording apparatus 101 according to the present invention. The action history browsing device 103 includes data receiving means 801, action history data browsing means 802, action history data request input means 803, and data transmission means 804.

  The action history data request input unit 803 is an input interface for a user to input a request for browsing the action history data 400 like a character input keyboard of a computer terminal. When the action history data request input unit 803 receives the condition of the action history data 400 that the user wants to browse from the user, the data transmission unit 804 transmits an acquisition request for the action history data 400 to the action history storage device 102 via the network 104. To do.

  The action history data browsing means 802 is a display interface that displays the action history data 400 like a display of a computer terminal. Then, the action history data 400 received by the data receiving unit 801 is delivered to and displayed on the action history data browsing unit 802, and the user can browse the desired action history data 400.

  Note that a plurality of action history browsing devices 103 may be provided in order to improve user convenience.

  FIG. 8 is a flowchart showing a flow until the behavior history data generating unit 202 acquires the behavior history data 400 as the first stage of processing in the behavior history recording apparatus 101 according to the present invention. Hereinafter, the flow of processing will be described based on this flowchart.

  First, when the processing of the action history recording apparatus 101 is started, the image data / user data processing unit 304 of the image data / user data acquisition unit 201 requests the image processing unit 301 to transmit the image data 405. The peripheral status information acquisition unit 303 is requested to acquire user data (S101). Next, the image data / user data processing unit 304 acquires the camera image captured by the image acquisition unit 301 as the image data 405 (S102). Next, in the image data / user data processing unit 304, the surrounding situation information acquisition unit 303 acquires position information (latitude information and longitude information of the current user's location and destination, respectively) and time information from the GPS satellite 309. (S103). Next, the image data / user data processing unit 304 acquires data for determining the importance of the recording target from the recording target importance determining means 203 (S104). When each user data is acquired in this way, when the image data / user data processing unit 304 acquires the user data and the image data 405, each data is sent to the action history data generating unit 202 (S105). Then, after an interval of 5 seconds, the processing from S101 to S105 is repeated (S106). In step S101 to step S106, the image data / user data processing unit 304 uses the user data as the position information and time information acquired from the GPS satellite 309 by the surrounding situation information acquisition unit 303. Even when the user's heart rate acquired from the acquisition unit 302, the environmental sound acquired by the surrounding state information acquisition unit 303, and such information are used in combination, the same processing as in steps S101 to S106 is repeated. .

  FIG. 9 is a flowchart showing the determination process of the importance of recorded data when the heart rate is used as the user data 403 of the action history data 400 in the action history recording apparatus 101 according to the present invention. Hereinafter, the flow of processing will be described with reference to FIG.

First, in the recording target importance determination unit 203, the recording target importance processing unit 501 acquires user heart rate data accumulated in the user data storage unit 502 (S201). The heart rate data is formed by accumulating a large number of past heart rate information of the user, and the data acquired by the recording target importance processing unit 501 in the above step is formed from such past information. Data on average user heart rate is also included. Next, the recording target importance level processing unit 501 acquires the current heart rate information of the user from the behavior history data generating unit 202 (S202). Next, the recording target importance processing unit 501 calculates the current heart rate based on the average heart rate data and the maximum heart rate data formed from the user's heart rate data group acquired in the past. Thus, the image quality of the image data 405 based on the current heart rate is calculated (S203). Where image quality JQ is
JQ = (acquired heart rate-average heart rate) / (maximum heart rate-average heart rate) * 100
Calculated by This is calculated by assuming that JPEG Quality is 0% when the average heart rate (steady state) or less is 0%, and 100% when the maximum heart rate is used. That is, the higher the heart rate, the higher the image quality. Although the minimum heart rate is not used here, the minimum heart rate may be calculated as 0% instead of the average heart rate. The average value of the heart rate continues to be stored, but the maximum value is initialized at a constant period, for example, every day. The JPEG Quality value calculated in this way is stored as image quality information 404 in the header section 401 (S204). The recording target importance processing unit 501 further updates the heart rate data in the user data storage unit 502 by adding the current heart rate acquired in step S202 (S205).

  FIG. 10 is a flowchart showing the determination process of the importance level of recorded data when position information is used as the user data 403 of the action history data 400 in the action history recording apparatus 101 according to the present invention. Hereinafter, the flow of processing will be described with reference to FIG.

First, in the recording target importance determination unit 203, the recording target importance processing unit 501 acquires the position information related data stored in the user data storage unit 502 (S301). This position information related data also includes information on the destination where the user is heading (latitude information and longitude information of the destination) as set point information. Next, the recording target importance level processing unit 501 acquires the current position of the user (latitude information and longitude information acquired by communication with the GPS satellite 309) from the action history data generation unit 202 (S302). Next, the recording target importance processing unit 501 calculates the image quality based on the set point of the position information storage data and the current position information (S303). Where image quality is
((Destination longitude-Current position longitude) ^ 2 + (Destination latitude-Current position latitude) ^ 2) ^ (1/2)
The JPEG Quality is set to 100% when the distance is 0, and is set to a certain distance, for example, 0% when the distance is 5 ′ (minutes) or more. That is, the closer to the set point, the higher the JPEG quality. The JPEG Quality value calculated in this way is set in the image quality information area 404 of the header section 401 (S303).

  FIG. 11 is a flowchart showing the determination process of the importance level of recorded data when a change in the sound pressure level of the environmental sound is used as the user data 403 of the action history data 400 in the action history recording apparatus 101 according to the present invention. It is. Hereinafter, the flow of processing will be described with reference to FIG.

  First, in the recording target importance determination unit 203, the recording target importance processing unit 501 acquires the sound pressure level reference data stored in the user data storage unit 502 (S401). This is a large amount of environmental sound information acquired in the past around the user. Next, the recording target importance level processing unit 501 acquires the sound pressure level of the ambient sound around the current user from the action history data generation unit 202 (S402). Next, the recording target importance level processing unit 501 calculates a comparison result between the sound pressure level reference data and the current sound pressure level of the environmental sound, and calculates the image quality based on the calculated value (S403). Here, the image quality is the JPEG Quality value 0% when the sound pressure level x is x <= 50 dB, JPEG Quality 100% when x> = 100 dB, and JPEG Quality when 50 <x <100. Is calculated as (x-50) / 50%. That is, the higher the sound pressure level, the higher the JPEG Quality value. Then, the JPEG Quality value calculated by the recording target importance processing unit 501 is set in the image quality information area 404 of the header unit 401 (S404).

  FIG. 12 is a flowchart showing a flow of compressing the image data 405 based on the image quality information in the image data compression means 204 of the action history recording apparatus 101 according to the present invention. Hereinafter, the flow of the compression process of the image data 405 will be described with reference to FIG.

  First, the image data compression unit 204 acquires the action history data 400 processed and output by the recording target importance level determination unit 203 (S501). Next, the image data compression unit 204 reads the image data 405 from the acquired action history data 400 (S502). Next, the image data compression unit 204 reads the image quality information 404 from the header section 401 and performs compression processing of the image data 405 based on the quality defined in the image quality information 404 (S503). Here, compression processing is performed by changing the JPEG Quality value. The larger the numerical value of the image quality information 404, the higher the quality of the image data 405 (that is, compression processing at a lower compression rate), and the image quality information. The smaller the numerical value 404 is, the lower the quality of the image data 405 is (that is, compression processing is performed at a high compression rate). Then, the image data compression unit 204 replaces the compressed image data 405 with the image data 405 of the original action history data 400 (S504). Then, the image data compression unit 204 sends the action history data 400 replaced with the compressed image data 405 to the action history storage unit 205 and stores it (S505).

  As described above, the importance of the image data 405 of the action history data 400 is determined according to the user's situation, the image data 405 having a high importance is stored with high quality, and the image data 405 having a low importance is data. By reducing the amount of data stored, the overall amount of data stored and transmitted can be reduced while maintaining the quality of highly important data, thereby reducing the data storage area and the area of network resources used during transmission. it can.

  In the action history recording apparatus 101, the image data / user data acquisition means 201, the action history data generation means 202, the recording target importance determination means 203, the image data compression means 204, and the action history recording means 205 It is possible to record the user data 403 including the user's surrounding situation and the user's own information as a part of the action history data 400. The importance of the image data 405 can be calculated depending on the importance.

  Further, the image acquisition unit can acquire the image data 405 from the scenery that the user is viewing by photographing the scenery in the direction of the user's line of sight, and the image data 405 can be obtained from the biological information acquired by the biological information acquisition unit 302, The peripheral status information acquired by the peripheral status information acquisition unit 303 is sent to the image data / user data processing unit 304 together with the peripheral status information, and further sent to the action history data generating unit 202, whereby the user's biological information and the peripheral status are added to the image data 405. The added action history data 400 can be generated.

  Furthermore, by using the change in the user's heart rate and the change in the sound pressure of the environmental sound around the user as the biometric information in the user data 403, the importance of the action history is relevant and can be easily acquired. Information can be included in the action history data 400 or used to determine the importance of the image data 405.

  In addition, by acquiring the latitude information and longitude information of the user's location and destination and calculating the distance information and using it in the user data 403, information that is highly relevant to the importance of the action history is obtained. 400 or can be used to determine the importance of the image data 405. Furthermore, by acquiring such information through communication with the GPS satellite 309, accurate information can be easily acquired.

  In the recording target importance determination unit 203, the recording target importance processing unit 501 is included in the action history data 400 in contrast to the past user data 403 stored in the user data storage unit 502. By determining the importance of the image data 405, it is possible to determine the importance of the image data 405 based on highly accurate and accurate determination material.

  In addition, the behavior history management system 100 is connected to the behavior history recording device 101, the behavior history storage device 102, and the behavior history browsing device 103 via the network 104, and acquisition, storage, and browsing of data related to the behavior history are separately performed. , The function of the system is distributed, the action history recording apparatus 101 can be reduced in size and weight, and the action history storage apparatus 102 can store a large amount of data. In parallel with the acquisition and storage, the action history browsing device 103 can display the action history data in a state where it can be viewed by the user.

  In the present embodiment, as the method for determining the importance of the recording target, the user data 403 using biometric information based on a change in heart rate and the surrounding situation based on position information and sound pressure level are used. However, the present invention is not limited to this, but can be applied to other biological information and surrounding situation information.

  Further, in the present embodiment, a heart rate acquisition unit 306 is provided in the biometric information acquisition unit 302 and a change in heart rate (pulse rate) is acquired as the biometric information of the user. However, the present invention is not limited to this. Any information that can be used as biometric information may be used. For example, it is conceivable to use changes in the user's biological information, such as changes in blood pressure, amount of sweat, pupil size, body temperature, respiratory rate, and pupil orientation.

  In the above embodiment, the method for changing the JPEG quality has been described as the image compression method. However, any method for changing the compression rate may be used, for example, a method of thinning out the number of pixels of the image. It may be used.

  Furthermore, in the above-described embodiment, the recording target importance determination unit 203 uses changes in the user's biometric information acquired by the image data / user data acquisition unit 201, changes in location information, volume information, and the like. However, the present invention is not limited to this. For example, a change in the position or size of an object (for example, a building or a natural object serving as a landmark of a destination) in the image data 405 as a subject exists in the image data 405. The change in the importance information of the object can also be used as a judgment material. When such a determination material is used, a change in importance as a recording target of each image data 405 is determined on the basis of a change in importance of an object shown in the image data 405. Since it is possible to determine the importance of the subject based on the image data 405 itself, such as the length, position, and size of the time existing in 405 and the presence or absence of contact between the subject and the user, It can be expected that the acquisition means can be simplified.

(Example)
An example of the action history management system and the action history recording apparatus according to the present invention shown in the above embodiment is shown in FIG.

  In this embodiment, an action history recording device 101 constituting the action history management system 100 is worn on the body of a user 105.

  The user 105 wears the wearable computer 106 on the body. The wearable computer 106 is a small portable computer provided integrally with clothes, a bag, or the like, and has a calculation function, a data storage function, and a network connection function similar to those of a small personal computer. Then, the user can use the wearable computer 106 and record information almost always in close contact with or close to the body in the life time zone. Note that a notebook personal computer or the like may be used instead of the wearable computer 106.

  Of the action history recording apparatus 101, the action history data generating means 202, the recording target importance determining means 203, the image data compressing means 204, the storage means 205, the action history data transmitting means 206, the image data / The image data / user data processing unit 304 of the user data acquisition unit 201 is mounted on the wearable computer 106 as a program.

  On the other hand, the wearable computer 106 is connected to an image acquisition unit 301, a biological information acquisition unit 302, and a surrounding situation information acquisition unit 303 that form the behavior history recording apparatus 101.

  The image acquisition unit 301 is formed as eyeglasses worn by the user 105, and a substantially cylindrical small CCD camera is provided as a camera unit 305 at the vine part of the glasses, and the scenery in the line of sight of the user 105 is displayed for a certain period of time. Automatically shoot every time.

  The biological information acquisition unit 302 is formed using the heart rate acquisition unit 306 as a heart rate meter, and a heart rate acquisition sensor is fixed to the arm of the user 105 with a band. In this embodiment, the pulse rate is acquired and regarded as the heart rate. However, the heart rate itself may be acquired by attaching a sensor around the heart of the chest of the user 105.

  Further, the peripheral state information acquisition unit 303 is formed as a microphone as a microphone unit 307 and a wireless communication unit as a position information acquisition unit 308 built in the wearable computer 106. The microphone unit 307 acquires environmental sounds around the user 105, and the position information acquisition unit 308 communicates with the GPS satellite 309 to present the current position information (latitude, longitude, height) of the user 105 and current time information. To get.

  The wearable computer 106 incorporates control means (not shown) that controls the image acquisition unit 301, the biological information acquisition unit 302, and the surrounding state information acquisition unit 303 that form the action history recording apparatus 101. Yes.

  The wearable computer 106 connects to the network 104 wirelessly. For connection to the network 104, a method using a mobile phone line or a PHS line can be considered. When a mobile phone line or a PHS line is used, communication is performed with the base station 107, and when a wireless LAN is used, communication is performed with an access point 108 such as HOTSPOT.

  In this way, by storing most of the configuration of the action history recording apparatus 101 in the wearable computer 106, the action history recording apparatus 101 and the action history management system 100 according to the present invention can be realized.

  An action history storage device 102 is connected to the network 104. In addition, as the action history browsing device, a first action history browsing device 103 a directly connected to the network 104 and a second action history browsing device 103 b carried by the user 105 are provided. The first behavior history browsing device 103a is a stationary personal computer, and communicates with the behavior history storage device 102 via a network to display desired behavior history data 400. The second action history browsing device 103b is a personal digital assistant (PDA) having a keyboard as the action history data request input means 803 and a display as the action history data browsing means 802 on the surface, and an action history storage apparatus wirelessly. The desired action history data 400 is displayed by communicating with 102. By making the action history data request input means 803 portable in this way, the user can easily browse the desired action history data 400 even when away from home.

It is a functional block diagram showing the whole action history management system concerning one embodiment of the present invention. It is a functional block diagram which shows the structure of the action history recording device which concerns on one embodiment of this invention. It is a functional block diagram which shows the structure of an image data and user data acquisition means among action history recording devices same as the above. It is a data block diagram which shows the structure of the action history data by an action history data production | generation means among action history recording apparatuses same as the above. It is a functional block diagram which shows the structure of a recording object importance determination means among action history recording devices same as the above. It is a functional block diagram which shows the structure of the action history preservation | save apparatus among action history recording devices same as the above. It is a functional block diagram which shows the structure of an action history browsing apparatus among action history recording devices same as the above. It is a flowchart figure which shows operation | movement of the action history data acquisition process among action history recording devices same as the above. It is a flowchart figure which shows a process in the case of performing recording data importance determination process by the change of heart rate among action history recording apparatuses same as the above. It is a flowchart figure which shows a process in the case of performing a recording data importance determination process by a positional information among action history recording apparatuses same as the above. It is a flowchart figure which shows a process in the case of performing recording data importance determination processing by a sound pressure level among action history recording devices same as the above. It is a flowchart figure which shows a process in the case of performing the image data compression process in an image data compression means among action history recording devices same as the above. It is one Example of an action history management system and an action history recording device same as the above.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Action history management system, 101 ... Action history recording apparatus, 102 ... Action history storage apparatus, 103, 103a, 103b ... Action history browsing apparatus, 104 ... Network, 105 ... User, 201 ... Image data User data acquisition means, 202 ... Action history data generation means, 203 ... Recording target importance determination means, 204 ... Image data compression means, 205 ... Storage means, 206 ... Action history data transmission means, 301 ... Image acquisition section, 302 DESCRIPTION OF SYMBOLS ... Biometric information acquisition part, 303 ... Peripheral condition information acquisition part, 304 ... Image data and user data processing part, 305 ... Camera part, 306 ... Heart rate acquisition part, 307 ... Microphone part, 308 ... Position information acquisition part, 309 ... GPS satellites, 401 ... Behavior history data, 402 ... Time information, 403 ... User data, 404 ... Image Quality information, 405 ... image data

Claims (14)

Image data obtained by photographing the periphery of the user and image data / user data acquisition means for acquiring user data characterizing the current situation of the user;
Action history data generating means for generating action history data of the user by associating the user data with the image data;
Image data compression means for compressing the image data in the action history data;
An action history recording apparatus comprising: storage means for recording the action history data including the compressed image data. An action history recording device for automatically recording the user's action history when the user wears or carries the body,
Image data obtained by photographing a landscape around the user along the user's action route, time data obtained by obtaining the image data, the user's biological information at the time of obtaining the image data, and the Image data / user data acquisition means for acquiring user data characterizing at least one of the user's surrounding situation information;
Action history data generating means for generating action history data of the user by associating the time data and the user data with the image data;
A recording object importance determining means for determining the importance of the user data in the action history data and calculating the importance of the image data based on the importance;
Image data compression means for compressing the image data in the action history data by a data size depending on the importance of the image data calculated by the recording target importance determination means;
An action history recording apparatus comprising: storage means for recording the action history data including the compressed image data. The image data / user data acquisition means includes:
An image acquisition unit that captures a scene in the user's line-of-sight direction and acquires the image data;
A biometric information acquisition unit for acquiring the user's biometric information for acquiring the user data, distance information between the current location of the user and a destination to which the user is headed, and the vicinity of the user The behavior history recording apparatus according to claim 1, further comprising: at least one of surrounding situation information regarding a situation and a surrounding situation information acquiring unit to acquire.   4. The action history recording apparatus according to claim 3, wherein the biological information acquisition unit uses a change in the heart rate of the user as the biological information.   The surrounding state information acquisition unit includes a location information acquisition unit that acquires the location where the user is currently located and the latitude / longitude information of the destination to which the user is going to calculate the distance information. The action history recording apparatus according to claim 3 or 4.   6. The action history recording apparatus according to claim 5, wherein the position information acquisition unit acquires the latitude / longitude information and the time data by communication with a GPS satellite.   The behavior history recording apparatus according to claim 3, wherein the surrounding situation information acquisition unit includes a microphone unit that acquires an environmental sound around the user. The recording object importance level judging means is
A user data storage unit for storing past user data;
The current user data included in the behavior history data acquired from the behavior history data generation means is included in the behavior history data in comparison with the past user data group stored in the user data storage unit. The action history recording apparatus according to claim 1, further comprising: a recording target importance processing unit that determines the importance of the image data.   An action history browsing apparatus for browsing action history data acquired by the action history recording apparatus according to claim 1, wherein the action history data is acquired by wireless communication. An action history browsing apparatus, wherein the user history is displayed in a viewable state.   The behavior history browsing device according to claim 9, wherein the behavior history browsing device is a portable information terminal. Each connected via a network,
The action history recording device according to any one of claims 1 to 8,
An action history storage device for storing the action history data acquired by the action history recording device;
An action history management system comprising: the action history browsing apparatus according to claim 9, wherein the action history data stored by the action history storage apparatus is displayed in a state that can be browsed by a user. In the behavior history recording device that the user wears or carries on the body and automatically records the user's behavior history, acquiring image data obtained by photographing the scenery in the user's line-of-sight direction; and
Obtaining user data characterizing at least one of the time data obtained from the image data, the user's biometric information at the time of obtaining the image data, and the surrounding state information of the user;
Associating the time data and the user data with the image data to form action history data;
The importance of the image data in the behavior history data is determined based on the user data in the behavior history data, image quality information is calculated depending on the importance, and the image quality information is used as the behavior history. Storing in data;
Compressing the image data of the behavior history data with a compression size depending on the image quality information;
And recording the action history data including the compressed image data in a storage means.   The user data is formed by at least one of a heart rate of the user, a distance between the current location of the user and a destination, and an environmental sound around the user. 12. The action history recording method according to 12.   A program for causing a computer to execute the action history recording method according to claim 12 or 13.

Images