JP2003296782A - Device and program for recording action - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an action recording device for automatically obtaining one's own action records, and recording them, and also to provide its program. <P>SOLUTION: The action pattern of a user is previously stored. For example, the action of the user is detected by an acceleration sensor 7 and a direction sensor 12 with the change of an action state as a clue, and matched with the previously registered action pattern. In the case of coincidence, the action is specified, a place is calculated based on the output of a GPS 8, a height is calculated based on the output of a height indicator 9, the action state, the place and the height are specified, and, then, a data base is created. By the configuration, the actions of the user are automatically recorded without a complicated work such as a manual writing input. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an action recording device and an action recording program for recording the action of a user (hereinafter referred to as a user).

[0002]

2. Description of the Related Art Today, in order to record one's schedule and actions,
The system notebook and electronic notebook are widely used. For example, in the case of the system notebook, it is formatted on a daily basis, weekly basis, or monthly basis, and a meeting with a business partner or a private schedule is handwritten. In the case of the electronic notebook, a schedule is input using a keyboard or a handwriting input pen according to a preset application. Then, if you take a different action at a later date, erase the previous description with an eraser, or operate according to the correction program,
Correct the description.

[0003]

However, the handwriting process for the system notebook and the input process for the electronic notebook are troublesome tasks. Further, when the description is corrected as described above, the work becomes more complicated. Further, if the recording is performed after a long time has passed after actually performing the action, the memory becomes ambiguous and the action record cannot be written accurately.

On the other hand, today's GPS (global positioning s)
It is in an environment where it is possible to easily obtain location information using technologies such as ystem). Especially, not only car navigation installed in automobiles today, but also portable navigation that can be carried and navigation installed in mobile phones. Proposed.

Therefore, the present invention has been made in view of the above problems, and provides an action recording device and an action recording program capable of acquiring an action record of oneself and automatically recording it together with position information and height information. It is a thing.

[0006]

According to the invention as set forth in claim 1, the above-mentioned problems can be solved by a judging means for judging the operating state based on the output data of the first sensor, and the output data of the second sensor. Position information acquisition means for acquiring position information based on the above-mentioned, and when it is determined that there is a change in the operating state determined by the determining means, a new operating state is determined by the determining means, and the new operation is performed. This can be achieved by providing an action recording device characterized by recording the state and the position information acquired by the position information acquisition means together with date and time information.

Here, for example, the first sensor is an acceleration sensor, and the second sensor is a sensor for acquiring position information such as GPS. The acceleration sensor detects acceleration in three directions of the X-axis direction, the Y-axis direction, and the Z-axis direction, and performs extraction processing of a new operation state when, for example, the acceleration in any one direction changes.

Therefore, with the above configuration, when the operating state of the user changes, the change is automatically detected, a new operating state is discriminated, and the position information and date / time information are stored together with, for example, a memory. It can be stored in the device and can automatically record its own behavior record.

Further, the change in the operating state can be detected when either the cycle or the amplitude of the output waveform of the discriminating means is changed, and the change in the operating state of the user can be surely detected, so that the change is more accurate. Action records can be obtained. Also, by adding an altitude sensor to the above action record,
More accurate position information can be obtained, and a more effective action record can be obtained.

Further, according to the invention described in claim 5, it is possible to record the action record in the schedule,
For example, when an action record different from the preset schedule is recorded, it can be checked and used as a reference for subsequent scheduling. Further, according to the invention described in claim 7, the above-mentioned problem is to perform a determination process of determining an operation state based on output data of the first sensor, and to obtain position information based on output data of the second sensor. When it is determined that there is a change in the position information acquisition process and the operation state determined by the determination process, a new operation state is determined, and the new operation state and the position information are stored together with date and time information. This can be achieved by providing a behavior recording program that is a program that performs a storage process and that can be processed by a computer.

With this configuration also, when the operating state of the user changes, the change is automatically detected, a new operating state is determined, and the position information and date / time information are stored together with, for example, a storage device or It can be stored in the schedule, and it becomes possible to obtain more excellent action record information.

[0012]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below in detail with reference to the drawings. <First Embodiment> FIG. 1 is a system configuration diagram of an action recording apparatus of the present invention.

In the figure, the action recording device of this example is a CP.
It comprises U1, ROM2, RAM3, input unit 4, display unit 5, external storage unit 6, acceleration sensor 7, GPS 8, altimeter 9, communication control unit 10, EEPROM 11, and direction sensor 12. The CPU 1 performs an operation state determination process, a position calculation process, an altitude calculation process, and the like, which will be described later, based on the program stored in the ROM 2.

The ROM 2 stores the above program and also a database (DB) of map information in advance.
Further, the EEPROM 11 constructs a database (DB) of operation patterns described later by the processing described below.
The RAM 3 is used as a work area, and the register 1
~ 3 are provided.

The input unit 4 is composed of a keyboard, a mouse, etc., and is used, for example, for inputting a motion name when registering a motion pattern of a user. Further, the display unit 5 displays the recorded action record, aggregated data, and the like. Also, the difference between the action schedule on the schedule and the actual action record is displayed.

The external storage unit 6 is composed of a hard disk or the like, and stores a user's action record. The acquisition and recording process of this action record will be described later. The acceleration sensor 7 is
The motion (action) of the user is detected from the accelerations in the X-axis direction, the Y-axis direction, and the Z-axis direction. The GPS 8 also receives radio waves from a predetermined number of satellites or more and outputs the received signals to the CPU 1.

Further, the azimuth sensor 12 has an azimuth as the X axis and a Y as the azimuth.
It is a sensor that can detect each of the components of the axis and the Z axis, and detects the moving direction of the user wearing the action recording device. The detection data of the direction sensor 12 and the acceleration sensor 7
It is possible to comprehend the trajectory of the user's action based on the detection data of, and it is possible to track the current position of the user when the user is at a point where the GPS 8 cannot receive radio waves. It will be possible.

Further, the altimeter 9 measures the atmospheric pressure, and the CPU
Output to 1. The CPU calculates height information from the altitude and atmospheric pressure information of the reference position acquired via the communication control unit 10, for example. In the above configuration, the processing of this example will be described below.

First, the operation pattern registration process will be described. Since this operation pattern is different for each user, this process is a process for extracting the characteristics of each operation pattern and registering them in the EEPROM 11 in advance to construct an operation pattern database. In addition, as the operation patterns to be registered, daily operations such as “ride a train”, “walk”, and “run” are registered.

FIG. 2 is a flow chart for explaining the operation pattern registration processing. First, the user performs an operation desired to be registered, and at this time, extracts the cycle and the acceleration (amplitude) from the waveform output by the acceleration sensor 7 (step (hereinafter referred to as S) 1). In this case, the user attaches the acceleration sensor 7 to a predetermined place (such as the waist) and performs an operation to register.

FIG. 3 is a graph showing the data output from the acceleration sensor 7 with the horizontal axis representing time and the vertical axis representing acceleration. As shown in the figure, the data output from the acceleration sensor 7 has, for example, a peak, the peak interval in the horizontal axis indicates a cycle, and the peak interval (amplitude) in the vertical axis.
Indicates acceleration. For example, in the example of the figure, the peak interval (cycle) of the peaks a1 and a2 in the horizontal axis direction is | t1-t2 |, and the peak interval (acceleration) in the vertical axis direction is | g1-g2 |. Similarly, the peak interval (cycle) of the peaks a2 and a3 in the horizontal axis direction is | t2-t3 |, and the peak interval (acceleration) in the vertical axis direction is | g2-g3 |.

The information on the cycle and the acceleration includes the characteristics of the motion of the user, and as described later, a motion pattern database is created by associating the motion name with the extracted information. 4A to 4C are views specifically showing the output state of the acceleration sensor 7, where FIG. 4A shows the output in the X-axis direction and FIG. 4B shows the output in the Y-axis direction. The output is shown, and FIG. 7C shows the output in the Z-axis direction. The above X
The azimuth sensor 12 is used for each azimuth in the axial direction, the Y-axis direction and the Z-axis direction
Specified by the output of.

Next, the data obtained by the above processing (S1) is transmitted to the CPU 1 to perform the peak point extraction processing (S2). In this peak point extraction processing, for example, the input X-axis direction data is serially received, and the points at which the input data (acceleration) changes from increase to decrease and the points at which the input data (acceleration) changes from decrease to increase are peaked. Extract as points.

Next, the peak interval (cycle) in the horizontal axis direction is calculated from the obtained peak point data (S3). For example, in the example shown in FIG. 4A, peak points from X1 to X6 are extracted and the peak intervals are | tx1-tx4 |, | tx4-tx2 |,
| Tx2-tx5 |, | tx5-tx3 |, | tx3-tx6 |, and the respective intervals are calculated.

Next, the peak interval (acceleration) in the vertical axis direction is calculated from the obtained peak point data (S4). For example, in the example shown in FIG. 4A, the peak intervals (acceleration) are | gx1-gx4 |, | gx4-gx2 |, | gx2-gx5 |, | gx5-gx3.
｜, ｜ gx3-gx6 ｜, and these peak intervals (acceleration)
Is calculated.

Next, the average value of the peak intervals in the horizontal axis direction and the peak intervals in the vertical axis direction (hereinafter, respectively indicated by period or acceleration) is obtained (S5). Here, the average value of the period is set to tx0, and the average value of the acceleration is set to gx0. Through the above processing, the cycle and acceleration in the X-axis direction are calculated, and it is further determined whether or not the cycle and acceleration in the Y-axis direction and Z-axis direction are calculated (S6). Then, similar processing is performed for the Y-axis direction and the Z-axis direction, and the cycle and acceleration are calculated (NO in S6, S2 to S6). Therefore, by the above processing, the cycle in the Y-axis direction is | ty1-ty4 |, | ty4-ty2 |, | ty2-ty5 |, | ty5 in the case of FIG.
-ty3 |, | ty3-ty6 |, and the average value ty0 of the cycles is calculated. Also, the acceleration is ｜ gy1-gy4 ｜, ｜ gy4-gy2 ｜, ｜
gy2-gy5 |, | gy5-gy3 |, | gy3-gy6 |, and similarly the average value gy0 of acceleration is calculated.

The cycle and acceleration in the Z-axis direction have no peak points in the example of FIG. 4C, and the cycle tz0 is zero. However, the acceleration gz0 is output as a DC component. The information obtained by the above processing is displayed on the display unit 5 (S7). FIG. 5 shows this display example, and the above calculation results are displayed in the X-axis direction, the Y-axis direction, and the Z-axis direction, respectively.

Next, the user inputs an action name. The operation name is input by operating the input unit 4 and inputting an operation name of "get on a train", for example, as shown in the figure (S8).
Next, the user checks the "register" button 4a to register the above data in the EEPROM 11. "Back"
It is also possible to return to the previous processing by checking the button 4b of.

FIG. 6A shows an example in which the above-mentioned operation pattern registration processing is repeated to register operation patterns such as "walking", "running", and "riding a train". Further, FIG. 6B is a numerical example of the above operation pattern. Next, the user actually equips the acceleration sensor 7, the GPS 8, and the altimeter 9 with the database constructed by the above processing, and records the action.

First, a change in acceleration in the acceleration sensor 7 is detected. This process is a detection process which is a starting point when the process specifically moves to the action recording process, and is processed according to the flowchart shown in FIG. 7. First, the acceleration in the X-axis direction is measured (step (hereinafter referred to as ST) 1). Then, the peak points are extracted in the same manner as described above (ST2), and it is determined whether there is a change in the cycle (peak interval in the horizontal axis direction) (ST3). This judgment is made, for example, in register 1 of RAM3.
Then, the data of the cycle of the immediately preceding operation is stored and compared with the data of the cycle newly sent from the acceleration sensor 7 to determine whether it is within a preset threshold range.

If there is a change in the cycle, it is determined that the user's action has changed, and the process proceeds to the action recording process (YES in ST3, ST4). On the other hand, when there is no change in the cycle (even if there is a change, it is within the range of the threshold value), it is determined whether there is a change in the next peak interval (acceleration in the vertical axis direction) (NO in ST3, ST5). ).

If there is a change in acceleration, it is determined that the user's motion has changed in this case as well, and the process proceeds to the action recording process (YES in ST5, ST4). On the other hand, if there is no change in the acceleration, the process moves to the next acceleration measurement in the Y-axis direction (ST6). A peak point is detected also in the Y-axis direction (ST7), and if there is a change in the cycle, it is determined that the user's action has changed and the process moves to the action recording process (S).
If T8 is YES, ST4), if there is no change in the cycle, it is determined whether or not there is a change in acceleration, and if there is a change in acceleration, the action recording process starts (YES in ST9, ST4).

Further, the same processing is performed in the Z-axis direction (ST10 to ST12), and when there is a change in the cycle,
Alternatively, when there is a change in acceleration, the process proceeds to action recording processing (YES in ST11 or YES in ST12). If there is no change in the cycle and acceleration in the X-axis direction to the Z-axis direction, it is determined that the user's action is the same as the previous action,
The process ends (NO in ST12, ST13).

When the operation of the user is changed by the above process, the change is surely detected by the acceleration sensor 7, and the process proceeds to the action recording process. FIG. 8 is a flowchart illustrating the action recording process performed when it is determined that the operation pattern has changed by the above process. This action recording process is a process of detecting and recording what the new action performed by the user is, where the new action is performed, and at what height the new action is performed. . Therefore, first, the operation state determination process is performed (step (hereinafter referred to as STP) 1), the position detection process is performed (STP2), and the altitude detection process is further performed (STP).
3). The details will be described below.

FIG. 9 is a flow chart for explaining the operation state discrimination processing. First, when it is determined that the operation pattern of the user has changed due to the above-described processing, the acceleration sensor 7
Extracts the acceleration in each coordinate axis direction (STP1-1).
Next, a peak point is extracted for one coordinate, for example, the X-axis direction (STP1-2). This peak point extraction processing is similar to the above-mentioned processing, and the cycle is calculated from the detected peak point data (STP1-3). In addition, the acceleration is calculated from the data of the detected peak point (STP1-
4). Then, each average value is calculated (STP1-
5) Perform the same processing for the other axial directions (STP)
1-6 is NO, STP1-2 to STP1-6).

The result obtained as described above is stored in, for example, the register of the RAM 3, and the operation pattern similar to the data is retrieved from the EEPROM 11 (STP).
1-7). In this case, the database of operation patterns registered as described above is searched for a matching operation pattern.

Next, when a matching operation pattern is detected by the above search processing (YES in STP1-8), the registration data of the operation pattern is updated (STP).
1-9). In this case, the operation name is read and the RAM3
(STP1-10). After that, the date and time are corrected and the database is updated (STP1
-11). That is, by constantly registering the updated motion pattern, the information in which the transition of the motion of the user is added is registered.

The correction in step STP1-11 is shown in FIG.
In consideration of the time required to acquire the current date and time in step STP1-11 after the change in acceleration is detected in the step of the flowchart of FIG. 1, the time required for the acquisition is subtracted from the acquired current date and time.

On the other hand, if there is no matching operation pattern by the above search processing (NO in STP1-8), it is determined whether or not the operation pattern obtained by this processing is newly registered (STP1-12). Here, if a new operation pattern is not registered, the process ends (STP1
-12 is NO). On the other hand, when registering a new operation pattern (YES in STP1-12), the operation pattern registration process is executed (STP1-13). In this registration process, after performing each step in FIG. 2, enter the action name,
The entered action name is temporarily stored (STP1-14), the date and time is entered and recorded in the database (STP1-1).
1).

As described above, the new motion name of the user is known from the motion pattern information by the motion state determination process, and is saved as the current motion of the user. next,
User position detection processing is performed (STP shown in FIG. 8).
2). FIG. 10 is a flowchart specifically explaining this position detection processing. First, the position data detected by the GPS 8 is transmitted to the CPU 1. The CPU 1 performs positioning calculation processing from the transmitted position data to calculate latitude and longitude (STP2-1).

Next, the map database is searched from the calculated latitude and longitude data (STP2-2). Names corresponding to latitude and longitude are registered in this map database, and the position on the map is specified to extract the name of the point position (STP2-3). Then, the name is temporarily stored in the register of the RAM 3 (STP2-
4).

Next, altitude detection processing is performed (S shown in FIG. 8).
TP3). FIG. 11 is a flowchart specifically explaining the altitude detection process. In the figure, first, the atmospheric pressure is measured by the altimeter 9 (STP3-1). Next, read the reference altitude and atmospheric pressure data (STP3-2),
The altitude is calculated from the measured atmospheric pressure data and the reference altitude and atmospheric pressure data (STP3-3). In this way, the calculated altitude data is stored in the register of the RAM 3 (STP3-4).

As described above, the contents of the new operation performed by the user, the place, and the altitude are known by the operation state determination process (STP1), the position detection process (STP2), and the altitude detection process (STP3). It is registered in the above register. Next, date and time data is added to each of the above data and recorded in the database of the external storage unit 6 (STP4). The data recorded in this manner increases sequentially with time, and is recorded each time the user's operation changes. 12
Indicates a part of the data sequentially registered in this manner, and the operation pattern, position information including location and latitude and longitude, and height information are sequentially registered according to the date and time data. For example, it is recorded that the stairs of XX station (latitude 35 degrees XX minutes, mild 136 degrees XX minutes) were climbed at 8:10 on March 7, 2002.

The same station at 8:12 on March 7, 2002 (latitude 35 degrees xx minutes, longitude 136 degrees xx minutes)
It is recorded that the user was “walking” at a position where the height data was 10 m. The procedure is as shown in FIG. After that, it is determined whether the current time is midnight (STP
5). Then, if the current time is not midnight, the process ends (NO in STP5). On the other hand, if the current time is midnight (YES in STP5), the database in which the action record is stored is totaled (ST6). FIG. 13 is a diagram showing a result of tabulation of the action records, which is a tabulation of user's daily action records.

On the other hand, FIG. 14 is a flow chart for explaining the process of displaying the action record registered in the database on the display unit 5. First, the desired action record information is read from the database (STP7). Next, from the "Place" and "Height" items, select "Where (in the drawing," Where "
Is added after the question mark mark, but it is omitted in the description) ”(ST
P8). For example, if the "place" is the above-mentioned station,
The station information is read from the database, and it is known that the position 3 m high is the platform. Also, it is known that the position of 10 m in height is the ticket gate. Therefore, the specific “where” position information is known from the “place” and “height” information, and the position of the XX station is specified.

Next, it is judged whether or not there is other data to be displayed (STP9). If there is other data to display (STP
9 is YES), and the above processing is further repeated to create specific “where” position information (STP7 to STP9). Next, the contents created by the above processing are displayed (STP
10). FIG. 15 is a display example of the action record. When,
Where and what you were doing is displayed over time. Also, by operating the scroll buttons,
You can move the display up and down to view all activity records.

Next, it is judged whether the item "where" is designated (STP11), and if the item "where" is not designated, the process is terminated (NO in STP11). on the other hand,
If the "where" item is specified (STP11 is Y
ES), and extract the information of the specified latitude and longitude (ST
P12), and read the map data (STP13). Then, the corresponding map is displayed (STP14), and the target is identified and displayed (STP15).

By processing as described above, it is possible to automatically record one's own action record, and to omit the complicated operation of handwriting in the system notebook or data input in the electronic notebook as in the conventional case. You can Further, by displaying the own action record recorded in the database, it is possible to refer to the own action later and use it for the efficiency of the action and the creation of an efficient schedule.

According to the above description of the embodiment, the period and the acceleration are calculated after detecting the acceleration in each coordinate axis direction, but more efficient processing can be performed by using the Fourier transform. FIG. 16 is a system configuration diagram thereof, and FIG. 17 is a flow chart for explaining the processing. 16 has basically the same configuration as that of FIG. 1 described above, but differs in that Fourier transform processing is performed. Therefore, in FIG. 16, the same numbers as in FIG. 1 are attached.

First, similarly to the above, the acceleration of each coordinate axis detected by the acceleration sensor 7 is extracted (step (hereinafter, W) 1). FIG. 18A shows data obtained by the above extraction processing, and Fourier transform processing is performed on this waveform data (W2). FIG. 18B shows waveform data obtained by the Fourier transform processing.

Next, the peak frequency and acceleration are extracted from the waveform data shown in FIG. 7B (W3). And
Similarly to the above, in the Y-axis direction and the Z-axis direction, the Fourier transform process (W4 is NO, W2) and the peak frequency and acceleration extraction process are similarly performed (W3). Then, the operation pattern obtained by the above processing is registered in the database (W5). Note that the following processing is the same as that in FIG. 2 described above, and the behavior recording processing is performed after the user's operation pattern is registered in the database.

By performing the above processing, it is possible to automatically record one's own action record, and it is possible to perform the operation pattern registration process more efficiently. <Second Embodiment> Next, a second embodiment of the present invention will be described.

In this example, when the action recording process is performed by using the action pattern registered in the database, the extracted action is compared with the action described in the schedule. The details will be described below. FIG. 19 is a flowchart illustrating the processing of this example. First, similar to the flowchart of FIG. 8 described in the above-described first embodiment, what is the action performed by the user, where the action was performed, and at what height the action was performed. To detect. These processes are the same as those described above, the operation state determination process (step (hereinafter referred to as V) 1) is executed according to the flowchart in FIG. 9 described above, and the position detection process (V2) is performed in FIG.
Is executed according to the process shown in FIG.
3) is executed according to the processing shown in FIG. Therefore, when the above processes are completed, the corresponding operation pattern, place information, and height information are recorded in the database.

In this state, a preset schedule database is read (V4). Then, the operation pattern corresponding to the date and time of the schedule, the position information, and the height information are stored in the RAM 3, for example (V5). Next, the record content of the schedule is compared with the actual action record (V6). FIG. 20 is a flowchart specifically explaining this process.
First, one file is extracted from the action schedule (V6-1),
Further, one file is extracted from the action record in association with time (V6-2).

Next, the two extracted files are compared to determine whether the locations match (V6-3). Here, if the locations do not match (NO in V6-3), a flag is set in the result area of the file (V6-4). On the other hand, if the locations match (V6-3 is YES), it is further determined that the actions match (V6-5), and if the actions do not match (V6-5).
Is NO), a flag is set in the result area of the file (V6-4).

If the location and the operation are the same, the process shifts to the presence / absence determination of another file without setting a flag (V6-6). Therefore, subsequently, files are sequentially extracted, and it is determined whether the locations match or the operations match. FIG. 21 is a diagram showing a state in which a flag is set in the result area of the schedule by the above processing. "1" set in the result area shown in the figure indicates the setting of the flag, and indicates that the action schedule and the action record do not match.

FIG. 22 is a flow chart for explaining the notification process when the flag is set. First, the schedule table file is read from the database and it is determined whether there is a flag (V9, V10). Here, when the flag is not set, the notification process ends, but when the flag is set (V10 is YES), the action schedule and action record of the flagged file are notified (V11). .

For example, referring to the example of FIG. 21, 200
From 14:00 to 14:30 on March 7, 2nd,
The flag "1" is set in the result area. Therefore, in this case, the content of the action schedule “meeting, in-house reception” and the content of the action record “14:07 Walk, XX Co., Ltd.” are displayed to show that there is a difference between the action schedule and the actual action. .

Similarly, since the flag "1" is set in the result area from 14:30 to 15:00 on the same day, the content of the action schedule "meeting, in-house reception" and the action record "14: 23 stairs, 14:27 board the train,
The content of "JR Ozaku Station ticket gate" is displayed to show that there is a difference between the action schedule and the actual action. The procedure is as shown in FIG.

Therefore, when the action recorded in advance on the schedule is different from the action actually performed, the user is automatically notified, the cause of the difference between the schedule and the actual action is investigated, and the more efficient schedule thereafter. Can be applied to the setting of. In the above, the time to notify the user can be set arbitrarily.

Further, in the above description of the embodiment, the position detection is performed by using the GPS8, but the position detection is performed by a mobile phone or a PHS (peer).
The location information may be acquired using a rsonal handy phone system). Further, the acceleration sensor 7 shown in FIG. 1 described above is composed of, for example, a strain gauge or a piezoelectric element, and is attached to, for example, a belt. Further, in the above-mentioned configuration, the operation state of the user is detected by the cycle and the acceleration. For example, the frequency of walking is known from the cycle, and the stride is known from acceleration. Therefore, it is possible to judge from the above result whether it is a "walking" motion, a "running" motion, or a "stair climbing" motion. However, the configuration is not necessarily limited to the above-described configuration, and the output of the acceleration sensor 7 may be spectrum-analyzed to obtain more detailed information, which may be used as a material for operation determination.

Further, the motion discrimination is not limited to the use of the acceleration sensor 7, but, for example, in order to know the state of desk work in more detail, various sensors such as a piezoelectric element and a magnetic sensor are attached to the arm or hand, and the sensor is used. It may be configured to add the information and determine the operating state.

Further, in the above-mentioned state determination, it is possible to perform Bluetooth communication between the sensors to acquire a detailed operation state such as “operate a personal computer” or “read a book”. . Further, the altimeter 9 measures the atmospheric pressure in order to obtain the altitude information by the arithmetic processing for the altitude of the position and the atmospheric pressure. Therefore,
The altitude and atmospheric pressure information of the reference position may be acquired from the server via a network such as the Internet.

Further, the above-mentioned reference altitude and atmospheric pressure information may be registered in the ROM 2 and the measured atmospheric pressure information may be used to calculate the altitude of the current position. Furthermore, the information of the altimeter equipped on the wristwatch or the like may be directly obtained using Bluetooth. The map information database stored in the ROM 2 does not necessarily have to be registered in the ROM 2, but may be registered in the external storage unit 6, for example, and is supplied from the content distribution company that distributes the map information via the communication control unit 10. It may be configured to receive.

[0065]

As described above, according to the present invention,
The actions taken by the user and the places visited by the user can be automatically recorded, and there is no need to perform complicated recording work as in the past. Also, every time there is a change in the behavior of the user, it is possible to confirm the behavior of the user later, for example, by comparing it with the behavior actually performed by the user in correspondence with the preset schedule. , You can check whether you have actually performed as planned.

Further, if there is a difference from the above confirmation result, the cause can be investigated and used for improving the work efficiency, for example.

[Brief description of drawings]

FIG. 1 is a system diagram of an action recording device of the present invention.

FIG. 2 is a flowchart illustrating an operation pattern registration process.

FIG. 3 is an example of waveform data obtained by extracting acceleration.

4A is a diagram showing an output waveform of the acceleration sensor in the X-axis direction, FIG. 4B is a diagram showing an output waveform of the acceleration sensor in the Y-axis direction, and FIG. It is a figure which shows the output waveform of an acceleration sensor.

FIG. 5 is a diagram showing an example of registration of operation patterns.

FIG. 6A is a diagram showing an example of registration of an operation pattern, and FIG. 6B is a diagram showing specific numerical values of the operation pattern.

FIG. 7 is a flowchart for extracting a change in acceleration.

FIG. 8 is a flowchart illustrating an action recording process.

FIG. 9 is a flowchart illustrating an operation state determination process.

FIG. 10 is a flowchart illustrating position detection processing.

FIG. 11 is a flowchart illustrating an altitude detection process.

FIG. 12 is a diagram showing a part of an action record that is sequentially registered.

FIG. 13 is a diagram showing a result of tabulation of action record information.

FIG. 14 is a flowchart illustrating display of an action record.

FIG. 15 is a diagram showing a display example of an action record.

FIG. 16 is a system diagram illustrating a modified example of the first embodiment.

FIG. 17 is a flowchart illustrating a modified example of the first embodiment.

FIG. 18 (a) is a waveform diagram before Fourier transform,
(B) It is a waveform diagram after Fourier transform.

FIG. 19 is a flowchart illustrating an action recording process.

FIG. 20 is a flowchart illustrating a process of comparing an action record with scheduled contents.

FIG. 21 is an example of a schedule table for explaining flag setting processing.

FIG. 22 is a flowchart illustrating a notification process when a flag is set.

[Explanation of symbols]

1 CPU 2 ROM 3 RAM 4 Input section 4a Registration button 4b Back button 5 Display 6 External storage 7 Accelerometer 8 GPS 9 Altimeter 10 Communication control unit 11 EEPROM 12 Direction sensor

Claims (7)

[Claims] 1. A discriminating unit that discriminates an operating state based on output data of a first sensor, and a positional information acquiring unit that acquires positional information based on output data of a second sensor. When it is determined that there is a change in the operating state determined by the means, a new operating state is determined by the determining means, and the new operating state and the position information acquired by the position information acquiring means are stored together with date and time information. An action recording device characterized by recording. 2. A height information acquisition means for acquiring height information based on output data of a third sensor, further comprising: when it is determined that there is a change in the operating state determined by the determination means, The action recording device according to claim 1, wherein the action information recording device further records the height information acquired by the height information acquisition means to the different operating state, the position information, and the date and time information. 3. The discriminating means performs discriminating processing based on waveform data detected by an acceleration sensor, and the operation state is changed by changing either a cycle or an amplitude between peak positions of the waveform data. The action recording device according to claim 1, wherein the action recording device detects the action. 4. Information on a cycle and amplitude corresponding to a basic operation state is registered in advance, and the operation state is determined by comparing the information on the cycle and the amplitude detected by the acceleration sensor. The action recording apparatus according to claim 3, wherein the registered cycle and amplitude information is updated after determining the operation state. 5. The action recording device according to claim 1, wherein the operation state and the position information are recorded together with date and time information in a schedule table in which an action schedule is recorded in advance. 6. The information of the operating state or place is compared with the information of the operating state or place previously recorded in the schedule, and if at least one of them is different, the fact is notified. The action recording device according to claim 5. 7. A determination process for determining an operating state based on output data of a first sensor, a position information acquisition process for obtaining position information based on output data of a second sensor, and a determination process by the determination process. A program for performing a recording process of determining a new operating state and recording the new operating state and the position information together with date and time information when it is determined that the operating state has changed. Action recording program that can be processed by.