JP2013140233A - Terminal device, display control program and display control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device, a display control program and a display control method which can easily specify a display location of an image which shows an operated application.SOLUTION: A terminal device 100 comprises an information acquisition unit 145 which acquires a first operation time and date when an application is operated and a first operation location at the first operation time and date in association with each other, acquires a second operation time and date and a second operation location at the second operation time and date in association with each other, and a third operation time and date whose corresponding operation location is unknown. The terminal device 100 also comprises a location estimation unit 155 which estimates the unknown operation location so that a difference between a ratio of a distance between the unknown operation location and the first operation location to a distance between the unknown operation location and the second operation location, and a ration of a time difference between the third operation time and date and the first operation time and data to a time difference between the third operation time and date and the second operation time and date is included within a prescribed range.

Description

  The present invention relates to a terminal device, a display control program, and a display control method.

  Patent Document 1 discloses a display processing device that displays a photographed image at a position on a map corresponding to a photographing position. This display processing device has a function of displaying a photographed image associated with a photographing position on a photographing position on a map, and displaying a photographed image not associated with a photographing position at a drop position on the map. .

JP 2007-323543 A

The display processing device disclosed in Patent Document 1 automatically displays an image associated with a shooting position at a corresponding position on a map. However, when displaying an image that is not associated with a shooting position on a map, the user needs to perform a drop operation individually. For this reason, when the number of images that are not associated with shooting positions increases, the number of drop operations increases, which is cumbersome and has low operability.
The same problem occurs not only when an image is captured, but also when an image indicating an operated application is displayed at a generation position or a planned position on a map and the operation position is not added to the image.

The present invention has been made in view of the above points, and an object of the present invention is to provide a terminal device, a display control program, and display control that can more easily specify the display position of an image representing an operated application. It is to provide a method.
The present invention also provides a terminal device and a display control program capable of specifying an approximate operation position with a simple operation and displaying an image representing the operated application on a map even when the exact operation position of the application cannot be specified. Another object is to provide a display control method.

The terminal device according to the first aspect of the present invention provides:
The first operation date / time when the application was operated and the first operation position where the application was operated at the first operation date / time were acquired in association with each other, and the second operation date / time when the application was operated And the second operation position at which the application was operated at the second operation date / time, and the operation date / time at which the application was operated, and the operation of the application at the operation date / time. Information acquisition means for acquiring a third operation date and time whose position is unknown;
The ratio of the distance between the unknown operation position and the first operation position and the distance between the unknown operation position and the second operation position, the third operation date and time, and the first operation Position estimation means for estimating the unknown operation position so that a difference between a time difference from a date and time and a ratio between a time difference between the third operation date and time and the second operation date and time is included in a predetermined range. When,
Display means for displaying the estimated position estimated by the position estimating means and the application image indicating that the application has been operated in association with each other;
It is characterized by that.

In the terminal device according to the first aspect,
Operation accepting means for accepting a user operation;
Information storage means for storing the third operation date and time,
The information storage means does not store the first operation date in association with the first operation position, and also stores the second operation date in association with the second operation position. If not, the information acquisition means associates the first operation date and time designated by the first operation accepted by the operation acceptance means with the first operation position designated by the first operation. The second operation date and time specified by the second operation received by the operation receiving means and the second operation position specified by the second operation are acquired in association with each other, and the information storage Obtaining the third operation date and time from the means;
It is also good.

In the terminal device according to the first aspect,
Operation accepting means for accepting a user operation;
Information storage means for storing the third operation date and time,
The information storage means does not store the second operation date in association with the second operation position, but stores the first operation date in association with the first operation position. In this case, the information acquisition unit acquires the first operation date and time and the first operation position in association with each other from the information storage unit, and is designated by the second operation received by the operation reception unit. Obtaining the second operation date and time and the second operation position designated by the operation in association with each other, and obtaining the third operation date and time from the information storage means;
It is also good.

In the terminal device according to the first aspect,
The position estimation means estimates a position within a predetermined distance from a straight line connecting the first operation position and the second operation position acquired by the information acquisition means as the unknown operation position;
It is also good.

In the terminal device according to the first aspect,
Route estimation means for estimating a movement route on a map from the first operation position acquired by the information acquisition means to the second operation position;
The position estimating means estimates a position within a predetermined distance from the movement route as the unknown operation position;
It is also good.

In the terminal device according to the first aspect,
The display means displays the third operation date and time acquired by the information acquisition means in association with the application image in a date and time display area for displaying the operation date and time of the application, and posts the operation position of the application. In the map display area for displaying the map, the position on the map display area corresponding to the first operation position acquired by the information acquisition unit and the map display area corresponding to the second operation position are displayed. Display the app image at the position,
It is also good.

In the terminal device according to the first aspect,
The display means displays the application image associated with the first operation position in a predetermined manner, and displays the application image associated with the estimated position in a manner different from the predetermined manner.
It is also good.

A display control program according to the second aspect of the present invention is:
Computer
The first operation date / time when the application was operated and the first operation position where the application was operated at the first operation date / time were acquired in association with each other, and the second operation date / time when the application was operated And the second operation position at which the application was operated at the second operation date / time, and the operation date / time at which the application was operated, and the operation of the application at the operation date / time. Information acquisition means for acquiring a third operation date and time whose position is unknown;
The ratio of the distance between the unknown operation position and the first operation position and the distance between the unknown operation position and the second operation position, the third operation date and time, and the first operation Position estimation means for estimating the unknown operation position so that a difference between a time difference from a date and time and a ratio between a time difference between the third operation date and time and the second operation date and time is included in a predetermined range. ,
Causing the estimated position estimated by the position estimating means to function as a display control means for controlling the display means to display the application image indicating that the application has been operated in association with each other;
It is characterized by that.

A display control method according to the third aspect of the present invention is as follows.
The first operation date / time when the application was operated and the first operation position where the application was operated at the first operation date / time were acquired in association with each other, and the second operation date / time when the application was operated And the second operation position at which the application was operated at the second operation date / time, and the operation date / time at which the application was operated, and the operation of the application at the operation date / time. An information acquisition step of acquiring a third operation date and time whose position is unknown;
The ratio of the distance between the unknown operation position and the first operation position and the distance between the unknown operation position and the second operation position, the third operation date and time, and the first operation A position estimation step of estimating the unknown operation position so that a difference between a time difference from a date and time and a ratio between a time difference between the third operation date and time and the second operation date and time is included in a predetermined range. When,
A display control step of controlling the display means to display the estimated position estimated in the position estimating step and the application image indicating that the application has been operated in association with each other,
It is characterized by that.

  According to the terminal device, the display control program, and the display control method of the present invention, the display position of the image representing the operated application can be identified more easily.

(A) is a front view of the terminal device which concerns on embodiment of this invention, (b) is the back view. 2 is a hardware configuration diagram represented by a terminal device according to Embodiment 1. FIG. It is a figure showing an example of the application table which a terminal device memorize | stores. It is a figure showing an example of the address table which a terminal device memorizes. (A) is a figure showing an example of the operation condition table which a terminal device memorize | stores in Embodiment 1. FIG. (B) is a figure showing an example of the operation condition table which a terminal device memorize | stores in the modification 1 of Embodiment 1. FIG. (C) is a figure showing an example of the operation condition table which a terminal device memorize | stores in the modification 2 of Embodiment 1. FIG. It is a figure showing an example of the map image table which a terminal device memorizes. (A) is a figure showing an example of the icon table which a terminal device memorize | stores in Embodiment 1. FIG. (B) is a figure showing an example of the icon table which a terminal device memorize | stores in the modification 2 of Embodiment 1. FIG. 3 is a functional block diagram of a terminal device according to Embodiment 1. FIG. It is a flowchart showing an example of the log storage process which a terminal device performs. It is a figure showing an example of operation which a terminal unit received. 4 is a flowchart illustrating an example of an initial display control process executed by the terminal device in the first embodiment. (A) is a figure showing an example of the map display area which a terminal device displays, and an example of a date display area. FIG. 12B is an enlarged view of the date / time display area shown in FIG. (A) is a figure showing an example of the map display area displayed when designating an operation position, and an example of a date display area. (B) is a figure showing an example of the map display area displayed when an operation position is estimated. 5 is a flowchart illustrating an example of an estimated operation position display control process executed by the terminal device in the first embodiment. It is a figure showing the other example of the map display area displayed when an operation position is estimated. (A) is a figure showing the other example of a date display area. (B) is a figure showing an example of the map display area displayed when two positions are designated by the user. It is a flowchart showing an example of the presumed operation position display control process which a terminal device performs when two positions are designated by the user. (A) is a figure showing other examples of a map display field which a terminal unit displays, when two positions are specified by a user. (B) is a figure showing an example of the map display area which a terminal device displays in Embodiment 2. FIG. 10 is a flowchart illustrating an example of an estimated operation position display control process executed by the terminal device in the second embodiment. It is a functional block diagram showing an example of the function which the terminal device concerning Embodiment 2 has. It is a figure showing an example of the time-sequential display area which a terminal device displays in Embodiment 3. 14 is a flowchart illustrating an example of an initial display control process executed by a terminal device in the third embodiment. 10 is a flowchart illustrating an example of an estimated operation position display control process executed by a terminal device in the third embodiment. It is a figure showing an example of the time-sequential display area displayed when an operation position is estimated.

  Hereinafter, a terminal device 100 according to an embodiment of the present invention will be described with reference to the accompanying drawings.

<Embodiment 1>
The terminal device 100 according to the embodiment of the present invention includes a so-called mobile phone, a smartphone, and the like, has a function of executing various applications, stores an execution position of each application, and displays an icon representing the application as an application. It has a function to display at a position on the map corresponding to the operation position.

  On the front surface of the terminal device 100, as shown in FIG. 1A, an operation button 111, a touch panel 114, a microphone 115, and a speaker 116 for operating the power ON / OFF are arranged. A digital camera 105 is disposed on the back surface of the terminal device 100 as shown in FIG.

The operation button 111 is an operation button for switching power on / off. The touch panel 114 includes an LCD (Liquid Crystal Display) and a digitizer (position input device) arranged on the display surface of the LCD, and displays an arbitrary image and outputs a signal indicating the touched position. The microphone 115 converts input sound into an electrical signal. The speaker 116 outputs sound.
The digital camera 105 is composed of a CMOS camera or the like, and takes a still image or an operation.

  Further, as shown in FIG. 2, the terminal device 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, and a recording unit connected to each other via a bus 119. 104, the digital camera 105, the signal processing circuit 107, the GPS (Global Positioning System) circuit 109, the input control circuit 110, the LCD controller 114a, the touch panel 114, the microphone 115, the speaker 116, and the internal clock 117 are arranged. .

  The CPU 101 performs overall control of the terminal device 100 by executing a program stored in the ROM 102 or the recording unit 104. The RAM 103 functions as a work memory for the CPU 101, and stores data to be processed and data to be processed when the CPU 101 executes the program.

  The recording unit 104 includes a flash memory device, a hard disk device, or the like that cannot directly read / write contents from the CPU 101, and stores various applications executed by the CPU 101 and various tables referred to when the CPU 101 executes the applications. According to the control, various data are recorded in the various tables. The table configuration will be described later. The recording unit 104 may be installed inside the terminal device 100 or may be installed outside.

  The digital camera 105 captures an image according to the control of the CPU 101.

  The signal processing circuit 107 is connected to the antenna 106. The signal processing circuit 107 receives radio broadcast waves, television broadcast waves, or radio waves from a base station via the antenna 106, demodulates the received radio waves, and outputs a baseband signal to the CPU 101.

  Further, the signal processing circuit 107 performs various signal processing such as modulation processing on the audio signal output from the microphone 115 under the control of the CPU 101, and then outputs it as radio waves via the antenna 106.

  The GPS circuit 109 receives a GPS signal from a GPS satellite via the GPS antenna 108, and obtains the latitude and longitude of the current position of the terminal device 100 based on the received GPS signal. The GPS circuit 109 may not be able to measure latitude and longitude due to deterioration of the GPS signal reception status, power supply drop, and the like.

The input control circuit 110 outputs an electrical signal representing the operation performed on the operation button 111 to the CPU 101.
The LCD controller 114a outputs a drive signal (for example, an image signal and a scanning signal) to the LCD 114b in order to display an image instructed by the CPU 101 on the LCD 114b.
The digitizer 114c is stacked on the display screen of the LCD 114b, detects a user's touch operation, and outputs a signal indicating the operation position to the CPU 101. A touch panel 114 is formed by the LCD 114b and the digitizer 114c.
The internal clock 117 measures the current date and time.

Next, various tables stored in the recording unit 104 will be described with reference to FIGS.
First, as shown in FIG. 3, the recording unit 104 stores an application in which a plurality of records in which information (hereinafter referred to as application ID) for identifying an application installed in the terminal device 100 is associated with an application name are stored. Remember the table.

  Further, the recording unit 104 stores an address table as shown in FIG. The address table stores a plurality of records in which latitude and longitude are associated with an address at a position specified by the latitude and longitude. The address table is used when the latitude / longitude acquired by the GPS circuit 109 is converted into an address.

  The recording unit 104 stores an operation status table as shown in FIG. 5A in order to store the operation status of the application. This operation status table corresponds to a kind of log of application operations, and records a record in which an application ID, an application operation date and time, and an operation position specified by a combination of latitude and longitude or an address are associated with each other. Store multiple items. In addition, when the operation position at a certain operation date / time is unknown, the record storing the operation date / time includes a “null” character indicating that the latitude and longitude indicating the operation position and the address are unknown, an application ID, The application operation date and time are stored in association with each other.

  Further, the recording unit 104 stores a map image table as shown in FIG. 6 in order to specify a map on which the operation position of the application is posted. This map image table includes a path of an image representing a map (hereinafter referred to as a map image), and a minimum latitude (hereinafter referred to as a minimum latitude) and a minimum of the longitude and latitude of the position posted on the map image. A plurality of records in which the longitude (hereinafter referred to as the minimum longitude), the maximum latitude (hereinafter referred to as the maximum latitude), and the maximum longitude (hereinafter referred to as the maximum longitude) are associated with each other are stored. In other words, taking the first record of the map image table as an example, the lowest left point of the map image stored in the path “./map01.jpg” is the latitude “141 degrees 00 minutes 00 seconds”, longitude “43 The point at the top right of the map is the latitude “141 degrees 01 minutes 00 seconds” and the longitude “43 degrees 01 minutes 00 seconds”. That is, the latitude of the map is “141 degrees 00 minutes 00 seconds” or more and “141 degrees 01 minutes 00 seconds” or less, and the longitude is “43 degrees 00 minutes 00 seconds” or more and “43 degrees 01 minutes 00 seconds” or less. All the positions that are are posted.

  Furthermore, the recording unit 104 stores an icon table as shown in FIG. 7A in which file paths of icons to be displayed at positions on the map corresponding to application operation positions are stored. This icon table stores a plurality of records in which a path to a detected position image, a path of a designated position image, a path of an estimated position image, and a path of an unacquired image are associated with each application. .

  Here, the detection position image is an image representing an icon of the application, and corresponds to the operation position of the application (hereinafter referred to as a detection operation position) in which the position where the image is displayed is detected by the position detection unit 135. It is an image showing that it is a position on a map image.

  The designated position image is an image representing an application icon, and the position on the map image corresponding to the operation position of the application (hereinafter referred to as the designated operation position) where the position where the image is displayed is designated by the user. It is an image showing that.

  The estimated position image is an image representing an icon of the application, and the position where the image is displayed is estimated based on the designated operation position and the detected operation position (hereinafter, the estimated operation position). It is an image showing that it is the position on the map image corresponding to.

  The position unacquired image is an image representing an icon of the application, and the operation position at the operation date and time of the application displayed in association with the image is not detected, is not specified, and is estimated. It is an image showing that it is not.

  When the terminal device 100 is turned on, the CPU 101 functions as the application execution unit 125, the operation date / time detection unit 130, the operation position detection unit 135, and the log storage unit 140 illustrated in FIG. In addition, the touch panel 114 illustrated in FIG. 2 functions as the operation reception unit 141.

  The application execution unit 125 executes the application stored in the information storage unit 120. The operation date and time detection unit 130 acquires the operation date and time when the application is operated from the internal clock 117 shown in FIG. When the GPS circuit 109 shown in FIG. 2 outputs information indicating latitude and longitude, the operation position detection unit 135 detects an operation position expressed by latitude and longitude expressed by the output information. On the other hand, the operation position detection unit 135 does not detect the operation position when the GPS circuit 109 does not output information indicating latitude and longitude.

  When the operation position detection unit 135 detects the operation position, the log storage unit 140 associates the application ID of the application, the operation date and time, and the operation position to the operation status table as illustrated in FIG. Store. On the other hand, when the operation position detection unit 135 does not detect the operation position, the log storage unit 140 stores the application ID of the application and the operation date and time in association with each other in the operation status table.

Next, the operation of the terminal device 100 having the above hardware configuration and functional configuration will be described with reference to the flowchart in FIG.
Here, in order to facilitate understanding, a process when the terminal device 100 accepts the operation illustrated in FIG. 10 at a timing illustrated will be described.

  First, as illustrated in FIG. 10, when the user performs an operation to turn on the power on the operation button 111 at the date “2011/01/01 08:50”, the log storage unit 140 performs the input control illustrated in FIG. 2. A signal representing the operation is acquired from the circuit 110. Next, the log storage unit 140 starts execution of the log storage process shown in FIG.

  The log storage unit 140 sleeps until the application execution unit 125 outputs event data representing an event that occurs in response to a user operation during execution of the application.

  Next, as shown in FIG. 10, at the position of latitude “141 degrees 00 minutes 00 seconds” and longitude “43 degrees 00 minutes 00 seconds”, the user receives a radio at the date “2011/01/01 09:00”. Suppose that an operation for selecting an application (hereinafter referred to as a radio reception application) used for reception of the radio and an operation for instructing execution of the radio reception application are performed on the operation reception unit 141.

  At this time, the application execution unit 125 illustrated in FIG. 8 detects these operations based on the signal output from the touch panel 114 functioning as the operation reception unit 141 and the screen displayed on the LCD 114b of the touch panel 114. Next, the application execution unit 125 illustrated in FIG. 8 reads the radio reception application selected by the operation from the recording unit 104, and executes the read radio reception application.

  Next, the application execution unit 125 represents an event that the execution of the application has started, and outputs event data including the application ID “01” of the executed radio reception application to the log storage unit 140.

  Thereafter, the log storage unit 140 acquires event data from the application execution unit 125 (step S01). Next, the operation date / time detection unit 130 detects the operation date / time “2011/1/1 09:00” of the application from the internal clock 117 shown in FIG. 2 (step S02).

  Thereafter, the operation position detection unit 135 detects the latitude “141 degrees 00 minutes 00 seconds” and the longitude “43 degrees 00 minutes 00 seconds” specifying the operation position of the terminal device 100 from the GPS circuit 109 (step S03).

  Next, the log storage unit 140 determines that the operation position detection unit 135 has detected the latitude and longitude that specify the operation position (step S04; Yes), and the information storage unit 120 stores the address table shown in FIG. The address associated with the latitude closest to the detected latitude and the longitude closest to the detected longitude is searched (step S05).

  After that, the log storage unit 140 identifies the radio reception application application ID “01” acquired in step S01 and the radio reception application operation date and time “2011/1/1 9:00” detected in step S02. And the latitude “141 degrees 00 minutes 00 seconds” and longitude “43 degrees 00 minutes 00 seconds” of the operation position detected in step S03, and the address “Yokohama City, Kanagawa Prefecture XX” retrieved in step S05. “1 chome” is associated with each other and stored in the operation status table shown in FIG. 5A (step S06).

  Next, returning to step S01, the log storage unit 140 sleeps until the application execution unit 125 outputs event data. Next, as shown in FIG. 10, at the position of latitude “141 degrees 00 minutes 20 seconds” and longitude “43 degrees 00 minutes 20 seconds”, at the date and time “2011/01/01 09:30” It is assumed that an operation for instructing the operation reception unit 141 to end the radio reception application is performed.

  Next, the log storage unit 140 represents an event of the end of the radio reception application, and acquires event data including the application ID “01” of the radio reception application from the application execution unit 125 (step S01).

  Thereafter, after step S02 to step S05 are repeated, the log storage unit 140 displays the radio reception application application ID “01”, the radio reception application operation date and time “2011/1/1 09:30”, and the operation position. The latitude “141 degrees 00 minutes 20 seconds” and longitude “43 degrees 00 minutes 20 seconds” and the address “Yokohama City Kanagawa Prefecture ○ △ 2 chome” of the operation position are stored in the operation status table in association with each other (step S06).

  Next, returning to step S01, the log storage unit 140 sleeps until the application execution unit 125 outputs it.

  After that, as shown in FIG. 10, at the position of latitude “141 degrees 00 minutes 40 seconds” and longitude “43 degrees 00 minutes 40 seconds”, the user is shown at the date “2011/01/01 10:00”. Assume that an operation for instructing execution of an application (hereinafter referred to as a camera application) for controlling the digital camera 105 shown in FIG.

  Next, the log storage unit 140 represents an event of camera application execution start, and acquires event data including the application ID “02” of the camera application from the application execution unit 125 (step S01).

  Thereafter, after step S02 to step S05 are repeated, the log storage unit 140 sets the camera application application ID “02”, the radio reception application operation date and time “2011/01/01 10:00”, and the operation position. The latitude “141 degrees 00 minutes 40 seconds” and longitude “43 degrees 00 minutes 40 seconds” and the operation location address “Yokohama City, Kanagawa Prefecture ○ □ 4 chome” are associated with each other and stored in the operation status table (step S06). ).

  Next, returning to step S01, the log storage unit 140 sleeps until the application execution unit 125 outputs event data.

  Next, as shown in FIG. 10, at the position of latitude “141 degrees 01:00 hours” and longitude “43 degrees 01:00 hours” at the date and time “2011/01/01 10:30”, the user Assume that an operation for instructing termination of the camera application is performed on the operation reception unit 141.

  Next, the log storage unit 140 represents an event of the end of the camera application, and acquires event data including the application ID “02” of the camera application from the application execution unit 125 (step S01).

  Thereafter, after step S02 to step S05 are repeated, the log storage unit 140 sets the camera application application ID “02”, the radio reception application operation date and time “2011/01/01 10:30”, and the operation position. The latitude “141 degrees 01 minutes 00 seconds” and longitude “43 degrees 01 minutes 00 seconds” and the address of the operation position “Yokohama City, Kanagawa Prefecture △△ 6 chome” are associated with each other and stored in the operation status table (step S06). ).

  Next, returning to step S01, the log storage unit 140 sleeps until the application execution unit 125 outputs event data.

  Next, as shown in FIG. 10, at the position of latitude “141 degrees 01 minutes 20 seconds” and longitude “43 degrees 01 minutes 20 seconds”, the user at the date “2011/01/01 11:00” It is assumed that an operation for instructing execution of the radio reception application is performed on the operation reception unit 141.

  Next, the log storage unit 140 represents an event of the start of the radio reception application, and acquires event data including the application ID “01” of the radio reception application from the application execution unit 125 (step S01).

  Thereafter, step S02 is repeated. Next, the operation position detection unit 135 tries to detect the latitude and longitude of the operation position from the information output from the GPS circuit 109 (step S03). At this time, since the terminal device 100 was operated underground, the GPS circuit 109 could not receive radio waves from GPS hygiene, and the latitude and longitude of the terminal device 100 could not be detected. For this reason, since the GPS circuit 109 does not output information indicating the latitude and longitude, the operation position detection unit 135 cannot detect the latitude and longitude of the operation position.

  Next, the log storage unit 140 determines that the operation position detection unit 135 has not detected the latitude and longitude of the operation position (step S04; No). Next, the log storage unit 140 stores the radio reception application application ID “01” and the radio reception application operation date “2011/01/01 11:00” in association with each other in the operation status table (Step S1). S07).

  Next, returning to step S01, the log storage unit 140 sleeps until the application execution unit 125 outputs event data.

  Next, at the position of latitude “141 degrees 01 minutes 40 seconds” and longitude “43 degrees 01 minutes 40 seconds”, the operation accepting unit performs an operation for the user to select a channel at the date “2011/01/01 11:30” Suppose that it went to 141.

  Next, the log storage unit 140 represents an event of channel selection, and acquires event data including the application ID “01” of the radio reception application from the application execution unit 125 (step S01).

  Thereafter, step S02 and step S03 are repeated. At this time, since the terminal device 100 was continuously operated underground, the operation position detection unit 135 could not detect the latitude and longitude of the operation position.

  Next, the log storage unit 140 determines that the operation position detection unit 135 has not detected the latitude and longitude of the operation position (step S04; No), and the radio reception application application ID “01” and the operation date and time “2011”. “/ 01/01 11:30” are stored in the operation status table in association with each other (step S07).

  Next, returning to step S01, the log storage unit 140 sleeps until the application execution unit 125 outputs event data.

  Next, the operation accepting unit performs an operation in which the user selects a channel at the date “2011/01/01 12:00” at the position of latitude “141 degrees 02:00” and longitude “43 degrees 02:00” Suppose that it went to 141. At this time, it is assumed that the terminal device 100 is continuously operated underground.

  Next, by repeating Step S01 to Step S04 and Step S07, the application ID “01” of the radio reception application and the operation date and time “2011/01/01 12:00” are stored in the operation status table. .

  Next, at the position of latitude “141 degrees 02 minutes 20 seconds” and longitude “43 degrees 02 minutes 20 seconds”, the operation reception unit performs an operation to end the radio reception application at the date “2011/01/01 12:30” Suppose that it went to 141. At this time, it is assumed that the terminal device 100 is continuously operated underground.

  Next, by repeating Step S01 to Step S04 and Step S07, the application ID “01” of the radio reception application and the operation date and time “2011/01/01 12:30” are stored in the operation status table. .

  Then, as shown in FIG. 10, when the user performs an operation to turn off the power on the operation button 111 at the date “2011/01/01 12:40”, the log storage unit 140 causes the input control shown in FIG. A signal representing the operation is acquired from the circuit 110. Next, the log storage unit 140 ends the execution of the log storage process.

  Next, the user performs an operation for displaying the operation position of the application on the operation reception unit 141. The CPU 101 detects the operation based on the signal output from the operation receiving unit 141 and the screen displayed on the LCD 114b of the operation receiving unit 141. Next, the CPU 101 executes an initial display control process as shown in FIG. 11 for displaying the operation position on the LCD 114b in cooperation with the hardware shown in FIG. Thus, the CPU 101 functions as a display control unit 150 as shown in FIG.

Hereinafter, an example of the initial display control process illustrated in FIG. 11 will be described.
When starting the execution of the initial display control process, the display control unit 150 acquires information indicating the latitude and longitude of the current position of the terminal device 100 from the GPS circuit 109 illustrated in FIG. 2 (step S11). Next, a map image in which the latitude and longitude points represented by the acquired information are posted is acquired. For this reason, the display control unit 150, based on the latitude and longitude represented by the acquired information, from the map image table shown in FIG. 6, the minimum latitude smaller than the latitude, the maximum latitude larger than the latitude, A file path of a map image representing a map associated with the minimum longitude smaller than the longitude and the maximum longitude larger than the longitude is searched.

  Next, the display control unit 150 acquires the map image stored in the file path from the information storage unit 120 (step S12). Thereafter, the display control unit 150 displays the acquired map image on a map display area AM of the LCD 114b as shown in FIG. 12A (step S13).

  Next, the display control unit 150 selects the first record of a plurality of records stored in the operation status table shown in FIG. 5A in ascending order of operation date and time (step S14).

  Next, the display control unit 150 stores the data in the latitude field, longitude field, and address field of the record selected in step S14 (hereinafter referred to as the selected record), so the selected record has an operation position. Then, it discriminate | determines (step S15; Yes). Next, the display control unit 150 acquires the path of the detected position image associated with the application ID “01” included in the selection record from the icon table illustrated in FIG. 7A and stores the path in the acquired path. A detection position image is acquired (step S16).

  Thereafter, the display control unit 150 identifies a position on the map image corresponding to the operation position of the selected record. The display control unit 150 defines a Y-axis with the lower left vertex of the map image as the origin and an upward direction of the map image as positive, and an X-axis with the right direction toward the map image as positive. Next, the display control unit 150 calculates the X coordinate representing the position on the map image corresponding to the operation position using the following equation (1), and calculates the Y coordinate using the following equation (2). .

X coordinate value = horizontal length of map image ÷ difference between minimum longitude and maximum longitude × difference between operation position longitude and minimum longitude (1)
Y coordinate value = vertical length of map image ÷ difference between minimum latitude and maximum latitude × difference between latitude and minimum latitude of operation position (2)

  Thereafter, as shown in FIG. 12A, the display control unit 150 displays the detected position image PA1 acquired in step S16 at the specified coordinate position on the map image (step S17).

  Next, the display control unit 150 determines that there is an unprocessed record in the operation status table shown in FIG. 5A (step S18; Yes), returns to step S14, and starts from the top of the operation status table. Select the second record. After that, the display control unit 150 executes the processing from step S15 to step S17, thereby obtaining the detected position image PA2 of the radio reception application identified by the application ID “01” included in the second record in the second record. Is displayed at a position on the map image corresponding to the operation position.

  Next, after executing the process of step S18, the display control unit 150 returns to step S14 and selects the third record from the top of the operation status table. Thereafter, the display control unit 150 executes the processing from step S15 to step S17, so that the detected position image PA3 of the camera application identified by the application ID “02” included in the third record is displayed in the third record. It is displayed at a position on the map image corresponding to the operation position.

  Next, the display control unit 150 executes the process from step S14 to step S17 after executing the process of step S18, thereby identifying the camera identified by the application ID “02” included in the fourth record of the operation status table. The detected position image PA4 of the application is displayed at a position on the map image corresponding to the operation position.

  Next, the display control unit 150 returns to step S14 after executing the process of step S18, and selects the fifth record from the top of the operation status table. Thereafter, the display control unit 150 determines that the selected record has no operation position because no data is stored in the latitude field, the longitude field, and the address field of the selected record (step S15; No). Next, the display control unit 150 acquires a position unacquired image associated with the application ID “01” included in the selected record from the icon table illustrated in FIG. 7A (step S19). After that, the display control unit 150, as shown in FIG. 12B, the acquired position unacquired image PA5, the operation date and time “2011/01/01 11:00” of the radio reception application included in the selection record, Are displayed in the date and time display area AT of the LCD 114b (step S20).

  Next, after executing the process of step S18, the display control unit 150 repeats the processes of step S14, step S15, and step S19 and step S20 three times, so that the position unacquired images PA6 to PA8 and the radio reception application The operation date and time “2011/01/01 11:30”, “2011/01/01 12:00”, and “2011/01/01 12:30” are set to a date and time display area AT different from the map display area AM. Display. This is because the icons PA1 to PA4 are associated with the operation positions, but the icons PA5 to PA8 are displayed in a clearly distinguished manner that they are not associated with the operation positions.

  For the same reason, the position-unacquired images PA5 to PA8 are displayed in a darker color as a whole than the detected position images PA1 to PA4. This is not only for distinguishing and displaying the detected position images PA1 to PA4 and the position unacquired images PA5 to PA8, but also for attracting the user's attention from the detected position images PA1 to PA4 to the position unacquired images PA5 to PA8.

  Next, after determining that there is no unprocessed record in the operation status table (step S18; Yes), the display control unit 150 ends the execution of the initial display control process.

  The user drags the icon PA8 displayed in the date / time display area AT shown in FIG. 12A, whereby the icon PA8 and the operation date / time “2011/01/01 12:30” associated with the icon PA8 are displayed. And specify. Next, the user designates the operation position of the application on the operation date “2011/01/01 12:30” by dropping the icon PA8 in the map display area AM.

  The CPU 101 performs the operation based on the signal indicating the position where the drag and drop operation performed by the user from the operation receiving unit 141 shown in FIG. 8 is performed and the screen displayed on the LCD 114b of the operation receiving unit 141. Is detected. When detecting the drag and drop operation, the CPU 101 counts the number of detected position images displayed in the map display area AM. The CPU 101 switches processing to be executed in response to the counted number of detected position images. Since the detected position images PA1 to PA4 are displayed in the map display area AM, the CPU 101 determines that the counted value “4” is “1” or more. Next, the CPU 101 executes an estimated operation position display control process for displaying the estimated operation position as shown in FIG. 14 in cooperation with the hardware shown in FIG. Thus, the CPU 101 functions as an information acquisition unit 145, a position estimation unit 155, and a position storage unit 160 as shown in FIG. The processing executed when the CPU 101 determines that the number of detected position images displayed in the map display area AM is “0” will be described later.

Hereinafter, a process example of the estimated operation position display control process illustrated in FIG. 14 will be described.
When the information acquisition unit 145 starts execution of the estimated operation position display control process, the image (hereinafter referred to as “designated image”) PA8 designated by the drag-and-drop operation and the designated operation date (hereinafter designated “designated operation date”). “2011/01/01 12:30” is identified (step S31). Next, the information acquisition unit 145 specifies a position on the map image (hereinafter referred to as a drop position) where the icon PA8 has been dropped by a drag-and-drop operation (step S32).

  After that, the information acquisition unit 145 specifies the latitude and longitude of the designated operation position corresponding to the drop position using the following formulas (3) and (4) (step S32).

Latitude of specified operation position = Y coordinate of drop position ÷ vertical length of map image x difference between minimum latitude and maximum latitude + minimum latitude (3)
Longitude of designated operation position = X coordinate of drop position ÷ horizontal length of map image × difference between minimum longitude and maximum longitude of the map image + minimum longitude (4)

  Thereafter, the position storage unit 160 shown in FIG. 8 stores the specified designated operation position in association with the designated operation date and time in the operation status table shown in FIG. 5A (step S33).

  Next, the display control unit 150 acquires the file path of the designated position image associated with the same application ID “01” as the designated image PA8 from the icon table of FIG. Thereafter, the display control unit 150 acquires the designated position image from the acquired file path (step S34a).

  Next, as shown in FIG. 13A, the display control unit 150 displays the designated position image PA8 'at the position where the icon PA8 has been dropped (step S34b).

  The designated position image PA8 'is displayed in a darker color as a whole than the detected position images PA1 to PA4. The detection position images PA1 to PA4 are displayed at positions on the map image corresponding to the detection operation position, while the designated position image PA8 ′ is a position on the map image corresponding to the designation operation position (ie, a drop position). This is for clearly distinguishing what is displayed on the screen.

  The designated position image PA8 'is displayed in a lighter color as a whole than the position unacquired images PA5 to PA8. This is because the user's attention is attracted from the position-unacquired image PA5 to PA8 from the designated position image PA8 '.

  Thereafter, the display control unit 150 ends the display of the icon PA8 and the designated operation date “2011/01/01 12:30” in the date display area AT (step S35).

  Next, the position estimation unit 155 obtains the latest operation date and time “2011/01/01 10:30” before the designated operation date and time “2011/01/01 12:30” in FIG. Obtained from the operation status table shown in a). Since the acquired operation date / time is also the date / time when the detected operation position is detected, it will be referred to as a detection date / time (step S36).

  After that, the position estimation unit 155 operates the operation dates “2011/01/01 11:00”, “2011/01/01 1:30” from the detection date “2011/01/01 10:30” to the designated operation date “2011/01/01 12:30”, “ "2011/01/01 11:30" and "2011/01/01 12:00" are acquired from the operation status table (step S37). These acquired operation dates are hereinafter referred to as acquisition dates.

  Next, the position estimation unit 155 connects the designated operation position and the detection operation position associated with the detection date “2011/01/01 10:30” as shown in FIG. Is calculated (step S38).

  Thereafter, the position estimation unit 155 determines the length “30 minutes” from the acquisition date “2011/01/01 11:00” to the detection date “2011/01/01 10:30” and the acquisition date “2011/01/2011”. The ratio “1: 3” with the length “1 hour 30 minutes” from “01 11:00” to the designated operation date “2011/01/01 12:30” is calculated. This ratio “1: 3” is from the operation position corresponding to the display position of the icon PA4 to the position estimated as the operation position at the acquisition date “2011/01/01 11:00” (that is, the estimated operation position). Since this is the ratio of the movement time and the movement time from the estimated operation position to the operation position corresponding to the designated position image PA8 ′, it is hereinafter referred to as a movement time ratio.

  Next, the position estimation unit 155 includes a distance from the operation position corresponding to the display position of the icon PA4 to the estimated operation position, a distance from the estimated operation position to the operation position corresponding to the display position of the designated position image PA8 ′, The acquisition date and time “2011/01/01 11 so that the difference between the ratio (hereinafter referred to as distance ratio) and the travel time ratio“ 1: 3 ”is less than a predetermined value and within a predetermined distance from the straight line LN. : 00 "is estimated (step S39).

  Similarly, the position estimation unit 155 estimates the operation position at the acquisition date “2011/01/01 11:30” so that the distance ratio is “1: 1”, and the unacquired operation date “2011/01/01 The operation position at “12:00” is estimated so that the distance ratio is “3: 1”.

  Thereafter, the position storage unit 160 associates the estimated operation position estimated in step S39 with the acquisition date “2011/01/01 11:00”, and stores it in the operation status table shown in FIG. . Similarly, the position storage unit 160 stores the estimated operation positions in association with the acquisition dates “2011/01/01 11:30” and “2011/01/01 12:00” (step S40).

  Next, the display control unit 150 specifies the position-unacquired image PA5 displayed in the date / time display area AT in association with the acquisition date / time “2011/01/01 11:00”. Next, the display control unit 150 acquires the file path of the estimated position image indicated by the same application ID “01” as the position non-acquired image PA5 from the icon table illustrated in FIG. Thereafter, the display control unit 150 acquires an estimated position image from the acquired file path (step S42a). Next, as shown in FIG. 13B, the display control unit 150 displays the estimated position image PA5 'at a position on the map image corresponding to the estimated operation position. Similarly, as shown in FIG. 15, the display controller 150 displays the estimated position images PA6 'and PA7' on the map image (step S42b).

  The estimated position images PA5 'to PA7' are displayed in a lighter color overall than the detected position images PA1 to PA4, the position unacquired images PA5 to PA8, and the designated position image PA8 '. This is because the estimated position images PA5 'to PA7' are clearly distinguished from the detected position images PA1 to PA4, the position unacquired images PA5 to PA8, and the designated position image PA8 '.

  Thereafter, the display control unit 150 acquires the position-unacquired images PA5 to PA7 and the acquisition dates “2011/01/01 11:00”, “2011/01/01 11:30”, and “2011/01/01 12:00. "In the date and time display area AT is terminated (step S43). Thereafter, the display control unit 150 ends the execution of the estimated operation position display control process.

  The user visually recognizes the position on the map image on which the estimated position image PA5 'is displayed. At this time, in order to correct the display position of the estimated position image PA5 ′, the user performs an operation of dragging the estimated position image PA5 ′ and dropping it at a certain position (hereinafter referred to as a corrected position) on the map display area AM. .

  The information acquisition unit 145 illustrated in FIG. 8 detects the operation based on the signal output from the operation reception unit 141 illustrated in FIG. 8 and the screen displayed on the LCD 114b of the operation reception unit 141. Next, the information acquisition unit 145 acquires the estimated position image PA5 'designated by the operation and the correction position designated by the operation. Next, the position storage unit 160 searches the operation status table shown in FIG. 5A for the operation date and time associated with the operation position corresponding to the display position of the estimated position image PA5 '. Thereafter, the position storage unit 160 calculates an operation position corresponding to the correction position. Thereafter, the position storage unit 160 updates the operation position associated with the searched operation date and time with the calculated operation position. Next, after acquiring the designated position image associated with the same application ID “01” as the estimated position image PA5 ′, the display control unit 150 ends the display of the estimated position image PA5 ′ and corrects the designated position image. Display in position.

  The case where the detected position images PA1 to PA4 are displayed in the map display area AM as shown in FIG. 12A when the initial display control process shown in FIG. did. In this example, it has been described that the user drags any one of the position unacquired images PA5 to PA8 from the date and time display area AT and performs a drop operation on the map display area AM.

  Next, a case where the detected position image is not displayed in the map display area AM when the initial display control process is completed will be described as an example. In this example, as shown in FIG. 16A, it is assumed that the position non-acquired images PA1 to PA4 and four operation dates and times are displayed in the date and time display area AT.

  It is assumed that the user has dragged and dropped the position unacquired image PA1 in the date and time display area AT and dropped the position unacquired image PA1 in the map display area AM. At this time, the information acquisition unit 145 counts the number of detected position images displayed in the map display area AM, and determines that the counted value is “0”. Next, the display control unit 150 starts execution of the estimated operation position display control process as shown in FIG.

Hereinafter, a process example of the estimated operation position display control process illustrated in FIG. 17 will be described.
When the information acquisition unit 145 starts execution of the estimated operation position display control process, the information acquisition unit 145 performs the same process as steps S31 to S35 described with reference to FIG. 14 on the icon PA1 ( Step S131 to step S135). Thereby, the information acquisition unit 145 acquires the designated operation position (hereinafter referred to as the first designated operation position), and displays the designated position image PA1 ′ as shown in FIG. 16B at the drop position.

  Next, it is assumed that the user has dragged and dropped the position unacquired image PA4 in the date / time display area AT shown in FIG. 16A and dropped the position unacquired image PA4 in the map display area AM.

  The information acquisition unit 145 acquires the designated operation position (hereinafter referred to as the second designated operation position) by performing the same processing as in steps S31 to S35 on the icon PA4 (step S231 to step S235), The designated position image PA4 ′ is displayed at the drop position.

  After that, the position estimation unit 155 performs the same processing as in step S37, so that the designated operation date and time (referred to as the first designated operation date and time) associated with the icon PA1 “2011/01/01 11:00” Operation date and time “2011/01/01 11:30” and “2011/01/01 12” up to “2011/01/01 12:30” designated operation date and time (referred to as second designated operation date and time) associated with icon PA4 : 00 "is acquired from the operation status table (step S337).

  Next, as in step S38, the position estimation unit 155 calculates a linear expression representing a straight line LN connecting the first designated operation position and the second designated operation position (step S338).

  After that, the position estimation unit 155, like step S39, the length “30 minutes” from the acquisition date “2011/01/01 11:30” to the first designated operation date “2011/01/01 11:00”. And the movement time ratio “1: 2” between the acquisition date “2011/01/01 11:30” and the second designated operation date “2011/01/01 12:30” to the length “1 hour”. calculate. In addition, the position estimation unit 155 extends from the operation position corresponding to the display position of the icon PA1 ′ to the position estimated as the operation position on the acquisition date “2011/01/01 11:30” (that is, the estimated operation position). The difference between the distance and the distance from the estimated operation position to the operation position corresponding to the display position of the designated position image PA4 ′ and the movement time ratio “1: 2” is equal to or less than a predetermined value, and a straight line The operation position at the acquisition date “2011/01/01 11:30” is estimated so as to be within a predetermined distance from LN. Similarly, the position estimation unit 155 estimates the operation position of the application at the acquisition date “2011/01/01 12:00” (step S339).

  Thereafter, the display control unit 150 performs the same processing as in steps S40 to S43, thereby displaying the icon PA2 ′ and the icon PA3 ′ as shown in FIG. The execution of the control process is terminated.

  The icon PA1 associated with the earliest operation date and time “2011/01/01 11:00” shown in FIG. 16A is associated with the latest operation date and time “2011/01/01 12:30”. The case where the user performed a drag-and-drop operation on the icon PA4 has been described.

  Next, the icon PA1 associated with the earliest operation date and time “2011/01/01 11:00” shown in FIG. 16A and the second earliest operation date and time “2011/01/01 11:30” A process performed by the terminal device 100 will be described by giving an example in which the user performs an operation of dragging and dropping the icon PA2 associated with the icon PA2.

  In this example, the terminal device 100 displays designated position images PA1 'and PA2' at the drop positions as shown in FIG. Next, the terminal device 100 has an operation date and time that is later than the second earliest operation date and time “2011/01/01 11:30”, and that does not correspond to the operation position “2011/01/01 12:00. And “2011/01/01 12:30”. Thereafter, the terminal device 100 uses the method described in step S339 and step S340 in FIG. 17 to determine the operation positions at the acquisition dates “2011/01/01 12:00” and “2011/01/01 12:30”. presume. Thereafter, as illustrated in FIG. 18A, the terminal device 100 displays estimated position images PA3 'and PA4' at positions on the map image corresponding to the estimated operation positions.

  According to these configurations, when the operation date and time and the operation position of the application specified by the user are acquired, the operation position of the application at the operation date and time not corresponding to the operation position is estimated, and the estimated operation position and the estimated position image Are displayed in association with each other. For this reason, even if the number of operation positions and unsupported operation dates increases, it is possible to reduce the effort for the user to specify an operation position in order to display an icon at the position where the application was operated on the unsupported operation date and time. .

  According to these configurations, the operation position, the unsupported operation date and time, and the icon are displayed in association with the date and time display area AT, while the icon is displayed at the position of the map display area AM corresponding to the detection position. For this reason, it becomes easy for the user to determine which operation date and time the operation position is associated with.

  Further, according to these configurations, when the operation position of the application at the operation date and time not corresponding to the operation position is estimated, an icon is displayed at the position of the map display area AM corresponding to the estimated operation position, The display of the unsupported operation date and time in the date and time display area AT is ended. For this reason, the user can easily determine at which operation date and time the operation position is not estimated.

  According to these configurations, the icon is displayed in a predetermined manner at the position of the map display area AM corresponding to the detected operation position, and the icon is displayed at the position of the map display area AM corresponding to the estimated operation position. Is also displayed in a mode of low overall density. For this reason, even if the information posted on the map image increases or the number of icons displayed on the map image increases, the user can easily determine which operation position is the estimated position. Become.

  Further, according to these configurations, a position within a predetermined distance from the straight line LN connecting the designated operation position and the detection operation position is set as the estimated operation position. Here, when moving from a certain position to another position on foot, the user walks the shortest route along the straight line LN using a back alley rather than walking on a road away from the straight line LN such as a main street. There are many. Therefore, the operation position of the application can be estimated more accurately with a smaller amount of calculation.

  In the present embodiment, the terminal device 100 has been described as a mobile terminal device. However, the present invention is not limited to this, and the terminal device 100 may be an in-vehicle device.

  In the present embodiment, the events transmitted by the application execution unit 125 to the log storage unit 140 include, for example, an operation event for operating the application, a start event for starting the application in response to the operation, and an end event for ending the application One of these. Therefore, the operation date / time of the application includes the start date / time, the end date / time, and the operation date / time of the application.

  Further, the CPU 101 shown in FIG. 2 functions as a software timer by cooperating with the internal clock 117, and the application execution unit 125 can adopt a configuration having the software timer. In this configuration, when the execution of the predetermined time is notified by the software timer, the application execution unit 125 includes an application ID of the application that was operated when the predetermined time has elapsed, and represents an event that the predetermined time has elapsed. Event data may be transmitted to the log storage unit 140. That is, the log storage unit 140 associates the application ID, the operation date / time of the application, and the operation position with a predetermined time interval, or associates the application ID with the operation date / time of the application. It is possible to employ a configuration for storing in the operation status table 5 (a).

  Furthermore, the log storage unit 140 has a software timer, and when the elapse of the predetermined time is notified by the software timer, the application ID of the application operated when the predetermined time elapses, the operation date and time of the application, The operation position can be associated with each other, or the application ID can be associated with the operation date / time of the application and stored in the operation status table.

  In the present embodiment, the terminal device 100 has been described as displaying the icon of the camera application at a position on the map image corresponding to the operation position of the camera application. However, the present invention is not limited to this. The terminal device 100 may display a thumbnail image of an image captured by the digital camera 105 at a position on the map image corresponding to the operation position of the camera application. That is, the terminal device 100 may display an image associated with the application at a position on the map image corresponding to the operation position of the application.

  Further, although the terminal device 100 has been described as displaying a map image including the current position and displaying an icon at a position on the map image corresponding to the operation position of the application, the present invention is not limited to this. The terminal device 100 can employ a configuration that displays a map image that includes all or part of the operation positions stored in the operation status table shown in FIG.

  In the present embodiment, the terminal device 100 has been described on the assumption that the position-unacquired image is displayed in a darker color as a whole than the detected position image. However, the present invention is not limited to this. The terminal device 100 may display the position unacquired image in a display mode that is more emphasized than the detected position image. For example, the terminal device 100 may display the image in a display mode having a higher contrast than the detected position image. Further, the terminal device 100 may display the position unacquired image in a blinking manner, but may not display the detected position image in a blinking manner or may display the image in a blinking manner with a longer period than the position unacquired image.

  Similarly, the terminal device 100 displays the designated position image in any manner as long as it is a display mode that is emphasized more than the detected position image and is not emphasized more than the position unacquired image. Also good. Similarly, the terminal device 100 may display the estimated position image in any manner as long as it is a display mode that can be distinguished from the detected position image, the position unacquired image, and the designated position image. Furthermore, the terminal device 100 may display the detected position image, the position unacquired image, the specified position image, and the estimated position image in any display form as long as they are distinguished from each other.

  In the present embodiment, the log storage unit 140 illustrated in FIG. 8 has been described as storing the operation position detected by the operation position detection unit 135 in the information storage unit 120. However, the present invention is not limited to this. For example, the log storage unit 140 may include the operation position detection unit 135. In addition, the application execution unit 125 may include the operation position detection unit 135, and event data including information indicating the operation position detected by the operation position detection unit 135 may be transmitted to the log storage unit 140.

  In the present embodiment, the terminal device 100 has been described as displaying the map display area AM and the date / time display area AT as shown in FIG. 12A on the LCD 114b shown in FIG. It is not limited. For example, the touch panel 114 may include two display devices, a first LCD and a second LCD, and may display a map display area AM on the first LCD and a date / time display area AT on the second LCD.

<Modification 1 of Embodiment 1>
In the first embodiment, when the user performs a drag-and-drop operation, the position estimation unit 155 illustrated in FIG. 8 has been described as estimating the operation position of the application based on the drop position. In the first modification of the first embodiment, each time the log storage unit 140 stores the operation date and time associated with the operation position in the information storage unit 120, the position estimation unit 155 operates the operation date and time before the operation date and time. Then, the operation position of the application at the operation date and time not associated with the operation position is estimated. Hereinafter, description is abbreviate | omitted about the structure and operation | movement of the terminal device 100 which concern on the modification 1 of this embodiment, Comprising: The same thing as the structure and operation | movement of the terminal device 100 of this embodiment is abbreviate | omitted.

  The position storage unit 160 becomes “ON” when the estimated operation position and the operation position associated with the operation date / time that are not associated with the operation position are the estimated operation position, and the estimated operation position is “ON”. It is possible to adopt a configuration in which an estimation flag that is “OFF” when it is not a position is associated with and stored in the operation status table shown in FIG.

  The display control unit 150 displays the estimated position image at a position on the map image corresponding to the operation position of the record having the “ON” estimation flag, and displays the estimated position image at the operation position stored in the record having the “OFF” estimation flag. A configuration in which the detected position image is displayed at a corresponding position on the map image can be employed.

  According to this configuration, even if the user does not specify the operation date and time and the operation position, the operation position of the application at the operation date and time that is not associated with the operation position is estimated, and the map image corresponding to the estimated operation position An icon can be displayed in the upper position.

<Modification 2 of Embodiment 1>
In the first embodiment, the terminal device 100 has been described as displaying an icon associated with the operated “application” at a position on the map image corresponding to the operation position. In the second modification of the first embodiment, the terminal device 100 displays an icon associated with not only the operated “application” but also the “operation” for the application at a position on the map image corresponding to the operation position. . Hereinafter, description is abbreviate | omitted about the structure and operation | movement of the terminal device 100 which concern on the modification 2 of this embodiment, Comprising: The same thing as the structure and operation | movement of the terminal device 100 of this embodiment is abbreviate | omitted.

  The information storage unit 120 illustrated in FIG. 8 further stores the operation content as the operation state of the application. For this reason, the information storage unit 120 stores an operation status table in which application operations are further associated with application IDs, application operation dates and times, and operation positions, as shown in FIG.

  Further, the information storage unit 120 stores an icon reminiscent of both the application and the operation content of the application. Therefore, as shown in FIG. 7B, the information storage unit 120 includes an application ID of an application, an operation content of the application, a detected position image that associates both the application and the operation content, a specified position image, An icon table in which the estimated position image and the position unacquired image are associated with each other is stored.

  When an operation is performed on the operation reception unit 141 illustrated in FIG. 8, the application execution unit 125 is based on a signal output from the operation reception unit 141 and a screen displayed on the LCD 114 b of the operation reception unit 141. Detect operation of. Next, the application execution unit 125 represents the content of the detected operation (hereinafter referred to as the operation content) and an event that has occurred in the execution of the application in response to the operation, and includes event data including the application ID of the application. Transmit to the log storage unit 140.

  The log storage unit 140 receives event data from the application execution unit 125 in step S01 of the log storage process described with reference to FIG. Next, after step S02 and step S03 are executed, it is assumed that step S05 is executed after the operation position detection unit 135 detects the latitude and longitude that specify the operation position (step S04; Yes). Thereafter, in step S06, the log storage unit 140 associates the operation content represented by the event data with the application ID, the operation date and time, and the latitude and longitude that specify the operation position and the address included in the event data. Save in the operation status table shown in FIG.

  On the other hand, after step S02 and step S03 are performed, suppose that the operation position detection part 135 did not detect the latitude and longitude which specify an operation position (step S04; Yes). After that, the log storage unit 140 stores the operation contents in the operation status table in association with the operation details associated with the application ID and the operation date / time.

  The display control unit 150 executes the processes from step S11 to step S14 of the initial display control process shown in FIG. Thereafter, in step S14, if the record selected from the operation status table shown in FIG. 5C (that is, the selected record) has an operation position (step S15; Yes), the display control unit 150 Based on the ID and the operation content, a detected position image is acquired from the icon table shown in FIG. 7B (step S16). Next, the display control unit 150 stores the application ID and operation content of the selected record in the properties of the detected position image, and then sets the detected position image to the coordinate position on the map image corresponding to the used position of the selected record. Displayed (step S17).

  On the other hand, if it is determined in step S14 that the selected record does not have an operation position (step S15; No), the display control unit 150 extracts an unacquired image from the icon table based on the application ID and the operation content. Obtain (step S19). Next, the display control unit 150 stores the application ID and operation content of the selected record in the properties of the position unacquired image, and then coordinates the unacquired image on the map image corresponding to the use position of the selected record. The position is displayed (step S20).

  Further, the display control unit 150 executes steps S31 to S33 of the estimated operation position display control process described with reference to FIG. Next, the display control unit 150 acquires the application ID and the operation content from the properties of the position-unacquired image specified by the user (that is, the specified image). Next, the display control unit 150 acquires the file path of the designated position image associated with the acquired application ID and operation content from the icon table shown in FIG. 7B (step S34a).

  The display control unit 150 executes the processing from step S35 to step S40 after displaying the designated position image at the drop position of the user in step S34b. Next, the display control unit 150 acquires the application ID and the operation content from the property of the position unacquired image. Thereafter, the display control unit 150 acquires the file path of the estimated position image associated with the acquired application ID and the operation content from the icon table shown in FIG. 7B (step S42a). Thereafter, the display control unit 150 displays the estimated position image at a position on the map image corresponding to the estimated operation position, and then executes step S43, and then ends the estimated operation position display control process.

  According to these configurations, an icon image reminiscent of the operation content and the operated application is displayed at a position on the map image corresponding to the detection operation position, the estimated operation position, and the designated operation position. For this reason, it becomes easy for the user to confirm what operation is performed on which application at which position on the map.

<Embodiment 2>
Next, Embodiment 2 of the present invention will be described. In the first embodiment, as described with reference to FIG. 18A, the user estimates the operation position of the application on the assumption that the user moves linearly. In the second embodiment, as illustrated in FIG. 18B, the user estimates the operation position of the application on the assumption that the user moves along a road, a railroad, or an airplane route. Hereinafter, description of the configuration and operation of the terminal device 100 according to Embodiment 2 that are the same as the configuration and operation of the terminal device 100 according to Embodiment 1 will be omitted.

  In the second embodiment, it is assumed that the terminal device 100 displays the detected position image PA1 in the map display area AM as shown in FIG. 18B by executing the initial display control process shown in FIG. . Thereafter, it is assumed that the user drags the icon PA3 from the date / time display area AT and then drops the icon PA3 'to the map display area AM.

  The CPU 101 illustrated in FIG. 2 detects the user's drag and drop operation based on the signal output from the operation reception unit 141 and the screen displayed on the LCD 114b of the operation reception unit 141. Next, the CPU 101 executes the estimated operation position display control process as shown in FIG. 19 in cooperation with the hardware shown in FIG. Accordingly, the CPU 101 functions as a route estimation unit 190 as illustrated in FIG. 20 in addition to the information acquisition unit 145, the display control unit 150, the position estimation unit 155, and the position storage unit 160 illustrated in FIG.

Hereinafter, a process example of the estimated operation position display control process illustrated in FIG. 19 will be described.
When the estimated operation position display control process is started, steps S31 to S37 are executed as described in the first embodiment. Thereby, the designated position image PA3 ′ is displayed as shown in FIG.

  Next, the route estimation unit 190 executes the navigation program, so that the user can pass from the operation position corresponding to the display position of the detected position image PA1 to the operation position corresponding to the display position of the designated position image PA3 ′. A route that is predicted to have the shortest required time from the multiple routes along the road, railroad, or train or airplane route, the route with the shortest distance, the route through the main road, or high speed A route preferentially passing through the road is estimated as a route through which the user has passed (step S38b).

  After that, the position estimation unit 155 determines that the difference between the distance ratio and the movement time ratio is within a predetermined range by the method described in step S39 of FIG. 14 and the path PH estimated that the user has passed or A position that satisfies the condition that the position is within a predetermined distance from the route PH is set as an estimated operation position (step S39b).

  Thereafter, the processing from step S40 to step S43 is executed, so that the position on the map image corresponds to the estimated operation position on the route PH or within a predetermined distance from the route PH as shown in FIG. The estimated position image PA2 ′ is displayed. Thereafter, the execution of the estimated operation position display control process is terminated.

  According to these configurations, since the route that the user has passed is estimated using the navigation program, the operation position of the application is estimated more accurately than when the route that the user has passed is estimated to be a straight line, for example. it can.

<Embodiment 3>
Next, a third embodiment of the present invention will be described. In the first embodiment, as described with reference to FIG. 12A, the terminal device 100 displays the operation date / time of the application in the date / time display area AT, and is displayed on the map display area AM corresponding to the application operation position. The icon of the application is displayed at the position. In the third embodiment, the terminal device 100 is a display area of the LCD 114b as shown in FIG. 21, and the application operation is displayed in the time series display area AH that displays the operation date and time and the operation position of the application in time series. Displays the date and time and the operation position. Hereinafter, the configuration and operation of the terminal device 100 according to the third embodiment, which are the same as the configuration and operation of the terminal device 100 according to the first embodiment, will not be described.

Hereinafter, a processing example of the initial display control process illustrated in FIG. 22 executed by the display control unit 150 in the third embodiment will be described.
When starting the initial display control process, the display control unit 150 executes the processes from step S14 to step S16 shown in FIG. As a result, the first record of the operation status table shown in FIG. 5A is selected.

  Next, as illustrated in FIG. 21, the display control unit 150 associates the operation date and time and the operation position of the selected record (that is, the selected record) with the detected position image PA1 acquired in step S16. Are displayed in the time series display area AH (step S17a).

  After that, the display control unit 150 sequentially executes the process of step S18 and step S14 to step S16 shown in FIG. 11 and the process of step S17a shown in FIG. As a result, the detected position images PA2 to PA4 and the operation date and time and the operation position of the second to fourth records in the operation status table are displayed in the time series display area AH in association with each other.

  Thereafter, the display control unit 150 sequentially performs the processes of Step S18, Step S14, Step S15, and Step S19 illustrated in FIG. As a result, the fifth record in the operation status table shown in FIG. 5A is selected. Next, the display control unit 150 displays the operation date and time of the selected record and the position unacquired image PA5 acquired in step S19 in the time-series display area AH in association with each other (step S20a).

  Thereafter, the display control unit 150 sequentially executes step S18, step S14, step S15, and step S19, and the process of step S20a illustrated in FIG. 22 three times in order. As a result, the position non-acquired images PA6 to PA8 and the operation dates and times of the sixth to eighth records of the operation status table are displayed in the time series display area AH in association with each other. Thereafter, the display control unit 150 determines that there is no unprocessed record in the operation status table (step S18; Yes), and ends the execution of the initial display control process.

  Next, it is assumed that the user performs an input operation to input an address indicating a position where the user has operated the application into the text box TB8 on the operation date and time displayed on the left side of the text box TB8 illustrated in FIG. .

  The information acquisition unit 145 detects an input operation performed by the user based on the signal output from the operation reception unit 141 illustrated in FIG. 8 and the screen displayed on the LCD 114b of the operation reception unit 141. When detecting the operation, the CPU 101 executes an estimated operation position display control process as shown in FIG.

  When the information acquisition unit 145 starts executing the estimated operation position display control process, the process from step S31 to step S34a illustrated in FIG. 14 is performed.

  Thereafter, as shown in FIG. 24, the display control unit 150 changes the position unacquired image PA8 displayed in the time series display area AH to the designated position image PA8 'acquired in step S34a (step S34c). Thereafter, the display control unit 150 displays the designated operation position in the text box TB8 displayed on the right side toward the designated position image PA8 'in the time-series display area AH (step S35b).

  Next, the processing from step S36 to step S42a shown in FIG. 14 is executed. Thereafter, the display control unit 150 changes and displays the position non-acquired images PA5 to PA7 displayed in the time series display area AH from the estimated position image PA5 'acquired in step S42a to PA7' (step S42c).

  Thereafter, the display control unit 150 displays the estimated operation positions in the text box TB5 to the text box TB7 displayed on the right side from the estimated position image PA5 ′ to PA7 ′ of the time-series display area AH (Step S1). S43b). Thereafter, the display control unit 150 ends the execution of the estimated operation position display control process.

  According to these configurations, since the operation date and time and the operation position are displayed in time series, the user can easily check the transition of the operation position of the application.

  Embodiments 1 to 3 can be combined. In particular, the position estimation unit 155 shown in FIG. 20 can employ a configuration in which the user's moving means is estimated based on the moving speed after the moving speed of the user is estimated using the following equation (5).

Movement speed V = movement distance L / movement time T (5)
Movement distance L: Distance from the detection operation position corresponding to the display position of the icon PA1 to the designated operation position corresponding to the display position of the icon PA3 ′ Movement time T: Time from the detection date and time to the specified operation date and time

  In other words, the position estimation unit 155 determines that the user is walking when the moving speed V is earlier than a predetermined lower limit value and slower than a predetermined upper limit value for determining whether or not the user is moving on foot. It is estimated that it is moving. Similarly, the position estimation unit 155 determines that the moving speed V is earlier than a predetermined lower limit value and slower than a predetermined upper limit value for determining whether or not the user is moving using a bicycle. It is estimated that the user's moving means is a bicycle. Furthermore, similarly, the position estimation unit 155 determines whether or not the user is moving using a motorcycle or a predetermined lower limit value and upper limit value for determining whether or not the user is moving using a train. Using the predetermined lower and upper limit values for determining, the predetermined lower and upper limit values for determining whether or not the user is moving using an airplane, and the moving speed V, the user's It is estimated whether the moving means is a motorcycle or a car, a train, or an airplane.

  In this configuration, when the position estimation unit 155 estimates that the user is moving on foot, bicycle, airplane, or train, the position estimation unit 155 estimates the operation position of the application using the method of the first embodiment, and the user gets on a motorcycle or a car. If it is estimated that the user is moving, a configuration in which the operation position of the application is estimated by the method of the second embodiment can be employed.

  That is, when the position estimating unit 155 estimates that the user's moving means is walking, a bicycle, an airplane, or a train, the icon PA3 is detected from the detection operation position corresponding to the display position of the icon PA1 as described in the first embodiment. A position within a predetermined distance from a straight line connecting to the designated operation position corresponding to the display position of 'is set as the estimated operation position. Further, when estimating that the user's moving means is a motorcycle or a car, the position estimation unit 155 changes the detection operation position corresponding to the display position of the icon PA1 to the display position of the icon PA3 ′ as described in the second embodiment. A position within a predetermined distance from the movement route connecting to the corresponding designated operation position is set as the estimated operation position.

  Here, when moving from one position to another by foot or bicycle, the user often walks on a shorter route using a back alley rather than walking on a main street or the like. Airplanes and trains often move linearly. On the other hand, when moving from a certain position to another position by motorcycle or car, the user often travels on the main street rather than the back alley. According to these configurations, the operation position of the application can be estimated more accurately in response to the moving means of the user.

  In addition, the application execution unit 125 illustrated in FIG. 20 can employ a configuration in which the navigation application is executed and the searched user travel route is stored in the information storage unit 120. In this configuration, the position estimation unit 155 stores the movement route including the route from the detection operation position corresponding to the display position of the icon PA1 to the designated operation position corresponding to the display position of the icon PA3 ′. In this case, the configuration for estimating the operation position can be operated using the method of the second embodiment. In these configurations, the position estimation unit 155 is configured to estimate the operation position of the application using the method of the first embodiment when the movement route including the route from the detection operation position to the designated operation position is not stored. Can be operated.

  It should be noted that not only can a terminal device provided with a configuration for realizing the functions according to the present invention be provided in advance, but an existing terminal device can also function as a terminal device according to the present invention by application of a program. That is, a display control program for realizing each functional configuration of the terminal device 100 according to any of the first to third embodiments is applied so that a computer (such as a CPU) that controls the existing terminal device can be executed. Thus, it can function as a terminal device according to the present invention.

  Such a program distribution method is arbitrary. For example, the program can be distributed by being stored in a recording medium such as a memory card, a CD-ROM, or a DVD-ROM, or via a communication medium such as the Internet. . Note that the display control method of the present invention can be implemented using the terminal device 100.

  Various embodiments and modifications of the present invention are possible without departing from the broad spirit and scope of the present invention. Further, the above-described embodiment is for explaining the present invention, and does not limit the scope of the present invention. That is, the scope of the present invention is shown not by the embodiments but by the claims. Various modifications within the scope of the claims and within the scope of the equivalent invention are considered to be within the scope of the present invention.

100 Terminal device 101 CPU
102 ROM
103 RAM
104 Recording unit 105 Digital camera 106 Antenna 107 Signal processing circuit 108 GPS antenna 109 GPS circuit 110 Input control circuit 111 Operation button 114a LCD controller 114b LCD
114c Digitizer 114 Touch panel 115 Microphone 116 Speaker 117 Internal clock 119 Bus 120 Information storage unit 125 Application execution unit 130 Operation date / time detection unit 135 Operation position detection unit 140 Log storage unit 141 Operation reception unit 145 Information acquisition unit 150 Display control unit 155 Position estimation Unit 160 position storage unit 190 route estimation unit

Claims (9)

The first operation date / time when the application was operated and the first operation position where the application was operated at the first operation date / time were acquired in association with each other, and the second operation date / time when the application was operated And the second operation position at which the application was operated at the second operation date / time, and the operation date / time at which the application was operated, and the operation of the application at the operation date / time. Information acquisition means for acquiring a third operation date and time whose position is unknown;
The ratio of the distance between the unknown operation position and the first operation position and the distance between the unknown operation position and the second operation position, the third operation date and time, and the first operation Position estimation means for estimating the unknown operation position so that a difference between a time difference from a date and time and a ratio between a time difference between the third operation date and time and the second operation date and time is included in a predetermined range. When,
Display means for displaying the estimated position estimated by the position estimating means and the application image indicating that the application has been operated in association with each other;
A terminal device characterized by that. Operation accepting means for accepting a user operation;
Information storage means for storing the third operation date and time,
The information storage means does not store the first operation date in association with the first operation position, and also stores the second operation date in association with the second operation position. If not, the information acquisition means associates the first operation date and time designated by the first operation accepted by the operation acceptance means with the first operation position designated by the first operation. The second operation date and time specified by the second operation received by the operation receiving means and the second operation position specified by the second operation are acquired in association with each other, and the information storage Obtaining the third operation date and time from the means;
The terminal device according to claim 1. Operation accepting means for accepting a user operation;
Information storage means for storing the third operation date and time,
The information storage means does not store the second operation date in association with the second operation position, but stores the first operation date in association with the first operation position. In this case, the information acquisition unit acquires the first operation date and time and the first operation position in association with each other from the information storage unit, and is designated by the second operation received by the operation reception unit. Obtaining the second operation date and time and the second operation position designated by the operation in association with each other, and obtaining the third operation date and time from the information storage means;
The terminal device according to claim 1. The position estimation means estimates a position within a predetermined distance from a straight line connecting the first operation position and the second operation position acquired by the information acquisition means as the unknown operation position;
The terminal device according to any one of claims 1 to 3, wherein Route estimation means for estimating a movement route on a map from the first operation position acquired by the information acquisition means to the second operation position;
The position estimating means estimates a position within a predetermined distance from the movement route as the unknown operation position;
The terminal device according to any one of claims 1 to 3, wherein The display means displays the third operation date and time acquired by the information acquisition means in association with the application image in a date and time display area for displaying the operation date and time of the application, and posts the operation position of the application. In the map display area for displaying the map, the position on the map display area corresponding to the first operation position acquired by the information acquisition unit and the map display area corresponding to the second operation position are displayed. Display the app image at the position,
The terminal device according to any one of claims 1 to 5, wherein The display means displays the application image associated with the first operation position in a predetermined manner, and displays the application image associated with the estimated position in a manner different from the predetermined manner.
The terminal device according to claim 1, wherein: Computer
The first operation date / time when the application was operated and the first operation position where the application was operated at the first operation date / time were acquired in association with each other, and the second operation date / time when the application was operated And the second operation position at which the application was operated at the second operation date / time, and the operation date / time at which the application was operated, and the operation of the application at the operation date / time. Information acquisition means for acquiring a third operation date and time whose position is unknown;
The ratio of the distance between the unknown operation position and the first operation position and the distance between the unknown operation position and the second operation position, the third operation date and time, and the first operation Position estimation means for estimating the unknown operation position so that a difference between a time difference from a date and time and a ratio between a time difference between the third operation date and time and the second operation date and time is included in a predetermined range. ,
Causing the estimated position estimated by the position estimating means to function as a display control means for controlling the display means to display the application image indicating that the application has been operated in association with each other;
A display control program characterized by that. The first operation date / time when the application was operated and the first operation position where the application was operated at the first operation date / time were acquired in association with each other, and the second operation date / time when the application was operated And the second operation position at which the application was operated at the second operation date / time, and the operation date / time at which the application was operated, and the operation of the application at the operation date / time. An information acquisition step of acquiring a third operation date and time whose position is unknown;
The ratio of the distance between the unknown operation position and the first operation position and the distance between the unknown operation position and the second operation position, the third operation date and time, and the first operation A position estimation step of estimating the unknown operation position so that a difference between a time difference from a date and time and a ratio between a time difference between the third operation date and time and the second operation date and time is included in a predetermined range. When,
A display control step of controlling the display means to display the estimated position estimated in the position estimating step and the application image indicating that the application has been operated in association with each other,
A display control method characterized by the above.

Images