JP2013013672A - Device,method and program for displaying information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately determine information to be displayed within a screen based on the transfer operation detected from the motion of a user.SOLUTION: A detection part 1701 detects prescribed transfer operation from the motion of the user. An operation amount obtaining part 1702 obtains the operation amount for target information from the length of trajectory or speed of the detected transfer operation. A changing part 1703 changes the target information based on the obtained operation amount. A display information obtaining part 1704 obtains display information to be displayed on the screen based on the changed target information. A display part 1705 displays the obtained display information on the screen. The operation amount obtaining part 1702 obtains (a) a prescribed predetermined value as the operation amount if the detected trajectory of the transfer operation is not similar to the trajectory of the transfer operation detected just before that; or obtains (b) a value larger than the predetermined value as the operation amount if the trajectories are similar to each other.

Description

  The present invention relates to an information display device, an information display method suitable for appropriately determining information to be displayed on a screen based on a moving operation detected from a user operation, and a program for realizing these by a computer About.

  Various information display devices that determine an operation amount for a parameter based on an operation received from a user are known. For example, there has been proposed a navigation device that determines the scroll amount of a map displayed on a touch screen based on the length and speed of a tracing operation received from a user. Such a navigation device is disclosed in Patent Document 1, for example.

  The designer of such an information display device sets in advance how much the operation amount for the parameter to be operated is to be set with respect to the length and speed of the tracing operation. In the navigation device, for example, data representing the range of the map displayed on the touch screen is the parameter to be operated, and the scroll amount is the operation amount. In a fighting game, for example, the physical strength of the character is an operation target parameter, and the damage given to the character is the operation amount.

  Here, as a simple method for enabling fine adjustment of the operation amount, there is a method in which the ratio of the operation amount to the length and speed of the tracing operation is set to a relatively small value. On the other hand, the user repeats the tracing operation until the desired operation amount is reached.

Japanese Patent No. 4314927

  However, many users feel that it is troublesome to repeat the tracing operation until a desired operation amount is reached. Such a problem is not limited to the case where the operation received from the user is a tracing operation. For this reason, an information display device that can appropriately determine an operation amount for an operation received from a user and display an image determined according to the operation amount on the screen is desired.

  The present invention has been made in view of the above problems, and an information display device suitable for appropriately determining information to be displayed on the screen, an information display method, based on a moving operation detected from a user's action, An object of the present invention is to provide a program for realizing these by a computer.

  In order to achieve the above object, an information display device according to a first aspect of the present invention includes a detection unit, an operation amount acquisition unit, a change unit, a display information acquisition unit, and a display unit, and is configured as follows.

  First, the detection unit detects a predetermined movement operation from the user's action. That is, the user gives a movement operation to the information display device by moving a predetermined part of the body in the real space. On the other hand, for example, the detection unit detects a moving operation by monitoring the position of a predetermined part of the user's body (hereinafter referred to as “target part”) in the real space at predetermined intervals. Note that the position of the region of interest is represented by, for example, orthogonal coordinates in the real space. Further, the moving operation is represented by a set of a set of the position of the attention site and the detection time of the position of the attention site, for example.

  Then, the operation amount acquisition unit acquires the operation amount for the target information from the detected length or speed of the movement operation trajectory. The detected length of the trajectory of the movement operation is the length of the detected trajectory of the position of the target region. Further, the detected speed of the moving operation is a speed at which the detected position of the target region moves. Here, the length and speed of the trajectory of the movement operation are obtained from a set of a set of the position of the attention site and the detection time of the position of the attention site. For example, when the trajectory of the moving operation has a shape close to a line segment and the speed of the moving operation is substantially constant, the length and speed of the trajectory of the moving operation can be approximated as follows. That is, the length from the position of the target region with the earliest detection time to the position of the target region with the latest detection time is approximated to the length of the trajectory of the movement operation. Further, a value obtained by dividing the length of the trajectory of the moving operation by the elapsed time from the earliest detection time to the latest detection time is approximated with the speed of the movement operation.

  Here, the operation amount acquisition unit acquires the operation amount for the target information from the length of the trajectory of the movement operation, the speed of the movement operation, or both. Here, the target information is an operation target parameter. For example, in the case of a navigation device, the operation target parameter is a parameter representing the range of the map displayed on the screen. In this case, the operation amount for the target information is an operation amount for a parameter representing the range of the map displayed on the screen, such as an enlargement / reduction ratio, a scroll amount in each direction, and the like.

  The relationship between the length of the trajectory of the moving operation (or the speed of the moving operation) and the operation amount can be adjusted as appropriate. For example, the operation amount can be increased as the length of the trajectory of the moving operation is longer. Alternatively, the operation amount can be increased as the speed of the moving operation increases.

  The changing unit changes the target information based on the acquired operation amount. For example, in the case of a navigation device, the changing unit changes a parameter representing the range of the map displayed on the screen based on the acquired scroll amount.

  Here, the display information acquisition unit acquires display information to be displayed on the screen based on the target information after the change. For example, in the case of a navigation device, a map in a range specified by a parameter after change by the changing unit is extracted from the entire map.

  Then, the display unit displays the acquired display information on the screen. That is, the display unit displays an image generated on the screen based on the operation target parameter changed by the moving operation.

  Here, the operation amount acquisition unit acquires the operation amount according to the rules shown in the following (a) and (b).

  First, (a) when the detected trajectory of the moving operation is not similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A predetermined value associated in advance is acquired as an operation amount. Here, various management methods can be adopted as a management method of the detected moving operation. For example, a method of taking a history for each movement operation trajectory is conceivable. In this method, for example, every time a movement operation is detected, a history that can identify the locus of the detected movement operation is taken. This history can include, for example, the time when the trajectory was drawn (the time when the movement operation was detected), the length of the trajectory, the speed of the trajectory, and the shape of the trajectory.

  When there is no movement operation detected immediately before the detected movement operation (typically, when there is no history described above), the operation amount acquisition unit is the same as when the latest two trajectories are not similar. In addition, a predetermined value associated in advance with the length or speed of the detected trajectory of the moving operation is acquired as the operation amount.

  On the other hand, if (b) the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A value larger than a predetermined value associated in advance is acquired as an operation amount.

  The method for determining whether or not the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation can be adjusted as appropriate.

  Typically, when the degree of overlap between two movement operations is large, it can be determined that the two movement operations are similar to each other. For example, in the case where each of two movement operation trajectories is configured by a set of positions of a target region, the trajectory of one movement operation and the other movement with respect to the number of positions of the target region constituting the trajectory of one movement operation If the ratio of the number of positions of the target region common to the operation trajectory is equal to or greater than a predetermined threshold, it is determined that the trajectories of the two moving operations are similar to each other, and if the ratio is less than the predetermined threshold, 2 It can be determined that the trajectories of the two moving operations are not similar to each other. Such determination may be made after one of the two movement operation trajectories is translated in the screen.

  In addition, it is possible to appropriately adjust how to set a predetermined value that is associated in advance with the length or speed of the detected trajectory of the moving operation. For example, in the case of a navigation device, the length of the detected trajectory of the moving operation can be set as a default value. When the default value is set in this way, if the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before are not similar, the length of the detected trajectory of the moving operation is acquired as the scroll amount. Is done.

  On the other hand, when the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before are similar to each other, a larger operation amount is acquired than when the trajectories of these two moving operations are not similar to each other. For example, in the case of a navigation device, when the length of the detected movement operation locus is set to a default value, the detected movement operation locus is similar to the movement operation locus detected before, A scroll amount that is longer than the detected length of the trajectory of the movement operation is acquired.

  According to the configuration described above, the amount of operation by one moving operation is increased by performing a moving operation whose trajectory is similar to the previous moving operation. For this reason, the display state desired by the user can be achieved by a relatively small number of movement operations.

  As described above, according to the information display device of the present invention, it is possible to appropriately determine information to be displayed on the screen based on an operation received from the user.

  In the information display device of the present invention, the operation amount acquisition unit may acquire an operation amount for the last detected movement operation among the detected movement operations each time a movement operation is detected. Good. That is, the operation amount acquisition unit can quickly acquire the operation amount every time a movement operation is detected.

  Note that the operation amount acquisition unit classifies the trajectory of the last detected movement operation and the trajectory of the movement operation detected immediately before the last detected movement operation according to whether or not they are similar. Get the operation amount. Here, the trajectory of the movement operation detected last is a trajectory specified by the latest history in the history, that is, a history in which the time at which the trajectory is drawn in the history is the latest time.

  According to the information display device of the present invention, it is expected that the screen promptly transitions to the display state desired by the user.

  In the information display device of the present invention, the display unit can further display the trajectory of the last detected moving operation on the screen.

  It should be noted that it is possible to appropriately adjust how the trajectory of the last detected movement operation is displayed in the screen. Typically, all the positions of the region of interest detected when the last movement operation is performed are displayed in a predetermined color. For such display, the positions of these attention sites are stored in a storage device or the like as information representing the trajectory of the last detected movement operation. It should be noted that the trajectory of the last detected movement operation may be approximated by a predetermined function or the like and displayed with a predetermined thickness. According to this configuration, the user can repeatedly execute the same operation as the moving operation with reference to the trajectory of the moving operation detected last.

  According to the information display device of the present invention, it is expected that the screen promptly transitions to the display state desired by the user.

  In the information display device of the present invention, the detection unit can acquire the user's operation by photographing the user or measuring the position, speed, or acceleration of the controller held by the user. In this case, when the acquired user action is to move the part or the controller in a predetermined direction after stopping the predetermined part or the controller of the user's body, the predetermined part It can be detected that the type of movement operation associated with the direction is performed.

  For example, the detection unit can acquire a user's action by analyzing a moving image supplied from a camera that captures an image of the user as a subject. In this case, for example, the position of the site of interest in the image is detected by pattern matching, and the position of the site of interest in the real space is detected.

  Alternatively, the detection unit can acquire information on the user's operation by analyzing information such as acceleration supplied from a controller that includes an acceleration sensor or the like held by the user. In this case, the acquired user action is the movement of the hand holding the controller.

  Here, a plurality of types of movement operations may be prepared, and what kind of operation is the movement operation can be appropriately adjusted. For example, a movement operation may be prepared in association with the direction of movement from the state where the site of interest is stationary. Specifically, for example, when the user's right hand is the target region, a moving operation in which the user moves the right hand stationary and then moves upward toward the camera, the user moves the right hand stationary. The movement operation that associates the downward movement of the camera toward the camera from the bottom, the movement operation that associates the movement of the left hand toward the camera after the user stops the right hand, and the left movement of the right hand. Then, the movement of moving rightward toward the camera can be a moving operation associated with the rightward direction.

  According to the information display device of the present invention, it is possible to accurately recognize the moving operation performed by the user and appropriately determine information to be displayed on the screen.

  In the information display device of the present invention, the detection unit can acquire the user's tracing operation on the screen based on whether or not the user touches the screen, and can use the acquired tracing operation as a moving operation.

  That is, in the present invention, a touch screen can be adopted as the screen. In this case, the user moves the fingertip, the pen tip of the touch pen, or the like in contact with the screen. On the other hand, the detection unit detects a tracing operation by monitoring a position (hereinafter referred to as a “touch position”) where a fingertip or a pen tip is in contact on the screen at predetermined intervals. Here, the tracing operation refers to, for example, an operation in which the fingertip or the pen tip moves on the screen while the user's fingertip or the touch pen pen tip is in contact with the screen. Note that the touch position is represented by, for example, orthogonal coordinates on the screen. The tracing operation is represented by a set of a touch position and a detection time of the touch position, for example.

  According to the information display device of the present invention, in the information display device having a touch screen, information to be displayed in the screen can be appropriately determined based on an operation received from the user.

  In the information display device of the present invention, the display unit can erase the trajectory of the last detected movement operation from the screen in the following cases. In this case, after the trajectory of the last detected moving operation is displayed on the screen, a predetermined grace period elapses without detecting the moving operation. In this case, the operation amount acquisition unit (c) corresponds in advance to the length or speed of the last detected movement operation locus when the last detected movement operation locus is not displayed on the screen. The attached default value can be acquired as the operation amount.

  In the present invention, when a moving operation with similar trajectories is repeated, the amount of operation by one moving operation increases. However, if the amount of operation by a single moving operation continues to be large, fine adjustment of the operation amount becomes difficult. Accordingly, when a predetermined grace period elapses without detecting a movement operation on the screen, the movement operation is detected by deleting the trajectory of the last detected movement operation from the screen, thereby preventing the movement operation from being repeated. Note that it is desirable that the operation amount be returned to the default value after the trajectory of the last detected moving operation is deleted from the screen. Therefore, the operation amount acquisition unit (c), when the trajectory of the last detected moving operation is not displayed on the screen, the default value associated in advance with the length or speed of the trajectory of the last detected moving operation. Is preferably acquired as the operation amount.

  According to the information display device of the present invention, it is possible to appropriately receive a moving operation from a user and appropriately determine information to be displayed on the screen based on the received moving operation.

  Further, in the information display device of the present invention, when the trajectory of the last detected moving operation among the detected moving operations is similar to each of the N moving operation trajectories detected immediately before, the operation amount The acquisition unit can employ the following value (A) or (B) as a value larger than the above-mentioned specified value. When the trajectory of the last detected movement operation is similar to each of the N moving operation trajectories detected immediately before, the same movement operation is executed by the user continuously (N + 1) times. This is the case.

(A) A value obtained by adding a value obtained by applying N to a monotonically increasing function having a positive range to a predetermined value.
(B) A value obtained by multiplying a predetermined value by a value obtained by applying N to a monotonically increasing function having a range of 1 or more.
It should be noted that what function is adopted as the monotonically increasing function can be appropriately adjusted. However, no matter what monotonously increasing function is employed, the operation amount corresponding to one moving operation increases each time the moving operation is repeated. Thus, every time a similar movement operation is performed, the operation amount corresponding to one movement operation increases, so that the operation burden on the user can be further reduced.

  According to the information display device of the present invention, it is possible to appropriately determine information to be displayed on the screen based on the operation received from the user while further reducing the operation burden on the user.

  In the information display device of the present invention, the display unit further displays on the screen the trajectory of the last detected moving operation among the detected moving operations, and the display unit displays the trajectory of the last detected moving operation. Can be determined based on N. That is, in the present invention, the appearance of displaying the trajectory of the last detected moving operation on the screen may be changed according to the number of times the moving operation is repeated.

  It is possible to appropriately adjust how the appearance is changed according to the number of repetitions of the moving operation. For example, as the number of repetitions increases, the thickness of the line representing the trajectory of the moving operation, the color of the line representing the trajectory of the moving operation, or the shape of the line representing the trajectory of the moving operation is changed. Specifically, for example, the number of repetitions is increased, and the thickness of the line representing the trajectory of the movement operation is increased (or decreased). Alternatively, as the number of repetitions increases, the color of the line representing the trajectory of the movement operation is made bright (or dark) or flashy (or plain).

  According to the information display device of the present invention, it is possible to appropriately determine information to be displayed on the screen based on an appropriate moving operation that is accepted from a user who is presented with the number of repetitions of the moving operation.

  In the information display device of the present invention, the target information may be the position or size of the range of interest in the document. In this case, the changing unit changes the position or size of the range of interest in the document based on the acquired operation amount. In addition, the display information acquisition unit acquires information included in the attention range whose position or size has changed in the document as display information. Here, the document may be a sentence created by a word processor or the like, an image obtained by a camera or the like, or a drawing created by drawing creation software such as CAD (Computer Aided Design). It may be a map. That is, in this specification, a document is not limited to what is comprised only by a character, but includes what is comprised by various things, such as a character, a symbol, an icon, and a line.

  According to this configuration, the position or size of the attention range in the document changes based on the operation amount, and information included in the attention range after the position or size change is displayed on the screen. Here, the attention range is a range including information displayed on the screen in the document. Note that when the movement operation associated with the scroll operation is performed, the position of the range of interest in the document changes. On the other hand, when a movement operation associated with the enlargement / reduction operation is performed, the size of the range of interest in the document changes.

  For example, when a part of the entire horizontally written document (hereinafter referred to as “partial document”) is displayed on the screen, the position of the range of interest is represented by the line number in the entire document of the first line of the partial document. The size of the attention range is represented by the number of lines in the partial document. For example, when a part of the entire map (hereinafter referred to as “partial map”) is displayed on the screen, the position of the range of interest is a map of the representative point (typically the center point) of the partial map. The size of the attention range is expressed by the size of the range that the partial map occupies with respect to the entire map.

  According to the information display device of the present invention, information to be displayed on the screen can be appropriately determined based on an operation received from the user during editing of a document.

  In the information display device of the present invention, the target information may be a parameter of a game character. In this case, the changing unit changes the parameter based on the acquired operation amount. On the other hand, the display information acquisition unit acquires the changed parameter as display information.

  According to this configuration, the parameter of the game character changes based on the operation amount, and an image based on the changed parameter is displayed on the screen. For example, in a fighting game, the parameter of the game character is the physical strength of the enemy character, and the operation amount is the attack power determined by the user's movement operation. In this case, a state in which the physical strength of the enemy character is reduced according to the attack power is displayed on the screen.

  According to the information display device of the present invention, information to be displayed on the screen can be appropriately determined based on an operation received from the user while the user is playing the game.

  In the information display device of the present invention, the detection unit may detect the predetermined movement operation from a first action by the first player and a second action by the second player. In this case, the screen is configured to include a first display that displays the display information and the trajectory, and a second display that displays the display information and the trajectory.

  That is, the information display device of the present invention may provide a user interface including a detection unit and a screen to a plurality of players, that is, a first player and a second player. Note that the system configuration of the information display apparatus may be anything. For example, the information display device detects the predetermined movement operation from the first movement by the first player and displays the display information and the trajectory on the first player; And a second touch screen that detects the predetermined movement operation from the second action by the second player and displays the display information and the trajectory to the second player. it can.

  Note that the first touch screen, the second touch screen, and the information display device main body may be connected by wired communication using a cable, or may be connected by wireless communication using a wireless LAN. In wireless communication, for example, communication in infrastructure mode or communication in ad hoc mode is possible.

  Here, on the first display and the second display, the trajectory of the last detected movement operation among the movement operations detected from the first operation or the second operation is displayed. Each time a movement operation similar to the movement operation represented by the displayed trajectory is detected from the first action or the second action, the amount of operation described above increases.

  According to the information display device of the present invention, information to be displayed in the screen can be appropriately determined based on operations received from a plurality of users.

  In order to achieve the above object, a game control method according to another aspect of the present invention includes an information display method executed by an information display device including a detection unit, an operation amount acquisition unit, a change unit, a display information acquisition unit, and a display unit. In addition, a detection process, an operation amount acquisition process, a change process, a display information acquisition process, and a display process are provided and configured as follows.

  First, in a detection process, a detection part detects predetermined | prescribed movement operation from a user's operation | movement. That is, the user gives a movement operation to the information display device by moving a predetermined part of the body in the real space. On the other hand, for example, the detection unit detects a moving operation by monitoring the position of a predetermined part of the user's body (hereinafter referred to as “target part”) in the real space at predetermined intervals. Note that the position of the region of interest is represented by, for example, orthogonal coordinates in the real space. Further, the moving operation is represented by a set of a set of the position of the attention site and the detection time of the position of the attention site, for example.

  In the operation amount acquisition step, the operation amount acquisition unit acquires the operation amount for the target information from the detected length or speed of the trajectory of the moving operation. The detected length of the trajectory of the movement operation is the length of the detected trajectory of the position of the target region. Further, the detected speed of the moving operation is a speed at which the detected position of the target region moves. Here, the length and speed of the trajectory of the movement operation are obtained from a set of a set of the position of the attention site and the detection time of the position of the attention site. For example, when the trajectory of the moving operation has a shape close to a line segment and the speed of the moving operation is substantially constant, the length and speed of the trajectory of the moving operation can be approximated as follows. That is, the length from the position of the target region with the earliest detection time to the position of the target region with the latest detection time is approximated to the length of the trajectory of the movement operation. Further, a value obtained by dividing the length of the trajectory of the moving operation by the elapsed time from the earliest detection time to the latest detection time is approximated with the speed of the movement operation.

  Here, in the operation amount acquisition step, the operation amount acquisition unit acquires the operation amount for the target information from the length of the trajectory of the movement operation, the speed of the movement operation, or both. Here, the target information is an operation target parameter. For example, in the case of a navigation device, the operation target parameter is a parameter representing the range of the map displayed on the screen. In this case, the operation amount for the target information is an operation amount for a parameter representing the range of the map displayed on the screen, such as an enlargement / reduction ratio, a scroll amount in each direction, and the like.

  The relationship between the length of the trajectory of the moving operation (or the speed of the moving operation) and the operation amount can be adjusted as appropriate. For example, the operation amount can be increased as the length of the trajectory of the moving operation is longer. Alternatively, the operation amount can be increased as the speed of the moving operation increases.

  In the changing process, the changing unit changes the target information based on the acquired operation amount. For example, in the case of a navigation device, the changing unit changes a parameter representing the range of the map displayed on the screen based on the acquired scroll amount.

  Here, in the display information acquisition step, the display information acquisition unit acquires display information to be displayed on the screen based on the changed target information. For example, in the case of a navigation device, a map in a range specified by a parameter after change by the changing unit is extracted from the entire map.

  In the display step, the display unit displays the acquired display information on the screen. That is, the display unit displays an image generated on the screen based on the operation target parameter changed by the moving operation.

  Here, in the operation amount acquisition step, the operation amount acquisition unit acquires the operation amount according to the rules shown in the following (a) and (b).

  First, (a) when the detected trajectory of the moving operation is not similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A predetermined value associated in advance is acquired as an operation amount.

  On the other hand, if (b) the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A value larger than a predetermined value associated in advance is acquired as an operation amount.

  The method for determining whether or not the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation can be adjusted as appropriate.

  Typically, when the degree of overlap between two movement operations is large, it can be determined that the two movement operations are similar to each other. For example, in the case where each of two movement operation trajectories is configured by a set of positions of a target region, the trajectory of one movement operation and the other movement with respect to the number of positions of the target region constituting the trajectory of one movement operation If the ratio of the number of positions of the target region common to the operation trajectory is equal to or greater than a predetermined threshold, it is determined that the trajectories of the two moving operations are similar to each other, and if the ratio is less than the predetermined threshold, 2 It can be determined that the trajectories of the two moving operations are not similar to each other. Such determination may be made after one of the two movement operation trajectories is translated in the screen.

  In addition, it is possible to appropriately adjust how to set a predetermined value that is associated in advance with the length or speed of the detected trajectory of the moving operation. For example, in the case of a navigation device, the length of the detected trajectory of the moving operation can be set as a default value. When the default value is set in this way, if the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before are not similar, the length of the detected trajectory of the moving operation is acquired as the scroll amount. Is done.

  That is, when the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before are similar to each other, a larger operation amount is acquired than when the trajectories of these two moving operations are not similar to each other. For example, in the case of a navigation device, when the length of the detected movement operation locus is set to a default value, the detected movement operation locus is similar to the movement operation locus detected before, A scroll amount that is longer than the detected length of the trajectory of the movement operation is acquired.

  According to the configuration described above, the amount of operation by one moving operation is increased by performing a moving operation whose trajectory is similar to the previous moving operation. For this reason, the display state desired by the user can be achieved by a relatively small number of movement operations.

  As described above, according to the information display device of the present invention, it is possible to appropriately determine information to be displayed on the screen based on an operation received from the user.

A program according to another aspect of the present invention is configured to cause a computer to function as each unit of the above information display device or to cause the computer to execute each step of the above information display method.
The program of the present invention can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory. The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  According to the present invention, an information display device and an information display method suitable for appropriately determining information to be displayed on a screen based on a moving operation detected from a user's operation, and for realizing these by a computer Programs can be provided.

It is a mimetic diagram showing the outline composition of the typical information processor with which the information display device concerning a 1st embodiment of the present invention is realized. It is a mimetic diagram showing appearance of an information display device concerning a 1st embodiment of the present invention. It is a block diagram which shows the structure of the information display apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows the attention range in a document. It is a figure which shows a mode that an attention range is changed. (A)-(f) is a figure which shows a mode that the appearance of a locus | trajectory image changes. It is a figure which shows a mode that the operation amount increases. It is a flowchart which shows the information display process which the information display apparatus which concerns on the 1st Embodiment of this invention performs. It is a figure which shows the image which the information display apparatus which concerns on the 2nd Embodiment of this invention displays. It is a figure which shows the relationship between the trace of a tracing operation, and basic attack power. It is a figure which shows the relationship between input time and a magnification. It is a figure which shows the relationship between the continuous input frequency | count and magnification. It is a figure which shows the calculation formula which calculates | requires attack power. It is a flowchart which shows the information display process which the information display apparatus which concerns on the 2nd Embodiment of this invention performs. It is a figure which shows the attention range in a map. It is a figure which shows a mode that the locus | trajectory image is displayed in the screen. It is a schematic diagram which shows schematic structure of the typical information processing apparatus with which the information display apparatus which concerns on the 4th Embodiment of this invention is implement | achieved. It is a figure which represents typically the external appearance of the information processing apparatus which concerns on the 4th Embodiment of this invention. It is a block diagram which shows the structure of the information display apparatus which concerns on the 4th Embodiment of this invention. It is a figure which shows a mode that the user is performing movement operation. It is a figure which shows the relationship between the kind of movement operation, and establishment conditions. It is a figure which shows the relationship between the continuous input frequency | count and magnification. It is a figure which shows a mode that the position and angle of a virtual camera change by moving operation being detected continuously. It is a figure which shows a mode that the model character was seen from the front. It is a figure which shows a mode that the model character was seen from the right side rather than the front. It is a figure which shows a mode that the model character was seen from the right side toward the model character. It is a figure which shows a mode that the model character was seen from the back. It is a flowchart which shows the information display process which the information display apparatus which concerns on the 4th Embodiment of this invention performs. It is a flowchart which shows a movement operation detection process. It is a figure which represents typically the external appearance of the information processing apparatus which concerns on the 5th Embodiment of this invention. It is a figure which shows a mode that the specific part object is displayed on the monitor. It is a figure which shows the structure of the information display system which concerns on the 6th Embodiment of this invention. It is a figure which shows the structure of the information display system which concerns on the 1st modification of the 6th Embodiment of this invention. It is a schematic diagram which shows schematic structure of the typical information processing apparatus with which the information display apparatus which concerns on the 2nd modification of the 6th Embodiment of this invention is implement | achieved.

  Embodiments of the present invention will be described below. In the following, in order to facilitate understanding, an embodiment in which the present invention is applied to a PDA (Personal Data Assistant) and a game device will be described. However, the present invention can be similarly applied to an information processing apparatus such as a mobile phone. That is, the embodiment described below is for explanation, and does not limit the scope of the present invention. Here, those skilled in the art can adopt an embodiment in which each or all of these elements are replaced with equivalent ones. Therefore, these embodiments are also included in the scope of the present invention.

(First embodiment)
(Description of information processing device)
FIG. 1 is a schematic diagram showing a schematic configuration of a typical information processing apparatus 100 in which the information display apparatus according to the first embodiment of the present invention is realized.

  The information processing apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an interface 104, an input unit 105, a memory cassette 106, and an image processing unit. 107, a touch screen 108, a NIC (Network Interface Card) 109, an audio processing unit 110, a microphone 111, a speaker 112, and an RTC (Real Time Clock) 113.

  When the information processing apparatus 100 is turned on in a state in which a memory cassette 106 (details will be described later) storing a word processor program and data is mounted in a slot (not shown) connected to the interface 104, A word processor program is executed. Thereby, the information display apparatus according to the present embodiment is realized. Note that the information display device according to the present embodiment is an information display device that functions as a word processor.

  The CPU 101 controls the overall operation of the information processing apparatus 100. The CPU 101 is connected to each component and exchanges control signals and data. The CPU 101 acquires various data from each component. The CPU 101 processes the various data by various operations. The CPU 101 supplies data indicating a processing result and a control signal to each component. The CPU 101 includes a cache and a register inside. Various data acquired by the CPU 101 is temporarily stored in a cache. Thereafter, the various types of data are extracted into a register and subjected to various operations.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on. By executing the IPL, the program recorded in the memory cassette 106 is read out to the RAM 103, and execution of the program by the CPU 101 is started. The ROM 102 stores operating system programs and data necessary for operation control of the entire information processing apparatus 100.

  The RAM 103 temporarily stores data and programs. The RAM 103 holds programs and data read from the memory cassette 106. In addition, the RAM 103 temporarily stores information transmitted to the external device and information transmitted from the external device.

  The interface 104 is an interface for connecting the memory cassette 106 to the information processing apparatus 100.

  The input unit 105 is a control button or the like shown in FIG. 2, and receives an instruction input from the user. The input unit 105 includes direction buttons for designating up, right, down, or left, a determination button, and the like.

  The memory cassette 106 is detachably connected to the information processing apparatus 100 via the interface 104. The memory cassette 106 has a read-only ROM area and an SRAM area. The read-only ROM area is an area in which a word processor program and image data and audio data used in the program are stored. The SRAM area is an area where data such as a document editing result is saved. The CPU 101 performs a reading process on the memory cassette 106 to read out necessary programs and data, and temporarily stores the read data in the RAM 103 or the like.

  The image processing unit 107 processes the data read from the memory cassette 106. The image processing unit 107 includes an image arithmetic processor (not shown) and a frame memory (not shown). The processing is executed by an image arithmetic processor. The processed data (image information) is recorded in a frame memory (not shown). The image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing. The image information converted into the video signal is output to a touch sensor type display (touch screen 108). Thereby, various image displays are possible.

  The image calculation processor executes a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed. In addition, the image arithmetic processor can also execute a calculation for obtaining a rendered image at high speed. The rendering image is an image representing a state where a polygon placed in the three-dimensional virtual space is looked down from a predetermined viewpoint position. The rendered image is generated by rendering polygon information by the Z buffer method. The polygon information is information representing a polygon arranged in a three-dimensional virtual space and to which various textures are added. The image arithmetic processor has a function of calculating the degree to which a polygon is illuminated by a typical (positive) light source such as a point light source, a parallel light source, or a cone light source. These functions are made into a library or hardware. Thereby, speeding up of these calculations is realized.

  Further, the image arithmetic processor draws the character string as a two-dimensional image on the frame memory or draws it on the surface of each polygon in accordance with the font information defining the character shape. The image arithmetic processor may use general font information recorded in the ROM 102, or may use dedicated font information recorded in the memory cassette 106. Note that the image arithmetic processor appropriately performs the various processes described above in cooperation with the CPU 101.

  The touch screen 108 is a liquid crystal panel configured by overlapping touch sensors. The touch screen 108 detects position information corresponding to the position pressed by the user with a finger or a touch pen, and inputs the position information to the CPU 101. That is, the touch screen 108 accepts an instruction input from the user, like the input unit 105. For example, as shown in FIG. 2, the touch screen 108 is disposed at the center of the front surface of the information processing apparatus 100.

  Note that data temporarily stored in the RAM 103 can be appropriately stored in the memory cassette 106 in accordance with an instruction input by the user via the input unit 105 or the touch screen 108.

  The NIC 109 is for connecting the information processing apparatus 100 to a computer communication network (not shown) such as the Internet. The NIC 109 is configured by, for example, an interface (not shown) that conforms to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). Alternatively, the NIC 109 uses an analog modem to connect to the Internet using a telephone line, an ISDN (Integrated Services Digital Network) modem, an ADSL (Asymmetric Digital Subscriber Modem) modem, or a cable television line to connect to the Internet. For example, and an interface (not shown) that mediates between the CPU 101 and the like.

  The information processing apparatus 100 can obtain current date and time information by connecting to an SNTP server in the Internet via the NIC 109 and acquiring information from the SNTP server.

  The audio processing unit 110 converts the audio data read from the memory cassette 106 into an analog audio signal. The audio processing unit 110 supplies an analog audio signal to the speaker 112 connected to the audio processing unit 110, and causes the speaker to output audio based on the analog audio signal. In addition, the sound processing unit 110 generates sound effects to be generated during document editing under the control of the CPU 101 and outputs sound corresponding to the sound effects from the speaker 112.

  When the audio data recorded in the memory cassette 106 is MIDI data, the audio processing unit 110 refers to the sound source data included in the audio data and converts the MIDI data into PCM data. In addition, when the audio data recorded in the memory cassette 106 is compressed audio data in the ADPCM (Adaptive Differential Pulse Code Modulation) format or the Ogg Vorbis format, the audio processing unit 110 expands the PCM data. Convert to The PCM data is D / A (Digital / Analog) converted at a timing corresponding to the sampling frequency and output to the speaker 112 or the like, thereby realizing voice output.

  The audio processing unit 110 performs A / D (Analog / Digital) conversion on the analog signal input from the microphone 111 at an appropriate sampling frequency, and generates a digital signal in the PCM format.

  The microphone 111 converts sound into an analog signal and supplies the analog signal obtained by the conversion to the sound processing unit. For example, as illustrated in FIG. 2, the microphone 111 is disposed at the front end of the information processing apparatus 100.

  The speaker 112 converts the analog signal supplied from the sound processing unit 110 into sound and outputs the sound. For example, as shown in FIG. 2, the speaker 112 is disposed at the front end of the information processing apparatus 100.

  The RTC 113 is a timekeeping device including a crystal resonator and an oscillation circuit. The RTC 113 is supplied with power from the built-in battery, and continues to operate even when the information processing apparatus 100 is powered off.

  In addition, the information processing apparatus 100 includes a DVD-ROM drive that reads programs and data from a DVD-ROM instead of the memory cassette 106, and the DVD-ROM has the same function as the memory cassette 106. You may make it let. The interface 104 may be configured to read data from an external memory medium other than the memory cassette 106. Alternatively, the information processing apparatus 100 may be configured to perform the same function as the ROM 102, the RAM 103, the memory cassette 106, and the like using a large-capacity external storage device such as a hard disk.

(Description of information display device)
Next, functions of the information display apparatus 300 according to the present embodiment will be described with reference to the drawings. First, the configuration of the information display apparatus 300 according to the embodiment of the present invention will be described with reference to FIG. Note that, when the information processing apparatus 100 is turned on while the memory cassette 106 is attached to the interface 104, the information display apparatus 300 according to the present embodiment is configured.

  As illustrated in FIG. 3, the information display device 300 includes a detection unit 301, an operation amount acquisition unit 302, a change unit 303, a display information acquisition unit 304, and a display unit 305.

  The detection unit 301 detects a tracing operation on the screen. The tracing operation is, for example, an operation in which the fingertip or the pen tip moves on the screen while the user's fingertip or the pen tip of the touch pen is in contact with the screen. The detection unit 301 detects the tracing operation by detecting the touch position of the fingertip or the pen tip on the screen, for example. The detection unit 301 is configured by the touch screen 108, for example.

  The operation amount acquisition unit 302 acquires the operation amount for the target information from the detected length or speed of the tracing operation. The target information is, for example, the position of the attention range in the document. Here, the attention range is a range in which the user pays attention to the entire document and is a range displayed on the screen. In the present embodiment, the operation amount is a scroll amount. The operation amount acquisition unit 302 is configured by the CPU 101, for example.

  The changing unit 303 changes the target information based on the acquired operation amount. For example, the changing unit 303 changes the position of the range of interest in the document based on the scroll amount. The change unit 303 is configured by the CPU 101, for example.

  The display information acquisition unit 304 acquires display information to be displayed on the screen based on the target information after the change. For example, the display information acquisition unit 304 acquires display information to be displayed on the screen after scrolling based on the position of the attention range after the change. The display information acquisition unit 304 is configured by the CPU 101, for example.

  The display unit 305 displays the trace of the last detected tracing operation among the detected tracing operations and the acquired display information on the screen. According to such a configuration, for example, the user can confirm what locus the last tracing operation has drawn while confirming a part of the document being edited. The display unit 305 includes, for example, a CPU 101, an image processing unit 107, and a touch screen 108.

  Here, the operation amount acquisition unit 302 is similar in that the trajectory of the last detected tracing operation among the detected tracing operations is similar to the trajectory of the tracing operation detected immediately before the last detected tracing operation. Depending on whether or not, the following processing is executed for each case.

  That is, (a) when these trajectories are not similar to each other, the operation amount acquisition unit 302 acquires, as the operation amount, a predetermined value that is associated in advance with the length or speed of the trajectory of the last detected tracing operation.

  On the other hand, the operation amount acquisition unit 302 (b) acquires, as an operation amount, a value larger than a predetermined value associated in advance with the length or speed of the trajectory of the last detected tracing operation when these trajectories are similar to each other. To do.

  That is, the operation amount acquisition unit 302 acquires an operation amount having a value larger than the operation amount acquired when the two latest tracing operation trajectories coincide with each other when the trajectories do not coincide with each other. It should be noted that the operation amount acquired when these trajectories do not match each other is a predetermined value that is associated in advance with the length or speed of the trajectory of the last detected tracing operation. This default value is set, for example, such that it becomes larger as the length of the trajectory of the last detected tracing operation becomes longer, and is set so as to become smaller as the length of this locus becomes shorter. Alternatively, the default value is set so as to increase as the speed of the tracing operation increases, and to decrease as the speed of the tracing operation decreases.

  Next, in the information display apparatus 300 according to the present embodiment, a method for increasing the amount of operation corresponding to one tracing operation by continuously performing tracing operations with similar trajectories will be described. In the present embodiment, when a drag operation is performed on the touch screen 108 while editing a document in the word processor, an image displayed on the touch screen 108 is based on an operation amount determined based on the trace operation. An example of scrolling will be described.

  Here, in the present embodiment, this operation amount is determined based on the length of the trajectory of the tracing operation. In other words, the operation amount is basically larger as the length of the tracing operation trajectory is longer, and is smaller as the tracing operation trajectory is shorter.

  First, the manner in which document information is displayed by the information display device 300 will be described with reference to FIG.

  The information display device 300 includes a touch screen 108 on the front surface. When the size of the document is large, if the entire document is displayed on the touch screen 108 at the same time, the displayed image becomes too small. Therefore, it is desirable that a part of the entire document is displayed on the touch screen 108. Here, of the entire document, the range of the document displayed on the touch screen 108 is referred to as an attention range. FIG. 4 shows a state in which the content (document) of the attention range 402 of the document 401 representing the entire document is displayed on the touch screen 108.

  The attention range 402 is specified by, for example, the number of the first line displayed on the touch screen 108 (hereinafter referred to as “display start line number”) Pst. The display start line number Pstt is changed when, for example, a vertical (longitudinal) tracing operation is accepted on the touch screen 108. That is, when a vertical tracing operation on the touch screen 108 is accepted, the document displayed on the touch screen 108 scrolls. In the present embodiment, the number of lines of the document displayed on the touch screen 108 is fixed (10 lines), and when the display start line number Pst is determined, the attention range is specified.

  Next, with reference to FIG. 5, how the image displayed on the touch screen 108 is scrolled by a vertical tracing operation will be described.

  Assume that the first tracing operation is performed so that the positional relationship between the touch screen 108 and the finger 410 changes from the state illustrated in FIG. 4 to the state illustrated in FIG. 5. It is assumed that the position of the finger 410 with respect to the touch screen 108 is moved upward by a distance L1 in FIG. 5 by this tracing operation. At this time, the display start line number Pstt is increased by the scroll amount S0 associated in advance with the distance L1. In FIG. 5, the attention range 402 and the finger 410 before the tracing operation is detected are indicated by broken lines, and the attention range 402 and the finger 410 after the tracing operation is detected are indicated by solid lines.

  Here, after the tracing operation is detected, an image representing the locus of the tracing operation (hereinafter referred to as “trajectory image”) is displayed on the touch screen 108. Here, in this embodiment, the appearance of the trajectory image displayed on the touch screen 108 changes when the tracing operations having similar trajectories are continuously executed. Here, when the next tracing operation is detected before the grace period elapses after the previous tracing operation is detected, it is considered that these tracing operations are continuously executed.

  In FIGS. 6A to 6F, after the tracing operation similar to each other is performed three times in succession, the locus image 600 representing the locus of the third tracing operation is displayed on the touch screen 108, An example is shown in which a fourth tracing operation having a similar trajectory to each of the first to third tracing operations has been detected after a predetermined grace period has elapsed. FIG. 6A is a diagram showing the touch screen 108a before the tracing operation. FIG. 6B is a diagram showing the touch screen 108b immediately after the first tracing operation. FIG. 6C is a diagram showing the touch screen 108c immediately after the second tracing operation. FIG. 6D is a diagram showing the touch screen 108d immediately after the third tracing operation. FIG. 6E is a diagram showing the touch screen 108e when a grace time has elapsed since the third tracing operation. FIG. 6F illustrates the touch screen 108f immediately after the fourth tracing operation. Note that the touch screens 108a to 108f are collectively referred to as the touch screen 108 as appropriate.

  Note that it is possible to appropriately adjust in which case the traces of the tracing operation are considered to be similar to each other. For example, when the tracing operation has a relatively large overlap, the tracing operations can be regarded as similar to each other. The degree of overlap of the trace of the tracing operation can be determined by how much the touch positions when the tracing operation is detected match each other. For example, P12 / (P1 + P2) where the number of touch positions in the first tracing operation is P1, the number of touch positions in the first tracing operation is P2, and the number of common touch positions in the second tracing operation is P12. Can be determined that the first tracing operation and the second tracing operation are similar to each other.

  Alternatively, when the coordinates of the representative points constituting the trajectory of the tracing operation are within a predetermined distance from each other, it can be determined that the trajectory of the tracing operation is similar to each other. The representative point is a start point, an end point, a center of gravity, or an intermediate point. The intermediate point is, for example, a point where contact is detected at a time intermediate between the time when the start point is detected and the time when the end point is detected.

  First, as shown in FIG. 6A, the trajectory image 600 representing the trajectory of the tracing operation is not displayed on the touch screen 108a until the tracing operation is detected. Note that trajectory images 600b, 600c, 600d, and 600f, which will be described later, are collectively referred to as a trajectory image 600 as appropriate. When the first tracing operation is detected, a trajectory image 600b representing the trajectory of the first tracing operation is displayed on the touch screen 108b, as shown in FIG. 6B. The trajectory image 600b is, for example, an image representing an arrow with the head of the arrow at the last detected touch position, and is an image represented by an arrow having a predetermined color and a predetermined thickness.

  Here, when a second tracing operation that overlaps the locus image 600b is detected before a predetermined grace period elapses after the locus image 600b representing the locus of the first tracing operation is displayed, FIG. As shown in (c), a trajectory image 600c representing the trajectory of the second tracing operation is displayed on the touch screen 108c. The trajectory image 600c representing the trajectory of the second tracing operation is displayed in a different form from the trajectory image 600b representing the trajectory of the first tracing operation. For example, the trajectory image 600c representing the trajectory of the second tracing operation is represented by a thicker arrow than the trajectory image 600b representing the trajectory of the first tracing operation.

  Similarly, when a third tracing operation that overlaps the locus image 600c is detected before a predetermined grace period elapses after the locus image 600c representing the locus of the second tracing operation is displayed, FIG. As shown in (d), a trajectory image 600d representing the trajectory of the third tracing operation is displayed on the touch screen 108d. The trajectory image 600d representing the trajectory of the third tracing operation is displayed in a different form from the trajectory image 600c representing the trajectory of the second tracing operation. For example, the trajectory image 600d representing the trajectory of the third tracing operation is represented by a thicker arrow than the trajectory image 600c representing the trajectory of the second tracing operation.

  In this way, when the trajectory of the last detected tracing operation is similar to each of the N tracing operations detected immediately before (where N is a natural number), the tracing operation last detected is the same. The appearance of displaying the locus on the touch screen 108 is determined based on N. In the present embodiment, as N is larger, a trajectory image 600 representing a thick arrow is displayed. Accordingly, when tracing operations having similar trajectories are continuously detected at intervals shorter than the grace period, a trajectory image 600 representing a thicker arrow is displayed on the touch screen 108.

  However, after the trajectory image 600 is displayed on the touch screen 108, the trajectory image 600 is deleted from the touch screen 108 when a predetermined grace period elapses without detecting a new tracing operation. In FIG. 6E, after the trajectory image 600d representing the trajectory of the third tracing operation is displayed on the touch screen 108d, the grace time elapses without detecting the fourth tracing operation, and the third tracing operation is performed. In the example, a trajectory image 600d representing an operation trajectory is deleted from the touch screen 108d.

  Then, after the trajectory image 600d representing the trajectory of the third tracing operation is erased from the touch screen 108d, when the fourth tracing operation is detected, 4 is displayed on the touch screen 108f as shown in FIG. A trajectory image 600f representing the trajectory of the second tracing operation is displayed. However, the appearance of the trajectory image 600f representing the trajectory of the fourth tracing operation is the trajectory of the first tracing operation even when the trajectory of the fourth tracing operation is similar to the trajectory of the third tracing operation. Is the same appearance as the trajectory image 600b.

In addition, when the trajectory of the tracing operation detected last is similar to each of the N tracing operations detected immediately before (where N is a natural number), the following (A) or (B) The value is the scroll amount (operation amount).
(A) A value obtained by adding a value obtained by applying N to a monotonically increasing function having a positive range to a predetermined value.
(B) A value obtained by multiplying a predetermined value by a value obtained by applying N to a monotonically increasing function having a range of 1 or more.

In other words, if the tracing operation when the tracing operations having similar trajectories are continuously detected (without an interval equal to or longer than the grace time ₎ , the function indicating the scroll amount is S _(N) and the monotonically increasing function is F _(N) . For N which is a natural number, the following expression (1) or expression (2) is satisfied. Here, S0 is the scroll amount when the tracing operation is detected in a single shot, and is a specified value associated with the length L1 of the tracing operation trajectory.
S _(N) = F _(N) + S0 (1)
S _(N) = F _(N) x S0 (2)

What function is adopted as the monotonically increasing function can be appropriately adjusted. However, no matter what monotonically increasing function is adopted, the scroll amount corresponding to one tracing operation is determined every time a tracing operation is detected if tracing operations with similar trajectories are detected continuously. To increase. That is, both the formula (1) and the formula (2) mean that S0 <S ₍₁₎ <S ₍₂₎ <S ₍₃₎ .

  Hereinafter, with reference to FIG. 7, a state in which the scroll amount with respect to one tracing operation changes will be described. Note that FIG. 7 shows a case where a tracing operation having similar trajectories is executed three times in succession, and after a predetermined grace period has elapsed after the tracing operation trajectory for the third time is displayed on the touch screen 108. An example in which a fourth tracing operation having a locus similar to each of the third tracing operation is detected is shown.

First, when the first tracing operation is detected, the attention range 402 is scrolled by S0. Next, after the first tracing operation is detected, if the second tracing operation is detected before the grace period elapses, the attention range 402 is scrolled by S ₍₁₎ . Furthermore, if the third tracing operation is detected before the grace period elapses after the second tracing operation is detected, the attention range 402 scrolls by S ₍₂₎ . When the fourth tracing operation is detected after the grace period has elapsed after the third tracing operation is detected, the attention range 402 is scrolled by S0.

  As described above, while the trajectory image 600 representing the trajectory of the last detected tracing operation is displayed on the touch screen 108 (from when the last tracing operation is detected until the grace period elapses), the last image is displayed. When a tracing operation similar to the tracing operation detected in the step is detected, the scroll amount for one tracing operation increases. On the other hand, after the trajectory image 600 representing the trajectory of the last detected tracing operation is deleted from the touch screen 108 (after the grace period has elapsed since the last tracing operation was detected), the last detected tracing operation is performed. When a tracing operation similar to the operation locus is detected, the scroll amount for one tracing operation is returned to the default value.

  Next, the operation of the information display apparatus 300 according to the present embodiment will be described with reference to FIG. FIG. 8 is a flowchart showing information display processing executed by the information display apparatus 300 according to the present embodiment. Note that the information display process shown in FIG. 8 is a process executed by the information display apparatus 300 functioning as a word processor, for example, after the file name of the file storing the contents of the document to be edited is specified.

  First, the CPU 101 executes an initialization process (step S101). Here, the CPU 101 executes processing such as reading a file storing the contents of the document displayed on the touch screen 108 from the memory cassette 106 to the RAM 103. Further, the CPU 101 sets the display start line number Pstt to 1. Further, the CPU 101 clears the value of a timer counter described later to zero. It is assumed that the display start line number Pstt and the value of the timer counter are stored in the RAM 103 or the like.

  When the CPU 101 completes the process of step S101, the CPU 101 displays the contents of the attention range on the touch screen 108 (step S102). Specifically, the CPU 101 cooperates with the image processing unit 110 to generate an image representing the content of the attention range designated by the display start line number Pst among the content of the file read to the RAM 103, A signal representing this image is supplied to the touch screen 108. On the other hand, the touch screen 108 displays the contents of the attention range based on the supplied signal. Here, the content of the attention range is the content of the document from the first line to the tenth line.

  CPU101 will detect a touch position, if the process of step S102 is completed (step S103). For example, the CPU 101 acquires coordinates representing the touch position based on a signal supplied from the touch screen 108. The CPU 101 stores coordinates representing the touch position in association with the detection time in the RAM 103 or the like.

  When completing the process in step S103, the CPU 101 determines whether or not the timer value is equal to or greater than a threshold value (step S104). Note that the value of the timer counter represents an elapsed time from the time when the trajectory image 600 is displayed on the touch screen 108 in step S111 described later. A timer counter that automatically counts up the value of the timer counter is activated in step S112 described later. This threshold value is a value representing a grace period that is the time from the time when the trajectory image 600 is displayed on the touch screen 108 to the time when the display is erased.

  When the CPU 101 determines that the value of the timer counter is equal to or greater than the threshold (step S104: YES), the CPU 101 controls the image processing unit 110 to erase the trajectory image 600 displayed on the touch screen 108 (step S105). .

  When the CPU 101 determines that the value of the timer counter is not equal to or greater than the threshold (step S104: NO), or when the process of step S105 is completed, the CPU 101 determines whether a tracing operation has been performed (step S106). For example, the CPU 101 determines whether or not there has been a stroking operation based on the coordinates representing the touch position stored in the RAM 103 in association with the detection time.

  When the CPU 101 determines that there is no tracing operation (step S106: NO), the CPU 101 returns the process to step S103.

  On the other hand, when determining that the tracing operation has been performed (step S106: YES), the CPU 101 determines whether or not the tracing operation detected this time is similar to the tracing operation detected immediately before (step S106). S107). That is, in step S107, the trajectory image 600 representing the trajectory of the tracing operation detected immediately before is displayed on the touch screen 108, and the trajectory of the tracing operation detected this time and the tracing operation detected immediately before are displayed. It is determined whether or not the trajectory is similar. Whether the trajectories of the tracing operation are similar to each other is determined based on, for example, whether the overlapping degree of these trajectories is greater than a predetermined threshold.

  If the CPU 101 determines that the trajectory of the tracing operation detected this time is similar to the trajectory of the tracing operation detected immediately before (step S107: YES), the CPU 101 substitutes (N + 1) for N, that is, N Is incremented by one (step S108). Here, N is a value indicating the number of times that the tracing operation similar to the tracing operation detected this time is continuously detected immediately before the tracing operation is detected. . Here, “continuous” means that the trajectory image 600 representing the trajectory of the previous tracing operation is displayed before the grace time elapses from the time when the trajectory image 600 representing the trajectory of the previous tracing operation is displayed on the touch screen 108. Means that the next stroking operation is detected). Note that the value of N is stored in the RAM 103.

  On the other hand, when the CPU 101 determines that the tracing operation detected this time is not similar to the tracing operation detected immediately before (step S107: NO), the CPU 101 substitutes 0 for N, that is, N Is set to 0 (step S109). Note that the value of N is stored in the RAM 103.

  When the CPU 101 completes the process of step S108 or step S109, the CPU 101 determines the scroll amount based on the value of N (step S110). Here, when the value of N is 0, the scroll amount is determined to be a predetermined value that is associated in advance with the detected length of the tracing operation. On the other hand, when the value of N is 1 or more, the scroll amount is larger than a predetermined value that is associated in advance with the length of the detected tracing operation, and is determined to be larger as N is larger. The The determined scroll amount is stored in the RAM 103.

  When the CPU 101 completes the process of step S110, based on the coordinates representing the touch position stored in the RAM 103, the CPU 101 displays a trajectory image 600 representing the trajectory of the last detected tracing operation on the touch screen 108 ( Step S111).

  CPU101 starts a timer counter, after complete | finishing the process of step S111 (step S112). The timer counter automatically counts up a value representing the elapsed time from the time when the trajectory image 600 representing the trajectory of the tracing operation is displayed on the touch screen 108 every predetermined cycle. This timer counter is realized by the cooperation of the CPU 101 and the RTC 113, for example.

  When the CPU 101 finishes the process of step S112, the CPU 101 executes a scroll process (step S113). For example, the CPU 101 changes the display start line number Pstt according to the scroll amount determined in step S110. Then, the CPU 101 controls the image processing unit 107 to generate an image representing the contents of the attention range designated by the display start line number Pst among the contents of the file read to the RAM 103. A signal representing the image is supplied to the touch screen 108. On the other hand, the touch screen 108 displays the contents of the attention range based on the signal supplied from the CPU 101. The CPU 101 generates and supplies an image representing the content of the range of interest specified by the display start line number Pst while gradually changing the display start line number Pstt, whereby the image displayed on the touch screen 108 is displayed. Scroll.

  When the CPU 101 ends the process of step S113, the process returns to step S103.

  According to the information display apparatus 300 according to the present embodiment, when a tracing operation with similar trajectories is continuously detected, the scroll amount associated with the tracing operation increases each time the tracing operation is detected. Therefore, the image displayed on the touch screen 108 can be quickly scrolled by a relatively small number of tracing operations.

(Second Embodiment)
In 1st Embodiment, the example which applies this invention to the information display apparatus 300 which functions as a word processor was shown. However, the present invention may be applied to the information display device 300 that functions as various devices. In the present embodiment, an example in which the present invention is applied to an information display device 300 that functions as a game device will be described. The game controlled by the game device may be any game, but in the present embodiment, a case will be described in which the teammate character and the enemy character are a boxing game in which boxing matches. When the information processing apparatus 100 is turned on while the memory cassette 106 storing the program and data for controlling the boxing game is attached to the interface 104 of the information processing apparatus 100 shown in FIG. The information display device 300 according to the present embodiment is realized.

  First, with reference to FIG. 9, a screen during a boxing game controlled by the information display apparatus 300 according to the present embodiment will be described.

  During the play of the boxing game, as shown in FIG. 9, the teammate character 901, the enemy character 901, the teammate physical strength gauge 911, and the enemy physical strength gauge 912 are displayed on the touch screen 108.

  The teammate character 901 is a teammate character in the virtual space operated by the game user.

  The enemy character 902 is an enemy character that fights against a teammate character in the virtual space. The enemy character 902 is operated by a computer.

  The teammate physical strength gauge 911 is a gauge representing the physical strength of the teammate character 901. The physical strength of the teammate character 901 is represented by a numerical value of 0-100. When the teammate character 901 is attacked by the enemy character 902, the physical strength of the teammate character 901 decreases by the amount of the attack power of the enemy character 902. When the physical strength of the teammate character 901 becomes 0 or less, the defeat of the teammate character 901 is determined.

  The enemy physical strength gauge 912 is a gauge representing the physical strength of the enemy character 902. The physical strength of the enemy character 902 is represented by a numerical value of 0-100. When the enemy character 902 is attacked by the teammate character 901, the physical strength of the enemy character 902 decreases by the amount of the attack power of the teammate character 901. When the physical strength of the enemy character 902 becomes 0 or less, the defeat of the enemy character 902 is determined.

  Here, when the user wants the teammate character 901 to attack the enemy character 902, the user performs a tracing operation on the touch screen 108 so as to draw a trajectory associated with the type of attack. Note that a trajectory image 920 representing the trajectory of the latest tracing operation is displayed on the touch screen 108 from when the latest tracing operation is detected until a predetermined grace period elapses.

  Next, an attack that can be executed by the teammate character 901 will be described with reference to FIG. 10A.

  In the example shown in FIG. 10A, there are four types of attacks that can be executed by the teammate character 901: “straight”, “hook”, “upper”, and “deadly technique”. Each type of attack is associated with the trace of the tracing operation and the basic attack power.

The trajectory of the tracing operation is a trajectory of the tracing operation that should be executed by the user in order to cause the teammate character 901 to attack.
The trajectory of the tracing operation associated with “straight” is a trajectory drawn by tracing straight from the teammate character 901 toward the enemy character 902 on the touch screen 108.
The trajectory of the tracing operation associated with “hook” is a trajectory drawn by tracing a mountain from the teammate character 901 toward the enemy character 902 on the touch screen 108.
The trajectory of the tracing operation associated with “upper” is a trajectory drawn by tracing the valley from the ally character 901 toward the enemy character 902 on the touch screen 108.
The trajectory of the tracing operation associated with the “deadly move” is traced on the touch screen 108 while tracing straight from the ally character 901 toward the enemy character 902 and then moving slightly downward toward the ally character 901. This is a trajectory drawn by tracing straight toward the enemy character 902 again.

  The basic attack power is an attack power that is the basis of the attack power determined when the attack associated with the basic attack power hits the enemy character 902. The basic attack power associated with “straight” is 3. The basic attack power associated with “hook” is 2. The basic attack power associated with “Upper” is 5. The basic attack power associated with the “killer technique” is 10. Here, the attack power is the product of the basic attack power associated with the type of attack, the magnification associated with the input time, and the magnification associated with the number of consecutive inputs. The attack power is equal to the decrease in the physical strength of the attacked enemy character 902, that is, the damage received by the attacked enemy character 902.

  Here, the magnification associated with the input time will be described with reference to FIG. 10B. In this embodiment, a higher magnification is set as the input time, which is the elapsed time from the time when the tracing operation is started to the time when the tracing operation is completed, is shorter.

  In the example shown in FIG. 10B, when the input time is less than 0.2 sec, the magnification is 3 times, and when the input time is 0.2 sec or more and less than 0.5 sec, the magnification is 2 times, and the input time Is 0.5 sec or more, the magnification is 1 time.

  Next, with reference to FIG. 10C, the magnification associated with the number of continuous inputs will be described. In the present embodiment, a higher magnification is set as the number of continuous inputs, that is, the number of times that tracing operations having similar trajectories are successively input, is increased. Here, when the next tracing operation is detected before the predetermined grace time elapses from the time when the previous tracing operation was detected, these tracing operations are assumed to be continuous.

  In the example shown in FIG. 10C, when the number of continuous inputs is 1, the magnification is 1 time, when the number of continuous inputs is 2, the magnification is 2 times, and when the number of continuous inputs is 3, the magnification is When the number of continuous inputs is 4, the magnification is 4 times, and when the number of continuous inputs is 5, the magnification is 5 times.

  Hereinafter, an example in which the attack power is calculated based on the type of attack, the input time, and the number of continuous inputs will be described with reference to FIG. In the example shown in FIG. 11, after a tracing operation that draws a trajectory associated with “deadly move” is detected once, a tracing operation that draws a trajectory associated with “hook” is detected four times. Assume that these five tracing operations are all continuous.

First, when a trajectory associated with “A Special Move” is input in 0.1 sec by the first tracing operation, the attack power is 10 × 3 × 1 = 30.
Next, when the trajectory associated with “hook” is input in 0.3 sec by the second tracing operation, the attack power becomes 3 × 2 × 1 = 6.
Next, when the trajectory associated with “hook” is input in 0.3 sec by the third tracing operation, the attack power becomes 3 × 2 × 2 = 12.
Next, when the trajectory associated with “hook” is input in 0.1 sec by the third tracing operation, the attack power becomes 3 × 3 × 3 = 27.
Finally, if the locus associated with “hook” is input in 0.1 sec by the fifth tracing operation, the attack power becomes 3 × 3 × 4 = 36.

  As described above, in the present embodiment, the operation amount increases when the tracing operations having similar trajectories are detected continuously. That is, even when the stroking operation is performed in a single shot, even if the attack power is low, the attack power increases when the stroking operation is performed continuously. For example, in the example shown in FIG. 11, the attack power of the “hook” delivered by the fifth tracing operation is higher than the attack power of the “deadly skill” delivered by the first tracing operation. In other words, in the present embodiment, the attack power is set to increase when the tracing operations that draw the same trajectory are continuously executed accurately. Setting the attack power in this way corresponds to an increase in damage when boxing in the real world is subjected to the same attack continuously at the same location.

  Next, the operation of the information display apparatus 300 according to the present embodiment will be described with reference to FIG. FIG. 12 is a flowchart showing information display processing executed by the information display apparatus 300 according to the present embodiment. Note that the information display process shown in FIG. 12 is a process that is executed after the information display device 300 that functions as a game device that executes a boxing game receives an operation input that instructs the start of the boxing game, for example.

  First, the CPU 101 executes an initialization process (step S201). For example, the CPU 101 executes processing such as reading information of objects to be displayed on the initial screen, such as the teammate character 901, the enemy character 902, the teammate physical strength gauge 911, and the enemy physical strength gauge 912 from the memory cassette 106 to the RAM 103. Further, the CPU 101 sets 100 to a variable representing the physical strength of the teammate character 901 and a variable representing the physical strength of the enemy character 902. Further, the CPU 101 clears the value of a timer counter described later to zero. It is assumed that variables representing physical strength and timer counter values are stored in the RAM 103 or the like.

  When completing the process in step S201, the CPU 101 displays an image representing the initial screen on the touch screen 108 (step S202). Specifically, the CPU 101 cooperates with the image processing unit 110 to generate an image signal representing the initial screen based on the object information read into the RAM 103 and the variables representing the physical strength of each character, and touch Supply to the screen 108. On the other hand, the touch screen 108 displays an initial screen based on the supplied image signal. Here, the teammate physical strength gauge 911 and the enemy physical strength gauge 912 included in the initial screen are images representing 100.

  CPU101 will detect a touch position, if the process of step S202 is completed (step S203). For example, the CPU 101 acquires coordinates representing the touch position based on a signal supplied from the touch screen 108. The CPU 101 stores coordinates representing the touch position in association with the detection time in the RAM 103 or the like.

  When completing the process of step S203, the CPU 101 determines whether or not the value of the timer counter is equal to or greater than a threshold value (step S204). Note that the value of the timer counter represents an elapsed time from the time when the trajectory image 920 is displayed on the touch screen 108 in step S211 described later. A timer counter that automatically counts up the value of the timer counter is started in step S212, which will be described later. This threshold value is a value representing a grace period that is the time from the time when the trajectory image 920 is displayed on the touch screen 108 to the time when the display is deleted.

  If the CPU 101 determines that the value of the timer counter is equal to or greater than the threshold value (step S204: YES), the CPU 101 erases the trajectory image 920 displayed on the touch screen 108 by controlling the image processing unit 110 (step S204). S205).

  When the CPU 101 determines that the value of the timer counter is not equal to or greater than the threshold (step S204: NO), or when the process of step S205 is completed, the CPU 101 determines whether a tracing operation has been performed (step S206). For example, the CPU 101 determines whether or not there has been a stroking operation based on the coordinates representing the touch position stored in the RAM 103 in association with the detection time.

  If the CPU 101 determines that no tracing operation has been performed (step S206: NO), the process returns to step S203.

  On the other hand, when determining that the tracing operation has been performed (step S206: YES), the CPU 101 determines whether or not the tracing operation detected this time is similar to the tracing operation detected immediately before (step S206). S207). That is, in step S207, a trajectory image 920 representing the trajectory of the tracing operation detected immediately before is displayed on the touch screen 108, and the trajectory of the tracing operation detected this time and the tracing operation detected immediately before are displayed. It is determined whether or not the trajectory is similar. Whether the trajectories of the tracing operation are similar to each other is determined based on, for example, whether the overlapping degree of these trajectories is greater than a predetermined threshold.

  If the CPU 101 determines that the tracing operation detected this time is similar to the tracing operation detected immediately before (step S207: YES), the CPU 101 substitutes (N + 1) for N, that is, N Is incremented by one (step S208). Here, N is a value indicating the number of times that the tracing operation similar to the tracing operation detected this time is continuously detected immediately before the tracing operation is detected. . Here, “continuous” means that the trajectory image 920 representing the trajectory of the previous tracing operation is displayed before the grace time elapses from the time when the trajectory image 920 is displayed on the touch screen 108. Means that the next stroking operation is detected). Note that the value of N is stored in the RAM 103.

  On the other hand, when the CPU 101 determines that the trace operation trace detected this time is not similar to the trace action trace detected immediately before (step S207: NO), the CPU 101 substitutes 0 for N, that is, N Is set to 0 (step S209). Note that the value of N is stored in the RAM 103.

  When the CPU 101 completes the process of step S208 or step S209, the CPU 101 determines the attack power based on the value of N (step S210). Here, when the value of N is 0, the attack power is set to a default value associated in advance with the type of attack corresponding to the trace of the detected tracing operation and the speed of the tracing operation. On the other hand, when the value of N is 1 or more, the attack power is a value larger than the predetermined value, and is set to a larger value as N is larger. The determined attack power is stored in the RAM 103.

  When the CPU 101 completes the process of step S210, the trajectory image 920 representing the trajectory of the last detected tracing operation is displayed on the touch screen 108 based on the coordinates representing the touch position stored in the RAM 103 ( Step S211).

  When the CPU 101 ends the process of step S211, the CPU 101 starts a timer counter (step S212). The timer counter automatically counts up a value representing the elapsed time from the time when the trajectory image 920 representing the trajectory of the tracing operation is displayed on the touch screen 108 every predetermined cycle. This timer counter is realized by the cooperation of the CPU 101 and the RTC 113, for example.

  When the CPU 101 ends the process of step S212, the CPU 101 subtracts and displays the physical strength (step S213). For example, the CPU 101 controls the image processing unit 107 to generate an image signal representing the physical strength, which is obtained by subtracting the attack strength determined in step S210 from the physical strength represented by the enemy physical strength gauge 912, by the enemy physical strength gauge 912. , Supplied to the touch screen 108. On the other hand, based on the image signal supplied from the CPU 101, the touch screen 108 displays a screen including an image representing the enemy physical strength gauge 912 whose physical strength has been reduced by the attack strength determined in step S210.

  When the CPU 101 ends the process of step S213, the process returns to step S203.

  According to the information display apparatus 300 according to the present embodiment, when stroking operations with similar trajectories are continuously performed, the attack power associated with the stroking operation increases each time the stroking operation is detected. For this reason, if a tracing operation with similar trajectories is repeatedly detected, the enemy character 902 can be quickly damaged by a relatively small number of tracing operations.

(Third embodiment)
In the first embodiment, an example is shown in which an image representing a document displayed on the touch screen 108 is scrolled in the vertical direction by a tracing operation. However, the image displayed on the touch screen 108 is arbitrary, and the direction in which the image is scrolled by the tracing operation is also arbitrary. For example, the image displayed on the touch screen 108 may be an image representing a map, and the image may be scrolled in an arbitrary direction by a tracing operation.

  For example, as shown in FIG. 13, when a map of the attention range is displayed on the touch screen 108 out of a map 1301 representing the entire map, when the tracing operation is detected, the attention range is changed and the touch screen 108 is changed. The image displayed on is scrolled. Here, the attention range is specified by, for example, the display start coordinates Cstt. The display start coordinates Cstt are coordinates on the map 1301 at the upper left corner of the range of interest. That is, in this embodiment, the display start coordinates Cstt are changed based on the determined operation amount.

  Here, the direction in which the image is scrolled is a direction associated in advance with the direction in which the tracing operation is performed. For example, as shown in FIG. 13, when the tracing operation is performed in the lower left direction, the attention range 1302 in the map 1301 moves in the upper right direction. In FIG. 13, the attention range 1302 and the finger 410 after the tracing operation are indicated by solid lines. The attention range 1302 and the finger 410 before the tracing operation are indicated by broken lines.

  Here, the scroll amount is defined as a predetermined value previously associated with the length of the trajectory of the tracing operation (or the speed of the tracing operation) and the number of times that the tracing operation having similar trajectories is performed continuously. Determined based on. Then, the scroll amount is determined so that the scroll amount increases as the number of times increases.

  Further, as shown in FIG. 14, a trajectory image 1400 representing the trajectory of the last detected tracing operation is displayed on the touch screen 108 from the time when the tracing operation is detected to the time until the grace time elapses. Is displayed. Thus, by presenting the trajectory image 1400 to the user, the user can easily perform the tracing operation similar to the tracing operation already performed.

  According to the information display apparatus 300 according to the present embodiment, when a tracing operation with similar trajectories is continuously performed, the scroll amount associated with the tracing operation increases each time the tracing operation is detected. For this reason, when a tracing operation with similar trajectories is repeatedly detected, a map in a desired range can be quickly displayed on the screen by a relatively small number of tracing operations.

(Fourth embodiment)
In 1st-3rd embodiment, the example which applies this invention to an information display apparatus provided with a touch screen was shown. However, the information display device to which the present invention is applied is not limited to one provided with a touch screen. Hereinafter, the information display apparatus according to the present embodiment will be described. Note that the information display device according to the present embodiment functions as a game device that controls a dance game.

(Description of information processing device)
FIG. 15 is a schematic diagram showing a schematic configuration of a typical information processing apparatus 150 that performs the function of the information display apparatus of the present invention.

  The information processing apparatus 150 includes a CPU 101, a ROM 102, a RAM 103, an interface 104, an image processing unit 107, a NIC 109, a sound processing unit 110, an RTC 113, a hard disk 114, an external memory 115, and the like. , An input device 116, and a DVD-ROM (Digital Versatile Disk-Read Only Memory) drive 117.

  When a DVD-ROM storing a game program and data is loaded into the DVD-ROM drive 117 and the information processing apparatus 150 is turned on, the program is executed and the game apparatus of the present embodiment is realized. .

  The CPU 101 controls the overall operation of the information processing apparatus 150 and is connected to each component to exchange control signals and data. In addition, the CPU 101 uses an arithmetic logic unit (ALU) (not shown) to perform arithmetic operations such as addition, subtraction, multiplication, and division of data stored in a high-speed storage area called a register, logical sum, logical product, Logical operations such as logical negation, bit operations such as bit sum, bit product, bit inversion, bit shift, and bit rotation can be performed. Further, the CPU 101 includes a coprocessor that can perform saturation calculation such as addition / subtraction / multiplication / division for multimedia processing, vector calculation such as trigonometric function at high speed.

  The ROM 102 records an IPL (Initial Program Loader) that is executed immediately after the power is turned on. When the IPL is executed by the CPU 101, the program recorded on the DVD-ROM is read to the RAM 103, and the startup process by the CPU 101 is started.

  The RAM 103 is for temporarily storing data and programs, and holds, for example, programs and data read from a DVD-ROM, and other data necessary for game progress and chat communication. Further, the CPU 101 provides a variable area in the RAM 103 and performs an operation by directly operating the ALU on the value stored in the variable, or temporarily stores the value stored in the RAM 103 in the register. Perform operations such as performing operations on registers and writing back the operation results to memory.

  The interface 104 is an interface for connecting the external memory 115 to the information processing apparatus 150. Further, the information processing apparatus 150 can connect an additional hard disk via the interface 104.

  The image processing unit 107 processes the data read from the DVD-ROM by the CPU 101 or an image arithmetic processor (not shown) provided in the image processing unit 107, and then performs a frame memory (not shown) provided in the image processing unit 107. Record). Image information recorded in the frame memory is converted into a video signal at a predetermined synchronization timing, and is output to a monitor 250 connected to the image processing unit 107.

  The image calculation processor can execute a two-dimensional image overlay calculation, a transmission calculation such as α blending, and various saturation calculations at high speed. Further, the image arithmetic processor renders polygon information arranged in the virtual three-dimensional space and added with various pieces of texture information by the Z buffer method, so that the polygon arranged in the virtual three-dimensional space from a predetermined viewpoint position is rendered. It is also possible to perform a high-speed execution of a calculation for obtaining a rendering image viewed from a predetermined line of sight.

  Furthermore, by the cooperative operation of the CPU 101 and the image arithmetic processor, it is possible to draw a character string as a two-dimensional image on a frame memory or draw it on the surface of each polygon according to font information that defines the character shape. .

  In addition, the CPU 101 and the image arithmetic processor can write the image data stored in advance in the DVD-ROM into the frame memory, thereby displaying the state of the game on the screen. By repeatedly performing the process of writing and displaying the image data in the frame memory at a regular timing (typically the timing of the vertical synchronization interrupt (VSYNC)), an animation can be displayed on the monitor 250.

  The NIC 109 is for connecting the information processing apparatus 150 to a computer communication network (not shown) such as the Internet. The NIC 109 is configured by, for example, an interface (not shown) that conforms to the 10BASE-T / 100BASE-T standard used when configuring a LAN (Local Area Network). Alternatively, the NIC 109 uses an analog modem to connect to the Internet using a telephone line, an ISDN (Integrated Services Digital Network) modem, an ADSL (Asymmetric Digital Subscriber Modem) modem, or a cable television line to connect to the Internet. For example, and an interface (not shown) that mediates between the CPU 101 and the like.

  The audio processing unit 110 converts audio data read from the DVD-ROM into an analog audio signal and outputs it from a speaker. Also, under the control of the CPU 101, sound data such as sound effects and music to be generated during the progress of the game is generated, and the generated sound data is decoded to output various sounds from the speaker.

  When the audio data recorded on the DVD-ROM is MIDI data, the audio processing unit 110 refers to the sound source data included in the audio processing unit 110 and converts the MIDI data into PCM data. In addition, when the audio processing unit 110 is audio data compressed in the ADPCM format, the Ogg Vorbis format, or the like, the audio processing unit 110 converts the compressed audio data into PCM data. The PCM data can be output by performing D / A conversion at a timing corresponding to the sampling frequency and outputting it to a speaker.

  The RTC 113 is a timekeeping device including a crystal resonator and an oscillation circuit. The RTC 113 is supplied with power from the built-in battery, and continues to operate even when the information processing apparatus 105 is powered off.

  The hard disk 114 stores an operating system (OS) program and various game data necessary for operation control of the entire information processing apparatus 150. The CPU 101 can rewrite information stored in the hard disk 114 at any time.

  The external memory 115 is detachably connected to the information processing apparatus 150 via the interface 104. The external memory 115 stores data indicating game play status (past results, etc.), data indicating the progress of the game, data of logs (records) of communication with other devices using the network, and the like. . The CPU 101 can rewrite information stored in the external memory 115 at any time.

  As shown in FIG. 16, the input device 116 is installed near a monitor 250 on which a game screen is displayed. The input device 116 includes a camera that captures a user's situation. The CPU 101 analyzes image data representing an image photographed by the camera, and determines a user part (for example, a user's hand, foot, face, etc.) included in the image. Image analysis methods include, for example, analysis by pattern recognition, analysis by extraction of feature points, analysis by calculation of spatial frequency, and the like. Shooting by the camera is continuously performed during the game.

  Further, the input device 116 includes a depth sensor that measures the distance from the input device 116 to the user (or any part of the user). For example, the input device 116 irradiates the surroundings with infrared rays and detects the reflected waves of the infrared rays. Then, the input device 116 detects the irradiation wave from the irradiation wave launcher based on the phase difference between the irradiation wave and the reflected wave and the time (flight time) from when the infrared ray is emitted until the reflected light is detected. The distance (hereinafter also referred to as “depth”) to the object that reflects is obtained. Depth detection by the depth sensor is repeatedly performed at predetermined time intervals in each of the directions in which infrared rays can be emitted.

  By providing the depth sensor, the information processing apparatus 150 can grasp the three-dimensional position and shape of the object arranged in the real space in more detail. Specifically, as a result of image analysis of the first image data acquired at the first time and the second image data acquired at the second time by the CPU 101, the first image data and the second image data Assume that it is determined that a part representing the user's head is included in both of the image data. The CPU 101 determines in which direction the user's head is up, down, left, or right as viewed from the camera based on the change in the position of the head in the first image data and the position of the head in the second image data. In addition to being able to determine whether it has moved to some extent, the head of the user as viewed from the camera from the change in the depth of the head in the first image data and the depth of the head in the second image data It is also possible to determine how far the camera has moved in either the forward or backward direction (how close or away from the camera).

  As described above, the CPU 101 uses the image captured by the camera included in the input device 116 and the distance (depth) measured by the depth sensor included in the input device 116 as in the case of so-called motion capture. The user's three-dimensional movement in the space can be digitized and grasped.

  For example, in a dance game, when the user performs a dance motion in front of the monitor 250 screen (that is, in front of the input device 116), the CPU 101 can recognize that the user has performed a dance motion. Then, the CPU 101 can proceed with the game according to the recognized motion. That is, the user can input a desired instruction by moving his / her body freely without having a touchpad controller or the like. The input device 116 serves as a so-called “controller” that receives an instruction input from the user.

  Digital image data representing a captured image is a set of a plurality of pixels. Typically, a value representing the intensity of the three primary colors (R, G, B) is associated with each pixel. The fact that the depth in each direction is measured by the image depth sensor means that, in effect, one pixel has a depth (D) in addition to red (R), green (G), and blue (B). It is expressed using one dimension.

  A DVD-ROM mounted on the DVD-ROM drive 117 stores a program for realizing the game and image data, audio data, and the like accompanying the game in advance. The DVD-ROM drive 117 reads programs and data recorded on the attached DVD-ROM under the control of the CPU 101. The CPU 101 temporarily stores the read program and data in the RAM 103 or the like.

(Description of information display device)
Next, the function of the information display apparatus 1700 of the present embodiment realized by turning on the power of the information processing apparatus 150 in a state where the DVD-ROM for game control is mounted in the DVD-ROM drive 117. A typical configuration will be described.

  The game executed in the information display device 1700 of the present embodiment is a dance game. When starting the game, the CPU 101 reproduces music for dance and presents game tasks to be achieved by the user to the user in order. A game task is defined by associating in-game time with data representing the position that the user should be in the real space and the attitude to be taken. The CPU 101 displays a character object (hereinafter referred to as “exemplary character”, which is a dance instructor in this embodiment) reflecting the content of the game task on the monitor 250. The CPU 101 presents a game task to the user by changing the position and posture of the model character. In other words, the model character is a character that executes a swing motion to be performed by the user in the three-dimensional virtual space.

  The user moves his / her body while referring to the movement of the model character displayed as a moving image on the monitor 250. The movement of the user's body is detected by the input device 116. For example, the CPU 101 identifies the position and orientation of both hands of the user, the position and orientation of both feet of the user, the position and orientation of the user's head, and the like. Then, based on the identification result, the CPU 101 determines whether or not the user has moved his / her hand, foot, head, and the like according to a preset game task, that is, the user's score. If the user moves his / her body with reference to the movement of the model character, the user can enjoy the feeling of dancing according to the music.

  Note that the information display device 1700 of the present embodiment detects a moving operation from the user's action before or after the dance game is started, and determines the orientation of the model character displayed in the screen according to the detected moving operation. Change. According to such a configuration, the user can change the direction of the model character so that the movement of the body part to be referred to can be clearly confirmed.

  Note that changing the orientation of the model character is equivalent to changing the position and angle (orientation) of the virtual camera that generates an image to be displayed on the screen by shooting the model character in the three-dimensional virtual space. is there.

  FIG. 17 is a diagram illustrating a functional configuration of the information display device 1700 according to the present embodiment. As illustrated in FIG. 17, the information display device 1700 includes a detection unit 1701, an operation amount acquisition unit 1702, a change unit 1703, a display information acquisition unit 1704, and a display unit 1705.

  The detection unit 1701 detects a predetermined movement operation from the user's action. The moving operation is an operation given to the information display device 1700 when the user moves a predetermined part of the body (hereinafter referred to as “target part”) in the real space. The movement operation may be prepared in association with the direction in which the user moves the site of interest. For example, an operation in which the user moves in one direction from a state where one hand is stationary is a movement operation associated with the direction.

  On the other hand, the detection unit 1701 detects the movement operation by monitoring the position of the target region in the real space at predetermined intervals, for example. Specifically, for example, every time a vertical synchronization interrupt occurs a predetermined number of times, the detection unit 1701 calculates the position of the target site in the moving image with the target site as the subject and the distance from the information display device 1700 to the target site. By acquiring, the change of the position of the attention site in the real space is acquired, and the movement operation is detected based on the change of the position of the attention site. The detection unit 1701 is configured by, for example, the CPU 101 and the input device 116.

  The operation amount acquisition unit 1702 acquires the operation amount for the target information from the detected length or speed of the movement operation trajectory. The target information can be information representing the position and angle (orientation) of the virtual camera, for example. Here, assuming that the model character is always displayed at the center of the screen, the position of the virtual camera is determined when the angle of the virtual camera is determined. In the present embodiment, the target information is information indicating the direction of a vector (hereinafter referred to as “shooting direction vector”) from the virtual camera toward the model character, and the operation amount is the change amount of the direction of the shooting direction vector (virtual camera). The same as the moving distance of The operation amount acquisition unit 302 is configured by the CPU 101, for example.

  The changing unit 1703 changes the target information based on the acquired operation amount. For example, the changing unit 1703 changes the position and angle of the virtual camera installed in the three-dimensional virtual space based on the change amount of the direction of the shooting direction vector. The changing unit 1703 is configured by the CPU 101, for example.

  The display information acquisition unit 1704 acquires display information to be displayed on the screen based on the target information after the change. For example, the display information acquisition unit 1704 acquires an image representing a state in a three-dimensional virtual space photographed by a virtual camera whose position and angle are changed. The display information acquisition unit 1704 is configured by the CPU 101, for example.

  The display unit 1705 displays the acquired display information on the screen. Further, the display unit 1705 appropriately displays the trajectory of the last detected moving operation on the screen. According to such a configuration, for example, the user can confirm what locus the last moving operation has drawn while confirming the orientation of the model character displayed in the screen. The display unit 1705 includes, for example, a CPU 101, an image processing unit 107, and a monitor 250.

  Here, the operation amount acquisition unit 1702 is similar in that the trajectory of the last detected moving operation among the detected moving operations is similar to the trajectory of the moving operation detected immediately before the last detected moving operation. Depending on whether or not, the following processing is executed for each case.

  That is, the operation amount acquisition unit 1702 acquires (a) a default value associated in advance with the length or speed of the trajectory of the last detected movement operation as the operation amount when these trajectories are not similar to each other.

  On the other hand, the operation amount acquisition unit 1702 acquires (b) a value larger than a predetermined value associated in advance with the length or speed of the trajectory of the last detected movement operation as the operation amount when these trajectories are similar to each other. To do.

  That is, the operation amount acquisition unit 1702 acquires an operation amount having a value larger than the operation amount acquired when the latest two movement operation tracks match each other and the tracks do not match each other. It should be noted that the operation amount acquired when these trajectories do not coincide with each other is a default value associated in advance with the length or speed of the trajectory of the last detected movement operation. This default value is set, for example, such that it becomes larger as the length of the trajectory of the last detected movement operation becomes longer, and becomes smaller as the length of this trajectory becomes shorter. Alternatively, for example, the default value is set to be a larger value as the speed of the moving operation is faster, and is set to be a smaller value as the speed of the moving operation is slower.

  Next, with reference to FIG. 18, the moving operation detected from the user's action will be described.

  As shown in FIG. 18, the user moves the site of interest while facing the monitor 250. The attention site may be set anywhere, but in this embodiment, it is assumed to be the left hand 1811. On the other hand, the input device 116 detects the movement of the region of interest using a camera or a depth sensor. Here, it is assumed that the input device 116 detects the movement of the target region by acquiring the coordinates of the center of gravity of the target region at predetermined time intervals. The coordinates of the region of interest in the real space are represented by, for example, the X-axis coordinate, the Y-axis coordinate, and the Z-axis coordinate.

  Here, an axis orthogonal to the display surface of the monitor 250 (an axis connecting the user and the monitor 250) is an X axis, and a direction from the user toward the monitor 250 is a positive direction of the X axis. The vertical axis of the monitor 250 is the Y axis, and the direction from the bottom to the top of the screen is the + direction of the Y axis. The horizontal axis of the monitor 250 is the Z axis, and the direction from the right to the left of the screen is the + direction of the Z axis.

Also, as shown in FIG. 18, the coordinates of the center of gravity of the site of interest at the time t are RP _(t) (X _(t) , Y _(t) , Z _(t) ). Here, X _(t) is the X coordinate of the center of gravity of the site of interest at time t, Y _(t) is the Y coordinate of the center of gravity of the site of interest at time t, and Z _{(t )} Is the Z coordinate of the center of gravity of the site of interest at time t. Hereinafter, the coordinates of the center of gravity of the site of interest are appropriately set as the position of the site of interest.

  It is possible to appropriately adjust how the user's action is detected as a moving operation when the user changes the position of the site of interest. Further, a plurality of movement operations may be prepared in association with the direction in which the site of interest moves.

In the present embodiment, as shown in FIG. 19A, the movement operation is associated with each of the upward direction, the downward direction, the left direction, and the right direction.
Here, the establishment condition of the moving operation associated with the upward direction is that the Y coordinate monotonously increases and increases by a predetermined value or more after a state in which the change of the Y coordinate is less than a predetermined value continues for a predetermined time or longer.
In addition, the condition for establishing the movement operation associated with the downward direction is that the Y coordinate decreases monotonously and decreases by a predetermined value or more after a change in the Y coordinate is less than a predetermined value for a predetermined time or longer.
A condition for establishing the moving operation associated with the left direction is that the Z coordinate is monotonously increased and increased by a predetermined value or more after a change in the Z coordinate is less than a predetermined value for a predetermined time or longer.
Further, the condition for establishing the moving operation associated with the right direction is that the Z coordinate is monotonously decreased and decreased by a predetermined value or more after a change in the Z coordinate is less than a predetermined value for a predetermined time or longer.

  FIG. 18 shows a user's movement when a moving operation associated with the left direction is established. Specifically, FIG. 18 shows that the user's left hand 1811 that is the site of interest is stationary at a position near the torso for a predetermined time or more in a state of facing the monitor 250, and then in the + direction of the Z axis for a predetermined distance or more. It shows how it stretches.

  Here, in the present embodiment, the greater the number of continuous inputs, which is the number of times that movement operations with similar trajectories are continuously input, the more the operation amount associated with the length and speed of the trajectory of the movement operation. The multiplication factor is set high. Here, when the next moving operation is detected before the predetermined grace time elapses from the time when the immediately preceding moving operation is detected, these moving operations are assumed to be continuous.

  In the example shown in FIG. 19B, when the number of continuous inputs is 1, the magnification is 1 time, when the number of continuous inputs is 2, the magnification is 2 times, and when the number of continuous inputs is 3, the magnification is When the number of continuous inputs is 4, the magnification is 8 times. When the number of continuous inputs is 5, the magnification is 16 times. As described above, the manipulated variable may be an amount determined by a power whose exponent is the number of continuous inputs.

  FIG. 20 shows a state in which the position and angle of the virtual camera change as the moving operation is continuously detected. FIG. 20 shows a state where the virtual camera 2000 and the model character 1801 are looked down on in the three-dimensional virtual space. Here, in the three-dimensional virtual space, it is assumed that the distance from the virtual camera 2000 to the model character 1801 is constant at r1, and the virtual camera 2000 faces the direction in which the model character 1801 exists. In this case, when the direction of the shooting direction vector from the virtual camera 2000 toward the model character 1801 is determined, the angle of the virtual camera 2000 is determined and the position of the virtual camera 2000 is also determined.

  Here, if the direction of the shooting direction vector is the target information, the operation amount for the target information is the rotation angle of the shooting direction vector. In other words, when a moving operation is detected, the rotation angle of the shooting direction vector is determined, and the virtual camera 2000 is adjusted to face the direction of the exemplary character 1801 according to the rotation angle of the shooting direction vector, It moves so as to draw an arc with the model character 1801 as the center. Note that FIG. 20 shows that the movement operation associated with the left direction is detected three times in succession, and every time the movement operation is detected, the rotation angle corresponding to the number of continuous inputs is displayed above the three-dimensional virtual space. An example is shown in which the shooting direction vector rotates counterclockwise as viewed from the viewpoint. This will be specifically described below.

  In the initial state, it is assumed that the virtual camera 2000 is arranged at VP0 that is a position facing the front of the model character 1801. At this time, as shown in FIG. 21A, an image showing the model character 1801 viewed from the front is displayed on the monitor 250.

  Here, when the first movement operation associated with the left direction is detected, the virtual camera 2000 moves to VP1, which is a position moved counterclockwise by an angle indicated by θ1 with the model character 1801 as the center. Moving. Θ1 is an angle formed by a straight line connecting VP0 and the exemplary character 1801 and a straight line connecting VP1 and the exemplary character 1801.

  At this point in time, as shown in FIG. 21B, an image showing the model character 1801 viewed from the right side of the front is displayed on the monitor 250. Further, a trajectory image 2101b representing the trajectory of the first moving operation is displayed on the monitor 250. The trajectory image 2101b can be an arrow image indicating the direction associated with the detected moving operation, as shown in the figure. Here, the length of the arrow indicated by the trajectory image 2101b can be a length associated with the length or speed of the trajectory of the moving operation. However, in this embodiment, it is assumed that the length and speed of the trajectory of the moving operation are constant each time, and the length of the arrow is constant. The trajectory image 2101b is an image for presenting the trajectory of the position of the specific part to the user when a movement operation is detected. Accordingly, when a viewpoint (viewpoint having an X coordinate smaller than that of the user) is set at a predetermined position behind the user and the specific part is projected on the monitor 250, the locus of the specific part projected on the surface of the monitor 250 The trajectory image 2101b is displayed in the monitor 250 so as to overlap. That is, the trajectory image 2101b represents a trajectory drawn by a mirror image of a specific part when the monitor 250 is regarded as a mirror.

  Here, when the second movement operation associated with the left direction is continuously detected after the first movement operation, the virtual camera 2000 counterclockwise by the angle indicated by θ2 with the model character 1801 as the center. It moves to VP2, which is the position moved around. Θ2 is an angle formed by a straight line connecting VP1 and the model character 1801 and a straight line connecting VP2 and the model character 1801. Here, θ2 = θ1 × 2.

  At this time, as shown in FIG. 21C, an image showing the model character 1801 viewed from the right side toward the model character 1801 is displayed on the monitor 250. Further, a trajectory image 2101c representing the trajectory of the second movement operation is displayed on the monitor 250. The trajectory image 2101c can be an arrow image indicating the direction associated with the detected movement operation, as shown in the figure. Here, the thickness of the arrow indicated by the trajectory image 2101c can be made larger than the thickness of the arrow indicated by the trajectory image 2101b.

  When the third movement operation associated with the left direction is detected continuously after the second movement operation, the virtual camera 2000 rotates counterclockwise by an angle indicated by θ3 with the model character 1801 as the center. Move to VP3 which is the position moved to. Θ3 is an angle formed by a straight line connecting VP2 and the model character 1801 and a straight line connecting VP3 and the model character 1801. Here, θ3 = θ1 × 4.

  At this point in time, as shown in FIG. 21D, an image showing the model character 1801 viewed from the back (back) is displayed on the monitor 250. Further, a trajectory image 2101d representing the trajectory of the third movement operation is displayed on the monitor 250. The trajectory image 2101d can be an image of an arrow indicating the direction associated with the detected movement operation, as illustrated. Here, the thickness of the arrow indicated by the trajectory image 2101d can be made larger than the thickness of the arrow indicated by the trajectory image 2101c.

  Thus, the position and angle of the virtual camera 2000 are changed according to the operation amount based on the user's movement operation.

  Next, the operation of the information display apparatus 1700 according to this embodiment will be described with reference to FIG. FIG. 22 is a flowchart showing information display processing executed by the information display apparatus 1700 according to this embodiment. Note that the information display processing shown in FIG. 22 is executed after the information display device 1700 functioning as a game device for executing a dance game receives an operation input instructing to change the angle at which the model character 1801 is viewed, for example. Process.

  First, the CPU 101 executes an initialization process (step S301). For example, the CPU 101 executes processing such as reading information of an object to be displayed on the initial screen such as the model character 1801 from the CD-ROM to the RAM 103. Further, the CPU 101 sets a variable representing the direction of the shooting direction vector to 0. Note that the variable representing the direction of the shooting direction vector is represented by a numerical value of 0 or more and less than 360, for example, and the virtual camera 2000 is centered on the model character 1801 when the virtual camera 2000 exists in the initial position VP0. The numerical value may be increased by the rotation angle as it rotates counterclockwise. Further, the CPU 101 clears the value of a timer counter described later to zero. It is assumed that variables representing the direction of the shooting direction vector and timer counter values are stored in the RAM 103 or the like.

  When completing the process of step S301, the CPU 101 displays an image representing an initial screen on the monitor 250 (step S302). Specifically, in cooperation with the image processing unit 110, the CPU 101 generates an image signal representing an initial screen based on the object information read out to the RAM 103 and supplies the image signal to the monitor 250. On the other hand, the monitor 250 displays an initial screen based on the supplied image signal. The initial screen is, for example, the screen shown in FIG. 21A.

  When the CPU 101 completes the process of step S302, it detects the position of the site of interest (step S303). For example, based on a signal supplied from the input device 116, the CPU 101 acquires coordinates (X coordinate, Y coordinate, Z coordinate) representing the position of the target region. Note that the CPU 101 stores, in the RAM 103 or the like, coordinates representing the position of the target region in association with the detection time. In addition, when detecting the position of the attention site every time the vertical synchronization interrupt is generated a predetermined number of times, the CPU 101 waits until the vertical synchronization interrupt is generated a predetermined number of times and then detects the position of the attention site. To do.

  When the CPU 101 completes the process of step S303, it determines whether or not the timer value is equal to or greater than a threshold value (step S304). Note that the value of the timer counter represents an elapsed time from the time when the trajectory image 2101 is displayed on the monitor 250 in step S311 described later. The trajectory image 2101 is a generic name for the trajectory image 2101b, the trajectory image 2101c, and the trajectory image 2101d. A timer counter that automatically counts up the value of the timer counter is started in step S312 described later. This threshold value is a value representing a grace period that is the time from the time when the trajectory image 2101 is displayed on the monitor 250 to the time when the display is erased.

  When the CPU 101 determines that the value of the timer counter is equal to or greater than the threshold (step S304: YES), the CPU 101 deletes the trajectory image 2101 displayed on the monitor 250 by controlling the image processing unit 110 (step S305). ).

  If the CPU 101 determines that the value of the timer counter is not equal to or greater than the threshold (step S304: NO), or completes the process of step S305, it determines whether or not there has been a moving operation (step S306). The CPU 101 determines, for example, whether or not there has been a movement operation based on the coordinates representing the position of the region of interest stored in the RAM 103 in association with the detection time.

  Here, an example of a method for determining whether or not a moving operation has been performed based on coordinates representing the position of the target region will be described.

  First, a case where a moving operation associated with the left direction is detected will be described. Note that, as shown in FIG. 19A, the conditions for establishing the movement operation associated with the left direction are as follows. After the state where the change in the Z coordinate is less than a predetermined value continues for a predetermined time or more, the Z coordinate monotonously increases and increases by a predetermined value or more. It is to be.

  FIG. 23 is a flowchart illustrating a moving operation detection process for detecting a moving operation associated with the left direction.

  First, the CPU 101 determines whether or not a stop confirmation flag has been set (step S401). Here, the stop confirmation flag is a flag that is set when it is detected that the site of interest is stationary. Note that the stop confirmation flag is stored in the RAM 103 or the like and is cleared in the initialization process in step S301.

  If the CPU 101 determines that the stop confirmation flag has not been set (step S401: NO), the CPU 101 determines whether or not the amount of change in the Z coordinate is less than a threshold (step S402). Here, the change amount of the Z coordinate is the Z coordinate stored in the RAM 103 in association with the second latest detection time of the Z coordinate stored in the RAM 103 in association with the latest detection time. The amount of change from

  When the CPU 101 determines that the change amount of the Z coordinate is not less than the threshold (step S402: NO), the CPU 101 stops the stop time counter (step S403). Here, the stop time counter is a counter that counts up the value of a variable (hereinafter referred to as “stop time counter value”) indicating the time during which the amount of change in the Z coordinate is maintained below a predetermined threshold. is there. Note that the value of the stop time counter is stored in the RAM 103, for example. The stop time counter is realized, for example, by the cooperation of the CPU 101 and the RTC 113.

  On the other hand, when the CPU 101 determines that the amount of change in the Z coordinate is less than the threshold (step S402: YES), the CPU 101 starts a stop time counter (step S404). Note that the CPU 101 does not perform any processing when the stop time counter is already activated. On the other hand, when the stop time counter is stopped, the CPU 101 clears the value of the stop time counter to 0 and then starts the stop time counter.

  When the CPU 101 ends the process of step S404, it determines whether or not the value of the stop time counter is equal to or greater than a threshold value (step S405). That is, in step S405, it is determined whether or not there has been no change in the Z-axis direction of the site of interest for a predetermined time or more.

  When the CPU 101 determines that the value of the stop time counter is equal to or greater than the threshold (step S405: YES), it sets a stop confirmation flag (step S406).

  When the CPU 101 finishes the process of step S406, it stops the stop time counter (step S407) and stores the stop position (step S408). The stop position is, for example, a Y coordinate stored in the RAM 103 in association with the latest detection time, and is stored in the RAM 103.

  On the other hand, when the CPU 101 determines that the stop confirmation flag has been set (step S401: YES), the CPU determines whether or not the movement start flag has been set (step S409). Here, the movement start flag is a flag that is set when it is detected that the region of interest has shifted from a stationary state to a movement state in the + direction of the Z axis. It is assumed that the movement start flag is stored in the RAM 103 or the like and has been cleared in the initialization process in step S301.

  When determining that the movement start flag has not been set (step S409: NO), the CPU 101 determines whether or not the total decrease amount of the Z coordinate is equal to or greater than the first threshold (step S410). Here, the total decrease amount of the Z coordinate is stored in the RAM 103 in association with the detection time of the Z coordinate stored in the RAM 103 that is associated with the latest detection time and determined that the target region has stopped. The amount of decrease from the Z coordinate (the stop position stored in step S408). The first threshold value is a threshold value for determining whether or not the target region has shifted from the stationary state to the moving state. That is, in step S410, it is determined whether or not the target region has shifted from a stopped state to a moving state in the negative direction of the Z axis.

  If the CPU 101 determines that the total amount of decrease in the Z coordinate is equal to or greater than the first threshold (step S410: YES), the CPU 101 clears the stop confirmation flag (step S413). In other words, the purpose of this movement operation detection process is to detect a movement operation associated with the left direction. Therefore, when it is detected that the attention site has moved to the right from the stopped state, the attention site is again detected. The process returns to the process of detecting the stop state.

  On the other hand, if the CPU 101 determines that the total decrease amount of the Z coordinate is not equal to or greater than the first threshold value (step S410: NO), the CPU 101 determines whether the total increase amount of the Z coordinate is equal to or greater than the first threshold value (step S410). S411). Here, the total increase amount of the Z coordinate is stored in the RAM 103 in association with the detection time of the Z coordinate stored in the RAM 103 that is associated with the latest detection time and determined that the target region has stopped. This is the amount of increase from the Z coordinate (the stop position stored in step S408). That is, in step S411, it is determined whether or not the target region has shifted from a stopped state to a moving state in the + direction of the Z axis.

  When the CPU 101 determines that the total increase amount of the Z coordinate is equal to or greater than the first threshold (step S411: YES), the CPU 101 sets a movement start flag (step S412).

  On the other hand, when the CPU 101 determines that the movement start flag has been set (step S409: YES), the CPU determines whether or not the increase amount of the Z coordinate is less than the threshold (step S414). Here, the increase amount of the Z coordinate is the Z coordinate stored in the RAM 103 in association with the second latest detection time of the Z coordinate stored in the RAM 103 in association with the latest detection time. Increase from That is, in step S414, it is determined whether or not the movement of the target region in the + direction of the Z axis has been completed.

  When the CPU 101 determines that the increase amount of the Z coordinate is less than the threshold (step S414: YES), the CPU clears the stop confirmation flag (step S415), and further clears the movement start flag (step S416).

  CPU 101 complete | finishes the process of step S416, and will discriminate | determine whether the total increase amount of Z coordinate is more than a 2nd threshold value (step S417). Here, the second threshold value is a threshold value for determining whether or not the target region has moved to such an extent that it can be regarded as a moving operation. Accordingly, the second threshold value is larger than the first threshold value.

  When the CPU 101 determines that the total increase amount of the Z coordinate is equal to or greater than the threshold (step S417: YES), the CPU determines that there is a moving operation associated with the left direction (step S418). For example, the CPU 101 sets a flag indicating that there has been a moving operation associated with the left direction. This flag is stored in the RAM 103, for example.

  On the other hand, when the CPU 101 completes the process of step S403, determines that the value of the stop time counter is not equal to or greater than the threshold value (step S405: NO), or ends the process of step S408, increases the amount of Z coordinates. Is determined not to be greater than or equal to the first threshold (step S411: NO), the process of step S412 is terminated, the process of step S413 is terminated, or the increase amount of the Z coordinate is determined not to be less than the threshold (Step S414: NO) Or, when it is determined that the total increase amount of the Z coordinate is not greater than or equal to the second threshold (Step S417: NO), it is determined that there is no moving operation associated with the left direction (Step S419). For example, the CPU 101 clears a flag indicating that there has been a moving operation associated with the left direction.

  When the CPU 101 ends the process of step S418 or step S419, the movement operation detection process ends.

  Note that the flowchart shown in FIG. 23 is a process for detecting a moving operation associated with the left direction, but a moving operation associated with another direction can also be detected by the same method. That is, by replacing the process of each step in the flowchart shown in FIG. 23 with the process shown below, a moving operation associated with another direction is detected. A stop confirmation flag, a stop time counter, and a movement start flag are prepared for each direction.

  First, when a movement operation associated with the right direction is detected, it is determined in step S410 whether or not the total increase amount of the Z coordinate is greater than or equal to the first threshold value. In step S411, the total decrease amount of the Z coordinate is the first value. It is determined whether or not the threshold value is greater than or equal to a threshold value. In step S414, it is determined whether or not the decrease amount of the Z coordinate is less than the threshold value. In step S417, whether or not the total decrease amount of the Z coordinate is equal to or greater than the second threshold value. In step S418, it is determined that there is a moving operation associated with the right direction, and in step S419, it is determined that there is no moving operation associated with the right direction.

  When a moving operation associated with the upward direction is detected, it is determined in step S402 whether or not the change amount of the Y coordinate is less than the threshold value. In step S410, the total decrease amount of the Y coordinate is greater than or equal to the first threshold value. In step S411, it is determined whether or not the total increase amount of the Y coordinate is greater than or equal to the first threshold value. In step S414, it is determined whether or not the increase amount of the Y coordinate is less than the threshold value. In step S417, it is determined whether or not the total increase amount of the Y coordinate is greater than or equal to the second threshold value. In step S418, it is determined that there is a moving operation associated with the upward direction, and in step S419, the movement associated with the upward direction. It is determined that there is no operation.

  When a movement operation associated with the downward direction is detected, it is determined in step S402 whether or not the change amount of the Y coordinate is less than the threshold value. In step S410, the total increase amount of the Y coordinate is greater than or equal to the first threshold value. In step S411, it is determined whether or not the total decrease amount of the Y coordinate is greater than or equal to the first threshold value. In step S414, it is determined whether or not the decrease amount of the Y coordinate is less than the threshold value. In step S417, it is determined whether or not the total decrease amount of the Y coordinate is greater than or equal to the second threshold value. In step S418, it is determined that there is a moving operation associated with the downward direction, and in step S419, the movement associated with the downward direction. It is determined that there is no operation.

  When the CPU 101 determines that there is no movement operation associated with any direction (step S306: NO), the CPU 101 returns the process to step S303.

  On the other hand, when the CPU 101 determines that there is a moving operation associated with any direction (step S306: YES), the trajectory of the moving operation detected this time is similar to the trajectory of the moving operation detected immediately before. Whether or not (step S307). That is, in step S307, a trajectory image 2101 representing the trajectory of the movement operation detected immediately before is displayed on the monitor 250, and the trajectory of the movement operation detected this time and the trajectory of the movement operation detected immediately before are displayed. Are similar to each other. Whether or not the trajectories of the movement operation are similar to each other may be determined only by whether or not the directions associated with the movement operation match. In addition to the coincidence / mismatch of such directions, The determination may be made in consideration of whether the degree of overlap of these trajectories is larger than a predetermined threshold.

  When the CPU 101 determines that the locus of the movement operation detected this time is similar to the locus of the movement operation detected immediately before (step S307: YES), it substitutes (N + 1) for N, that is, N Is incremented by one (step S308). Here, N is a value indicating the number of times that a moving operation similar to the locus of the movement operation detected this time is detected immediately before the movement operation is detected. . Here, “continuous” means that the trajectory image 2101 representing the trajectory of the immediately preceding moving operation is displayed on the monitor 250 before the grace time elapses from the time when the trajectory image 2101 representing the trajectory of the immediately preceding moving operation is displayed on the monitor 250. Means that the next move operation is detected (while displayed). Note that the value of N is stored in the RAM 103.

  On the other hand, when the CPU 101 determines that the trajectory of the movement operation detected this time is not similar to the trajectory of the movement operation detected immediately before (step S307: NO), the CPU 101 substitutes 0 for N, that is, N Is set to 0 (step S309). Note that the value of N is stored in the RAM 103.

  When completing the process of step S308 or step S309, the CPU 101 determines the rotation angle based on the value of N (step S310). Here, the rotation angle is an angle for rotating a shooting direction vector (an angle at which the model character 1801 is shot). Here, when the value of N is 0, the rotation angle is set to a default value associated in advance with the direction of the detected moving operation, the length of the trajectory of the moving operation, the speed of the moving operation, and the like. The On the other hand, when the value of N is 1 or more, the rotation angle is a value larger than the predetermined value, and is set to a larger value as N is larger. The determined rotation angle is stored in the RAM 103.

  When the CPU 101 completes the process of step S <b> 310, the trajectory image 2101 representing the trajectory of the last detected movement operation is displayed on the monitor 250 based on the coordinates representing the position of the target region stored in the RAM 103. (Step S311).

  When the CPU 101 ends the process of step S311, the CPU 101 starts a timer counter (step S312). The timer counter automatically counts up a value representing the elapsed time from the time when the trajectory image 2101 representing the trajectory of the moving operation is displayed on the monitor 250 at every predetermined period. This timer counter is realized by the cooperation of the CPU 101 and the RTC 113, for example.

  When the CPU 101 finishes the process of step S312, the CPU 101 moves the virtual camera 2000 (step S313). For example, the CPU 101 moves the virtual camera 2000 according to the rotation angle determined in step S310, controls the image processing unit 107, and represents a state in the virtual space taken from the moved virtual camera 2000. An image signal is generated and supplied to the monitor 250. On the other hand, based on the image signal supplied from the CPU 101, the monitor 250 displays an image representing a state in the virtual space viewed from a viewpoint different from the previous one.

  When the CPU 101 ends the process of step S313, the process returns to step S303.

  According to the information display device 1700 according to the present embodiment, when a moving operation with similar trajectories is continuously performed, the rotation angle associated with the moving operation increases each time the moving operation is detected. For this reason, when a moving operation with similar trajectories is repeatedly detected, the viewpoint can be quickly rotated by a relatively small number of moving operations.

(Fifth embodiment)
In 4th Embodiment, the example which detects the motion of an attention site | part was shown using the input device 116 provided with a camera and an infrared sensor. However, the method for detecting the movement of the region of interest is not limited to this method. Hereinafter, in the present embodiment, in the information processing apparatus 150 according to the fourth embodiment, instead of the input device 116, the right hand controller 210, the left hand controller 220, and the sensor bar 230 are used to detect the movement of the attention site. An example will be described.

  FIG. 24 is a diagram illustrating a configuration example of the information display device according to the present embodiment.

  The right-hand controller 210 is a main controller, and has an appearance similar to a remote controller such as a television, for example, and is connected to the information processing apparatus 150 wirelessly (by wireless communication).

  On the other hand, the left-hand controller 220 is an auxiliary controller that is used while being connected to the right-hand controller 210, and transmits information to the information processing apparatus 150 via the right-hand controller 210.

  The user plays the game by holding the right-hand controller 210 and the left-hand controller 220 with both hands. In the information processing apparatus 150, holding the right hand controller 210 with the right hand and holding the left hand controller 220 with the left hand is determined as a correct (standard) way of holding.

  The sensor bar 230 is formed in a bar shape having a predetermined length, and is appropriately fixed on the upper portion of the monitor 250 along the direction of the screen. In the sensor bar 230, one light emitting element 231 is embedded at each end. Note that the number of light-emitting elements 231 embedded is an example, and may be larger than these numbers. The sensor bar 230 receives power from the information processing apparatus 150 and causes the light emitting element 231 to emit light appropriately. The sensor bar 230 is connected to the information processing apparatus 150 via a predetermined cable.

  In the right-hand controller 210, when the CCD camera 211 is disposed at the tip and the tip is directed to the monitor 250, the CCD camera 211 captures an image including the two light emitting elements 231 (two light emitting points) of the sensor bar 230. Further, the right-hand controller 210 includes a wireless communication unit therein, and sequentially transmits information of captured images to the information processing apparatus 150 by wireless communication.

  Then, the information processing apparatus 150 appropriately acquires the position and orientation of the right hand controller 210 based on the positional relationship between the two light emitting points in the image sent from the right hand controller 210. For example, the CPU 101, the image processing unit 107, and the like analyze the positional relationship between two light emitting points that can be seen from the right-hand controller 210, and the spatial position of the right-hand controller 210 and the direction of the tip (the direction of the longitudinal axis). Is calculated, and finally the user is operating the right-hand controller 210 on the screen. Note that such measurement of the position of the right-hand controller 210 is performed, for example, every vertical synchronization interrupt (1/60 seconds).

  The right-hand controller 210 includes a triaxial acceleration sensor therein, and can measure the movement of the right hand controller 210 in the three-axis direction. Note that the movement of the right-hand controller 210 may be measured by an angular velocity sensor, an inclination sensor, or the like instead of such an acceleration sensor. The right-hand controller 210 sequentially transmits such measurement results (eg, acceleration information for each of the three axes) to the information processing apparatus 150. Then, the information processing apparatus 150 detects the movement of the right hand controller 210 based on the measurement result sent from the right hand controller 210. For example, an operation such as a user swinging, twisting or striking the right-hand controller 210 and its moving direction are acquired. Note that such detection of the movement of the right-hand controller 210 is also performed, for example, every vertical synchronization interrupt.

  A cross-shaped key 212 is arranged on the upper surface of the right-hand controller 210, and the user can input an instruction specifying an arbitrary direction. An A button 213 and various buttons 215 are also arranged on the upper surface, and the user can input instructions associated with these buttons. On the other hand, the B button 214 is disposed on the lower surface of the right-hand controller 210. The B button 214 has a depression formed on the surface to be pressed, and can be operated so that the user pulls the trigger.

  A plurality of small holes 216 are provided on the upper surface of the right-hand controller 210 so that clear sound can be output from a speaker embedded therein. The indicator 217 on the upper surface of the right-hand controller 210 is appropriately lit so that the user can identify even when a plurality of right-hand controllers 210 are used. The power button 218 prepared on the upper surface of the right-hand controller 210 instructs, for example, on / off of the information processing apparatus 150. Further, a vibration mechanism such as a vibrator is arranged inside the right-hand controller 210 so that vibration can be generated in response to instruction information sent from the information processing apparatus 150.

  On the other hand, the left-hand controller 220 also includes a triaxial acceleration sensor inside, and can measure the movement of the left-hand controller 220 in the three-axis direction. Note that the movement of the left-hand controller 220 may be measured by an angular velocity sensor, an inclination sensor, or the like instead of such an acceleration sensor. The left-hand controller 220 sequentially transmits such measurement results (eg, acceleration information for each of the three axes) to the information processing apparatus 150 via the right-hand controller 210.

  Then, the information processing apparatus 150 detects the movement of the left-hand controller 220 based on the measurement result from the left-hand controller 220. For example, an operation such as a user swinging, twisting, or striking the left-hand controller 220 and its moving direction are acquired. The detection of the movement of the left-hand controller 220 is also performed for each vertical synchronization interrupt, for example.

  A control stick 221 is arranged on the upper surface of the left-hand controller 220, and the user can input an instruction specifying an arbitrary direction. In addition, a C button 222 is disposed at the tip of the left hand controller 220, and a Z button 223 is disposed on the lower surface of the left hand controller 220 so that the user can perform various operations. It has become.

  As described above, the operation, position, and the like of the right-hand controller 210 and the left-hand controller 220 are obtained by the combination of the right-hand controller 210, the left-hand controller 220, and the sensor bar 230. The measurement of the position of the right-hand controller 210 or the like is not limited to the method in which the CCD camera 211 captures the light emission point (the light emitting element 231) of the sensor bar 230, and other methods can be appropriately applied. For example, the position of the right-hand controller 210 or the like may be obtained from the time difference of wireless communication between two points via the sensor bar 230, or the right hand may be determined based on the principle of triangulation using ultrasonic waves or infrared rays. The position of the controller 210 or the like may be obtained.

  Here, when the user is holding the right hand controller 210 with the right hand, the position of the right hand and the position of the right hand controller 210 can be regarded as substantially the same position. Therefore, when the user holds the right hand controller 210 with the right hand, the CPU 101 can detect the movement of the right hand by the various processes described above.

  Similarly, when the user is holding the left hand controller 220 with the left hand, the position of the left hand and the position of the left hand controller 220 can be regarded as substantially the same position. Therefore, when the user holds the left hand controller 220 with the left hand, the CPU 101 can detect the movement of the left hand by the various processes described above.

  Note that the information display processing according to the present embodiment is performed in step S303 except that the position of the target region is detected using the right hand controller 210, the left hand controller 220, and the sensor bar 230 instead of the input device 116. This is the same as the information display process shown in FIG.

  According to the information display apparatus according to the present embodiment, when a moving operation with similar trajectories is continuously performed, the rotation angle associated with the moving operation increases each time the moving operation is detected. For this reason, when a moving operation with similar trajectories is repeatedly detected, the viewpoint can be quickly rotated by a relatively small number of moving operations.

(Sixth embodiment)
In the first to fifth embodiments, examples in which the present invention is applied to one information display device have been described. However, the present invention may be applied to an information display system including a plurality of information display devices. Hereinafter, the information display system according to the present embodiment will be described.

  As shown in FIG. 26, the information display system 2600 according to this embodiment includes an information display device 310, an information display device 320, and an information display server 330. The information display device 310, the information display device 320, and the information display server 330 are connected to each other via a computer communication network such as the Internet, and communicate with each other by infrastructure communication. In addition, when at least one of the information display device 310 and the information display device 320 has a function that the information display server 330 has, the information display server 330 may not be included in the information display system 2600.

  The information display device 310 is connected to the information display device 320 and the information display server 330 via the Internet, and transmits and receives various data. For example, the information display device 310 presents an image based on the image information received from the information display server 330 to the user A. Further, the information display device 310 transmits information indicating the movement operation detected from the operation of the user A to the information display server 330. The information display device 310 may have the same configuration as the information display device 300 according to the first embodiment. For example, the information display apparatus 310 is realized by turning on the information processing apparatus 100 in a state where a predetermined memory cassette 106 is mounted in the slot of the information processing apparatus 100.

  The information display device 320 is connected to the information display device 310 and the information display server 330 via the Internet, and transmits and receives various data. For example, the information display device 320 presents an image based on the image information received from the information display server 330 to the user B. Further, the information display device 320 transmits information indicating the movement operation detected from the operation of the user B to the information display server 330. The information display device 320 basically has the same configuration and function as the information display device 310.

  The information display server 330 is connected to the information display device 310 and the information display device 3210 via the Internet, and transmits and receives various data. For example, the information display server 330 generates image information representing an image presented to the user A or the user B, and transmits the image information to the information display device 310 or the information display device 320. Further, the information display server 330 receives information indicating the movement operation detected from the operation of the user A from the information display device 310, and receives information indicating the movement operation detected from the operation of the user B from the information display device 320. Receive. The information display server 330 is configured by a personal computer, a workstation, or the like. The information display server 330 includes a server side control unit, a server side storage unit, a server side communication unit, and the like.

  Next, the operation of the information display system 2600 according to this embodiment will be described. In the present embodiment, an example will be described in which the information display system 2600 controls a boxing game in which one user character is operated by both the user A and the user B. The basic control of the boxing game is the same as the information display process shown in FIG. Hereinafter, an information display process executed by the information display system 2600 according to the present embodiment will be described with reference to FIG.

  The information display server 330 executes basic control of the boxing game, and the information display device 310 and the information display device 320 function as a user interface. In this case, the server-side control unit controls the boxing game according to the program stored in the server-side storage unit. In addition, the server-side control unit controls the server-side communication unit to transmit image information to the information display device 310 and the information display device 320, and information indicating a movement operation is transmitted to the information display device 310 and the information display device 320. Receive from.

  First, in step S201, the server-side control unit executes an initialization process to read out information on an object displayed on the initial screen and initialize variables.

  In step S <b> 202, the server-side control unit generates an image representing an initial screen, and transmits the generated image to the information display device 310 and the information display device 320. On the other hand, the information display device 310 and the information display device 320 display the image received from the information display server 330 on the screen. Therefore, the image that the information display device 310 presents to the user A and the image that the information display device 320 presents to the user B are the same image.

  In step S203, the information display device 310 detects a touch position by a touch operation performed by the user A, and the information display device 320 detects a touch position by a touch operation performed by the user B. Note that the coordinates representing the touch position and the detection time are appropriately supplied to the information display server 330. And the coordinate showing a touch position is matched with detection time, and is memorize | stored in the server side memory | storage part.

  In step S204, the server-side control unit determines whether or not the value of the timer counter is equal to or greater than a threshold value. Note that the value of the timer counter represents the elapsed time from the time when the information display device 310 and the information display device 320 displayed the trajectory image. This threshold value is a value representing a grace period that is the time from the time when the information display device 310 and the information display device 320 display the trajectory image to the time when the trajectory image is deleted.

  Here, in step S <b> 205, the server-side control unit transmits information indicating the image from which the trajectory image has been deleted to the information display device 310 and the information display device 320. Thereby, the images displayed by the information display device 310 and the information display device 320 are images from which the trajectory image has been deleted.

  In step S <b> 206, the server-side control unit determines whether or not a tracing operation by the user A or a tracing operation by the user B has been performed. For example, the server-side control unit determines whether or not there has been a tracing operation based on the coordinates representing the touch position stored in the server-side storage unit in association with the detection time.

  In step S207, the server-side control unit determines whether or not the trajectory of the tracing operation detected this time is similar to the trajectory of the tracing operation detected immediately before. Here, the tracing operation performed by the user A and the tracing operation performed by the user B are not distinguished. That is, it is determined whether or not the trace of the latest tracing operation performed by either the user A or the user B is similar to the trace of the previous tracing operation performed by either the user A or the user B.

  In step S208, the server-side control unit substitutes (N + 1) for N, that is, increases the value of N by one. Here, N is a value indicating the number of times that the tracing operation similar to the tracing operation detected this time is continuously detected immediately before the tracing operation is detected. . Note that the value of N is stored, for example, in the server-side storage unit.

  On the other hand, in step S209, the server-side control unit substitutes 0 for N, that is, sets the value of N to 0. Note that the value of N is stored, for example, in the server-side storage unit.

  In step S210, the server-side control unit determines the attack power based on the value of N. The determined attack power is stored, for example, in the server-side storage unit.

  Next, in step S211, the server side control unit generates an image including a trajectory image representing the trajectory of the last detected tracing operation based on the coordinates representing the touch position stored in the server side storage unit. To the information display device 310 and the information display device 320. Thereby, the images displayed by the information display device 310 and the information display device 320 are images including a trajectory image.

  In step S212, the server-side control unit starts a timer counter. The timer counter automatically counts up a value representing the elapsed time from the time when the trajectory image representing the trajectory of the tracing operation is displayed on the screen every predetermined period. The timer counter is provided in the information display server 330, for example.

  In step S <b> 213, the server-side control unit generates an image indicating that the physical strength is reduced according to the determined attack power, and transmits the image to the information display device 310 and the information display device 320. As a result, the images displayed by the information display device 310 and the information display device 320 are images that show how the physical strength is reduced according to the determined attack power.

  According to the information display system 2600 according to the present embodiment, when a tracing operation with similar trajectories is performed by any of a plurality of users, the attack power associated with the tracing operation every time the tracing operation is detected. Becomes larger. According to such a configuration, it is possible to defeat the enemy character more efficiently when all users repeat the same tracing operation, rather than repeating different tracing operations for each user. Thereby, a sense of unity and solidarity is born between the users, and it can be expected that the pleasure of playing one game by a plurality of users is increased.

(Modification)
The present invention is not limited to the first to sixth embodiments described above, and various modifications are possible.

  In the first, fourth, and fifth embodiments, an example has been described in which the thickness of the arrow indicated by the trajectory image 600 gradually increases as the number of repetitions of the tracing operation and the moving operation with similar trajectories increases. However, the appearance of the trajectory image 600 that changes as the number of repetitions increases is not limited to this. For example, the color (saturation, brightness, hue) of the trajectory image 600 can be changed as the number of repetitions increases.

  In the first and third embodiments, an example in which the operation amount determined based on the tracing operation is the scroll amount of the image displayed on the screen is shown. In the second embodiment, the operation amount is determined based on the tracing operation. In the fourth and fifth embodiments, the operation amount determined based on the moving operation is an example of the rotation angle of the viewpoint of viewing the model character. It was. However, the operation amount determined based on the tracing operation or the moving operation may be any value. For example, the operation amount determined based on the tracing operation may be a map enlargement rate (or reduction rate) when a map is displayed on the screen. In this case, the enlargement ratio (or reduction ratio) is determined so that the enlargement ratio is large (or the reduction ratio is small) every time tracing operations having similar trajectories are continuously detected.

  In the first and third embodiments, an example in which the operation amount is determined by the length of the trajectory of the tracing operation is shown, and in the second embodiment, an example in which the operation amount is determined by the speed of the tracing operation is shown. . However, it is possible to appropriately adjust whether the operation amount is determined based on the length of the trajectory of the tracing operation or moving operation or the speed of the tracing operation or moving operation. Further, the operation amount may be determined based on both the length of the trajectory of the tracing operation and the moving operation and the speed of the tracing operation and the moving operation.

  In addition, the conditions for detecting the tracing operation and the moving operation are not limited to those disclosed in the above embodiment. For example, in the fourth embodiment, the example in which the movement amount in the other direction is not considered as the condition for establishing the movement operation associated with a certain direction is shown, but the movement amount in the other direction may be considered.

  In the fourth embodiment, the trajectory image 2101 representing the trajectory of the specific part is displayed on the screen, while the image representing the current position of the specific part is not displayed on the screen. However, in the present invention, an image representing the current position of the specific part may be displayed on the screen.

  For example, as shown in FIG. 25, the CPU 101 may display a target part object 2501 that imitates the target part at a position in the screen corresponding to the current position of the target part (left hand 1811) in the real space. Note that when a viewpoint (viewpoint having an X coordinate smaller than that of the user) is set at a predetermined position behind the user and the specific part is projected on the screen, the target part is overlapped with the specific part projected on the screen. An object 2501 can be displayed in the screen. That is, the attention site object 2501 corresponds to a mirror image of a specific site when the screen is viewed as a mirror. Note that FIG. 25 illustrates a state in which the target region is moved by the user so that the target region object 2501 traces the trajectory image 2101b after the first movement operation is detected.

  According to such a configuration, the user is presented with which position in the screen the current position of the specific part in the real space corresponds to. For this reason, the user can execute a moving operation with reference to the position of the specific part object 2501 displayed in the screen. Typically, the user can easily repeat the moving operation similar to the input movement operation by moving the specific part so that the specific part object 2501 traces the trajectory image 2101b in the screen.

  In the sixth embodiment, the example in which the present invention is applied to the information display system 2600 including a plurality of information display devices connected to each other by infrastructure communication has been described. However, the information display system to which the present invention is applied is described below. It is not limited to this example. For example, as shown in FIG. 27, the present invention may be applied to an information display system 2700 in which an information display device 340 and an information display device 350 are connected by ad hoc communication. In this case, the function provided in the information display server 330 is provided in at least one of the information display device 340 and the information display device 350. The number of information display devices connected to each other is not limited to two and may be three or more.

  In the sixth embodiment, an example in which the present invention is applied to an information display system including a plurality of information display devices has been described. However, even if the present invention is applied to an information display device having functions provided in the information display system. Good. For example, as shown in FIG. 28, the present invention can be applied to an information display device realized by an information processing device 160 including two touch screens (touch screen 108A and touch screen 108B). In this case, the touch screen 108 </ b> A detects the moving operation from the first operation by the user A, and presents the display information and the locus of the moving operation detected last to the user A. The touch screen 108 </ b> B detects the moving operation from the second operation by the user B, and presents the display information and the trajectory of the moving operation detected last to the user B. The amount of operation increases each time a movement operation similar to the last detected movement operation is detected from the first action or the second action.

  In the sixth embodiment, an example is shown in which the present invention is applied to a game system in which a plurality of users operate the same teammate character, but the system to which the present invention is applied is not limited to this example. For example, the present invention may be applied to a game system in which each of a plurality of users operates one of a plurality of teammate characters who cooperate with each other to fight an enemy character. Also in this case, when similar tracing operations are repeated by a plurality of users, damage to the enemy character increases. Typically, each of a plurality of users repeats a tracing operation for causing the teammate character operated by the user to perform the same attack as the teammate character operated by another user, thereby increasing the damage to the enemy character. Will go.

  The system to which the present invention is applied is not limited to a game system, and the present invention may be applied to a system in which a plurality of users browse and edit a document (text, map, drawing, etc.).

  As described above, according to the present invention, an information display device, an information display method, and the like suitable for appropriately determining information to be displayed on the screen based on the moving operation detected from the user's operation, Can be provided by a computer.

100, 150, 160 Information processing apparatus 101 CPU
102 ROM
103 RAM
104 Interface 105 Input unit 106 Memory cassette 107 Image processing unit 108, 108A, 108B, 108a-f Touch screen 109 NIC
110 Audio processing unit 111 Microphone 112 Speaker 113 RTC
114 Hard disk 115 External memory 116 Input device 117 DVD-ROM drive 210 Right hand controller 211 CCD camera 212 Cross key 213 A button 214 B button 215 button 216 Hole 217 Indicator 218 Power button 220 Left hand controller 221 Control stick 222 C button 223 Z button 230 Sensor bar 231 Light emitting element 250 Monitor 300, 310, 320, 340, 350, 1700 Information display device 301, 1701 Detection unit 302, 1702 Operation amount acquisition unit 303, 1703 Change unit 304, 1704 Display information acquisition unit 305, 1705 Display unit 330 Information display server 401 Document 402, 1302 Attention range 410 Finger 600, 600b, 600c, 600d, 600f, 920, 1 00,2101,2101b, 2101c, 2101d, the path image 901 ally character 902 enemy character 911 ally physical strength gauge 912 enemy stamina gauge 1301 map 1801 model character 1811 left hand 2000 virtual camera 2501 specific site object 2600,2700 information display system

Claims (13)

A detection unit for detecting a predetermined movement operation from a user's action;
An operation amount acquisition unit that acquires an operation amount for target information from the length or speed of the detected trajectory of the movement operation,
A changing unit that changes the target information based on the acquired operation amount,
A display information acquisition unit that acquires display information to be displayed on the screen based on the target information after the change,
A display unit for displaying the acquired display information on the screen;
The operation amount acquisition unit
(A) When the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before the detected moving operation are not similar, the length or speed of the detected trajectory of the moving operation is set. A default value associated in advance is acquired as the operation amount,
(B) If the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A value larger than a predetermined value associated in advance is acquired as the operation amount. The information display device according to claim 1,
The operation amount acquisition unit acquires the operation amount with respect to the last detected movement operation among the detected movement operations every time the movement operation is detected. . The information display device according to claim 1 or 2,
The display unit further displays a trajectory of the last detected movement operation among the detected movement operations on the screen. The information display device according to any one of claims 1 to 3,
The detection unit captures the user's action by photographing the user or measuring the position, speed, or acceleration of a controller held by the user,
In the case where the acquired user action is to move the part or the controller in a predetermined direction after stopping the predetermined part or the controller of the user's body, the predetermined direction An information display device that detects that a movement operation of a type associated with is performed. The information display device according to any one of claims 1 to 3,
The detection unit acquires the user's tracing operation on the screen based on whether or not the user touches the screen, and uses the acquired tracing operation as the moving operation. The information display device according to claim 3,
After the last detected movement operation trajectory is displayed on the screen, when a predetermined grace period elapses without the movement operation being detected, the display unit displays the last detected movement operation trajectory. Erase from the screen,
The operation amount acquisition unit
(C) When the trajectory of the last detected movement operation is not displayed on the screen, a default value associated in advance with the length or speed of the trajectory of the last detected movement operation is used as the operation amount. An information display device characterized by acquiring. The information display device according to any one of claims 1 to 6,
When the trajectory of the last detected moving operation among the detected moving operations is similar to each of the N moving operation trajectories detected immediately before, the operation amount acquisition unit calculates a positive value range. A value obtained by adding a value obtained by applying N to a monotonically increasing function having the default value or a value obtained by multiplying the default value by a value obtained by applying N to a monotonically increasing function having one or more value ranges from the default value An information display device characterized by a large value. The information display device according to claim 7,
The display unit further displays a trajectory of the last detected movement operation among the detected movement operations on the screen.
The display unit determines an appearance for displaying a trajectory of the last detected movement operation on the screen based on N. The information display device according to any one of claims 1 to 8,
The target information is the position or size of the range of interest in the document,
The changing unit changes the position or size of the range of interest in the document based on the acquired operation amount,
The information display device, wherein the display information acquisition unit acquires information included in an attention range whose position or size is changed in the document as the display information. The information display device according to any one of claims 1 to 8,
The target information is a parameter of a game character,
The changing unit changes the parameter based on the acquired operation amount,
The display information acquisition unit acquires the changed parameter as the display information. The information display device according to claim 3,
The detection unit detects the predetermined movement operation from a first action by a first player and a second action by a second player,
The screen includes a first display that displays the display information and the locus, and a second display that displays the display information and the locus. An information display method executed by an information display device including a detection unit, an operation amount acquisition unit, a change unit, a display information acquisition unit, and a display unit,
A detection step in which the detection unit detects a predetermined movement operation from a user's action;
An operation amount acquisition step in which the operation amount acquisition unit acquires an operation amount with respect to target information from the length or speed of the detected movement operation locus,
A changing step in which the changing unit changes the target information based on the acquired operation amount;
A display information acquisition step in which the display information acquisition unit acquires display information to be displayed on a screen based on the target information after the change;
The display unit includes a display step of displaying the acquired display information on the screen,
In the operation amount acquisition step, the operation amount acquisition unit includes:
(A) When the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before the detected moving operation are not similar, the length or speed of the detected trajectory of the moving operation is set. A default value associated in advance is acquired as the operation amount,
(B) If the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A method of displaying an information, wherein a value larger than a predetermined value associated in advance is acquired as the operation amount. Computer
A detection unit for detecting a predetermined movement operation from a user's action;
An operation amount acquisition unit that acquires an operation amount for target information from the length or speed of the detected trajectory of the movement operation,
A changing unit that changes the target information based on the acquired operation amount,
A display information acquisition unit that acquires display information to be displayed on the screen based on the target information after the change,
A program for functioning as a display unit for displaying the acquired display information on the screen,
The operation amount acquisition unit
(A) When the detected trajectory of the moving operation and the trajectory of the moving operation detected immediately before the detected moving operation are not similar, the length or speed of the detected trajectory of the moving operation is set. A default value associated in advance is acquired as the operation amount,
(B) If the detected trajectory of the moving operation is similar to the trajectory of the moving operation detected immediately before the detected moving operation, the length or speed of the detected trajectory of the moving operation is set. A program that acquires a value larger than a predetermined value associated in advance as the operation amount.

Images