JP2014142693A - Information processor, control method for information processor, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable information processor designed such that even a complicated input operation can easily be performed with one hand.SOLUTION: A display part 101 displays on a display screen first and second menu screens, each of which includes a plurality of items for processing. A terminal state detecting part 105 detects the direction of movement and an amount of movement of the own device from a reference position in a three-dimensional space. From the detected direction and amount of movement, a determination part 110 determines whether a shake operation has been performed or not, the shake operation being a series of actions in which the own device moves in one direction and returns to the reference position within a fixed time. If the shake operation is performed, a control part 109 exerts control such that an item is selected from the first menu screen in a case where the first direction of movement during the shake operation is horizontal, an item is selected from the second menu screen in a case where the first direction of movement is vertical, and processing is performed according to each item selected in a case where the first direction of movement is in a depth direction.

Description

  The present invention relates to a portable information processing device, and more particularly to input processing to the information processing device.

Mobile terminals, which are small and portable information terminal devices, are in widespread use. Examples of the mobile terminal include a PDA (Personal Digital Assistant), a smartphone, and a tablet terminal.
Mobile terminals often have a touch panel provided with a touch sensor on a display screen as an input device. The user performs various input operations by touching the touch panel. In the touch operation, the mobile terminal may be held with one hand and the touch operation may be performed with the other hand. In this case, the user uses both hands for the input operation. However, since the user may not be able to use both hands depending on the usage situation, a desired input operation may not be performed.

  When a desired function is selected from the menu screen displayed on the display screen, the touch operation on the selection button in the menu screen may be repeated. However, the display screen of the mobile terminal is generally small, and the selection button is likely to be pressed incorrectly. Further, depending on the display position of the selection button, it is necessary to operate with both hands, which is troublesome.

  Patent Document 1 discloses an invention in which an operation mode of an imaging apparatus is switched without performing an input operation by touching a display screen as much as possible. In Patent Document 1, mode switching is performed in accordance with a change in posture of the imaging apparatus centering on the direction of the photographing optical axis and a direction of an operation applied to the imaging apparatus.

JP 2010-219641 A

  In Patent Document 1, it is possible to select one mode from a menu screen that allows selection of a plurality of modes, for example, switching of imaging modes. However, the menu screen has a hierarchical structure, and it is difficult to perform more detailed menu settings after selecting one mode.

  In order to solve the above problems, it is a main object of the present invention to provide a portable information processing apparatus that can be easily performed with one hand even with a complicated input operation.

  An information processing apparatus according to the present invention that solves the above-described problems includes a plurality of first items that are sequentially selected by the user, and a plurality of first items that are selected in order according to the selected first item. Display means for displaying two items so that the selected first item and second item can be identified, terminal state detection means for detecting the movement direction and movement amount of the own apparatus, and the detected movement direction And a determination means for determining whether or not the device has been shaken as a series of operations that move in one direction and return to the original position within a predetermined time based on the movement amount; If it is determined that the first movement direction at the time of the shake operation is the first direction, the selected first item is changed to the next first item, and the changed first item is determined. According to Control means for changing the content of the second item and changing the selected second item to the next second item when the first moving direction is a second direction different from the first direction; It is characterized by providing.

  According to the present invention, since an item can be selected from a plurality of first items or a plurality of second items depending on the initial movement direction of the shake operation, even a complicated input operation can be easily performed with one hand. be able to.

The schematic block diagram of a mobile terminal. (A), (b) is explanatory drawing of the rotation direction and rotation angle of a mobile terminal. (A), (b) is explanatory drawing of the moving direction and movement amount of a mobile terminal. Explanatory drawing of the attitude | position of a mobile terminal and the movement in three-dimensional space. (A), (b), (c), (d) is explanatory drawing of the action operation | movement by a user. (A), (b), (c), (d) is explanatory drawing about the analysis of the action content. (A), (b), (c), (d) is explanatory drawing about the analysis of the action content. (A), (b), (c) is explanatory drawing of determination of whether the shake operation is what was intended. The flowchart showing the procedure of the setting operation by a user. FIG. 4 is an exemplary diagram of a print setting screen displayed on a display screen. 6 is a flowchart illustrating a processing procedure when performing print settings for a network printer. Explanatory drawing of hold operation.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 is a schematic configuration diagram of a mobile terminal 100 which is a portable information processing apparatus according to the first embodiment. The mobile terminal 100 includes a display unit 101, an operation unit 102, a network I / F (interface) 103, a storage unit 104, a terminal state detection unit 105, and a CPU 106. The mobile terminal 100 is connected to a network 111 such as a LAN (Local Area Network). Devices that can be connected to the network 111 such as the network printer 112 are connected to the network 111.

  The display unit 101 is a display and provides a display screen for performing input / output to the user. The operation unit 102 receives an input operation from the user and sends input data to the control unit 109 according to the input operation. In this embodiment, the display unit 101 and the operation unit 102 are realized in an integrated configuration like a touch panel.

  The network I / F 103 is a communication interface for performing communication with other devices connected to the network 111. It is also possible to connect to the Internet via the network 111.

  The storage unit 104 includes a ROM (Read Only Memory) that stores a control program for the CPU 106, a RAM (Random Access Memory) that is used as a temporary storage area such as a work area as the main memory of the CPU 106, and the like.

The terminal state detection unit 105 detects changes in the state of the mobile terminal 100 such as the posture, orientation, and movement state in the three-dimensional space. The detection result is sent to the CPU 106. For this purpose, the terminal state detection unit 105 includes an attitude change detection unit 107 and a movement change detection unit 108.
The posture change detection unit 107 detects the rotation state (rotation direction and rotation angle) of the mobile terminal 100 using, for example, a three-dimensional gyro sensor, and detects the change in posture and direction. The movement change detection unit 108 detects the movement (movement direction and amount) by detecting a change in acceleration of the mobile terminal 100 using, for example, a three-dimensional acceleration sensor. In addition, the terminal state detection unit 105 may include a sensor that detects the direction of the mobile terminal 100, such as a geomagnetic sensor, for example, to detect the state of the mobile terminal 100.

The CPU 106 includes a control unit 109 and a determination unit 110.
The determination unit 110 determines what action operation the user has performed on the mobile terminal 100 based on the change in the state of the mobile terminal 100 detected by the terminal state detection unit 105. The determination result is sent to the control unit 109. The control unit 109 performs overall operation control of the mobile terminal 100 according to the instruction information sent from the operation unit 102 or the determination unit 110.

  In this embodiment, a change in the state of the mobile terminal 100 is detected by the posture change detection unit 107 and the movement change detection unit 108 in the terminal state detection unit 105, but any sensor that can detect the same state can be used. Anything is acceptable.

FIG. 2 is an explanatory diagram of the rotation direction and rotation angle of the mobile terminal 100 detected by the posture change detection unit 107.
As shown in FIG. 2A, an orthogonal coordinate system is defined in which the vertical direction is the Zw axis, the horizontal magnetic north pole direction is the Yw axis, and the direction perpendicular to the Zw axis and the Yw axis is the Xw axis. The three-dimensional gyro sensor of the posture change detection unit 107 detects the amount of rotation about each axis.

FIG. 2B is an explanatory diagram of the rotation operation with respect to each coordinate axis. Each of the three axes has a counterclockwise rotation plus (+) and a clockwise rotation minus (-).
The rotation around the Xw axis is called a pitch or a tilt angle, and takes a value of “−180 degrees” to “179 degrees”. With reference to the display screen of the mobile terminal 100, the upward horizontal state is “0 degree”, the vertical state is “90 degrees”, the downward horizontal state is “−180 degrees” and “179 degrees”, and the vertical inverted state is “−90”. Degree ".
The rotation around the Yw axis is called a roll or a rotation angle, and takes a value of “−90 degrees” to “90 degrees”. With the display screen of the mobile terminal 100 as a reference, the horizontal state is “0 degrees”, the upper right shoulder is “90 degrees”, and the upper left shoulder is “−90 degrees”.
The rotation around the Zw axis is called azimuth or azimuth and takes values from “0 degree” to “359 degree”. Using the short side upper surface of the mobile terminal 100 as a reference, the north-facing state is “0 degrees”, the east-facing state is “90 degrees”, the south-facing state is “180 degrees”, and the west-facing state is “270”. Degree ".
In addition, as shown in FIG. 2B, the state in which the display screen of the mobile terminal 100 is faced up and the short side upper surface of the mobile terminal 100 is held horizontally toward the north is a reference state of the rotation angle (pitch, roll All azimuths are “0 degrees”). The posture change detection unit 107 detects the amount of change from the reference state as the rotation direction and rotation angle of the mobile terminal 100.

FIG. 3 is an explanatory diagram of the moving direction and moving amount of the mobile terminal 100 detected by the movement change detecting unit 108.
As shown in FIG. 3, an orthogonal coordinate system that represents the moving direction and moving amount of the mobile terminal 100 is defined. That is, the normal direction of the display screen of the mobile terminal 100 is defined as the ZD axis, the short side direction of the display screen is defined as the XD axis, and the long side direction of the display screen is defined as the YD axis. By defining in this way, when the long side of the mobile terminal 100 is held in the vertical direction, the XD axis is the horizontal direction, the YD axis is the vertical direction, and the ZD axis is the front-back direction. The moving direction of the mobile terminal 100 is the left direction of the XD axis, the downward direction of the YD axis, and the forward direction of the ZD axis are plus (+) moving directions, respectively, the right direction of the XD axis, the upward direction of the YD axis, the ZD axis Each backward direction is a minus (−) moving direction.

FIG. 3B is an illustration of acceleration values detected by the three-dimensional acceleration sensor of the movement change detection unit 108 when the attitude of the mobile terminal 100 changes. Based on the detected acceleration [m / s ² ] of the mobile terminal 100, the time integral value of the acceleration is the velocity [m / s] and the time integral value of the velocity is the movement amount [m].

  As described above, the posture change detection unit 107 obtains the rotation angle of the mobile terminal 100 in the orthogonal coordinate system defined with reference to the gravitational magnetic field, and the movement change detection unit 108 uses the orthogonal coordinate system defined with reference to the mobile terminal 100. The acceleration value for is obtained. As shown in FIG. 4, based on the detection results of the posture change detection unit 107 and the movement change detection unit 108, the posture of the mobile terminal 100 (vertical state / horizontal state, vertical / horizontal direction, etc.) and movement in the three-dimensional space (previous / Rear, left / right, up / down) can be detected.

  The determination unit 110 uses the detection results of the posture change detection unit 107 and the movement change detection unit 108 to generate acceleration information such as how the mobile terminal 100 has been moved in consideration of the posture of the mobile terminal 100. And what kind of action operation was performed is judged by the generated acceleration information.

  FIG. 5 is an explanatory diagram of the action operation by the user, which is the basis of the input operation. The action action by the user represents how the mobile terminal 100 is moved.

  FIG. 5A is an explanatory diagram of an orthogonal coordinate system for representing the movement of the mobile terminal 100 due to the action action of the user. The left / right direction (horizontal direction) is the X axis, the vertical direction (vertical direction) is the Y axis, and the front / rear direction (depth direction) is the Z axis. The acceleration information analyzed by the determination unit 110 is acceleration information with respect to the user-based orthogonal coordinate axes in FIG.

  FIG. 5B is an exemplary diagram when the mobile terminal 100 is moved up and down in the Y-axis direction. The determination unit 110 determines that an action has been performed in which the mobile terminal 100 is once lowered from the state in which the mobile terminal 100 is held and immediately returned to the original position. Such a series of operations for shaking the mobile terminal 100 back is referred to as “shake operation”. The direction of the shake operation is determined by the initial movement direction (plus / minus). For example, the action in FIG. 5B is a downward shake operation.

5C illustrates an example in which the mobile terminal 100 is shaken in the X-axis direction (left-right direction), and FIG. 5D illustrates an example in which the mobile terminal 100 is shaken in the Z-axis direction (front-rear direction). FIG. In the figure, the user holds the mobile terminal 100 vertically and holds it vertically, but the orientation of the mobile terminal 100 is not limited to this, and for example, the user may hold the display screen horizontally and perform a shake operation. .
As described above, the user can perform a shake operation of the mobile terminal 100 on the three axes (6 directions) of up / down / left / right / front / rear.

  The determination of the action content by the determination unit 110 will be described with reference to FIGS. The determination unit 110 determines whether or not the action operation performed on the mobile terminal 100 by the user is a shake operation.

FIG. 6A is a state example diagram when the mobile terminal 100 is shaken in the X-axis direction (left-right direction). When a shake operation is performed in the X-axis direction, the movement change detection unit 108 detects acceleration that changes in the X-axis direction, as shown in FIG. Which direction is the shake operation is determined depending on whether the initial motion of the acceleration is a positive direction or a negative direction.
The moving speed of the mobile terminal 100 is calculated by time-integrating the acceleration. FIG. 6C is a diagram illustrating a change in moving speed over time. From FIG. 6C, it can be seen that the mobile terminal 100 is accelerated / decelerated at a plus speed and then is accelerated / decelerated by the same amount at a minus speed.
The amount of movement of the mobile terminal 100 is calculated by integrating the speed over time. FIG. 6D is a diagram illustrating a change in the movement amount with time. FIG. 6D shows the distance that the mobile terminal 100 has moved from the initial position (reference position). In FIG. 6D, it can be seen that the mobile terminal 100 returns to the reference position after moving to a certain distance.

  FIG. 7A is a state example diagram when the mobile terminal 100 is shaken (moved) in the X-axis direction. In this case, the movement change detection unit 108 detects an acceleration that changes in the X-axis direction, as shown in FIG. Similarly to FIG. 6, the moving speed of the mobile terminal 100 calculated by integrating the acceleration over time is shown in FIG. The movement amount of the mobile terminal 100 calculated by integrating the speed over time is shown in FIG. In this case, since the initial motion of acceleration starts from plus, it can be seen that the mobile terminal 100 is swung in the plus direction of the X axis. Furthermore, it can be seen from the movement speed and the movement amount that only the acceleration motion in the plus direction is added, and after the movement, the mobile terminal 100 is held at the position after the movement.

  In this way, it is possible to determine whether or not the shake operation is performed based on the acceleration measured by the movement change detection unit 108 and the movement speed and movement amount calculated from the acceleration. In the above example, FIG. 6 is an example of a shake operation and FIG. 7 is an example of other operations.

After determining that the shake operation has been performed, the terminal state detection unit 105 determines whether the shake operation is intended by the user. The shake operation is an operation in which the mobile terminal 100 is swung (moved) in one direction and immediately returned to the original position (reference position) within a certain time. It becomes. Therefore, the time Δt required for the shake operation is compared with a reference time τ that is a fixed time for determining the shake operation. If the time Δt is equal to or less than the reference time τ, the shake operation is determined. If the time is equal to or longer than the reference time τ, the process ends as a malfunction that is not a shake operation. When a large value is set for the reference time τ, a slower operation is also determined as a shake operation. The shake operation is often performed between “0.3 and 2.0 seconds”, and it is usually desirable to set the reference time τ at about “2.0” seconds.
Further, the magnitude (amplitude) of the acceleration is compared with a preset threshold value α, and if it is larger than the threshold value α, it is determined that a shake operation has been performed. As described with reference to FIG. 6, the amount of movement from the reference position is determined based on the magnitude of acceleration. For this reason, it is determined that a shake operation has been performed when the amount of movement exceeds a certain amount.

  FIG. 8 is an illustration of acceleration when determining whether or not the shake operation is intended. When FIG. 8A is determined to be a shake operation, FIG. 8B is determined to be a shake operation when the shake operation time is long and is not determined to be a shake operation, and FIG. An example of the case where it is not done is shown.

  The determination of the shake operation is performed for each of the three axis directions of the X axis, the Y axis, and the Z axis. When the shake operation is detected on a plurality of axes in two different directions, the one with the maximum shake operation is adopted. For example, when the movement amount has components in two directions of the X axis and the Y axis, it is determined that the shake operation is performed in the direction in which the movement amount component is larger. However, when a shake operation with the same strength is detected, a threshold determination process is performed so that the shake operation is recognized only when the value is, for example, 10% stronger than the next largest shake operation. Do. If it is below the threshold, it is treated as indistinguishable. Note that the threshold value used here is not limited to this. Further, the selection method is not limited to this.

FIG. 9 is a flowchart showing a processing procedure when such input processing to the mobile terminal 100 is performed. In the input process, a menu screen is displayed on the display screen of the mobile terminal 100. The menu screen has a hierarchical structure including a first hierarchy and a second hierarchy. A plurality of items are prepared on each of the first layer menu screen and the plurality of second layer menu screens, and one item can be selected by a user operation.
Hereinafter, items included in the menu screen of the first hierarchy are referred to as first items, and items included in the menu screen of the second hierarchy are referred to as second items. The second item is changed according to the first item selected from the menu screen of the first hierarchy. For example, when the A item is selected from the menu screen of the first hierarchy, items subordinate to the A item are displayed on the menu screen of the second hierarchy.

  After the menu screen is displayed on the display screen, the terminal state detection unit 105 of the mobile terminal 100 detects an action operation by the user on the mobile terminal 100 (S501). For example, when the acceleration detected by the posture change detection unit 107 and the movement change detection unit 108 is equal to or greater than a certain value, the terminal state detection unit 105 determines that an action operation by the user has been detected, and the detection result is sent to the determination unit 110. Send. That is, when the rotation angle or acceleration due to the action of the user of the mobile terminal 100 is greater than or equal to a certain value, the terminal state detection unit 105 determines that an action operation has been detected. The terminal state detection unit 105 repeats step S501 until an action operation is detected (S501: N).

  The determination unit 110 analyzes the detection result sent from the terminal state detection unit 105 and determines whether or not the action operation by the user is a shake operation (S501: Y, S502). At this time, it is also determined whether or not the shake operation is intended by the user. If the action operation is not a shake operation, the process returns to step S501 to wait for detection of the action operation again (S502: N).

  When the action operation by the user is a shake operation, the control unit 109 executes one of three different processes depending on the initial movement direction at the time of the shake operation (S502: Y, S503). Here, the first direction is the X-axis direction (horizontal direction), the second direction is the Y-axis direction (vertical direction), and the third direction is the Z-axis direction (depth direction). It is not limited to this.

When the first movement direction of the shake operation is the first direction, the control unit 109 changes the first item on the menu screen of the first hierarchy according to the shake operation (S503: first direction, S504). At this time, the first item is changed according to the direction of the shake operation detected in step S503. For example, in the case of a shake operation in the positive direction of the first direction, it is changed to the next first item, and in the case of a shake operation in the negative direction, it is changed to the previous first item. The changed first item becomes the item selected by the user from the menu screen of the first hierarchy.
After the process according to the shake operation in the first direction, the control unit 109 makes it possible to select the second item subordinate to the first item on the menu screen of the first hierarchy selected in step S504. The second item on the menu screen of the second hierarchy is changed (S505). Thereafter, the display screen is updated based on the first item of the first hierarchy selected in step S504 and the second item of the second hierarchy changed in step S505 (S508). Note that the change content set by the previous operation is held in the storage unit 104, and the value set immediately before is reflected when the second item is displayed.

  When the first movement direction of the shake operation is the second direction, the control unit 109 changes the second item on the menu screen of the second hierarchy according to the shake operation (S503: second direction, S506). At this time, the second item is changed according to the direction of the shake operation detected in step S503. For example, in the case of a shake operation in the positive direction of the second direction, the next second item is changed, and in the case of a shake operation in the negative direction, the previous second item is changed. The changed second item becomes the item selected by the user from the menu screen of the second hierarchy. Thereafter, the control unit 109 updates the display screen based on the changed second item of the second hierarchy (S508).

  When the initial movement direction of the shake operation is the third direction, the control unit 109 executes a predetermined process assigned to the operation in the third direction (S503: third direction, S507). At this time, the processing content can be changed according to the direction of the shake operation detected in step S503. For example, a shake operation in the plus direction executes processing, and a shake operation in the minus direction cancels processing. In the case of execution of processing, processing according to the contents of the first and second items selected in steps S504 to S506 is executed.

[Operational form]
An example will be described in which the mobile terminal 100 is used to perform print settings for the network printer 112 connected to the network 111 and execute printing. After specifying the network printer 112 on the mobile terminal 100, detailed print settings are performed.

FIG. 10 is an exemplary view of a print setting screen that is an example of a menu screen displayed on the display screen of the mobile terminal 100. On the print setting screen, a print preview 201 is displayed at the top of the screen. At the bottom of the screen, a dial-type first menu screen 202 for selecting a print setting item (first item), which is a menu screen of the first hierarchy, is displayed. On the first menu screen 202, an item (first item) can be changed by a swipe operation in the vertical direction of the screen. A swipe operation is an operation of sliding a finger smoothly while touching the screen. The print settings of the network printer 112 include setting items such as “number of copies setting, Nin1 printing, duplex setting” and the like, which can be selected in sequence by the user.
Below the dial-type first menu screen 202, a dial-type second menu screen 203 for selecting a selection value (second item), which is a second-level menu screen, is displayed. The second menu screen 203 can be sequentially selected by the user by performing a swipe operation in the horizontal direction of the screen. A setting value subordinate to the first item on the first menu screen 202 is assigned to the second item on the second menu screen 203. For example, in the setting of “Nin1”, setting values such as “2in1, 4in1,..., 16in1” are assigned and displayed.

In the present embodiment, the user selects items in order from the first menu screen 202 and the second menu screen 203 by a shake operation of the mobile terminal 100 instead of the swipe operation. A single shake operation has the same role as advancing / returning the first item on the menu screen by a swipe operation. For example, the item to be selected can be determined by the number of shake operations. Moreover, you may change into the item advanced by the number of items according to the movement amount at the time of a shake operation. The selected item is displayed so that it can be identified that it has been selected. In the example of FIG. 10, “Nin1” is displayed on the first menu screen 202 and “2in1” is selected on the second menu screen, so that it can be identified.
In the mobile terminal 100 in which the print setting screen is displayed on the display screen, for example, a shake operation in the first direction is assigned to the selection of the print setting item that is the first item on the first menu screen 202. The shake operation in the second direction is assigned to the selection of the setting value corresponding to each print setting item which is the second item on the second menu screen 203. Processing such as execution of printing and cancellation of print settings is assigned to the shake operation in the third direction.

When the direction of the shake operation is the first direction, in step S504 in FIG. 9, the control unit 109 changes the print setting item on the first menu screen 202 according to the shake operation in the first direction. The print setting items can be cyclically set in the order of “number of copies → Nin1 →... → double-sided setting → color setting → number of copies” by, for example, a shake operation in the plus direction. On the other hand, it can be set in the order of “number of copies → color setting → double-side setting →... → Nin1 → number of copies” by a shake operation in the minus direction.
In step S505, the control unit 109 updates the content of the setting value, which is an item on the second menu screen 203, according to the print setting item changed in step S504. For example, when the print setting item on the first menu screen 202 is changed from “double-sided setting” to “color setting”, the setting value on the second menu screen 203 is changed from “single-sided, double-sided” to “color, monochrome, monochrome color”. Update to
In step S508, the control unit 109 reflects and displays the print settings set in steps S504 and S505 and the set values whose contents have been changed on the display screen as shown in FIG.

When the direction of the shake operation is the second direction, the control unit 109 changes the setting value, which is an item on the second menu screen 203, in step S506 in FIG. For example, when color settings are made, the setting values are changed in the order of “color → monochrome → single color → color” by the shake operation in the plus direction, and “color → monochrome color → monochrome → color” by the shake operation in the minus direction. The setting value is changed in the order.
In step S508, the control unit 109 reflects the content of the setting value, which is an item on the second menu screen 203, and the second menu screen 203 based on the changed setting value on the display screen as shown in FIG. indicate.

  When the direction of the shake operation is the third direction, in step S507 in FIG. 9, the control unit 109 executes a process such as print execution or print setting cancellation. The print job based on the print setting is transmitted to the network printer 112 by the shake operation in the plus direction. The print setting is canceled by the shake operation in the minus direction, and the process ends.

  With the above processing, setting items can be selected and predetermined processing can be executed by a shake operation on the mobile terminal 100. Moreover, since the contents that can be selected can be switched according to the direction of the shake operation, it is possible to deal with a menu item having a hierarchical structure, and the use range can be expanded. Therefore, user convenience can be greatly improved.

[Second Embodiment]
In the second embodiment, restrictions are placed on items that can be selected from the menu screen by adding a touch operation to the display screen to the shake operation. Also in the second embodiment, the mobile terminal 100 of the first embodiment is used.
FIG. 11 is a flowchart illustrating a processing procedure when print settings are made to the network printer 112. The same processing as the processing procedure in the first embodiment of FIG. 9 is represented by the same step number, and detailed description thereof is omitted.

  The determination unit 110 detects an action operation by the user to the mobile terminal 100 from the state of the mobile terminal 100 detected by the terminal state detection unit 105, and determines whether the action operation is a shake operation (S501, S502). Steps S501 and S502 are repeated until a shake operation is determined.

  When the action operation is a shake operation, the determination unit 110 receives an input operation by the operation unit 102 and determines whether the input operation is a hold operation (S502: Y, S1000). As shown in FIG. 12, the hold operation is an operation in which the user's finger touches the touch panel for a predetermined time or more. When the hold operation is detected, the control unit 109 confirms the direction of the shake operation (S1000: Y, S503). When there is a shake operation and no hold operation is detected, the control unit 109 performs the processing of Step S503 to Step S507 of the first embodiment (S1000: N, S1004).

  The control unit 109 executes one of three different processes depending on the direction of the shake operation. As in the first embodiment, the first direction is the X-axis, the second direction is the Y-axis, and the third direction is the Z-axis. Changing the print setting item, changing the setting value, and starting / Assume that a process of ending the print setting process is assigned.

When the initial movement direction of the shake operation is the first direction, the control unit 109 changes the first item on the menu screen of the first hierarchy according to the shake operation based on a predetermined restriction (S503: first) Direction, S1001). For example, in the case of the constraint “display only the hierarchy item whose setting has been changed”, if the shake operation is performed while the hold operation is being performed, the user can select the menu screen item below the second layer based on the constraint condition. Only the changed items are displayed in order and can be selected. For example, it is assumed that only “Nin1” and “color setting” are already changed in the first item of the first menu screen of “number of copies”, “Nin1”, “double-sided setting”, “color setting”. In this case, when the shake operation is performed while the hold operation is performed, only the setting change is circulated and displayed as “number of copies (current state) → Nin1 → color setting → Nin1”. This eliminates the need to select from all the first items when it is desired to restore the changed setting to the original setting or to change the setting to another setting, thereby improving the operability for the user. The changed first item becomes the item selected by the user from the menu screen of the first hierarchy.
The restriction is not limited to this, and a restriction that frequently changes the setting or presents a recommended item may be added.
The control unit 109 changes the second item content of the second hierarchy according to the first item changed in step S1001 (S505).

  When the direction of the shake operation is the second direction, the control unit 109 changes the second item on the menu screen of the second hierarchy based on a predetermined restriction (S503: second direction, S1002). The changed second item becomes the item selected by the user from the menu screen of the second hierarchy. The constraints may be the same as those in step S1001 or may be different. For example, by adding the restriction “fix the setting up to the second layer”, when there is an item on the menu screen of the third layer subordinate to the item of the menu screen of the second layer, It is possible to select items on the menu screen of the third hierarchy. For example, “double-sided setting” which is one of the print setting items includes subordinate setting values such as “single-sided” and “double-sided”. When “double-sided” is selected here, the menu of the third hierarchy depending on the items of the menu screen of the second hierarchy such as “left-binding”, “right-binding”, “upper-binding”, and “bottom-binding”. There are items on the screen. In such a case, by performing a shake operation while performing a hold operation, it is possible to select an item on the third-level menu screen.

  When the direction of the shake operation is the third direction, the control unit 109 performs a predetermined process based on a predetermined restriction (S503: third direction, S1003). For example, when only the shake operation is performed, a print job for all pages is transmitted to the network printer 112. By performing a shake operation while performing a hold operation, only the page displayed in the print preview 201 is transmitted to the network printer 112 as a job.

  By combining the shake operation and the hold operation by the processing as described above, it is possible to select only a limited hierarchical menu or to restrict execution based on a predetermined restriction. In addition to the touch on the display screen, the hold operation may be an operation of pressing a physical button prepared on the mobile terminal 100.

[Third Embodiment]
In the first and second embodiments, when the determination unit 110 detects a shake operation, it is determined whether or not the shake operation is based on the time of the shake operation or the magnitude of the acceleration. However, for example, when used during walking, a shake operation may be detected regardless of the user's intention. Therefore, in the third embodiment, an unintended shake operation is invalidated to prevent malfunction.

  While walking, acceleration occurs in the vertical direction or the front-back direction. This is determined to be a shake operation with a certain rhythm, and an item on the menu screen is selected regardless of the user's intention. Therefore, the determination unit 110 determines whether or not the user is moving due to walking or the like from the period of shake operations that occur continuously and the amount of movement derived from the acceleration. If it is determined that the user is moving, the selection of the item by the shake operation is not accepted, or the threshold value for the shake operation determination is changed. For example, the shake operation time is set short and the acceleration is increased, so that the shake operation is considered only when the shake is vigorously shaken. As a result, it is possible to prevent malfunction and to reduce discomfort felt by the user during malfunction.

  Note that the mobile terminal 100 described above can be applied to various devices such as a mobile phone, a smartphone, a PDA, a digital camera, and an electronic book terminal. The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the computer program and the storage medium storing the computer program constitute the present invention. One processor may perform all the processing, or a plurality of processors may perform the distributed processing.

  DESCRIPTION OF SYMBOLS 100 ... Mobile terminal, 101 ... Display part, 102 ... Operation part, 103 ... Network I / F, 104 ... Memory | storage part, 105 ... Terminal state detection part, 106 ... CPU, 107 ... Posture change detection part, 108 ... Movement change detection 109, a control unit, 110, a determination unit, 111, a network, 112, a network printer.

Claims (7)

A plurality of first items selected in sequence by the user, and a plurality of second items whose contents change according to the selected first item and selected in sequence by the user, respectively, Display means for displaying so that the second item can be identified;
Terminal state detecting means for detecting the moving direction and moving amount of the device itself;
Judgment means for judging whether or not the device itself has been shaken, which is a series of operations that move in one direction and return to the original position within a predetermined time, based on the detected moving direction and the moving amount;
If it is determined that the own device has been shaken, if the first moving direction during the shake operation is the first direction, the selected first item is changed to the next first item. The content of the second item is changed in accordance with the changed first item, and the selected second item is selected when the first moving direction is a second direction different from the first direction. And control means for changing to the next second item,
Information processing device. When the movement amount detected by the terminal state detection unit includes components in the first direction and the second direction, the determination unit moves the own device in a direction in which the detected component of the movement amount is larger. Is judged to have been shaken,
The information processing apparatus according to claim 1. The determination means is a continuous shake operation intended by the user in accordance with a continuous cycle and the movement amount of each shake operation when it is determined that the shake operation with the same initial movement direction is continuously performed. It is a feature to judge whether or not,
The information processing apparatus according to claim 2. When it is determined that the own device has been subjected to the shake operation, the control means replaces the selected first item or second item with the next first item or second item, and performs the shake operation. It is characterized by changing to the first item or the second item forwarded by the number of items according to the amount of movement in the first movement direction at the time,
The information processing apparatus according to any one of claims 1 to 3. It further comprises an operation means for receiving an operation by the user,
When it is determined that the control device has performed the shake operation while the operation means is accepting the operation, the control means can select a first one of the plurality of first items and the plurality of second items. 1 item and 2 items are limited,
The information processing apparatus according to any one of claims 1 to 3. A plurality of first items selected in sequence by the user, and a plurality of second items whose contents change according to the selected first item and selected in sequence by the user, respectively, A display control step for displaying so that the second item can be identified;
A terminal state detection step for detecting the direction and amount of movement of the device itself;
A determination step of determining whether or not the device has been shaken, which is a series of operations that move in one direction within a predetermined time and return to the original position, based on the detected moving direction and moving amount;
If it is determined that the own device has been shaken, if the first moving direction during the shake operation is the first direction, the selected first item is changed to the next first item. The content of the second item is changed in accordance with the changed first item, and the selected second item is selected when the first moving direction is a second direction different from the first direction. And a control step of changing to the next second item,
A method for controlling an information processing apparatus.   A computer program for causing a computer to execute the control method according to claim 6.

Images