JP2017016711A - Display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To modify information displayed on a screen appropriately through a simple operation.SOLUTION: A display program includes: receiving first input relating to first operation on information displayed on a display unit; receiving second input relating to second operation on the information displayed; changing display magnification, when the second input received after the first input is drag operation, on the basis of a distance between a reference position relating to at least one of the first input and the second input, and a current position of the drag operation, and a moving direction of the drag operation; and modifying the information displayed, in accordance with the changed display magnification.SELECTED DRAWING: Figure 5

Description

  The present application relates to a display program for changing display contents on a screen by a predetermined operation.

  Conventionally, there is a method of using a dedicated button (for example, a zoom button) prepared in advance as an operation for performing zooming (for example, change such as enlargement or reduction) on the display content of the screen. In the above-described method, it is necessary to provide a software or hardware button for zooming, and it is necessary to fix the zoom center or to set it in advance. Conventionally, there are a method of zooming at a predetermined magnification every time the button is pressed, and a method of updating the display while changing the enlargement rate at a predetermined speed while the button is pressed. Conventionally, there are a method of fixing the position of the center point of the zoom to the center of the screen, and a method of performing prior setting such as using a point touched on the screen immediately before.

  As another method for changing the display content, for example, there is a method using a zoom slider. Conventionally, the zoom rate can be changed by moving a slider realized by software or hardware by a user. When a zoom slider is used on software, it is necessary to provide a slider display area on the screen, and to provide a zoom slider on hardware requires installation costs. In the case of a slider, there is a problem that it takes time to separately set the center of zoom.

  Conventionally, there is a method of performing zoom or the like by a pinch operation using a touch panel capable of multi-touch detection. The pinch operation is a method that is widely adopted in portable communication terminals such as smartphones in recent years. However, since it is operated with a plurality of fingers, it is very difficult to operate with one hand, and it is usually necessary to support the communication terminal from the back side with one hand and operate with the other hand. Conventionally, there is also a circular gesture zoom function in which the position is zoomed by drawing a circle on the touch panel. However, with a circular gesture, it is difficult to draw a circle at a predetermined position on the screen with one hand (especially the thumb), and an operation with both hands is required as in a pinch operation.

  Furthermore, conventionally, zooming is started by stopping the pointing input or pressing strongly, or a near area (near area) and a far area (far area) are set with reference to the zoom start point, and zooming in or zooming is performed using each area. There is a way to do out. Conventionally, there is a method of enlarging a screen with a single short press and reducing with a short press twice. Conventionally, there is a method of enlarging or reducing a certain amount by long-pressing or double-tapping the screen (see, for example, Patent Documents 1 to 3).

JP 2011-28635 A JP 2005-234199 A JP 2011-22851 A

  However, operations such as tap (selection), double tap (predetermined magnification zoom), and drag (scroll) on the screen in the conventional method described above are also used in other operations such as menu selection and determination. For this reason, in the conventional method, if the above-described operation is used during the zoom operation, the same operation is mixed, so that the target screen display cannot be appropriately changed.

  Conventionally, as described above, there is a method of performing zooming or the like based on a finger holding time with respect to the screen. However, in this case, other operations cannot be performed during the stopping, and a waiting time for the stopping is required.

  Further, when enlarging by double tap, the zoom rate cannot be arbitrarily specified, and zooming is performed with a preset value. Therefore, in the conventional method, for example, the display content on the screen cannot be changed to an appropriate arbitrary magnification by a simple operation such as one hand.

  In view of such a problem, the disclosed technique aims to appropriately change the display content of a screen with a simple operation.

  A display program according to an aspect of the disclosure receives a first input related to a first operation on display content displayed on a display unit, receives a second input related to a second operation on the display content, and When the second input received after one input is a drag operation, the distance between the reference position related to at least one of the first input and the second input and the current position of the drag operation And the display magnification is changed based on the moving direction of the drag operation, and the computer is caused to execute a process of changing the display content corresponding to the changed display magnification.

  According to the disclosed technique, the display content of the screen can be appropriately changed with a simple operation.

It is a figure which shows an example of a function structure of the information processing apparatus in this embodiment. It is a figure which shows an example of the hardware constitutions of information processing apparatus. It is a flowchart which shows an example of the display process in this embodiment. It is a flowchart which shows an example of the display process at the time of scroll mode. It is a flowchart which shows an example of the display process at the time of zoom mode. It is a flowchart which shows an example of the display process at the time of rotation mode. It is a figure which shows the 1st specific example of the display content corresponding to user operation. It is a figure for demonstrating the relationship between the movement amount by drag | drug, and a zoom rate. It is a figure which shows the 2nd specific example of the display content corresponding to user operation. It is a figure which shows the 3rd specific example of the display content corresponding to user operation. It is a figure which shows the 4th specific example of the display content corresponding to user operation. It is a figure which shows the 5th specific example of the display content corresponding to user operation.

  Hereinafter, embodiments will be described in detail with reference to the accompanying drawings.

<Functional Configuration Example of Information Processing Device in Present Embodiment>
FIG. 1 is a diagram illustrating an example of a functional configuration of the information processing apparatus according to the present embodiment. The information processing apparatus 10 illustrated in FIG. 1 includes a position input unit 11, an input count measurement unit 12, an input position holding unit 13, a time measurement unit 14, a distance calculation unit 15, a state reset unit 16, and a drag determination. A unit 17, a mode control unit 18, a reference position calculation unit 19, a change amount calculation unit 20, a display content setting unit 21, and a display unit 22.

  The position input unit 11 receives an input of an arbitrary position (pointing position) on the display screen in the display unit 22, for example. For example, when the display unit 22 is a touch panel, the position input unit 11 detects the position information by detecting the pressure or temperature when the user presses the screen of the display unit 22 with a finger or an electronic pen. Can be input. The position input unit 11 can also input a position by dragging. Here, the drag refers to a state in which, for example, the user's finger or the like is moved while being in contact with the screen of the display unit 22. Therefore, the position information input by dragging the position input unit 11 continues to change every predetermined time.

  Further, the position input unit 11 may not be a position input by a touch panel, and can accept a position input using an arbitrary pointing device such as a mouse, a trackball, or an object tracking by real-time analysis of a camera image. For example, when using a mouse, a trackball, or the like, the position input unit 11 can accept a position obtained by a predetermined operation such as a button press, a drag operation, or a predetermined object moving in a predetermined direction. Moreover, although the position input part 11 can receive the instruction | indication position from a user as coordinate information, it is not limited to this.

  The input count measuring unit 12 measures the number of times a position input from the position input unit 11 is received, for example. Specifically, for example, when the display unit 22 is a touch panel, the input number counting unit 12 measures the number of times the display unit 22 is switched from a non-pressed state to a pressed state using a finger, an electronic pen, or the like. Therefore, the number of inputs is, for example, the number of times the position input from the position input unit 11 is turned off (OFF) (for example, the number of taps).

  The input position holding unit 13 holds the start point, the end point, or both of the position input from the time when the number of position inputs held by the input number measuring unit 12 increases from zero. For example, when the display unit 22 is a touch panel, the coordinates of the point where the user's finger or the like is pressed on the touch panel correspond to the start point of the position input, and the coordinates of the point where the user's finger or the like is separated from the touch panel are the position input. Corresponds to the end point of. Note that the input position holding unit 13 does not hold only the last input position, but can hold, for example, a plurality of previous input positions as an array. In addition, although it can be set according to the calculation content etc. in the distance calculation part 15 or the reference position calculation part 19 etc. about how much is hold | maintained, it is not limited to this, The number set beforehand The input position can be held.

  The time measuring unit 14 measures the elapsed time from the time when the number of position inputs held by the input number measuring unit 12 increases from zero. The time measurement unit 14 may measure the elapsed time by counting up using a counter provided in advance, for example, or may measure the elapsed time based on an internal clock such as Real Time Clock (RTC). .

  The distance calculation unit 15 calculates the value of the distance between the position of the start point and the current input position for the input position information held by the input position holding unit 13. When the number of position inputs is not 0, the distance calculation unit 15 calculates, for example, the distance between the above-described start point position and the current input position during the drag operation at a predetermined timing or in real time.

  Here, the distance obtained by the distance calculation unit 15 is for determining whether or not the positions between the taps are sufficiently close in a plurality of continuous taps in the zoom operation of the present embodiment. In this case, for example, for each of a plurality of input positions held by the input position holding unit 13, the maximum value of the distance between the first point held and the remaining points is obtained to determine the position between the taps. However, the present invention is not limited to this.

  When the measurement time obtained from the time measurement unit 14 exceeds the preset threshold value or the distance value obtained from the distance calculation unit 15 exceeds the preset threshold value, the state reset unit 16 The state such as the number of inputs held by the input number measuring unit 12 is reset. In addition, although reset shows that the frequency | count of input is set to 0, for example, it is not limited to this. That is, the state reset unit 16 can set restrictions on the time taken for the continuous taps and the distance between the continuous taps in the multiple taps in the zoom operation of the present embodiment, for example.

  The drag determination unit 17 determines whether or not it is a drag input based on the amount of movement of the continuous input position in the position input unit 11. Note that the continuous position input state specifically refers to a state in which the number of inputs has not changed and the position information from the user on the current display screen is moving (drag state). It is not limited. That is, the drag determination unit 17 determines whether or not a drag input is made based on the amount of movement of the continuous input position in the position input unit 11. That is, whether or not the pointing position input is an input by a drag operation by comparing the distance that the pointing position has moved without being turned off (OFF) as it is from a position where the pointing position is turned on (ON). judge.

  Here, the moving distance of the position can be the length of the traveled path (route) or the linear distance from the position input start point to the current designated position, but is not limited to this. . Further, the threshold value used for determining whether or not the drag is performed is, for example, from an input position movement amount from input ON (ON) to OFF (OFF) that can occur at the tap so that a difference from a simple tap becomes clear. Use a sufficiently large value. For example, in the present embodiment, when the movement amount is about 10 mm at the maximum by the tap operation, the threshold value can be about 20 mm or more, but is not limited to this. Furthermore, in this embodiment, it is possible to check the distribution of tap movement in advance and set a statistically sufficiently large threshold value, but the threshold setting method is not limited to this.

  The mode control unit 18 performs control to shift from the normal mode to the zoom mode, for example, when the number of inputs held by the input number measurement unit 12 is a predetermined number (for example, “2”) or more. Further, in addition to the condition of the number of inputs described above, the mode control unit 18 may perform control for shifting to the zoom mode, for example, when the drag determination unit 17 determines that the drag is performed.

  Specifically, the mode control unit 18 shifts to the scroll mode or the zoom mode according to the number of inputs held by the input number measurement unit 12 when, for example, the drag determination unit 17 determines dragging. In addition, the mode control unit 18 may call the state reset unit 16 to cancel the mode when the position input is turned off.

  In addition, for example, when the mode control unit 18 does not shift to the zoom mode, the mode control unit 18 performs control to shift to the scroll mode (or leave the scroll mode). Specifically, for example, the mode control unit 18 shifts to the zoom mode when the number of inputs held by the input number measurement unit 12 is equal to or greater than a predetermined number (for example, two times), and is less than the predetermined number (for example, one time). Shift to scroll mode at.

  Further, the mode control unit 18 shifts to a rotation mode in which the display content is rotated in a predetermined direction when the input position moves in a circular arc shape by a predetermined amount or more around the reference position calculated by the reference position calculation unit 19, for example. be able to.

  Further, the mode control unit 18 can perform control so as to cancel the change of the display mode by performing a predetermined operation on the screen of the display unit 22 with a user's finger or the like, for example. Specifically, the mode control unit 18 cancels the change of the display content processed in each mode when the movement direction of the input position by the drag input is changed in the zoom mode or the rotation mode. Return to the display contents before the mode transition.

  The reference position calculation unit 19 calculates a position serving as a zoom reference based on the input position (for example, a start point) held by the input position holding unit 13. The reference position coordinates calculated by the reference position calculation unit 19 may be, for example, an average of a plurality of input point coordinates held in the input position holding unit 13 or may be held in the input position holding unit 13. However, the present invention is not limited to this.

  Based on the zoom reference position (center position) obtained by the reference position calculation unit 19 after the shift to the zoom mode and the position information input from the position input unit 11, the change amount calculation unit 20 calculates the zoom rate for the display content. calculate. Note that the zoom rate is obtained by linearly converting, for example, a difference value in the horizontal direction (for example, x coordinate) or a difference value in the vertical direction (for example, y coordinate) between the reference position calculated by the reference position calculation unit 19 and the current input position. It is possible to calculate using the obtained value and the zoom rate immediately before the zoom mode shift. Specifically, the zoom rate is calculated by multiplying the value obtained by linearly converting the difference value in the horizontal direction (for example, the x coordinate) or the difference value in the vertical direction (for example, the y coordinate) by the zoom rate immediately before shifting to the zoom mode. However, the calculation method is not limited to this. For example, in this embodiment, one of the enlargement and reduction zooms (for example, during zooming) uses the above-described calculation method using the linear conversion, and the other (for example, during reduction zoom) uses the linear conversion. Other calculation methods set in advance may be used without using.

  Further, when the mode control unit 18 shifts to the rotation mode, the change amount calculation unit 20 acquires a rotation angle corresponding to the movement amount of the arcuate rotation movement (arc movement) around the reference position. Specifically, the change amount calculation unit 20 calculates the rotation angle based on, for example, the rotation angle immediately before the transition to the rotation mode and the angle formed by the line segment connecting the reference position and the current input position and the horizontal line passing through the reference position. get.

  The display content setting unit 21 holds various setting contents such as the display position in the scroll mode, the zoom rate when the mode is shifted to the zoom mode, and the rotation angle when the mode is shifted to the rotation mode. Further, the display content setting unit 21 changes the display content of the display unit 22 based on the held setting content.

  Note that the amount of change in display content (for example, scroll amount, zoom rate, rotation angle, etc.) in the display content setting unit 21 is obtained by, for example, the change amount calculation unit 20 or the like. Therefore, the display content setting unit 21 changes the display content in accordance with a predetermined display mode based on the reference position obtained from the reference position calculation unit 19 and the change amount obtained from the change amount calculation unit 20.

  For example, when the display unit 22 is a touch panel, a scroll operation or the like is performed following the movement of the user's finger on the touch panel in the scroll mode. Note that what kind of scrolling is performed with respect to the movement of the finger can be arbitrarily set by the display content setting unit 21. That is, in the scroll mode described above, information such as the display position immediately before the transition to the scroll mode and the distance between the reference position obtained by the reference position calculation unit 19 and the input position input from the position input unit 11 are used. The display content is set in the display content setting unit 21. In the zoom mode described above, information such as the zoom ratio immediately before shifting to the zoom mode, the reference position obtained by the reference position calculation unit 19, and the distance and direction input from the position input unit 11 are used. The display content is set in the display content setting unit 21.

  Here, for example, in the zoom mode, the display content setting unit 21 displays a predetermined guide display indicating that the current display content is in the zoom mode, at a predetermined position calculated based on the zoom reference position (center position). Can be set to be displayed. The guide display includes, for example, at least one of a reference mark corresponding to the size (zoom rate) before shifting to the zoom mode and a direction mark indicating the direction of the input position for changing the display content. However, the present invention is not limited to this. The guide display may include the current zoom rate. Further, the guide display may include a zoom mark obtained by enlarging or reducing the reference mark in accordance with the zoom rate.

  In addition, if the display content setting unit 21 is already displayed at a predetermined zoom rate in the zoom mode at the time of the shift to the rotation mode, the display content setting unit 21 may rotate the display content with the set zoom rate. The display content may be rotated by returning to the zoom ratio value before the mode.

  In the present embodiment, in the zoom mode, when the current input position by the drag operation is in the vicinity of the screen edge of the display unit 22, the finger of the user performing the drag operation is stopped for a predetermined time. By this operation, the display content setting unit 21 can set the reference position to scroll and display in a direction away from the current input position (near the screen edge). Note that the scroll display described above can also be applied when the current display is in the rotation mode, for example.

  Furthermore, the display content setting unit 21 can also be set to cancel the change of the display content in each display mode when the mode control unit 18 cancels the change of the display mode.

  The display unit 22 changes the display content of the screen based on various setting information in the display content setting unit 21. For example, the display unit 22 displays a display content such as an image, a video, a document (for example, a web page), text, or the like at a predetermined zoom rate obtained by the change amount calculation unit 20 and a predetermined value obtained by the reference position calculation unit 19. Zoom display (enlargement or reduction) or the like is performed based on the center position. Further, the display unit 22 rotates the display content or scrolls the display content based on the setting information in the display content setting unit 21. The display unit 22 has a function as an input unit for inputting information by detecting pressure on the screen by a user's finger or pen, for example, such as a touch panel, and outputs the above-described display contents. It may have a function as an output unit.

  The display unit 22 may be an organic Electro Luminescence (EL) system or a liquid crystal system, as long as it has a display resolution sufficient to display a software keyboard and input handwriting. As the touch panel, for example, a resistive film method, a capacitance method, an optical method, an electromagnetic induction method, or the like can be used. For example, a sampling rate and a resolution that can perform touch input and handwriting input to a software keyboard should be provided. Any method is acceptable.

  Here, the information processing apparatus 10 mentioned above is mounted as one aspect | mode using the computer system which mounts the touchscreen device integrated with a display apparatus, for example, and the software which operate | moves on it. The software portion may be realized by hardware that performs an equivalent function. As such a computer system, for example, a communication terminal such as a mobile phone, a smart phone, a tablet terminal, or a Personal Digital Assistant (PDA) can be used. The information processing apparatus 10 may be a personal computer (PC), a game machine, a music playback device, or the like.

  With the information processing apparatus 10 described above, the display content of the screen can be changed to an appropriate arbitrary magnification by a simple operation. In the present embodiment, not only the magnification can be changed, but also the display content can be rotated or the display content change by each display mode can be canceled, but the present invention is not limited to this.

<Information processing apparatus 10: hardware configuration example>
Here, in the information processing apparatus 10 described above, an execution program (display program) that can cause a computer to execute each function is generated, and the execution program is installed in, for example, a general-purpose PC. The display process can be realized. Here, an example of a hardware configuration of a computer capable of realizing the display processing in the present embodiment will be described with reference to the drawings.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus. In the example of FIG. 2, a hardware configuration when the information processing apparatus is a communication terminal such as a smartphone is illustrated.

  In the example of FIG. 2, a microphone 31, a speaker 32, a display unit 33, an operation unit 34, a power unit 35, a wireless unit 36, a short-range communication unit 37, an auxiliary storage device 38, and a main storage device 39, a central processing unit (CPU) 40, and a drive device 41.

  The microphone 31 inputs a voice uttered by the user and other sounds. The speaker 32 outputs the other party's voice or sounds such as ringtones. The microphone 31 and the speaker 32 are used when talking with the other party by a telephone function or the like. However, the microphone 31 and the speaker 32 are not limited to this. For example, information and various instructions may be input using the microphone 31. Processing results, error information, and the like may be acquired by voice.

  The display unit 33 displays time information, information relating to whether or not the communication area is outside, text data such as image data and document data, and the like. The display unit 33 corresponds to the display unit 22 shown in FIG.

  The operation unit 34 is pressed by the user at the time of setting various functions, at the time of registering a telephone number or the like, at the time of outgoing and incoming calls. For example, when the display unit 33 has a function such as a touch panel, the operation unit 34 performs a predetermined operation on the screen, for example, to set the content displayed on the screen to an arbitrary magnification. Appropriate changes can be made and rotational operations can be performed.

  The power unit 35 supplies power to each component of the information processing apparatus 10. In addition, although the electric power part 35 is internal power supplies, such as a battery, for example, it is not limited to this. The power unit 35 can also detect the amount of power at all times or at predetermined time intervals and monitor the amount of power.

  The radio unit 36 is a communication data transmission / reception unit that receives a radio signal (communication data) from a base station using, for example, an antenna or transmits a radio signal to the base station via an antenna. Note that the wireless unit 36 measures the reception strength by, for example, Receive Signal Strength Indication (RSSI), and transmits and receives communication data when communication is possible based on the measurement result.

  The short-range communication unit 37 performs short-range communication with an external device using a communication method such as infrared communication or Bluetooth (registered trademark). The wireless unit 36 and the short-range communication unit 37 described above are communication interfaces that enable transmission and reception of data with an external device. Using the communication interface, the execution program etc. is acquired from the connected external device etc., or the execution result obtained by executing the program or the execution program itself corresponding to this embodiment is provided to the external device etc. Can be.

  The auxiliary storage device 38 is a storage unit such as a hard disk drive or a solid state drive (SSD), for example, stores an execution program, a control program, and the like in this embodiment, and performs input / output as necessary.

  The main storage device 39 stores an execution program read from the auxiliary storage device 38 in response to an instruction from the CPU 40, and stores various information obtained during program execution. The main storage device 39 includes, for example, a read only memory (ROM) and a random access memory (RAM), but is not limited thereto.

  The CPU 40 performs processing of the entire computer, such as various operations and input / output of data with each hardware component, based on a control program such as an operating system (OS) and an execution program stored in the main storage device 39. By controlling, each processing in the screen display is realized. Various information necessary during the execution of the program may be acquired from the auxiliary storage device 38 and the execution result or the like may be stored.

  An execution program can be acquired from the connected management server 12 or the like, or an execution result obtained by executing the program or the execution program itself corresponding to the present embodiment can be provided to an external device or the like.

  The drive device 41 can detachably set the recording medium 42, for example, and can read various information recorded on the set recording medium 42 and write predetermined information on the recording medium 42. The drive device 41 includes, for example, a medium loading slot and the like, but is not limited to this.

  The recording medium 42 is a computer-readable recording medium that stores an execution program and the like as described above. The recording medium 42 may be a semiconductor memory such as a flash memory, for example. Further, the recording medium 42 may be a portable recording medium such as a Universal Serial Bus (USB) memory.

  Here, the execution program installed in the computer main body in the present embodiment is provided by, for example, a portable recording medium 42 such as a flash memory. The recording medium 42 on which the program is recorded can be set in the drive device 41, and an execution program included in the recording medium 42 is transferred from the recording medium 42 via the drive device 41 to the auxiliary storage device 38 based on a control signal from the CPU 40. Installed on. That is, in this embodiment, by installing an execution program (for example, a display program) in the hardware configuration of the computer main body described above, the hardware resource and the software cooperate to perform the display processing and the like in this embodiment. Can be realized. Further, the display program corresponding to the above-described display processing may be in a resident state on the apparatus, for example, or may be activated by an activation instruction.

<Example of display processing in this embodiment>
Next, an example of display processing in the present embodiment will be described using a flowchart. FIG. 3 is a flowchart illustrating an example of display processing in the present embodiment. In the following description, display processing from the normal mode (a state in which the mode is not changed in the present embodiment) will be described as an example. In addition, the display unit 22 that displays target data such as image data and document data has a touch panel, for example, as described above, and can perform position input or the like by an operation on the screen of the user or the like.

In the display process shown in FIG. 3, for example, the coordinate value X (X = (x, y)) of the input position is acquired from a pointing input (position input) on the screen by the user (S01). Next, the display process checks the pointing state (S02), and determines whether the pointing state is changed from OFF (non-pressed state) to ON (pressed state) (S03). For example, when the display unit 22 is a touch panel or the like as described above, the pointing state is a state in which the user taps the screen. The display process is performed when the pointing state is changed from OFF to ON (in S03, YES), the pointing position X acquired in the process of S01 is stored in the input position holding unit 13 or the like (S04). Note that the pointing position at this time is XB. Further, in the display process, the pointing position X acquired in the process of S01 is added to the array XS (S05). The process of S05 is used, for example, when calculating the average of the input point coordinates or setting the reference position based on the acquired first or last point coordinates.

  Next, the display process checks the value of the input count CT (S06), and determines whether CT is 0 (S07). In the display process, when CT is 0 (YES in S07), the time measurement is reset (S08). That is, the measurement time T is set to zero. Here, in the display process, if CT is not 0 after the process of S08 or in the process of S07 (NO in S07), the number of times CT changed from OFF to ON is increased by 1 (S09).

  Next, in the display process, after the process of S09 or when the state has not changed from OFF to ON in S03 (NO in S03), the distance between the stored array XS and the current input position X (in FIG. 3). In the example, a maximum value D is calculated (S10). In addition, the case where it has not changed from OFF to ON as described above includes, for example, the case where the pointing state is already in the ON state in the process of S02.

  Further, the display process compares the distance D obtained by the process of S10 with a preset distance threshold DS (S11) and determines whether the distance D is greater than the threshold DS (D> DS?). (S12). In the display process, when the distance D is not greater than the threshold value DS (that is, D ≦ DS) (NO in S12), next, the measurement time T is compared with a preset measurement time threshold value Ts (S13). Then, it is determined whether or not the measurement time T is larger than the threshold value TS (T> TS?) (S14).

  Here, when the distance D is larger than the threshold value DS in the process of S12 described above (YES in S12), the display process sets the input count CT to 0, emptys the array XS (S15), and performs the process. finish. That is, in the process of S15, the state is reset. In the display process, when the measurement time T is longer than the threshold value TS in the process of S14 (YES in S14), the process of S15 described above is performed, and the process ends.

  Next, in the display process, when the measurement time T is not longer than the threshold value Ts in the process of S14 (that is, T ≦ TS) (NO in S14), the distance DB between the current input position X and the start point XB is DB. Is obtained (S16). In the display process, it is determined whether or not the distance DB is larger than a preset second threshold value DS2 (DB> DS2?) (S17). In the process of S17, the drag determination is performed using the second threshold value DS2. In the display process, when the distance DB is larger than the second threshold value DS2 in the process of S17 (YES in S17), it is determined that the user is performing a drag operation, and the reference position XC is obtained from the array XS (S18). . In the process of S18, for example, the first coordinate value of the array XS is set as the reference position XC.

  Next, the display process reads the current display content (S19). In the process of S19, for example, the current display position XD, the current zoom ratio SD, and the current rotation angle RD can be read, but the present invention is not limited to this. The current display position XD includes, for example, the position coordinates of display data positioned at the center of the screen.

  Next, the display process checks the input count CT (S20), determines whether the input count CT is 1 (CT = 1?) (S21), and if the input count CT is 1 (S21). In YES, the display mode is changed to the scroll mode to change the display content (S22). In S21, when the input count CT is not 1 in S21 (NO in S21), it is determined whether the input count CT is 2 or more (CT ≧ 2?) (S23), and the input count CT. Is 2 or more (YES in S23), the display mode is changed to the zoom mode and the display content is changed (S24). That is, in the process of S24, the display content is enlarged or reduced at a predetermined zoom rate set by the display content setting unit 21 described above, for example. Further, in S23, when the number of times of input CT is not 2 or more in S23 (NO in S23), the display process is terminated as it is.

  In the display process, when the distance DB is equal to or smaller than the second threshold value DS2 in the process of S17 (NO in S17), it is determined that the user is not performing a drag operation, and the process ends.

  In the processes of S21 to S24 described above, the scroll mode is shifted when the input count CT is 1, and the zoom mode is shifted when the input count CT is 2 or more. However, the present invention is limited to this. It is not a thing and each number of times can set a predetermined number arbitrarily. Therefore, for example, when the input count CT is 2 times, the mode may be shifted to the scroll mode, and when the input count CT is 3 times or more, the mode may be shifted to the zoom mode.

<S22: Example of display processing in scroll mode>
Next, an example of a display process in the scroll mode corresponding to the process of S22 described above will be described using a flowchart. FIG. 4 is a flowchart illustrating an example of display processing in the scroll mode.

  In the display process shown in FIG. 4, for example, the coordinate value X (X = (x, y)) of the input position is acquired from a pointing input on the screen by the user (S31). Next, the display processing determines whether or not the pointing state by the user has been changed from ON (pressed state) to OFF (non-pressed state) (S32). Here, when the display process is not changed from ON to OFF (NO in S32), a difference vector VC from the reference position XC obtained by the process of S18 described above to the current input position X is obtained (S33). ). Here, the difference vector VC includes information on the difference value and the direction.

  Next, the display process sets a position (XD + VC) moved by the difference vector VC from the original display position XD as a new display position (S34), performs a scroll operation with the set display position as a reference, and performs a target operation. Data (for example, image data) is redisplayed (S35).

  In the display process, when the input changes from ON to OFF in S32 (YES in S32), the scroll mode is canceled (S36).

<Example of display processing in S24: zoom mode>
Next, an example of a display process in the zoom mode corresponding to the process of S24 described above will be described using a flowchart. FIG. 5 is a flowchart illustrating an example of display processing in the zoom mode.

  In the display process shown in FIG. 5, for example, a coordinate value X (X = (x, y)) is acquired from a pointing input by the user (S41). Next, the display processing determines whether or not the pointing state by the user has been changed from ON (pressed state) to OFF (non-pressed state) (S42).

  If the display process is not changed from ON to OFF (NO in S42), it is determined whether or not the trajectory of the input position X with respect to the reference position XC is moving in a predetermined arc (S43). Note that whether or not the arc is moving is determined by, for example, acquiring a plurality of input positions at predetermined time intervals, calculating the distance between the acquired plurality of input positions and the reference position, and the distance is within a certain range. If the input position is moving while maintaining the inner distance, it is determined that the arc is moving. Note that the method for determining the arc movement is not limited to this.

  Here, when it is determined that the circular arc movement is not performed in the display process (NO in S43), as described above, the difference vector VC from the reference position XC to the current input position X is obtained (S44). The quantization direction AC of VC is obtained (S45). Next, the display process obtains a length LC obtained by projecting VC in the direction AC, and obtains a code value SC corresponding to the direction (S47).

  Here, the display process determines whether or not SC is smaller than 0 (SC <0?) (S48). If SC is 0 or more (when the sign value is positive) (NO in S48), a predetermined value is set. A new zoom ratio is set by calculating (S49). In the process of S49, for example, it is possible to calculate as “zoom rate = (LC + C) / C × SD”, where C is a constant, SD is the zoom rate before shifting to the zoom mode, and LC is in the axis direction of enlargement or reduction. This represents the distance between the projected point and the reference position.

  In the display process, when SC is smaller than 0 (when the sign value is negative) (YES in S48), a new zoom ratio is set by a predetermined calculation (S50). In the process of S50, for example, it can be calculated as “zoom rate = C / (LC + C) × SD”. In addition, about the calculation method in the process of S49 and S50, it is not limited to this.

  In the display process, after the processes of S49 and S50 are completed, the target data enlarged or reduced based on the set zoom rate is displayed again (S51). That is, in the display process shown in the example of FIG. 5, for example, enlargement zoom or reduction zoom can be performed based on the drag direction in the zoom mode, and the zoom rate can be set according to the drag length.

  In the display process, when it is determined that the arc is moving in the process of S43 described above (YES in S43), the display mode is changed to the rotation mode and the display content is changed (S52). In the display process, when the input is changed from ON to OFF in S42 described above (YES in S42), the zoom mode is canceled (S53).

<Example of display processing in S52: rotation mode>
Next, an example of display processing in the rotation mode corresponding to the processing of S52 described above will be described using a flowchart. FIG. 6 is a flowchart illustrating an example of display processing in the rotation mode.

  In the display process shown in FIG. 6, for example, the coordinate value X (X = (x, y)) of the input position is acquired from the pointing input by the user (S61). Next, the display process determines whether or not the pointing state by the user has been changed from ON (pressed state) to OFF (non-pressed state) (S62).

  If the display process is not changed from ON to OFF (NO in S62), the difference vector VC from the reference position XC to the current input position X is obtained as described above (S63), and the rotation based on the difference vector VC is performed. The angle RC is obtained (S64). In the process of S64, for example, the rotation angle RC can be obtained based on the angle formed by the line segment of the difference vector VC and the horizontal line, but the present invention is not limited to this.

  Next, in the display process, for example, a new rotation angle is set based on the rotation angle RD just before the rotation mode shift and the rotation angle RC obtained in S64 (S65). In the process of S65, for example, a new rotation angle can be acquired by adding the rotation angle RD immediately before the rotation mode transition and the rotation angle RC obtained in S64. However, the present invention is not limited to this. In the display process, the target data is rotated and displayed again based on the set rotation angle (S66).

  In the display process, when the input is changed from ON to OFF in S62 (YES in S62), the rotation mode is canceled (S67).

<Specific examples of display contents corresponding to user operations>
Here, a specific example of display contents corresponding to a user operation in the present embodiment will be described with reference to the drawings.

<First specific example>
FIG. 7 is a diagram illustrating a first specific example of display contents corresponding to a user operation. In the first specific example, the display content is changed by a user operation shown in FIGS. Note that arrows (1) and (2) in FIGS. 7B to 7D indicate the operation content of the user's finger 51 on the screen 50 of the display unit 22, and are not displayed on the screen 50. Absent. 7B to 7D, an arrow (1) indicates an operation of tapping the screen 50 with the user's finger 51. An arrow (2) indicates an operation of tapping the screen 50 with the user's finger 51 and dragging in the direction of the arrow while being tapped (a state in which the finger 51 is in contact with the screen 50).

  First, FIG. 7A shows a state before a user operation is performed (so-called initial state). In the initial state shown in FIG. 7A, predetermined image data (car drawing data in the example of FIG. 7) instructed by the user or the like is displayed on the screen 50 of the display unit 22. The target data to be changed may be other image data, and is not limited to image data. The target data may be, for example, video data, document data such as a web page, text data, or the like.

  Here, in the first specific example, from the initial state shown in FIG. 7A, the user's finger 51 is used to move the screen 50 on the screen 50 in the procedure of arrows (1) and (2) shown in FIG. After tapping twice within a predetermined time, drag to the right. In the first specific example, by performing the above-described user operation, for example, the normal mode is changed to the zoom mode. The predetermined time indicates, for example, a measurement time after being tapped once by the operation of the arrow (1). For example, the threshold can be set as “1 second”, but is not limited thereto. . Moreover, the tap number should just be a predetermined number set beforehand, and is not limited to 2 times.

  Further, in the first specific example, as shown in FIG. 7C, the drag operation shown in FIG. 7B is continued, and further dragging is performed, with the tap position at the center (reference position). Enlarged display according to the amount (drag distance) is performed. The tap position may be, for example, the average coordinate of the position coordinates tapped with the arrows (1) and (2), the position coordinates tapped with the arrow (1), or the position coordinates tapped with the arrow (2). . That is, in the first specific example, when the drag distance is extended, the zoom rate is changed accordingly, and the display content of the screen 50 is changed in accordance with the changed zoom rate. In the examples of FIGS. 7B and 7C, the image data is enlarged and displayed by dragging the user's finger 51 to the right of the reference position by the operation of the arrow (2).

  Furthermore, in the first specific example, the operation of the arrow (2) is performed after the operation of the arrow (1) shown in FIG. 7D, and the user's finger 51 is moved to the left side of the reference position obtained from the tap position. By performing a drag operation, the display content can be reduced.

  That is, in the first specific example, when the drag operation of the arrow (2) is performed, if the drag operation is performed in a preset direction, the display content is enlarged and a direction other than the direction in which the display is further enlarged is performed. A reduced display is performed by performing a drag operation (for example, in the reverse direction). Note that the display content setting unit 21 can set conditions in advance in which direction the display content is changed by enlargement or reduction by being dragged with respect to the reference position. In this case, the angle range can be set in a predetermined direction, but the angle ranges are set so as not to overlap. Note that the setting range of the direction for zooming in and zooming out may not be in the reverse direction, but the reverse direction is easier for the user to understand and operate.

  In this embodiment, when the drag operation is performed without performing the above-described two taps (that is, when only the operation of the arrow (2) is performed), the scroll according to the drag amount is performed as the normal mode. .

<Relationship between drag and zoom ratio>
Here, the relationship between the amount of movement by dragging and the zoom rate will be described with reference to the drawings. FIG. 8 is a diagram for explaining the relationship between the amount of movement by drag and the zoom rate.

  In this embodiment, the relational expression between the amount of movement from the reference position by drag and the zoom rate is, for example, “enlarged zoom rate = (LC + C) / C × SD”, “reduced zoom rate = C / (LC + C) × SD”. Can be defined. Here, C is a constant, LC is the distance between the point projected in the axial direction of enlargement or reduction and the reference position, and SD is the zoom rate before shifting to the zoom mode.

  That is, in the example of FIG. 8, when the enlargement direction and the reduction direction with respect to the reference position are set in advance, and the drag operation is performed from the reference position to the current input point in the zoom mode, the current input point is first enlarged. A distance LC between the point projected in the axial direction and the reference position is calculated. Next, in the example of FIG. 8, using the value of the distance LC, the zoom rate SD before shifting to the zoom mode, and the constant C, the enlargement zoom rate is calculated by the above-described formula, and based on the calculated enlargement zoom rate. Thus, the display content on the screen is enlarged and displayed around the reference position.

  In the example of FIG. 8, the zoom rate is calculated using the points projected in the horizontal direction (horizontal axis direction), but the present invention is not limited to this. For example, the zoom ratio is enlarged or reduced in the vertical direction (vertical axis direction). When the zoom direction is set, the zoom rate may be calculated based on the distance between the point projected in the vertical direction and the reference position.

  In the example of FIG. 8, the zoom ratio is calculated based on the distance between the point projected in the axial direction of enlargement or reduction and the reference position. However, the present invention is not limited to this. For example, the reference position and the current input The distance to the point may be calculated, and the calculated distance may be substituted into the LC of the above formula to calculate the zoom ratio for enlargement or reduction. In this case, in the example of FIG. 8, the enlargement zoom rate is calculated when dragging to the right side from the reference position, and the reduction zoom rate is calculated when dragging to the left side from the reference position.

  Furthermore, in this embodiment, the magnification with respect to the moving distance can be set from the relationship between the distance from the reference position corresponding to the tap position to the edge of the screen and the preset maximum (minimum) magnification. In this case, for example, the distance from the reference position to the screen edge moved in the predetermined direction is set to the maximum magnification or the minimum magnification, and the magnification for the predetermined distance is set from the relationship between the set distance and the magnification.

  For example, in the zoom mode, it is assumed that the drag operation in the left direction from the reference position is set to the reduction zoom, and the drag operation in the right direction is set to the enlargement zoom. Here, the distance from the reference position to the left end of the screen is LL, and the distance to the right end is LR. Further, the minimum zoom rate that can be operated at a time is Smin, and the maximum zoom rate is Smax. At this time, the zoom ratio with respect to the display image is represented by “reduction zoom ratio = ((Smin−1) / LL × LC + 1) × SD” and “enlargement zoom ratio = ((Smax−1) / LR × LC + 1) × SD”. be able to. Note that LC represents the distance between the point projected in the axis direction of enlargement or reduction and the reference position, and SD represents the zoom ratio before shifting to the zoom mode. Thereby, the preset maximum magnification or minimum magnification can be realized using the distance from the reference position to the end.

<Relationship between drag direction and zoom in or zoom out>
Here, the relationship between the drag direction and the enlargement or reduction zoom in this embodiment will be described. In this embodiment, in the zoom mode, the direction in which the display content is changed by enlargement or reduction when dragged with respect to the reference position is determined in advance by a fixed direction or a predetermined angle for enlargement or reduction. Although it can be set with a range, it is not limited to this.

  For example, in this embodiment, it is determined whether the reference position for zooming is in the vicinity of the screen edge, and when the reference position is in the vicinity of the screen edge, the direction for performing the zoom operation by dragging is dynamically changed. Also good. Note that the vicinity means a region within a predetermined distance (for example, about 1 cm) from the edge of the screen, for example, but is not limited to this. For example, the predetermined distance can be arbitrarily set according to the screen size or the like. Can be set.

  For example, when the drag operation in the left direction from the reference position is set as the reduction zoom and the drag operation in the right direction from the reference position is set as the enlargement zoom in advance, the left side is moved to the left when the reference position is near the left edge of the screen. Drag operation (reduction zoom) cannot be performed. In such a case, in this embodiment, the drag direction for performing the reduction zoom is reset to the upward direction or the downward direction. If the reference position is in the vicinity of the left end of the screen, a drag operation (enlarged zoom) in the right direction is possible, and thus the drag direction of the enlarged zoom need not be changed. In other words, in the above example, it is checked whether the reference position on the screen is near the left or right screen edge. If it is near the left edge, the drag direction is used for reduction. If it is near the right edge, drag is used for enlargement. The direction can be reset by changing the direction upward or downward.

  Note that the present invention is not limited to the vicinity of the left and right screen edges. For example, when the drag direction for enlarging or reducing the reference position in the vertical direction is set, the vicinity of the upper and lower screen edges is set. If it is in the vicinity, change the drag direction. The above-described determination as to whether the object is near the screen edge can be easily grasped based on the position coordinates of the reference position. As described above, by dynamically changing the direction in which the zoom operation is performed, the user can change the display content with a simpler operation.

<Second specific example>
FIG. 9 is a diagram illustrating a second specific example of display content corresponding to a user operation. Note that arrows (1) and (2) shown in FIG. 9C indicate the operation content on the screen 50 using the user's finger 51 as described above.

  In the second specific example, the display content is changed in the zoom mode by the user operation shown in FIGS. In the second specific example, the above-described guide display is performed in the zoom mode.

  FIG. 9A shows a state in which, for example, the user's finger 51 is tapped twice on the screen 50 within a predetermined time, and the finger 51 remains in contact with the screen 50 after the tap. In this case, in this embodiment, the normal mode is changed to the zoom mode, but in the second specific example, guide display is performed on the screen 50. By this guide display, the user can easily grasp that the mode has been changed to the zoom mode.

  Note that the guide display shown in FIG. 9A includes a reference mark 52 corresponding to the size (zoom rate) before shifting to the zoom mode. Further, in the guide display shown in FIG. 9A, a direction mark 53-1 indicating a direction for zooming in (Zoom In) or a direction mark 53-2 indicating a direction for zooming out (Zoom Out) is provided. Including.

  The reference mark display 52 shown in FIG. 9A is displayed in a circle, and a predetermined semi-transparent color or pattern is added to the circle, but the shape, color, pattern, or the like is limited to this. Is not to be done. For example, the shape may be a star shape, a square, a reduced shape corresponding to the image size (outer shape), a triangle, a predetermined character mark, or the like. As for colors, only the outer peripheral portion of the reference mark 52 may be displayed in a predetermined color, and the inside of the reference mark 52 may be transparent.

  Further, the direction marks 53-1 and 53-2 shown in FIG. 9A have an arrow indicating a drag direction and display contents (for example, “Zoom In” and “Zoom Out”) by moving to the arrow. Although shown, the present invention is not limited to this.

  Here, in the example of FIG. 9A, the drag direction for enlarging or reducing in the left-right direction with respect to the reference position is set in advance, but when the reference position is near the screen edge as described above. The drag direction is reset, and a direction mark is displayed in the reset drag direction. For example, in the example of FIG. 9B, when the user taps the upper left position in the screen 50 twice using the finger 51 to enter the zoom mode, the reference position is near the end of the screen 50. Therefore, the left drag operation cannot be performed. Therefore, in this embodiment, the reduced zoom set in the left direction is reset in a direction different from the right phrase set in the enlarged zoom. In addition, although there are up and down directions as candidates for the direction to be reset, the drag operation cannot be performed because the upper direction is also near the end of the screen 50. Accordingly, the reduction zoom is reset in the downward direction, and a direction mark of reduction zoom (Zoom Out) is displayed in the downward direction as shown in FIG. 9B.

  Furthermore, in the second specific example, as shown in FIG. 9C, the guide display indicates how much the display content is enlarged or reduced according to the distance moved by the drag operation. The zoom factor 54 may be displayed. In the example of FIG. 9C, the target data is enlarged and displayed at a zoom rate of 150% by the drag operation at the current time. As shown in FIG. 9C, the zoom rate 54 may be displayed near the reference position, and is at a predetermined position such as a predetermined position on the screen 50 (for example, the upper right or the center of the screen 50). May be displayed.

  In the second specific example, as shown in FIG. 9C, a zoom mark 55 may be displayed as the guide display, which indicates how much is changed during dragging. The zoom mark 55 has a shape similar to that of the reference mark 52 and is enlarged or reduced with the reference position as a reference. That is, the zoom mark 55 is displayed by enlarging or reducing the reference mark 52 in correspondence with the value of the zoom factor 54, for example.

  Accordingly, in the zoom mode, when the zoom rate does not change from the state before the zoom mode (zoom rate = 100%), the same shape is superimposed and displayed on the reference mark 52 and the zoom mark 55. In the case of enlargement zoom, as shown in FIG. 9C, a zoom mark 55 is displayed outside the reference mark 52 in correspondence with the distance from the reference position by the drag operation. In the case of reduced zoom, the zoom mark 55 is superimposed and displayed inside the reference mark 52 in correspondence with the distance from the reference position by the drag operation.

  The zoom mark 55 may have a predetermined translucent color or pattern different from the reference mark 52, and only the outer peripheral portion of the zoom mark 55 may be displayed in a predetermined color. In addition, the reference mark 52 and the zoom mark 55 are displayed in a superimposed manner, but it is preferable that one of them can be visually recognized at the same time, for example, by making one of the outlines or semi-transparent, or by displaying a smaller mark superimposed on the upper side. In this way, in this embodiment, the zoom rate changes following the movement of the finger, and the current zoom rate can be easily grasped visually, so the user can intuitively perform the zoom operation. .

  Here, the size of the fiducial mark 52 is the above-described formula for calculating the zoom ratio (for example, zoom ratio = (LC + C) / C × SD) or the formula for calculating the zoom ratio (for example, zoom ratio = C / ( LC + C) × SD). For example, the size of the reference mark 52 is the same size as a circle whose radius is the constant C in the above formula, and the position is centered on the reference position. Further, the position of the zoom mark 55 is centered on the reference position, and the size of the zoom mark 55 can be, for example, “size of the reference mark 52 × zoom rate / SD”.

<Third specific example>
FIG. 10 is a diagram illustrating a third specific example of display content corresponding to a user operation. Note that the arrows (1) and (2) shown in FIGS. 10A and 10B indicate the operation content on the screen 50 using the user's finger 51 as described above. The third specific example shows a change in display content when the user's finger 51 is stopped at the edge of the screen in the zoom mode. Specifically, for example, when the current input position by drag input is in the vicinity of the screen edge (for example, within about 1 cm from the screen edge) and there is a stop for a predetermined time at that position, the reference position is the current position. Scroll away from the input position.

  For example, in the third specific example, the normal mode is changed to the zoom mode by the operation of the arrows (1) and (2) by the user's finger 51, and the user's finger 51 is moved by the drag operation indicated by the arrow (2). Suppose that the screen moves to the vicinity of the right end of the screen 50.

  At this time, in the third specific example, by stopping the user's finger 51 in the vicinity of the end of the screen 50 for a predetermined time (for example, about 1 second to 2 seconds), as shown in FIG. The screen 50 scrolls in the left direction. In the third specific example, the drag operation of the finger 51 is continued by the above-described scroll, and the zoom rate is changed as shown in FIG. 10B corresponding to the continued drag operation. In the third specific example, when the finger 51 is released from the screen during the above-described scrolling, the scrolling is stopped.

  The scroll direction is set based on the direction and position of the finger 51 that is being dragged. In the third specific example, the drag direction is determined by stopping the finger 51 for a predetermined time so that the drag operation can be continued even if the finger 51 dragged in a predetermined direction moves to the end of the screen 50. Scroll in the opposite direction. Note that scrolling in the direction opposite to the drag direction is, for example, scrolling in a direction away from the current input position. Thereby, in the 3rd example, drag operation can be continued with scroll operation.

  In the example of FIGS. 10A and 10B, the zoom rate is 150% in a state where the finger 51 is moved to the end of the screen 50 by the drag operation in the zoom mode, and then the finger 51 is held for a predetermined time. By stopping, the screen 50 is scrolled and the zoom rate is also changed to 180%.

  In the above-described screen example, the display content is also changed and displayed in real time according to the zoom rate to be displayed, but the display content is not limited to this. For example, in the third specific example, when the drag operation is performed in the zoom mode and the zoom mode is canceled by releasing the finger 51 from the screen 50 at a predetermined zoom rate, the zoom display corresponding to the zoom rate is changed. May be.

<Fourth specific example>
FIG. 11 is a diagram illustrating a fourth specific example of display content corresponding to a user operation. Note that arrows (1) and (2) shown in FIGS. 11A to 11C indicate the operation content on the screen 50 using the user's finger 51 as described above. Further, the arrow (3) shown in FIG. 11C is centered on the reference position while the drag operation is continued after the user's finger 51 is used to drag in a predetermined direction away from the reference position indicated by the arrow (2). An operation for performing an arcuate rotational movement is shown and is not displayed on the actual screen 50. That is, in the fourth specific example, in the zoom mode, the user moves the arc 50 around the reference position while dragging the screen 50 with the user's finger 51 to shift from the zoom mode to the rotation mode described above. An example is shown.

  For example, in the fourth specific example, as shown in FIG. 11A, the screen 50 is quickly tapped twice within a predetermined time by the operations of the arrows (1) and (2) using the user's finger 51, If the drag operation is performed as it is, the zoom mode is changed from the normal mode. In the example of FIG. 11A, the reference mark 52 described above is displayed as the guide display. However, the present invention is not limited to this. For example, the above-described direction mark may be displayed. There is no need.

  Further, in the fourth specific example, as shown in FIG. 11B, by performing a drag operation in a predetermined direction away from the reference position corresponding to the tap position, an enlarged display corresponding to the distance from the reference position is displayed. Done. In the example of FIG. 11B, the reference mark 52 and the zoom mark 55 described above are displayed as the guide display. However, the present invention is not limited to this. For example, the zoom ratio described above may be displayed. There is no need to display the guide.

  Here, in the fourth specific example, as shown by an arrow (3) in FIG. 11C, the finger 51 is moved in a circular arc shape by a predetermined amount or more to shift from the zoom mode to the rotation mode. Further, in the fourth specific example, the display content (target data) on the screen 50 is rotated as shown in FIG. 11D in accordance with the direction and amount moved by the arrow (3). In the example of FIG. 11D, the target data to be rotated is rotated in a predetermined direction after being returned to the state before zooming. However, the present invention is not limited to this, and the operation of FIG. You may rotate with the zoom displayed. Further, in the fourth specific example, as shown in FIG. 11A, for example, immediately after moving to the zoom mode, the operation of the arrow (3) shown in FIG. As shown in the fourth specific example, in the present embodiment, the display content can be appropriately changed by a simple operation of the user.

  Note that the third specific example described above can also be applied in the rotation mode shown in the fourth specific example. Specifically, for example, when the current input position (pointing position) by the user's finger 51 is in the vicinity of the screen edge and there is a stop for a predetermined time, the reference position is a predetermined amount away from the current input position. It can be scrolled.

<Fifth example>
FIG. 12 is a diagram illustrating a fifth specific example of display content corresponding to a user operation. Note that arrows (1) and (2) shown in FIGS. 12A to 12C indicate the operation content on the screen 50 using the user's finger 51 as described above. An arrow (3) shown in FIG. 12C indicates a zoom mode or a rotation mode while continuing the drag operation after dragging in a predetermined direction away from the reference position indicated by the arrow (2) using the user's finger 51. The movement direction corresponding to is an operation of moving in a different direction. That is, in the fifth specific example, the operation content up to that point is canceled by the operation of the arrow (3), and the original target data before the mode transition is displayed. The arrow (3) is not displayed on the actual screen 50.

  For example, in the fifth specific example, as shown in FIG. 12A, the screen 50 is quickly tapped twice within a predetermined time by the operations of the arrows (1) and (2) using the user's finger 51, If the drag operation is performed as it is, the zoom mode is changed from the normal mode. In the example of FIG. 12A, the reference mark 52 described above is displayed as the guide display. However, the present invention is not limited to this. For example, the direction mark described above may be displayed. There is no need.

  In the fifth specific example, as shown in FIG. 12B, by performing a drag operation in a predetermined direction away from the reference position corresponding to the tap position, an enlarged display corresponding to the distance from the reference position is displayed. Done. In the example of FIG. 12B, the reference mark 52 and the zoom mark 55 described above are displayed as the guide display. However, the present invention is not limited to this. For example, the zoom ratio described above may be displayed. There is no need to display the guide.

  Here, in the fifth specific example, the zoom mode is canceled by moving the finger 51 upward by a predetermined amount or more as shown in the arrow (3) of FIG. As shown in D), display contents (target data) before and after the mode are displayed on the screen 50. In the present embodiment, the cancel operation described above can be realized by setting a direction for canceling in advance and performing a drag operation in the set direction. In this case, the direction for performing the cancellation is set to a direction different from the direction for performing the zoom mode or the rotation mode described above.

  Further, in the fifth specific example, as shown in FIG. 12A, for example, immediately after moving to the zoom mode, the operation of the arrow (3) shown in FIG. it can. As shown in the fifth specific example, in the present embodiment, the display content can be appropriately changed by a simple operation of the user.

  The mode transition in each of the specific examples described above is controlled by the mode control unit 18. In addition, each specific example corresponds to the mode controlled by the mode control unit 18, the change amount (zoom rate, rotation angle) obtained by the change amount calculation unit 20, and the setting content obtained by the display content setting unit 21. The display content is changed based on. Each of the specific examples described above can be combined to change the display content of the screen 50.

  According to the embodiment described above, the display content of the screen can be appropriately changed with a simple operation. Specifically, according to the present embodiment, two or more position inputs within a certain time and a certain distance are performed by the position input unit, and the drag operation is continuously performed as it is, so that the reference corresponding to the tap position is obtained. The zoom ratio can be changed to follow the drag amount with the position as the center. Therefore, according to the present embodiment, it is possible to specify the reference position and the zoom rate at a time. For example, using the thumb of one hand or the like, zooming of display contents (target data) at an arbitrary magnification is easier than in the conventional method. Is possible. In addition, according to the present embodiment, the reference position and the rotation angle can be specified at once. For example, the display content can be rotated at an arbitrary rotation angle more easily than the conventional method using the thumb of one hand. It becomes. Furthermore, since the operation in this embodiment does not overlap with other general touch operations, the user can change the intended display content without being confused.

  Each embodiment has been described in detail above. However, the present invention is not limited to the specific embodiment, and various modifications and changes other than the above-described modification are possible within the scope described in the claims. .

In addition, the following additional remarks are disclosed regarding the above Example.
(Appendix 1)
Accept position input from the position input unit, measure the number of times the position input has been accepted,
Calculate the distance between the reference position obtained by the position input and the current input position,
Based on the movement amount of the input position, it is determined whether or not it is a drag input, and based on the determined result and the number of inputs, the display mode in the display unit is shifted to a predetermined mode,
When the predetermined mode is a zoom mode, the display content of the display unit is changed to a predetermined zoom rate according to the distance based on the distance and the moving direction of the input position by the drag input. Display program to make the computer execute.
(Appendix 2)
Measure the time since receiving the position input from the position input unit,
The display program according to appendix 1, wherein the number of times of input is reset when the number of times of input is less than the predetermined number before the predetermined time is measured.
(Appendix 3)
The display program according to claim 1 or 2, wherein when the number of inputs is equal to or greater than a predetermined number, the mode is shifted to a zoom mode, and when the number of inputs is less than the predetermined number, the mode is shifted to a scroll mode.
(Appendix 4)
The reference position is an average of input coordinates obtained from the position input unit, or a coordinate of the first or last input position acquired by the position input unit. Display program.
(Appendix 5)
The zoom ratio is calculated based on a value obtained by linearly converting a difference in a predetermined axial direction between the reference position and the current input position by the drag input, and a zoom ratio before shifting to the zoom mode. The display program according to any one of appendices 1 to 4.
(Appendix 6)
The display program according to any one of appendices 1 to 5, wherein a predetermined guide display is performed on the screen of the display unit when the zoom mode is entered.
(Appendix 7)
The guide display is
It includes at least one of a reference mark based on the display content before shifting to the zoom mode, a zoom mark corresponding to the zoom ratio, a direction mark indicating a direction for zooming in or zooming out, and a zoom ratio. The display program according to appendix 6, which is characterized.
(Appendix 8)
The display program according to appendix 8, wherein the reference mark and the zoom mark are displayed in a superimposed manner.
(Appendix 9)
The display program according to any one of appendices 1 to 8, wherein a moving direction for setting the zoom rate is changed according to a location of the reference position on the screen of the display unit.
(Appendix 10)
The reference position is scrolled in a direction away from the current input position when the current input position by the drag input is near the screen edge of the display unit and there is a stop for a predetermined time. The display program according to any one of appendices 1 to 9.
(Appendix 11)
The display program according to any one of appendices 1 to 10, wherein when the input position by the drag input is moved in a circular shape centered on the reference position by a predetermined amount or more, the mode is shifted to a rotation mode.
(Appendix 12)
When shifting from the zoom mode to the rotation mode, the zoom rate of the display content is kept at the zoom rate set in the zoom mode or returned to the zoom rate before the zoom mode. The display program according to attachment 11.
(Appendix 13)
Any one of Supplementary notes 1 to 12, wherein when the movement direction of the input position by the drag input is changed in the zoom mode, the change to the predetermined zoom ratio according to the distance is canceled. Display program described in the section.
(Appendix 14)
Accept position input from the position input unit, measure the number of times the position input has been accepted,
Calculate the distance between the reference position obtained by the position input and the current input position,
Based on the movement amount of the input position, it is determined whether or not it is a drag input, and based on the determined result and the number of inputs, the display mode in the display unit is shifted to a predetermined mode,
When the predetermined mode is a zoom mode, the display content of the display unit is changed to a predetermined zoom rate according to the distance based on the distance and the moving direction of the input position by the drag input. A display method characterized by comprising:
(Appendix 15)
A position input unit for receiving position input;
An input number measuring unit that measures the number of times the position input is received by the position input unit;
A distance calculation unit for calculating a distance between a reference position obtained by the position input and a current input position;
A drag determination unit that determines whether or not a drag input is based on the amount of movement of the input position obtained from the position input unit;
A mode control unit that shifts the display mode in the display unit to a predetermined mode based on the determination result in the drag determination unit and the input count in the input count measurement unit;
Based on the distance obtained from the distance calculation unit and the movement direction obtained from the drag determination unit when the mode control unit shifts to the zoom mode, the display content on the screen is in accordance with the distance. An information processing apparatus comprising: a display content setting unit configured to change to a predetermined zoom ratio.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 11 Position input part 12 Input frequency measurement part 13 Input position holding part 14 Time measurement part 15 Distance calculation part 16 State reset part 17 Drag determination part 18 Mode control part 19 Reference position calculation part 20 Change amount calculation part 21 Display Content setting unit 22 Display unit 31 Microphone 32 Speaker 33 Display unit 34 Operation unit 35 Power unit 36 Wireless unit 37 Short-range communication unit 38 Auxiliary storage device 39 Main storage device 40 CPU
41 Drive device 42 Recording medium 50 Screen 51 Finger 52 Reference mark 53 Direction mark 54 Zoom rate 55 Zoom mark

Claims (1)

Receiving a first input relating to a first operation on the display content displayed on the display unit;
Receiving a second input related to a second operation on the display content;
When the second input received after the first input is a drag operation, a reference position related to at least one of the first input and the second input, and a current position of the drag operation, A display program for causing a computer to execute a process of changing the display magnification based on the distance and the moving direction of the drag operation and changing the display content in accordance with the changed display magnification.

Images