JP4810607B2 - GUI control method and apparatus, and computer program - Google Patents

Description

  The present invention relates to a GUI control method and apparatus for controlling an operator and a pointer in a GUI (Graphical User Interface) that enables an operator displayed on the screen to be operated by a pointer that moves in accordance with the movement of the pointing device, and a computer The present invention relates to a technical field of a computer program that functions as a device for realizing such a GUI control method.

  In recent years, there are many softwares having a GUI. When operating an object on the screen using a pointing device such as a mouse in the GUI, the user usually operates the object by moving the pointer on the screen along the direction in which the object is to be moved. To do. For example, when operating an object simulating a rotary operator such as a rotary rotary volume control for adjusting the volume (hereinafter, also simply referred to as “rotary operator”), the user moves the pointer along the rotation direction. Operate the rotary operator by moving it. When operating the rotary operator with such a pointing device, it is practically difficult for the user to move the pointing device with high accuracy along the direction of rotation, so the pointer may come off the rotary operator, Is deviated from the trajectory to be moved. As a result, the operability for the user to operate the rotary operator is degraded.

  Therefore, for example, in order to improve the operability for the user, a method of rotating a rotary operator on the screen in accordance with a linear movement of the mouse (for example, a vertical movement) may be used. According to this method, for example, when the user moves the mouse back and forth while pressing the left button of the mouse on the rotary operator, the mouse pointer moves up and down according to the movement of the mouse, and the rotation operation is performed. The child rotates according to the movement of the mouse, independently of the movement of the mouse pointer.

  On the other hand, a DJ (Disc Jockey) device used for continuous playback while adding various special effects (effects) to music data or video data at a ballroom such as a club or disco is displayed on a computer. There is software (hereinafter referred to as “DJ software”) that reproduces and functions on a screen. In such DJ software, for example, various rotary operators such as a jog control simulating a turntable and a rotary volume control are displayed on the screen, and some rotary operators can be operated with a mouse ( For example, refer nonpatent literature 1).

DTM Magazine Web page, News February 26, 2002, Terashima Information Planning Co., Ltd., URL: http://www.dtmm.co.jp/dtmmnews/200212/news200212261.shtml

  When the method of rotating the rotary operation element according to the linear movement of the mouse as described above is used, for example, when the number of rotations by which the user rotates the rotary operation element increases, the mouse is moved in a certain direction such as upward. There is a technical problem that the operability is low in practical use because the moving distance to be moved becomes longer, and it is necessary to lift the mouse, stop the rotation once, and return the mouse to the original position. . Further, in the above-described DJ software, it is desirable that these rotary operation elements can be operated quickly because of the characteristic of the DJ. For this reason, as described above, although an attempt has been made to make the rotary operator operable with a mouse, there are cases where the actual turntable has to be used as a control device because of its low operability.

  The present invention has been made in view of, for example, the above-described problems, and is displayed on the screen in a GUI that allows the operation element displayed on the screen to be operated by a pointer that moves in accordance with the movement of the pointing device. It is an object of the present invention to provide a GUI control method and apparatus and a computer program that enable an operator to be easily operated using a pointing device.

(GUI control method)
For GUI control method of the present invention is to solve the above problems, GUI control method for controlling the rotary operation in the GUI that enables operation in accordance with the rotary operation device that is displayed on the screen to the user operation of the pointing device When the rotary operator rotates at a speed equal to or higher than a reference speed, the rotary operator controls the rotation so as to continue the rotation according to the movement of the user operation. An operation continuation process is provided.

  According to the GUI control method of the present invention, using a pointing device such as a mouse or a touch panel, an operation element such as a jog controller (or jog dial) or volume control displayed on the screen can be operated. In the GUI, the control and the pointer are controlled.

  In the present invention, in particular, the pointer is controlled by the pointer control step so that the deviation from the predetermined locus determined in accordance with the operation of the operation element is limited.

  The “operation of the operation element” means a movement that can be performed by the operation element, such as a linear operation or a rotation operation. More specifically, for example, the operation of the jog controller as an operation element configured to be rotatable is a rotation operation, and the operation of the slide fader as an operation element configured to be linearly movable is a linear operation. It is.

  The predetermined trajectory is determined in advance or at the start of the operation according to the operation of the operation element, and the operation of the operation element becomes possible when the pointer moves on the predetermined trajectory. In other words, the predetermined trajectory is determined in advance or at the start of the operation as a trajectory to which the pointer should move in order to operate the operator. For example, when the operator is a jog controller, the predetermined trajectory is determined in advance or at the start of the operation as a trajectory that draws a circle having a center that coincides with the center of the rotation operation corresponding to the rotation operation of the jog controller. . Alternatively, for example, in the case where the operation element is a tempo slider that performs a linear motion, the predetermined trajectory is determined in advance or as a trajectory that draws a straight line along the straight line corresponding to the linear motion of the tempo slider. The predetermined trajectory may be determined in advance as a plurality of different predetermined trajectories or at the start of the operation, and the plurality of predetermined trajectories may be switched over time or upon request from the user.

  The pointer is controlled by the control process so that the deviation from the predetermined locus is limited. For example, when the operation element is a rotary operation element having a circular shape such as a jog controller, the pointer is controlled so that the deviation from the outer periphery of the rotation operation element as the predetermined locus is reduced, or the predetermined locus It is controlled so that it can move only within the range inside the outer periphery of the rotary operator. Typically, the pointer is restrained or fixed on the outer periphery by the control process. Therefore, it is possible to avoid a situation in which it is difficult for the pointer to deviate from the predetermined trajectory and it is difficult to operate the operation element with the pointer. Therefore, the user can easily operate the operator displayed on the screen as intended using the pointing device. That is, the operability by the pointing device of the operator can be improved.

In one aspect of the GUI control method of the present invention, the rotary operator can be operated by a pointer that moves in response to a user operation of the pointing device, and the rotary operator and the pointer are controlled .

In another aspect of the GUI control method of the present invention, the pointer control process further controls the pointer so that a deviation from a predetermined trajectory determined corresponding to the operation of the rotary operator is limited, The predetermined locus is a locus surrounding the center of the rotation operation.

In another aspect of the GUI control method of the present invention, the pointer control step further includes a pointer position determination step for determining whether or not the pointer is positioned on the rotary operation element, and the pointer control step is performed by the pointer position determination step. If it is determined that the pointer is positioned on the rotary operation element, the pointer is controlled.

  According to this aspect, for example, the user can switch from the non-operation mode in which the operation element is not operated to the operation mode in which the operation element is operated without performing any operation other than the movement of the pointing device such as click.

  Note that the switching from the operation mode to the operation mode may be performed, for example, by determining that an operation other than the movement of the pointing device has been performed, or, for example, a predetermined movement operation of the pointing device has been performed. This may be done by determining this.

  In another aspect of the GUI control method of the present invention, the pointer control step performs control so that the pointer is fixed to the predetermined locus.

  According to this aspect, since the locus drawn by the pointer matches the predetermined locus, the user can more easily operate the operation element.

  In another aspect of the GUI control method of the present invention, the pointer control step includes a speed adjustment step of adjusting a moving speed at which the pointer moves.

  According to this aspect, for example, the movement speed when the pointer moves from the operation start position of the operation element to the predetermined locus is adjusted by the speed adjustment step. That is, by the speed adjustment process, for example, the moving speed at which the pointer moves is adjusted so as not to exceed a predetermined value. Therefore, the user can feel the movement of the pointer as a natural movement.

(GUI control device)
For the GUI control device of the present invention to solve the above problems, a GUI control unit for controlling the rotary operation in the GUI that enables operation in accordance with the rotary operation device that is displayed on the screen to the user operation Rotation operation continuation means for controlling the rotation operator so as to continue the rotation operation according to the movement of the user operation when the rotation operator is rotating at a speed equal to or higher than a reference speed. Is provided.

  According to the GUI control device of the present invention, it is possible to receive the same benefits as the benefits of the above-described GUI control method of the present invention.

  Note that the GUI control apparatus of the present invention can also adopt various aspects similar to the various aspects of the GUI control method of the present invention described above.

(Computer program)
For the computer program of the present invention is to solve the above problems, the GUI control unit for controlling the rotary operation in the GUI that enables operation in accordance with the rotary operation device displayed on the screen to the movement of the user operation, A computer program for causing a computer to function, and when the rotary operator is rotating at a speed equal to or higher than a reference speed, the rotary operator continues the rotating operation according to the movement of the user operation. Thus, it functions as a rotation operation continuation means to be controlled.

  According to the computer program of the present invention, it is possible to receive the same benefits as those received by the above-described GUI control method and apparatus of the present invention.

  According to the computer program of the present invention, the computer program is read from a recording medium such as a ROM, a CD-ROM, a DVD-ROM, a hard disk or the like for storing the computer program, and executed. Alternatively, the computer program Can be executed after being downloaded to a computer via communication means, the GUI method of the present invention described above can be realized relatively easily.

  It should be noted that the computer program of the present invention can also adopt various aspects similar to the various aspects of the GUI control method and apparatus of the present invention described above.

  These effects and other advantages of the present invention will become more apparent from the embodiments described below.

  As described above, the GUI control method of the present invention includes a control process. The GUI control method of the present invention includes control means. Therefore, the user can easily operate the operator displayed on the screen as intended.

It is a block diagram which shows notionally the structure of the information processing apparatus which concerns on a present Example. It is a flowchart which shows notionally the flow of the mouse down event process of the information processing apparatus which concerns on a present Example. It is a flowchart which shows notionally the flow of the mouse | mouth drag event process of the information processing apparatus which concerns on a present Example. It is a flowchart which shows notionally the flow of the mouse-up event process of the information processing apparatus which concerns on a present Example. FIG. 4 is a diagram (part 1) illustrating a positional relationship between a jog control and a pointer in each process illustrated in FIGS. 2 and 3; FIG. 4 is a diagram (part 2) illustrating a positional relationship between a jog control and a pointer in each process illustrated in FIGS. 2 and 3; FIG. 4 is a diagram (No. 3) illustrating a positional relationship between a jog control and a pointer in each process illustrated in FIGS. 2 and 3; FIG. 4 is a diagram (No. 4) illustrating a positional relationship between a jog control and a pointer in each process illustrated in FIGS. 2 and 3; FIG. 10 is a diagram (No. 5) illustrating a positional relationship between a jog control and a pointer in each process illustrated in FIGS. 2 and 3; FIG. 6 is a diagram (No. 6) illustrating a positional relationship between a jog control and a pointer in each process illustrated in FIGS. 2 and 3;

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information processing apparatus 100 Computer main body 110 Pointer control part 111 Speed adjustment part 120 Pointer position determination part 130 Drag operation detection part 140 Rotation operation continuation part 200 Display 300 Mouse 310 Pointer 410 Jog control

  Hereinafter, the best mode for carrying out the present invention will be described for each embodiment in order with reference to the drawings.

  In the following embodiments, the GUI control apparatus of the present invention is applied to an information processing apparatus in which DJ software having a GUI capable of operating an operator on a screen using a pointing device is incorporated. It is an example.

(Basic configuration)
First, the configuration of an information processing apparatus to which the GUI control apparatus according to this embodiment is applied will be described with reference to FIG. FIG. 1 is a block diagram conceptually showing the structure of the information processing apparatus in the example.

  1, the information processing apparatus 1 according to the present embodiment includes a computer main body 100, a display 200, and a mouse 300 as an example of a “pointing device” according to the present invention.

  The computer main body 100 includes a central processing unit (CPU), a memory, a hard disk device, and the like.

  The display 200 is composed of a liquid crystal display device, for example, and displays output information from the computer main body 100.

  The mouse 300 is a well-known mouse device, and can control the movement of the pointer 310 displayed on the screen 210 of the display 200. The movement of the pointer 310 is basically controlled based on the movement amount of the mouse 300 notified from the mouse 300 every predetermined time. The mouse 300 includes two buttons on the left and right, and when one of the buttons is pressed by the user, the mouse 300 notifies the computer main body 100 that the button has been pressed. When released, the mouse 300 notifies the computer main body 100 of the release. Instead of the mouse 300, other pointing devices such as a trackball, a joystick, and a touch panel may be used.

  DJ software having a GUI is incorporated in the computer main body 100, and a jog control 410, operation buttons 420, a tempo slider 430, and a display unit 50 are displayed on the screen 210 of the display 200. The jog control 410, the operation button 420, and the tempo slider 430 can be operated by moving the pointer 310 according to the movement of the mouse 300, respectively.

  The jog control 410 is an example of the “operator” according to the present invention, and is a disk-shaped operation key that can rotate in both directions (ie, clockwise and counterclockwise) around the fixed point 411. It is. The user presses the button of the mouse 300 while the pointer 310 is on the jog control 410, and the mouse 300 is pressed in the pressed state so that the locus of the pointer 310 surrounds the fixed point 411 (for example, the fixed point 411). The jog control 410 can be rotated by moving (that is, by performing a drag operation). When the user operates the jog control 410 while appropriately changing the rotation direction and rotation speed, the jog control 410 is recorded on an optical disk such as a CD or DVD loaded on the hard disk device of the computer main body 100 or an external player according to the rotation direction. Forward playback and reverse playback of content data can be set, and in addition, according to the rotation speed, the tone or the like of music played by a speaker or headphones (not shown) connected to the computer main body 100 is changed. Can be done. On the jog control 410, a mark 412 for enabling visual recognition that the jog control 410 is rotating is displayed.

  Note that the above-described forward reproduction refers to reproduction of content data in the order in which it is recorded, as in the case of reproducing music or the like by rotating an analog record such as LP in the forward direction. Therefore, music or the like is reproduced as a normal sound in response to the jog control 410 being rotated clockwise. On the other hand, the above-described reverse reproduction means that the content data is reproduced in the reverse order of the recorded order, as in the case where music or the like is reproduced by rotating the analog record in the reverse direction. In other words, music etc. are recorded continuously in analog records (analog recording), so if the analog record is rotated in the reverse direction, the music will be played in the reverse direction, which is different from the original music etc. However, if the jog control 410 is rotated counterclockwise, the individual digitally recorded content data is played in the reverse order, so that the analog record is reversed. The same pseudo-sound as in the case of reproducing by rotating in the direction is generated.

  By providing the same function as reverse playback of analog records in this way, for example, when the user repeats reciprocating rotation of the jog control 410 in the clockwise direction and the counterclockwise direction, it is called a so-called scratch sound. Onomatopoeia (onomatopoeia such as “Cucu” and “Gashagasha”) can be generated. When a player called a so-called disc jockey operates the jog control 410 to generate the above-described scratch sound or the like, editing for generating rap music or the like can be performed using a CD or DVD. Yes.

  The operation button 420 is a button that can be selected by the user, and is configured so that the user can change the operation of the information processing apparatus 1 by moving the pointer 310 on the operation button 420 and clicking. Specifically, the user can instruct to play, fast forward, rewind, pause, start playback from a predetermined cue point, or the like by clicking the operation button 420.

  The tempo slider 430 includes a slider button that can slide in the vertical direction, for example. When the user or the like moves the slider button up and down, the playback speed of the content data can be changed as appropriate. For example, by moving the slider button upward, the content data playback speed is relatively slow, or by moving the slider button downward, the content data playback speed is relatively fast. can do.

  The display unit 50 displays various types of information according to the reproduction of content data including music. For example, in the upper part of the display unit 50, the track number of the currently reproduced content data, the elapsed time of the currently reproduced content data (that is, the current reproduction time), and the current information processing apparatus 1 are loaded. The total number of tracks of content data recorded on the optical disc is displayed. In the lower part of the display unit 50, the beat density and the like of the content data along the playback time axis are wave-displayed.

  In FIG. 1, the computer main body 100 includes a pointer control unit 110, a pointer position determination unit 120, a drag operation detection unit 130, and a rotation operation continuation unit 140.

  The pointer control unit 110 is configured to be able to control the pointer 310 so that the deviation from the outer periphery of the jog control 410 becomes small. As will be described in detail later, the pointer control unit 110 moves the pointer 310 on the outer periphery of the jog control 410 when the pointer 310 is deviated from the outer periphery in the control mode in which the pointer control unit 110 should control the pointer 310. Move to.

  Further, the pointer control unit 110 has a speed adjustment unit 111. The speed adjusting unit 111 is configured to be able to adjust the moving speed when the pointer 310 is moved on the outer periphery of the jog control 410.

  The pointer position determination unit 120 is configured to be able to determine whether or not the pointer 310 is positioned on the jog control 410 (or within the jog control, that is, any portion inside the outer periphery of the jog control 410). .

  The drag operation detection unit 130 is configured to be able to detect a drag operation of the mouse 300.

  The rotation operation continuation unit 140 can control the jog control 410 to continue the rotation operation according to the movement of the mouse 300 when the jog control 410 is rotating at a speed higher than the reference speed. It is configured to be possible.

(Description of operation)
Next, the operation of the information processing apparatus according to this embodiment configured as described above will be described with reference to FIGS. 2 to 10 in addition to FIG. In the following, the operation of the information processing apparatus 1 when the user rotates the jog control 410 by moving the mouse 300 will be mainly described. FIGS. 2 to 4 are flowcharts conceptually showing the flow of processing performed by the information processing apparatus according to the present embodiment when the jog controller is operated by the user. FIG. 2 shows mouse down event processing. 3 shows mouse drag event processing, and FIG. 4 shows mouse up event processing. 5 to 10 are diagrams showing the positional relationship between the jog control and the pointer in each process shown in FIGS.

  As described above with reference to FIG. 1, the user presses the button of the mouse 300 on the jog control 410 and drags the mouse 300 in the pressed state so that the locus of the pointer 310 surrounds the fixed point 411. By operating, the jog control 410 can be rotated.

  FIG. 2 shows the flow of the operation of the information processing apparatus 1 (hereinafter referred to as “mouse down event processing”) when the button of the mouse 300 is pressed by the user.

  FIG. 3 shows the flow of the operation of the information processing apparatus 1 (hereinafter referred to as “mouse drag event processing”) when the button of the mouse 300 is pressed by the user and the mouse 300 is moved in the pressed state. ing.

  FIG. 4 shows the flow of the operation of the information processing apparatus 1 (hereinafter also referred to as “mouse up event processing”) when the user releases the button of the mouse 300 from the pressed state.

  When the user operates the jog control 410 with the mouse 300, the computer main body 100 repeatedly performs a mouse down event process, a mouse drag event process, and a mouse up event process.

  First, mouse down event processing will be described with reference to FIGS. 5 to 8 in addition to FIG.

  In FIG. 2, when the button of the mouse 300 is pressed by the user, a notification that the mouse 300 is pressed (that is, a mouse down event) is output to the computer main body 100, and the mouse down event process is started.

  In the mouse down event process, first, the pointer position determination unit 120 determines whether or not the pointer 310 is positioned in the jog control 410 (step S101). That is, in FIG. 5, it is determined whether or not the reference point P indicating the position of the pointer 310 is located within the outer circumference circle C showing the outer circumference of the jog control 410. The coordinates of the reference point P are (Xp, Yp). The outer circumference circle C is an example of the “predetermined locus” according to the present invention.

  If it is determined that the pointer 310 is not located within the jog control 410 (step S101: NO), the mouse down event process ends. That is, when the pointer 310 is not located in the jog control 410, it is determined that the user does not intend to operate the jog control 410, and the subsequent processing is not performed.

  On the other hand, when it is determined that the pointer 310 is in the jog control 410 (step S101: YES), the pointer control unit 110 is set to the control state, that is, set to the control mode (step S102). More specifically, a flag indicating that the pointer control unit 110 is in a control state in which the pointer 310 is to be controlled is set. That is, when the pointer 310 is in the jog control 410, it is determined that the user has an intention to operate the jog control 410, and the subsequent processing is performed.

  Subsequently, the angle θ of the position of the pointer 310 viewed from the center of the jog control 410 is calculated by the pointer control unit 110 (step S103). More specifically, as shown in FIG. 6, the angle θ with respect to the reference axis A of the line segment connecting the fixed point 411 which is the center of the jog control 410 and the reference point P indicating the position of the pointer 310 is calculated.

  Subsequently, as shown in FIG. 2 and FIG. 7, an intersection point Q 1 where a straight line L 1 passing through the fixed point 411 that is the center of the jog control 410 and the reference point P of the pointer 310 intersects with the outer circumference circle C of the jog control 410. The coordinates (Xq1, Yq1) are calculated by the pointer controller 110 (step S104).

  Subsequently, as shown in FIGS. 2 and 8, the pointer 310 is moved to the intersection Q1 by the pointer controller 110 (step S105). In other words, the pointer control unit 110 matches the coordinates (Xp, Yp) of the reference point P of the pointer 310 with the coordinates (Xq1, Yq1) of the intersection Q1.

  As described above, in the mouse down event process, when the pointer 310 is in the jog control 410, the pointer control unit 110 moves the pointer 310 to a point on the outer periphery of the jog control 410 (in the above example, in FIG. Move to intersection Q1).

  Next, mouse drag event processing will be described with reference to FIG. 9 in addition to FIG.

  In FIG. 3, when the user performs a drag operation of the mouse 300 (that is, the mouse 300 is moved while the button of the mouse 300 is pressed), a notification that the drag operation has been performed from the mouse 300 (that is, a mouse drag event). Is output to the computer main body 100, and mouse drag event processing is started. That is, when the user presses the button of the mouse 300 and the mouse 300 is moved in the pressed state, the mouse drag event process is performed following the mouse down event process. The mouse drag event process is performed until the button pressed by the user of the mouse 300 is released (that is, during the period during which the drag operation is continued), and the pressed button is released (that is, the drag operation is performed). When finished, a mouse up event process described later is performed. While the drag operation of the mouse 300 is continued by the user, a mouse drag event is output from the mouse 300 to the computer main body 100 every predetermined time ΔT, and the mouse drag process is performed a plurality of times in response to the mouse drag event. Is called.

  In the mouse drag process, it is first determined whether or not the control mode is set (step S201). That is, the pointer control unit 110 determines whether or not a flag indicating that the pointer control unit 110 is in an operating state is set. In other words, it is determined whether or not the control mode is set by the mouse down event process. If it is determined that the control mode is not set (step S201: NO), the mouse drag event process ends.

  On the other hand, when it is determined that the control mode is selected (step S201: YES), the angle θ of the position of the pointer 310 viewed from the center of the jog control 410 is set to the pointer control unit 110 as in step S103 in FIG. (Step S203).

  Subsequently, the pointer control unit 310 calculates the rotation amount and rotation speed of the jog control 410 from the previous angle of the position of the pointer 310 and the current position of the pointer 310 (step S203). That is, as shown in FIG. 9, the pointer 310 is moved from a point P1 (position when there was a previous mouse drag event) to a point P2 (position when there was a current mouse drag event, that is, by a drag operation of the mouse 300, that is, When moving to the current position), the angle θ1 with respect to the reference axis A of the line segment connecting the fixed point 411 and the point P1 and the angle θ2 with respect to the reference axis A of the line segment connecting the fixed point 411 and the point P2 are Each is calculated. The rotation amount and rotation speed of the jog control 410 are calculated from the angles θ1 and θ2 and a predetermined time ΔT between mouse drag events. Then, the jog control 410 rotates at the calculated rotation speed by the calculated rotation amount.

  Subsequently, as shown in FIGS. 3 and 9, the coordinates (Xq2, Yq2) of the intersection point Q2 where the straight line L2 passing through the fixed point 411 and the point P12 which is the current position and the outer circumference circle C of the jog control 410 intersect. Is calculated by the pointer controller 110 (step S204).

  Subsequently, the pointer controller 110 moves the pointer 310 to the intersection point Q2 (step S205). That is, the pointer controller 110 matches the coordinates (Xp, Yp) of the reference point P of the pointer 310 with the coordinates (Xq2, Yq2) of the intersection Q2.

  As described above, in the mouse drag event process, regardless of whether or not the pointer 310 is in the jog control 410, the pointer control unit 110 moves the pointer 310 to a point on the outer periphery of the jog control 410 (in the above example, 9 is moved to the intersection Q2).

  That is, in the control mode, the mouse drag event is performed every predetermined time ΔT even if the pointer 310 deviates from the outer circumference circle C of the jog control 410 during the period in which the drag operation of the mouse 300 is continued by the user. By the processing, the jog control 410 is moved to a point on the outer circumference circle C.

  That is, as shown in FIG. 10, in the present embodiment, particularly during the period in which the drag operation of the mouse 300 is continued by the user, even if the pointer 310 deviates from the outer circumference circle C, every predetermined time ΔT, It is moved to points Q1, Q2, Q3, Q4. In other words, while the user operates the jog control 410 with the mouse 300, the pointer 310 is restrained on the outer circumference circle C of the jog control 410.

  Here, if no measures are taken, for example, a locus where the pointer 310 surrounds the fixed point 411 that is the center of the jog control 410 (ideally, a circular locus centered on the fixed point 411). In practice, it is difficult for the user to move the mouse 300 continuously. For example, if the user does not rotate the mouse 300 accurately so that the pointer 310 surrounds the fixed point 411 that is the center of the jog control 410, the jog control 410 rotates in the direction opposite to the rotation direction intended by the user. There is a risk of operation. For this reason, it becomes difficult for the user to operate the jog control 410 with the mouse 300 without stress.

  However, particularly in the present embodiment, as described above, the pointer 310 is constrained on the outer circumference circle C of the jog control 410 by the pointer control unit 110 while the user operates the jog control 410 with the mouse 300. . Therefore, it is possible to avoid a situation in which it is difficult to operate the jog control 410 with the pointer 310 because the pointer 310 is displaced from the outer circumference circle C. That is, since the pointer 310 is restrained on the outer circumference circle C, the user can easily move the jog control 410 as long as the user moves the mouse 300 in the tangential direction of the outer circumference circle C to be moved from the point where the pointer 310 is currently located. Can be rotated as intended. That is, the user can easily operate the jog control 410 as intended using the mouse 300.

  Further, particularly in the present embodiment, the pointer 310 is restrained on the outer circumference circle C of the jog control 410 as described above. Therefore, the user can move the pointer 310 substantially along the outer circumference circle C that is relatively far from the fixed point 411 that is the center of the jog control 410, and the pointer 310 is located on the inner circumference side of the outer circumference circle C. Compared to a case where the movement is detected on a circle, for example, the number of notifications of a movement detection event such as a mouse move event can be increased. Therefore, it is possible to increase the resolution of the rotation operation of the jog control 410. However, the pointer 310 may be constrained on a circle centered on the fixed point 411 on the inner peripheral side of the outer peripheral circle C. Also in this case, the operability of the jog control 410 for the user can be improved.

  In addition, since the pointer 310 is constrained on the outer circumference circle C in the present embodiment, the distance between the fixed point 411 that is the center of the outer circumference circle C and the pointer 310 is almost always the radius of the outer circumference circle C. Can be the same as each other. Therefore, for example, the number of notifications of a movement detection event such as a mouse move event can be made almost constant, and the occurrence of variations in the calculation processing of the rotation speed of the jog control 410 and the calculation processing of the position of the pointer 310 can be reduced or eliminated. Can do.

  Furthermore, in particular, in this embodiment, the pointer 310 is restrained on the outer circumference circle C of the jog control 410, so that the user's operational feeling can be enhanced. That is, it is possible to give the user a sensation similar to that of rotating the actual turntable while touching the outer peripheral surface of the actual turntable.

  In this embodiment, the pointer 310 is constrained on the outer circumference circle C of the jog control 410. However, the pointer 310 may be constrained on a curve or polygon surrounding the fixed point 411 of the jog control 410. Further, the locus on which the pointer 310 is restrained may be outside the outer circumference circle C, that is, outside the jog control 410. In addition, the trajectory to which the pointer 310 is constrained does not always have to be the same. For example, even when a plurality of different trajectories are switched, such as switching between a hexagonal trajectory and a thirty dodecagonal trajectory. Good. In addition, in this embodiment, the pointer 310 is controlled to move on the outer circle C for each mouse drag event in the control mode. However, the distance between the outer circle C and the pointer 310 is larger than a predetermined value. Only in this case, the pointer 310 may be controlled to move on the outer circumference circle C. That is, the degree to which the pointer 310 is constrained on the outer circumference circle C may be relaxed, and the user may be able to move the pointer 310 in the radial direction of the outer circumference circle C within a predetermined range. Alternatively, the pointer 310 may be limited so that it can only move within the range inside the outer circumference circle C. In any case, the operability of the jog control 410 with the mouse 300 can be enhanced.

  Furthermore, in the present embodiment, the trajectory to which the pointer 310 is restrained is configured to be determined in advance as the outer circle C, but may be configured to be determined, for example, when there is a mouse down event. In other words, the trajectory in which the pointer 310 is restrained may be defined as a circumference centered on the fixed point 411 with the distance between the position of the pointer 310 and the fixed point 411 when the mouse down event occurs as a radius. That is, the trajectory in which the pointer 310 is restrained is determined as a circle having a relatively small radius when a mouse down event occurs when the pointer 310 is relatively close to the fixed point 411. When there is a mouse down event at a position relatively far from 411, the circumference may be determined as a relatively large radius. In this case, the user can determine or change the locus on which the pointer 310 is restrained as intended. Therefore, the operability with the mouse 300 of the jog control 410 can be further enhanced.

  In addition, particularly in this embodiment, when the pointer 310 is moved to a point on the outer circumference circle C (ie, step 105 described above with reference to FIG. 2 and step S205 described above with reference to FIG. 3), the speed adjustment is performed. The moving speed of the pointer 310 is adjusted by the unit 111 so as not to exceed a predetermined value. Therefore, it is possible to prevent the pointer 310 from jumping from a point other than the outer circumference circle C to a point on the outer circumference circle C on display. Therefore, the user can feel the movement of the pointer 310 as a natural movement.

  Further, particularly in this embodiment, when the jog control 410 is rotating at a speed equal to or higher than the reference speed, the jog control 410 continues the rotation operation so as to continue the rotation operation according to the movement of the mouse 300. Controlled by the unit 140. That is, for example, even if the movement of the mouse 300 is a linear movement in the vertical direction or the horizontal direction, the jog control 410 is controlled by the rotation operation continuation unit 140 so that the rotation operation of the jog control 410 is continued. The Therefore, the user can maintain the rotation by moving the mouse 300 linearly, for example. Therefore, the operability with the mouse 300 of the jog control 410 can be further enhanced.

  Next, referring to FIG. 4 again, the mouse drag event process will be described.

  In FIG. 4, when the user releases the button of the mouse 300 from the pressed state (for example, when the drag operation ends), a notification that the button of the mouse 300 is released from the pressed state (that is, the mouse Up event) is output to the computer main body 100, and mouse up event processing is started.

  In the mouse up event process, the control mode is cleared (step S301). More specifically, a flag indicating that the pointer control unit 110 is in a control state in which the pointer 310 should be controlled is lowered. That is, when the user does not press the button of the mouse 300, the control of the pointer 310 by the pointer control unit 110 ends.

  Thus, since the control of the pointer 310 by the pointer control unit 110 ends when the user does not press the button of the mouse 300, the pointer 310 is moved by the pointer control unit 110 which is not intended by the user. Can be almost eliminated. Therefore, the operability with the mouse 300 of the jog control 410 can be further enhanced.

  In the present embodiment, the rotary operation element such as the jog control 410 is described as an example of the “operator” according to the present invention. However, the GUI control method according to the present invention is illustrated in FIG. The present invention may be applied to an operator that operates linearly, such as the tempo slider 430 described above with reference to FIG. That is, for example, when operating the tempo slider 430, the pointer 310 may be constrained to a locus in which the slider button of the tempo slider 430 can be linearly operated. In this case, the operability of the tempo slider 430 with the mouse 300 can be improved.

  As described above, according to the present embodiment, the pointer 310 is constrained on the outer circumference circle C of the jog control 410 by the pointer control unit 110, so that the user uses the mouse 300 to move the jog control 410. It becomes possible to operate easily as intended. Therefore, in DJ software, it is practically possible to perform DJ operations such as the above-described operation that generates a scratch sound using a relatively simple device such as a mouse, and an actual turntable or the like is used as a control device. You don't have to. Furthermore, the mouse is smaller than the turntable and has an advantage that it can be used even in a relatively small place.

  The present invention is not limited to the above-described embodiments, and can be changed as appropriate without departing from the spirit or concept of the invention that can be read from the claims and the entire specification. An apparatus and a computer program are also included in the technical scope of the present invention.

  The GUI control method and apparatus, and the computer program of the present invention can be used for a GUI that allows an operator displayed on the screen to be operated by a pointer that moves in accordance with the movement of the pointing device. Further, for example, the present invention can also be used for a GUI control device that is mounted on or can be connected to various computer equipment for consumer use or business use.

Claims (8)

A GUI control method for controlling the rotary operation in the GUI that enables operation in accordance with the rotary operation device that is displayed on the screen to the user operation of the pointing device,
A rotation operation continuation step for controlling the rotation operator so as to continue the rotation operation according to the movement of the user operation when the rotation operator is rotating at a speed equal to or higher than a reference speed; GUI control method, characterized in that it comprises.   2. The GUI control method according to claim 1, wherein the rotary operator can be operated by a pointer that moves in accordance with a user operation of the pointing device, and the rotary operator and the pointer are controlled.   A pointer control step for controlling the pointer so that deviation from a predetermined trajectory determined corresponding to the operation of the rotary operator is limited;
  The predetermined locus is a locus surrounding the center of the rotation operation.
  The GUI control method according to claim 2, wherein: A pointer position determination step for determining whether or not the pointer is positioned on the rotary operator;
The GUI control method according to claim 3 , wherein the pointer control step controls the pointer when the pointer position determination step determines that the pointer is positioned on the rotary operation element. The GUI control method according to claim 3 , wherein the pointer control step performs control so that the pointer is fixed to the predetermined locus. The GUI control method according to claim 3 , wherein the pointer control step includes a speed adjustment step of adjusting a moving speed at which the pointer moves. A GUI control unit for controlling the rotary operation in the GUI that enables operation in accordance with the rotary operation device that is displayed on the screen to the user operation,
Rotation operation continuation means for controlling the rotation operator so as to continue the rotation operation according to the movement of the user operation when the rotation operator is rotating at a speed equal to or higher than a reference speed. GUI controller, characterized in that it comprises. The rotary operation device displayed on the screen as a GUI controller for controlling the rotary operation in the GUI that enables operation in accordance with the movement of the user's operation, a computer program for causing a computer to function,
When the rotary operator is rotating at a speed equal to or higher than a reference speed, the rotary operator is used as a rotary operation continuation unit that controls the rotary operator so as to continue the rotary operation according to the movement of the user operation. A computer program characterized by functioning .

Images