JP5217980B2 - Data processing apparatus and data processing system - Google Patents

Description

  The present invention relates to a data processing device, a data processing system, and the like.

  In recent years, a physical quantity signal corresponding to the movement of the main body (housing) in space (including at least one of the posture of the main body (including rotation and tilt) and the movement of the main body (including translational movement)) is generated and output. Therefore, there is an increasing need for a system using a pointing device (such as a three-dimensional mouse).

A technique using a device (a three-dimensional mouse) that moves a cursor pointer on an image display device by moving a portable device in a three-dimensional space and performs an operation with a button is disclosed in, for example, Patent Document 1 below. It is described in Patent Document 2.
JP-A-7-284166 JP2008-133505

  For example, in a menu selection system using a pointing device that detects a three-dimensional movement, for example, a user moves the pointing device in space, thereby causing a cursor pointer (hereinafter simply referred to as a cursor or a pointer) to be displayed as a menu. Move on the screen, and then operate the operation switch to select one option from a plurality of options.

  The operation switch is, for example, a push-type switch (including a protrusion and a plane, which is turned on by pressure and turned off by releasing the pressure, including a switch on the side). When the operation switch is operated, pressure from the finger is applied to the switch, so that the main body (housing) may move slightly in the space, which may cause the cursor position to deviate from the desired option. .

  That is, the position of the cursor at the time when the operation switch is turned on (for example, in the case of a push-type switch, the time when the contact is turned on when the switch is pressed) and the time when the operation of the operation switch is completed (for example, the switch is released There may be a deviation from the cursor position at the time of turning off), and the wrong choice (wrong menu) may be selected due to the deviation. When such a situation occurs, the pointing device becomes unusable and the reliability of the menu selection system also decreases.

  In particular, if the processing of the event corresponding to the option selected by the cursor is a processing that has serious consequences such as, for example, all erasure of the hard disk or initialization of the recording medium, an erroneous processing is executed. Therefore, sufficient measures are required.

  To deal with this problem, for example, each menu screen option has a large area, a switch that requires less operating force is used, the operation buttons are arranged, and the functions of the operation buttons are devised. However, all of them have limitations and are not sufficient from the viewpoint of surely preventing erroneous selection.

  According to at least one aspect of the present invention, it is possible to reliably prevent erroneous selection due to, for example, a blurring of a pointing device, and for example, a data processing system (for example, 3 Dimensional input devices (pointing devices) as well as data processing devices) can be realized.

(1) According to one aspect of the data processing apparatus of the present invention, a physical quantity signal generated according to a movement of a pointing device in a space, a switch operation signal generated by an operation of an operation switch provided in the pointing device, Is transmitted from the pointing device to the data processing device, and the data processing device is selected from a plurality of options displayed on the display unit by data processing based on the received physical quantity signal and the switch operation signal. The data processing apparatus used in a data processing system that generates an event corresponding to one option and executes the generated event, detects a cursor position based on the physical quantity signal, and stores cursor position information. An output cursor position detection unit and an image having the plurality of options; A display control unit that displays a cursor on the image based on the cursor position information output from the cursor position detection unit, a switch operation signal detection unit that detects the switch operation signal, and the switch Corresponding to first selection information corresponding to a first time point when the operation signal detection unit detects turn-on of the operation switch, and corresponding to a second time point when the switch operation signal detection unit detects turn-off of the operation switch. The second selection information is compared, and it is detected whether or not the first selection result based on the first selection information is the same as the second selection result based on the second selection information. When the selection information comparison unit and the selection information comparison unit match the first selection result and the second selection result, an event corresponding to the selected option Generated as execution event, if it is mismatched, the event generation unit does not generate the execution event comprises an event execution unit for executing said execution event, after the disagreement has occurred, the display size of the alternatives To change.

  In the data processing system, one of the causes of erroneous selection of menus and the like is that unnecessary movement occurs in the body of the pointing device due to operation of the operation switch, and the cursor position is shifted. When the position of the cursor is shifted, the cursor position at the time when the turn-on of the operation switch is detected (first time) is different from the cursor position at the time when the turn-off of the operation switch is detected (second time). Even if a misalignment occurs, menu misselection does not occur when the cursor is on the same option, but menu misselection occurs when the cursor at each time point is on a different option. Probability is high.

  Therefore, in this aspect, a selection information comparison unit is provided, and the selection information comparison unit compares the first selection information obtained at the first time point with the second selection information obtained at the second time point, It is detected whether the first selection result based on the first selection information is the same as the second selection result based on the second selection information.

  Here, “selection information” means “basic information related to selection processing that can be used to predict (or specify) a selection result that will occur if an operation switch is operated at a certain point in time. As the selection information, for example, “cursor position information at a certain point in time” or “information of an event associated with an option specified by a cursor at a certain point in time” can be used. That is, for example, based on the “cursor position information”, it is possible to identify the option specified by the cursor at that time, and therefore the selection result at that time (that is, what event is executed as a result) Can be predicted (identified), and “cursor position information” can be used as selection information. Similarly, if “information on the event associated with the option specified by the cursor at a certain point in time” is determined, the selection result (the content of the event to be executed) at that point can be predicted (specified). "Event information" can also be used as selection information.

  The selection information comparison unit compares the first selection information obtained at the first time point with the second selection information obtained at the second time point, and the selection result predicted by each selection information (that is, execution) Detected event) is detected. That the selection results are the same means that the cursor at the time when the operation switch is turned on (first time point) and the cursor at the time when the operation is turned off (second time point) are on the same option. A different result means that each of the cursors at both time points is on a different option, which means that the cursor position has deviated greatly instantaneously. If event execution is permitted in this state, there is a high possibility that an incorrect option is selected by the cursor after the position is instantaneously changed.

  Therefore, the event generation unit generates an execution event (event to be executed) only when a match is detected by the selection information comparison unit, and does not generate an execution event when no match is detected. Since an execution event is not generated, an erroneous event is not executed by the event execution unit. As described above, according to this aspect, even when the cursor position is largely shifted instantaneously, erroneous selection of a menu or the like is reliably prevented. Therefore, for example, it is possible to use a data processing system (for example, a menu selection system) with confidence without erasing the hard disk accidentally. In addition, the configuration of this aspect does not require the addition of special hardware, does not increase the hardware cost, and is easy to implement.

  The above-described “operation switch” is, for example, a push button switch or a slide switch. These switches include both protruding switches and planar switches. The operation switch is a type of switch that is turned on by, for example, the pressure of the user's finger and turned off by releasing the pressure, and is provided on the main surface of the housing or on the side surface of the housing. Including. The above-mentioned “event” refers to information (sometimes referred to as a message) that is transmitted to the program when some action occurs during the execution of the computer program. For example, the program executes by the event. A power process (process content) is specified. An “execution event” is an event that is actually executed (or should be executed). More specifically, for example, an event (or a process thereof) having information specifying a process to be executed by a program. Content).

(2) In another aspect of the data processing apparatus of the present invention, the selection information includes a cursor position storage unit that stores the cursor position information over a period of time from at least the first time point to the second time point. The comparison unit reads the first cursor position information and the second cursor position information from the cursor position storage unit, and an option specified based on the first cursor position information, and the second cursor It is detected whether or not the option specified by the position information matches, thereby detecting the match or mismatch of the first selection result and the second selection result.

  In this aspect, the cursor position information output from the cursor position detector is used as the selection information. The cursor position storage unit stores cursor position information for a predetermined period (for example, 1 second). The cursor position storage unit can store the cursor position information at regular time intervals (for example, every 1/60 synchronized with the frame rate of the television screen), for example.

  In addition, the selection information comparison unit, for example, at the second time point (when the operation switch turn-off is detected), at each of the first time point (when the operation switch turn-on is detected) and the second time point. Corresponding first and second cursor position information is read from the cursor position storage unit, and comparison processing and match detection processing are executed. The reading timing of the cursor position information by the selection information comparison unit can be variously modified. For example, the selection information comparison unit can read the first cursor position information at the first time point and can read the second cursor position information at the second time point.

(3) In another aspect of the data processing apparatus of the present invention, an event corresponding to the option specified by the cursor is stored as a temporary event for at least a time period from the first time point to the second time point. An event storage unit, wherein the selection information comparison unit reads out the first temporary event at the first time point and the second temporary event at the second time point from the temporary event storage unit; It is detected whether or not the tentative event matches the second tentative event, thereby detecting a match or mismatch between the first selection result and the second selection result.

  In this aspect, “information of an event associated with an option specified by the cursor” is used as selection information. At a certain point in time, the event associated with the option specified by the cursor is an event that is formally specified before the selection is confirmed, and whether or not it is actually selected is unknown. Since it is necessary to distinguish from “actually executed event”, it is expressed as “temporary event” here.

  The temporary event storage unit stores temporary events for a predetermined period (for example, 1 second). For example, the temporary event storage unit can store a temporary event at regular intervals (for example, every 1/60 synchronized with the frame rate of the television screen).

  In addition, the selection information comparison unit, for example, at the second time point (when the operation switch turn-off is detected), at each of the first time point (when the operation switch turn-on is detected) and the second time point. Corresponding first and second temporary events are read from the temporary event storage unit, and comparison processing and match detection processing are executed. Various modifications can be made to the timing for reading the temporary event by the selection information comparison unit. For example, the selection information comparison unit can read the first temporary event at the first time point and can read the second temporary event at the second time point.

  (4) According to one aspect of the data processing system of the present invention, a physical quantity signal generated according to the movement of the main body in the space, and a switch operation signal generated by operating an operation switch provided in the main body, A pointing device that transmits the data to the data processing apparatus; and any one of the data processing apparatuses described above.

  Thereby, it is possible to realize a highly reliable data processing system (such as a menu selection system) that can surely prevent erroneous selection due to shaking of the pointing device.

  As described above, according to at least one aspect of the present invention, it is possible to reliably prevent, for example, erroneous selection due to shaking of the pointing device, for example, on a highly reliable menu selection system or on the screen. A data processing system (including a three-dimensional input device (pointing device) and a data processing device) such as a game system that needs to move the cursor can be realized. Further, according to at least one aspect of the present invention, an erroneous menu selection can be surely prevented without being easily implemented and causing an increase in hardware cost.

  Next, embodiments of the present invention will be described with reference to the drawings. Note that the present embodiment described below does not unduly limit the contents of the present invention described in the claims, and all the configurations described in the present embodiment are as means for solving the present invention. It is not always essential.

(First embodiment)
In this embodiment, the cursor position information output from the cursor position detection unit is used as the selection information, and the selection result when the operation switch is turned on and turned off is predicted (specified) by comparing the cursor position information. When a match / mismatch is detected and no match is detected, an execution event is not generated, thereby reliably preventing selection of an erroneous menu or the like.

  Here, “selection information” means “basic information related to selection processing that can be used to predict (or specify) a selection result that will occur if an operation switch is operated at a certain point in time. As the selection information, for example, “cursor position information at a certain point in time” or “information of an event associated with an option specified by a cursor at a certain point in time” can be used. That is, for example, based on the “cursor position information”, it is possible to identify the option specified by the cursor at that time, and therefore the selection result at that time (that is, what event is executed as a result) Can be predicted (identified), and “cursor position information” can be used as selection information.

(Example of data processing system configuration and operation)
FIG. 1 is a diagram illustrating an example of a configuration of a menu selection system which is an example of a data processing system. The menu selection system in FIG. 1 includes a three-dimensional pointing device 100 and a data processing device 200. The three-dimensional pointing device is an input device having a function of generating a physical quantity signal corresponding to a movement in space (for example, at least one of posture, rotation, and translation), and is, for example, a three-dimensional mouse. The “pointing device” is an input device in a computer system or the like, and is interpreted in the broadest sense (for example, interpreted as the same meaning as an input device). The data processing device 200 is, for example, a computer main body, and performs information processing (menu display processing, event execution, etc.) for realizing menu selection by the user in this embodiment.

  The three-dimensional pointing device 100 and the data processing apparatus 200 can transmit and receive information by communication (both wired communication and wireless communication can be used. For example, infrared light can be used as wireless communication). In the menu selection system of FIG. 1, the two can exchange information with each other by wireless communication via the antennas AN1 and AN2.

  The three-dimensional pointing device 100 can transmit a physical quantity signal corresponding to the movement of the main body (housing) in the space and a switch operation signal generated by operating the operation switch to the data processing apparatus 200.

  The three-dimensional pointing device 100 includes a three-dimensional motion sensor 110. The three-dimensional motion sensor 110 includes a first gyro sensor (angular velocity sensor) MS1 that detects an angular velocity about the x axis, a second gyro sensor MS2 that detects an angular velocity about the y axis, and an angular velocity about the z axis. A third gyro sensor MS3 for detection and a three-axis acceleration sensor (three-dimensional acceleration sensor) MS4 for detecting acceleration for each of the three axes (x axis, y axis, z axis) are provided.

  The three-dimensional pointing device 100 includes an operation switch (here, a push-type switch) SW operated by the user, A / D converters 112a to 112d, a control unit 114 on which the CPU 116 is mounted, a memory 119, and a power source 121. And a communication unit (communication interface) 118 and an antenna AN1.

  The three-dimensional motion sensor 110 detects angular velocity and acceleration, and outputs a physical quantity signal corresponding to the detected physical quantity. Each of the A / D converters 112a to 112c converts an angular velocity signal that is an analog signal output from each of the first gyro sensor MS1 to the third gyro sensor MS3 into a digital signal. The A / D converter 112d converts an acceleration signal that is an analog signal output from the triaxial acceleration sensor MS4 into a digital signal. The A / D converters 112a to 112d output physical quantity signals PQ1 to PQ4 (which may be collectively referred to as physical quantity signals PQ) that are digital signals, and the physical quantity signals PQ1 to PQ4 are control units. 114.

  The push-type switch SW is, for example, a push button switch, and includes both a projecting switch and a planar switch. For example, it is a type of switch that is turned on by the pressure of the user's finger or the like and turned off by releasing the pressure, and includes a switch provided on the main surface of the housing and a switch provided on the side surface of the housing. The “push-down switch” is an example of an operation switch, and is not limited to this. Another example of the operation switch is a slide type switch.

  When the user operates the operation switch (push-down switch SW), pressure is applied by a finger or the like, so that the main body (housing) may be moved slightly in the space under the influence, and this unnecessary movement. Depending on the menu, an incorrect selection may occur. Therefore, in the present embodiment, by devising a data processing method in the data processing apparatus 200, erroneous menu selection due to unnecessary movement of the three-dimensional pointing device 100 is surely prevented.

  The data processing device 200 generates an event corresponding to one option selected from a plurality of options displayed on the display unit by data processing based on the received physical quantity signal and the switch operation signal, and the generated event Execute. An “event” refers to information (sometimes called a message) transmitted to a program when an action occurs during execution of the computer program. For example, a process to be executed by the program according to the event. (Processing content) is specified. An “execution event” is an event that is actually executed. Specifically, for example, it is an event (or content of the process) having information for specifying a process to be executed by the program.

  The data processing device 200 includes a communication unit (communication interface) 210, a cursor position detection unit 212 that detects the position of the cursor CS1 (CS2) based on the received physical quantity signal, and outputs cursor position information, and a display panel 300. A display control unit 216 that displays a menu image having a plurality of options IN and displays a cursor on the menu image based on the cursor position information output from the cursor position detection unit 212 is included.

  Display control unit 216 includes a cursor display unit 217 and a menu display unit 219. In FIG. 1, on the display panel 300, a plurality of options IN (indicated as A to H and 1-4 in the figure) and a cursor CS1 (CS2) are displayed. When cursor display is required, the cursor display unit 217 obtains cursor position information from the cursor position detection unit 212 and displays the cursor CS1 (CS2) on the display panel 300.

  Each of the plurality of options IN (A to H, 1 to 4) is associated with each of the plurality of events 1: 1. For example, it is assumed that the currently displayed menu is a processing menu related to a storage medium (for example, CDROM) or a hard disk of a computer system. For example, the option E is “copy of information stored in storage medium (creation of duplicate)”. ”And option 1 is“ initialization of hard disk ”. In this case, the option E is associated with an event “storage medium copy process”, and the option 1 is associated with an event “hard disk initialization process”.

  The data processing device 200 further includes a switch operation signal detection unit 214 that detects the received switch operation signal, and a cursor position storage unit 220 that stores the cursor position information output from the cursor position detection unit 212 over a predetermined time. , A cursor position comparison unit 222 as a selection information comparison unit, a memory 226 that temporarily stores menu information MD, an event generation unit 224, and an event execution unit 228.

  The cursor position storage unit 220 temporarily stores the cursor position information CD output from the cursor position detection unit 212 at regular intervals (for example, every 1/60 synchronized with the frame rate of the television screen). The cursor position storage unit 220 can be constituted by, for example, a shift register, and can also be constituted by a ring buffer using a memory element. The cursor position storage unit 220 can store cursor position information (cursor position data) CD input every 1/60 seconds, for example, for 1 second. Thereby, each of the cursor position information in the immediately preceding 1 second is read from the cursor position storage unit 220 based on a certain time (for example, the time when the switch-on detection signal S1on is output from the switch operation signal detection unit 214). Is possible.

  When the push switch SW of the three-dimensional pointing device 100 changes from a first state (for example, an off state) to a second state (for example, an on state), the switch operation signal detection unit 214 detects that and first The switch-on detection signal S1on which is a switch operation signal is output. Further, when the push-down switch SW changes from the second state (on state) to the second state (off state), this is detected and a switch-off detection signal S1off that is a second switch operation signal is output. . The switch-on detection signal S1on and the switch-off detection signal S1off are supplied to the cursor position comparison unit (selection information comparison unit) 222 and the event generation unit 224, respectively.

  As described above, the cause of erroneous selection of the menu is that an unnecessary movement occurs in the main body of the three-dimensional pointing device 100 due to the operation of the push-down switch (operation switch) SW, and the cursor position is shifted. is there. When the cursor is displaced, the cursor position at the time when the turn-on of the push-down switch (operation switch) SW is detected (the first time: the time when the switch-on signal S1on is output) and the time when the turn-off is detected The cursor position is different at (second time point: time point when the switch-off signal S1off is output). Even if a misalignment occurs, menu misselection does not occur if the cursor is on the same option, but menu misselection may occur if each cursor is on a different option at each point in time. High nature.

  Therefore, the cursor position comparison unit 222 functioning as a selection information comparison unit compares the first cursor position information corresponding to the first time point with the second selection information corresponding to the second time point, and first It is detected whether the first selection result based on the selection information and the second selection result based on the second selection information are the same. For example, it is detected whether the options selected at each of the first time point and the second time point are the same, or whether the events associated with the selected options are the same.

  The same selection result (selected option or event) means that the cursor at the turn-on time (first time) of the push-down switch SW is the same as the cursor at the turn-off time (second time). On the other hand, when the selection results are different, each of the cursors at both time points is on a different option, which means that the cursor position is instantaneously greatly deviated. If event execution is permitted in this state, it is highly likely that the wrong option will be selected by the cursor after the position has changed instantaneously. To do.

  That is, the cursor position comparison unit 222 corresponds to the cursor position information (CDx or CDy) at the first time point or the second time point, or the option selected at each time point when the selection result matches is detected. The attached event (that is, the provisional event TEV) is sent to the event generation unit 224 as information for specifying the execution event. On the other hand, when the selection results do not match, information for specifying an execution event is not sent. In this case, a flag indicating that the event cannot be executed can be sent instead.

  The event generation unit 224 executes the execution event (execution only) when information for specifying an execution event is sent from the cursor position comparison unit 222, that is, only when a match is detected by the cursor position comparison unit 222. Event to be generated) When an EVT is generated and no match is detected, an execution event EVT is not generated. When the execution event EVT is not generated, the event is not executed by the event execution unit 228 (for example, an application program), so that an erroneous event is reliably prevented from being executed.

  Each unit described above can be configured by a hardware circuit, for example. However, the present invention is not limited to this, and each unit can be configured by, for example, a functional block realized by a CPU and software.

(Consideration of the relationship between the switch operation state and the level of the physical quantity signal output from the 3D motion sensor)
FIG. 2 is a diagram illustrating the relationship between the operation state of the push-down switch (operation switch) and the level of the physical quantity signal output from the three-dimensional motion sensor. In FIG. 2, the horizontal axis indicates the elapsed time (t), and the vertical axis indicates the signal level of the angular velocity signal (physical quantity signal) PQ1 around the x axis. In the figure, each of P1 to P6 indicates a peak of the angular velocity signal (physical quantity signal) PQ1.

  In FIG. 2, a period T1 (time t1 to t2) is a cursor scanning period (a period during which the user scans (moves) the cursor for menu selection). The period T2 (time t2 to t3) is a braking period (a period necessary for stopping the movement of the cursor that has reached (or has approached) a desired option). The period T3 (time t3 to t4) is a switch-on period (specifically, a period in which the contact point of the mechanical switch is on).

  In the cursor scanning period T1, the signal level of the angular velocity signal (physical quantity signal) PQ1 changes greatly with the passage of time, and peaks P1 to P4 occur. In the braking period T2, the signal level change width of the angular velocity signal (physical quantity signal) PQ1 becomes small, and the signal level is stabilized. The push switch (operation switch) SW is turned on at time t3 and turned off at time t4.

  As is apparent from FIG. 2, immediately after the push-down switch SW is turned on (time t3), the signal level of the angular velocity signal (physical quantity signal) PQ1 changes greatly instantaneously and a peak P5 is generated. Even immediately after the push-down switch SW is turned off (time t4), the signal level of the angular velocity signal (physical quantity signal) PQ1 changes greatly instantaneously and a peak P6 occurs. Here, the problem is the peak P5. If the signal level of the angular velocity signal (physical quantity signal) PQ1 changes greatly instantaneously, the cursor position changes instantaneously greatly correspondingly. And if an option is selected by the cursor after instantaneous position fluctuation has occurred, there is a high possibility that erroneous processing will be executed.

  Although the switch-off is detected at time t4, the cursor position at this timing (time t4) is the cursor position after an instantaneous position change has occurred. Therefore, in order to detect whether or not the selection result is different before and after instantaneous fluctuation occurs, the cursor position at the time of switching on (time t3) and the cursor position at the time of switching off (time t4) Are extracted from the cursor position storage unit 220 and compared with each other to detect a match / mismatch of the selection results (whether the same option is selected, whether the same event is generated, etc.). As described above, the event is executed only when they match.

(Specific operation example)
FIGS. 3A and 3B are diagrams illustrating specific operation examples for event generation in the data processing apparatus illustrated in FIG. 1. As shown in FIG. 3A, each of the options (A, E, 1) displayed on the display panel 300 is associated with each of event 1, event 2, and event 3 in 1: 1. It has been. For example, it is assumed that the option E is a menu “copying information stored in a storage medium (creating a copy)” and the option 1 is a menu “initializing a hard disk”. In this case, the option 2 is associated with an event 2 called “storage medium copy process”, and the option 1 is associated with an event 3 called “hard disk initialization process”.

  Then, it is assumed that the cursor at time t3 (when the switch is on: before the cursor position change occurs) in FIG. 2 is CS1, and the cursor at time t4 (when the switch is off: after the cursor position change occurs) is CS2. To do. In this case, although the user desires to execute the event 2, there is a high possibility that the unintended event 3 is actually executed.

  Therefore, in this embodiment, as shown in FIG. 3B, the cursor position before and after the instantaneous change in the cursor position is compared to determine whether the event can be executed. That is, the cursor position storage unit 220 stores at least cursor position information CD for a time corresponding to the above-described switch-on period T3. In the figure, each of CD1 to CDn + 2 represents cursor position information sampled every 1/60 seconds and stored in the cursor position storage unit 220.

  For example, when a switch-off detection signal S1off is output from the switch operation signal detection unit 214 at time t4, the cursor position comparison unit 222, at that timing, corresponds to the cursor position information CD3 corresponding to the switch-on time (time t3). The cursor position information CDn + 1 corresponding to the time when the switch is off (time t4) is read from the cursor position storage unit 220 and compared. The cursor position information read timing can be variously modified. For example, the cursor position comparison unit 222 can read the corresponding cursor position information CD3 at time t3 and can read the corresponding cursor position information CDn + 1 at time t4. It is also possible to read the cursor position information after time t4.

  For example, the cursor position comparison unit 222 collates (matches) the menu information MD with the read cursor position information CD3, CDn + 1, and determines whether or not each cursor position is on the same option. . When it is determined that each cursor position is on the same option, a selection result match is detected. When each cursor position is determined to be on a different option, the selection result does not match. It is detected.

  The cursor position comparison unit 222 associates the cursor position information (CD3 or CDn + 1) corresponding to the time t3 or the time t4 or the option E selected at each time point when the selection result matches. Event 2 (that is, provisional event TEV) is sent to the event generation unit 224 as information for specifying an execution event. On the other hand, when the selection results do not match, information for specifying an execution event is not sent. In this case, a flag indicating that the event cannot be executed can be sent instead.

  The event generation unit 224 executes the execution event (execution only) when information for specifying an execution event is sent from the cursor position comparison unit 222, that is, only when a match is detected by the cursor position comparison unit 222. If no match is detected, no execution event is generated. When the execution event is not generated, the event is not executed by the event execution unit 228 (for example, an application program), so that an erroneous event is reliably prevented from being executed.

  Thus, according to the present embodiment, erroneous menu selection can be reliably prevented even when the cursor position instantaneously deviates greatly. Therefore, for example, the hard disk erasure is not executed by mistake, and the menu selection system can be used with confidence. In addition, the configuration of the present embodiment does not require any special hardware, does not increase hardware costs, and is easy to implement.

(Second Embodiment)
In this embodiment, event information (provisional event) associated with the option specified by the cursor is used as selection information, and the selection result at the time of turning on and turning off the operation switch is predicted by comparing the provisional event. (Identification) is performed, and a match / mismatch between the two is detected. When no match is detected, an execution event is not generated, thereby reliably preventing selection of an erroneous menu or the like.

  FIG. 4 is a diagram illustrating another example of the configuration of the menu selection system which is an example of the data processing apparatus. In the data processing device 100 shown in FIG. 4, a temporary event generation unit 250 is newly provided, a temporary event storage unit 252 is provided instead of the cursor position storage unit 220 of FIG. As a comparison unit, a temporary event comparison unit 254 is provided instead of the cursor position comparison unit 222 of FIG.

  The provisional event generation unit 250 collates (attaches) the cursor position information CD output from the cursor position detection unit 212 with the menu information MD output from the menu display unit 219, and selects an option specified by the cursor. A temporary event is identified and associated with the option 1: 1. The generated temporary event TEV is stored in the temporary event storage unit 252. The temporary event storage unit 252 stores at least a temporary event TEV for a time corresponding to the switch-on period T3. For example, the temporary event TEV is acquired every 1/60 seconds for about 1 second, and the acquired temporary event TEV is sequentially stored in the temporary event storage unit 252.

  For example, when the switch-off detection signal S1off is output at time t4 when the switch is off, the temporary event comparison unit 254 displays the temporary events (TEVx and TEVy) at the time t3 and the time t4 when the switch is on. It reads out from the event memory | storage part 252, compares both, and detects whether both correspond. If a match is detected, the tentative event comparison unit 254 sends the tentative event TEVx (= TEVy) in which a match is detected to the event generation unit 224.

  For example, the event generation unit 224 receives the temporary event TEVx (= TEVy) supplied from the temporary event comparison unit 254 at a timing delayed by a predetermined time from the timing (time t4) when the switch-off detection signal S1off is input. The execution event EVT is specified as it is, and the specified execution event EVT is supplied to the event execution unit 228. The effect obtained is the same as in the above-described embodiment.

  5A and 5B are diagrams illustrating specific operation examples for generating an event in the data processing apparatus illustrated in FIG. FIG. 5A shows an example of operation when selection is successful (when a match is detected), and FIG. 5B shows an example of operation when selection is unsuccessful (when no match is detected).

  In FIG. 5A, the temporary event storage unit 252 stores temporary events TEV1 to TEVn + 2. When the switch-on detection signal S1off is input to the temporary event comparison unit 254 at time t4, temporary events TEV3 and TEVn + 1 corresponding to time t3 and time t4 are read by the temporary event comparison unit 254. The temporary events TEV3 and TEVn + 3 correspond to, for example, event 2 shown in FIG. In FIG. 5A, a match between the temporary events is detected, and the temporary event comparison unit 254 sends the event 2 to the event generation unit 224. The event generation unit 224 sets the event 2 as an execution event and sends the event 2 to the event execution unit 228.

  On the other hand, in FIG. 5B, no match between the temporary events is detected, and therefore the temporary event comparison unit 254 does not send the temporary event information to the event generation unit 224 (no output). As a result, the event generation unit 224 cannot generate the execution event EVT, and accordingly, an erroneous event is not executed by the event execution unit 228.

(Third embodiment)
In the embodiment described above, if a match of the selection results corresponding to the first time point and the second time point is not detected, the selection fails and the event is not executed. In practice, it may happen that selection failures continue. It cannot be denied that the operability is slightly deteriorated if the selection failure continues, but if the following measures are taken, it is possible to make the user hardly feel practical inconvenience.

(Ingenuity to suppress continuous failures)
(1) For example, when a selection failure occurs, the area of options is expanded. For example, when a push-type switch is used, the cursor tends to move in the vertical direction. Therefore, by setting the option to be displayed vertically, it is possible to increase the probability that the cursor after the position change remains on the same option even if the cursor is blurred.
(2) Each option of the menu has a predetermined effective selection area, but only a target having a predetermined area at the center is displayed on the display panel. Before the selection fails, the target of each option is displayed in the first size, and after the selection fails, the display is switched to a second size smaller than the first size. That is, the target is reduced to prompt the user to select a menu more accurately (cursor movement). In this case, even if the cursor deviates from the target, there is a high probability that the cursor will remain in the valid area, and the possibility that selection failures will continue decreases.

According to the embodiment of the present invention described above, for example, the following effects can be obtained. However, the following effects are not always obtained, and the following list of effects should not be used as a basis for unduly limiting the technical idea of the present invention.
(1) Even when an erroneous selection is not permitted as in the case of initialization of a hard disk, an erroneous selection due to a blur of the pointing device is not performed, and a data processing system such as a highly reliable menu selection system can be obtained.
(2) As a secondary effect, if the selection is wrong, if the option is deliberately blurred (points to an option different from the option that was intentionally pressed when released), the specified cancellation is automatically performed. Can be performed, and usability is improved.
(3) A three-dimensional input device can be used with confidence.
(4) Currently, there are many cases where a three-dimensional space is handled on a computer using a three-dimensional CAD, a game, or the like, and accordingly, a device capable of inputting a three-dimensional motion is increasing. According to the invention of the embodiment of the present invention, a system using a small three-dimensional pointing device with high reliability and excellent operability is realized.

  Thus, according to at least one embodiment of the present invention, for example, a method that is easy to implement and does not cause an increase in hardware costs can reliably prevent erroneous selection due to blurring of the pointing device. For example, a highly reliable menu selection system, a data processing system (eg, a three-dimensional input device (pointing device)) and a data processing device such as a game system that needs to move a cursor or the like on the screen are included. ) Can be realized.

  Although the embodiments of the present invention have been described in detail, those skilled in the art will readily understand that many modifications are possible without departing from the novel matters and effects of the present invention. Therefore, all such modifications are included in the present invention. For example, in the above-described embodiment, the menu selection system has been described as an example. However, the present invention is widely used for game operation of a game system using a three-dimensional input device, remote control in a remote operation system of a camera or a robot, and the like. can do. The term “pointing device” is to be interpreted in the broadest sense and includes a wide range of input devices capable of inputting a physical quantity signal corresponding to a spatial displacement and a switch operation signal. Further, the configuration of the three-dimensional motion sensor is not limited to the above-described embodiment, and other configurations (for example, a configuration having a magnetic sensor in addition to the gyro sensor and the acceleration sensor) may be adopted. it can. Further, the spatial displacement includes the posture and rotation of the pointing device, and also includes translation. A pointing device that detects a one-dimensional or two-dimensional displacement is also included. Note that the translation (horizontal movement, vertical movement, etc.) of the pointing device can be calculated by integrating fluctuations in the output of the acceleration sensor with time.

The figure which shows an example of a structure of the menu selection system which is an example of a data processing system The figure which shows the relationship between the operation state of a push-type switch (operation switch), and the level of the physical quantity signal output from a three-dimensional motion sensor 3A and 3B are diagrams showing specific operation examples for event generation in the data processing apparatus shown in FIG. The figure which shows the other example of a structure of the menu selection system which is an example of a data processing system. 5A and 5B are diagrams showing specific operation examples for event generation in the data processing apparatus shown in FIG.

Explanation of symbols

100 3D pointing device, 110 3D motion sensor,
112a to 112d A / D converter, 114 control unit, 116 CPU,
118 communication unit (communication interface or transmission interface), 119 memory,
121 power supply, AN1, AN2 antenna, 200 data processing device,
210 communication unit, 212 cursor position detection unit, 214 switch operation signal detection unit,
216 Display control unit, 217 Cursor display unit, 219 Menu display unit,
220 cursor position storage unit, 222 cursor position comparison unit (selection information comparison unit),
224 event generation unit, 226 memory, 228 event execution unit,
250 temporary event generation unit, 252 temporary event storage unit,
254 provisional event comparison unit (selection information comparison unit), 300 display panel,
IN option, CS1, CS2 Cursor pointer (cursor pointer position)

Claims (4)

A physical quantity signal generated according to the movement of the pointing device in the space and a switch operation signal generated by operating an operation switch provided in the pointing device are transmitted from the pointing device to the data processing apparatus, A data processing device generates an event corresponding to one option selected from a plurality of options displayed on the display unit by data processing based on the received physical quantity signal and the switch operation signal. The data processing apparatus used in a data processing system for executing the event,
A cursor position detecting unit that detects a cursor position based on the physical quantity signal and outputs cursor position information;
A display control unit for displaying an image having the plurality of options and displaying a cursor on the image based on the cursor position information output from the cursor position detection unit;
A switch operation signal detector for detecting the switch operation signal;
First selection information corresponding to a first time point when the switch operation signal detection unit detects turn-on of the operation switch, and a second time point when the switch operation signal detection unit detects turn-off of the operation switch. And whether the first selection result based on the first selection information and the second selection information based on the second selection information are the same. A selection information comparison unit to be detected;
When the first selection result and the second selection result are matched by the selection information comparison unit, an event corresponding to the selected option is generated as an execution event. An event generator that does not generate execution events;
An event execution unit for executing the execution event,
A data processing apparatus, wherein the display size of the option is changed after the mismatch occurs. The data processing apparatus according to claim 1, wherein
A cursor position storage unit that stores the cursor position information over a period of time from at least the first time point to the second time point;
The selection information comparison unit reads the first cursor position information and the second cursor position information from the cursor position storage unit, and an option specified based on the first cursor position information; A data process characterized by detecting whether or not the option specified by the cursor position information of two matches, and thereby detecting a match or mismatch between the first selection result and the second selection result apparatus. The data processing apparatus according to claim 1, wherein
A temporary event storage unit that stores an event corresponding to the option specified by the cursor as a temporary event, and stores at least a time from the first time point to the second time point;
The selection information comparison unit reads the first temporary event at the first time point and the second temporary event at the second time point from the temporary event storage unit, and the first temporary event and the second temporary event A data processing apparatus for detecting whether or not the tentative event matches, thereby detecting a match or mismatch between the first selection result and the second selection result. A pointing device that transmits a physical quantity signal generated according to the movement in the space of the main body and a switch operation signal generated by operating an operation switch provided in the main body to a data processing device;
A data processing device according to any one of claims 1 to 3,
A data processing system comprising:

Images