JP2013012010A - Pointer display device, pointer display method, and pointer display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a pointer display device that allows the operation of moving a pointer over a selection item icon to be performed more comfortably.SOLUTION: A pointer display device includes a controller (58) for controlling the position of a pointer (PT) to be displayed on a screen on the basis of the posture of a gripping device (RM) or a change in the posture. The controller (58) controls the travel speed of the pointer (PT) on the screen according to the number of icons (P1-P11) that are displayed in a prescribed region (AR2) of the screen and can be selected with the pointer (PT).

Description

  The present invention relates to a pointer display device, a pointer display method, and a pointer display program, and in particular, a pointer display device, a pointer display method, and a pointer that control pointer display on a screen in accordance with the posture or posture change of a remote control device. It relates to the display program.

A technique for controlling the amount of movement of the pointer on the screen in accordance with the tilt amount of the remote control device is disclosed in Patent Document 1 as a video projection device.
In the technique disclosed in Patent Document 1, the remote control device includes a sensor that detects its own tilt and a pointer display on / off button, and the video projection device starts from when the on / off button of the remote control device is pressed. The moving amount of the pointer displayed on the screen is obtained based on the tilt amount of the remote control device.

JP 2007-248710 A

By the way, in the conventional technology as shown in Patent Document 1, when the number of selection item icons that can be selected by the pointer on the screen is small and the icons are far away from each other, the remote control device is used to move the pointer a long distance. It is necessary to increase the tilt or increase the tilting speed.
Therefore, there is a problem that the burden on the hand holding the remote control device is large and it is difficult to align the pointer with the aimed icon.

  Conversely, if there are many selection item icons that can be selected with the pointer and the icons are close to each other, the amount of pointer movement may be small, but it is easy to reduce the tilt of the remote control device or slow down the tilting speed. However, there is a problem that it is difficult to align the pointer with the target icon, for example, the pointer passes through the icon even with a slight change in posture.

These problems are not only related to the number of selection item icons but also due to the layout of the selection item icons on the screen and the distance between the icons.
As described above, there is a room for improvement with respect to the operation of placing the pointer on the selection item icon, and it is expected that they will be improved.

  Therefore, the problem to be solved by the present invention is to provide a pointer display device, a pointer display method, and a pointer display program capable of comfortably performing an operation for aligning a pointer with a selection item icon.

In order to solve the above problems, the present invention has the following configuration as means.
1) A control unit (58) for controlling the position of the pointer (PT) displayed on the screen based on the posture of the gripping device (RM) or the change of the posture is provided.
The control unit (58) displays the pointer (PT) on the screen according to the number of icons (P1 to P11) displayed in the predetermined area (AR2) of the screen and selectable with the pointer (PT). A pointer display device (51) for controlling the moving speed.
2) Provided with a control unit (58) for controlling the position of the pointer (PT) displayed on the screen based on the posture of the gripping device (RM) or the change in the posture,
The control unit (58) is arranged between a position of an icon (P1 to P11) displayed in a predetermined area (AR2) of the screen and selectable by the pointer (PT) and a position where the pointer (PT) is displayed. The pointer display device (51) controls the moving speed according to the distance (LA).
3) The pointer display device according to 1) or 2), wherein the predetermined region (AR2) is a region narrower than the screen including a region of the entire screen or a position where the pointer is displayed. is there.
4) In the pointer display method in which the control unit (58) controls the position of the pointer (PT) displayed on the screen based on the posture of the gripping device (RM) or the change in the posture.
Determining the number of icons displayed in the predetermined area (AR2) of the screen and selectable with the pointer (PT);
And a moving speed setting step of setting a moving speed of the pointer (PT) based on the determined number of icons.
5) In the pointer display method in which the control unit (58) controls the position of the pointer (PT) displayed on the screen based on the posture of the gripping device (RM) or the change in the posture.
The distance (LA) between the position of the icon (P1 to P11) displayed in the predetermined area (AR2) of the screen and selectable by the pointer (PT) and the position where the pointer (PT) is displayed is determined. A distance determination step;
And a moving speed setting step for setting a moving speed of the pointer (PT) based on the determined distance (LA).
6) The pointer according to 4) or 5), wherein the predetermined area (AR2) is an area that is narrower than the screen including an area of the entire screen or a position where the pointer (PT) is displayed. It is a display method.
7) Based on the posture of the gripping device (RM) or the change in the posture, the computer of the display device (DP) that controls the position of the pointer (PT) displayed on the screen,
Determining the number of icons (P1 to P11) displayed in the predetermined area (AR2) of the screen and selectable with the pointer (PT);
And a movement speed setting step of setting a movement speed of the pointer (PT) based on the determined number of icons.
8) On the computer of the display device (DP) that controls the position of the pointer (PT) displayed on the screen based on the posture of the gripping device (RM) or the change in the posture,
The distance (LA) between the position of the icon (P1 to P11) displayed in the predetermined area (AR2) of the screen and selectable by the pointer (PT) and the position where the pointer (PT) is displayed is determined. A distance determination step;
And a moving speed setting step for setting a moving speed of the pointer (PT) based on the determined distance (LA).
9) The pointer according to 7) or 8), wherein the predetermined area (AR2) is an area that is narrower than the screen including an area of the entire screen or a position where the pointer (PT) is displayed. It is a display program.

  According to the present invention, there is an effect that the operation of aligning the pointer with the selection item icon can be performed more comfortably.

It is a figure for demonstrating the electronic device and remote control device which mount the Example of this invention pointer display apparatus. It is a top view explaining the remote control device applied to the Example of the pointer display method of this invention. It is a block diagram which shows the Example of the pointer display apparatus of this invention. It is a perspective view for demonstrating the remote control apparatus applied to the Example of the pointer display method of this invention. It is the 1st figure which shows the display screen for demonstrating the Example of the pointer display method of this invention. It is a 2nd figure which shows the display screen for demonstrating the Example of the pointer display method of this invention. It is the 3rd figure which shows the display screen for demonstrating the Example of the pointer display method of this invention. It is a perspective view explaining the electronic device carrying the modification in the Example of the pointer display apparatus of this invention.

The preferred embodiments of the present invention will be described with reference to FIGS.
Note that the phrase “video” described below means an image including one or both of a still image and a moving image.

FIG. 1 shows an electronic device DK and a remote control device RM equipped with a pointer display device 51 of the present invention.
The remote control device RM is a gripping device that can be gripped with one hand or both hands.
The electronic device DK is, for example, a car navigation device. The electronic device DK is an example in which the display device DP is built in, but the display device DP may be an external device.
A remote control signal to be described later is output as light from the output unit RMa of the remote control device RM, and is received and input by a remote control receiving unit DKa provided in the electronic device DK. The pointer display device 51 controls the position and movement of the pointer displayed on the display device DP based on the input remote control signal. Note that the communication between the remote control device RM and the electronic device DK is not limited to communication using light, and various communication methods can be used regardless of wired wireless communication.

FIG. 2 is a diagram illustrating the remote controller RM.
The remote control device RM includes a button operation unit 1 including a cross key and a determination button arranged at the center thereof, a sensor unit 3 that detects posture information for obtaining the posture of the remote control device RM, and operations of the remote control device RM itself. A remote controller control unit 4 that generates a remote control signal based on input information from the button operation unit 1 and attitude information from the sensor unit 3, an output unit RMa that outputs the remote control signal with light, a power source 5, and a sensor And an effective button 2 for outputting an on / off signal related to the posture information from the unit 3 to the remote control unit 4.

  The sensor unit 3 includes a gyro sensor 3a and an X, Y, Z triaxial acceleration sensor 3b.

FIG. 3 is a block diagram of the pointer display device 51.
The pointer display device 51 includes a video signal input unit 52, a video signal processing unit 53, a video synthesis unit 54, a video output unit 55, a pointer image generation unit 56, a synthesis condition setting unit 57, and a control unit 58.
Furthermore, the control unit 58 includes a selection item icon number determination unit 58a and a selection item icon position determination unit 58b. The selection item icon number determination unit 58 a or the selection item icon position determination unit 58 b may be provided outside the control unit 58.

An external video signal SG1 is input to the video signal input unit 52. The external video signal is, for example, a guidance map screen in car navigation, a video from a DVD, a TV broadcast, a PC (personal computer), and the like, and is generated in the electronic device DK or externally the electronic device. This is a video signal input to the DK. The video based on this video signal is a synthesized video in which pointers are synthesized at a later stage.
The video signal input unit 52 outputs the video signal SG1 to the video signal processing unit 53 and the control unit 58.

  The control unit 58 determines the number of selection item icons determined by the selection item icon number determination unit 58a and the selection item icon position determination unit 58b from the remote control signal SG2 from the remote control light receiving unit DKa and the video signal SG1 from the video signal input unit 52, respectively. The pointer position on the video screen and the optimum pointer image are set based on the selection item icon position and output as pointer position information J1 and pointer image information J2, respectively.

  The pointer image generation unit 56 generates a pointer image to be synthesized based on the pointer image information J2 output from the control unit 58 and outputs the pointer image J3.

  Based on the pointer position information J1 from the control unit 58 and the pointer image J3 from the pointer image generation unit 56, the composition condition setting unit 57 performs conditions for compositing pointers (composition position, size of the pointer to be synthesized, color, etc. ) And the pointer composition information J4 is output.

The video signal processing unit 53 processes the video with respect to the video signal SG1 from the video signal input unit 52 so that the pointer is favorably visually recognized in the video when the pointer is synthesized in the subsequent stage. The processed video is output as a processed video signal SG3.
In the processing, for example, the color around the pointer of the video as a background and the contrast with the pointer are adjusted so that the pointer is conspicuous so that the visibility of the combined and displayed pointer is not impaired.
Information such as the shape and size of the pointer and the display position is obtained from the pointer synthesis information J4 from the synthesis condition setting unit 57.

  The video synthesis unit 54 synthesizes (superimposes) the pointer on the processed video signal SG3 based on the pointer synthesis information J4, and outputs the synthesized video signal SG4.

The video output unit 55 outputs the composite video signal SG4 to the outside of the pointer display device 51. If the pointer display device 51 has a display unit, the composite video signal SG4 is output to the display unit.
With this output, an image in which the pointer is synthesized is displayed on the display device DP.

  Next, the operation of the electronic device DK including the remote control device RM and the pointer display device 51 and the pointer display method will be described in detail.

<Operation of remote control device>
FIG. 4 shows three axes (X, Y, Z) defined in the remote control device RM.
Specifically, the horizontal direction when the output unit RMa of the remote control device RM is placed flat at the head is set as the X axis, the front-rear direction is set as the Y axis, and the vertical direction is set as the Z axis. The rotation (+) and (−) are defined in the direction shown in FIG.
The sensor unit 3 detects the inclination of the remote control device RM for each axis. As an example, when a tilt occurs due to rotation around the Y axis (in the direction of the arrow AR4Y in FIG. 4), the tilt angle from the horizontal posture (in units of degrees or rad) is detected based on the horizontal posture.
Similarly, the inclination by the rotation around the X axis and the Z axis is detected.

  The detection result is output as a set of (X, Y, Z) as tilt angle information. For example, (+20, −35, +10). This detection is continuously performed and the results are also continuously output. Of course, the detection may be executed intermittently, but in order to obtain a good operation feeling, it is desirable to perform continuous detection or intermittent detection in a very short period.

The reference posture may not be a horizontal posture. For example, the posture of the remote control device RM at the time when the user presses the valid button 2 may be set as the reference posture, and the amount of inclination from the reference posture may be detected. This is preferable because it is difficult to place an excessive operation burden on the user's hand holding the remote control device RM.
In the tilt detection, the spatial position of each axis may not be fixed.
The setting of the reference posture accompanying the pressing of the effective button 2 and the acquisition of the tilt angle based on the reference may be performed by the control unit 58 of the pointer display device 51 described later, not the remote controller RM side.

The sensor unit 3 detects the angular velocity of the remote control device RM for each axis. As an example, when the remote control device RM rotates around the Y axis, the angular velocity (unit: rad / sec) is output.
This detection is also similarly detected for the rotation about the X axis and the Z axis.

  The detection result is output as a set of (X, Y, Z) as angular velocity information. For example, (−10, −15, +40). This detection is continuously performed and the results are also continuously output. Of course, the detection may be performed intermittently, but in order to capture the change in the angular velocity with high accuracy and obtain a good operation feeling, it is desirable to perform continuous detection or intermittent detection in a very short period.

  The remote control unit 4 of the remote control device RM generates a remote control signal SG2 including operation information of the button operation unit 1, effective button information indicating pressing and releasing of the effective button 2, inclination angle information, and angular velocity information. Then, the light is output from the output unit RMa to the outside by light.

<Operation of pointer display device>
The control unit 58 sets the position of the pointer to be synthesized, the moving speed, the direction when the pointer image has directionality, and the like based on each information included in the remote control signal SG2.
This setting method is not limited.
As an example, the case based on the tilt angle information will be described. The horizontal direction of the screen corresponds to the tilt around the Y axis in FIG. 4, and the vertical direction of the screen corresponds to the tilt around the X axis in FIG.
Further, for the left and right length La and the vertical length Lb of the screen to be displayed, the conversion magnification is set, for example, 90 ° = La / 2 = Lb / 2. This conversion magnification corresponds to a reference coefficient N described later.
In the case of a display with a screen size of La = 800 mm and Lb = 450 mm, the remote controller RM is moved from the posture at the time when the valid button 2 is pressed (when it is changed from a non-pressed state to a pressed state) from When tilted + 15 ° around and −20 ° around the X axis, the position of the pointer on the screen moves 67 mm to the right and 54 mm downward. If the pointer is moved only when the valid button 2 is kept pressed and the pointer is not moved when the valid button 2 is not pushed, erroneous operations can be reduced. . The button for determining the validity / invalidity of this operation (whether or not to move the pointer) and the button for determining the reference of the posture may be the same button or different buttons. Good.
As in this example, the behavior of the pointer on the screen is associated with each piece of information included in the remote control signal SG2. When the movement speed of the pointer is associated with the angular speed information, there is little sense of discomfort.

In setting the position of the pointer and the moving speed, the control unit 58 also refers to the number of selection item icons and the selection item icon position.
The number of selection item icons is determined by the selection item icon number determination unit 58a based on the video obtained from the video signal SG1. It is determined including the case where the number is 0 (zero), that is, there is no corresponding icon.
The selection item icon position is determined by the selection item icon position determination unit 58b based on the video obtained from the video signal SG1. In this determination, the position of the pointer to be combined on the screen set by the control unit 58 is referred to, and the determination is made including the distance between each selection item icon and the pointer position.

Hereinafter, it explains in full detail using FIGS.
FIGS. 5A and 5B show a screen of a composite video to be combined with a pointer, and shows that the pointer PT is combined.
In FIG. 5A, selection item icons P1 to P3 are displayed, and in FIG. 5B, selection item icons P4 to P11 are displayed.

5A, the selection item icon number determination unit 58a determines the number of selection item icons “3” and outputs it as the selection item icon number S.
Similarly, with respect to FIG. 5B, it is determined as “8” and is output as the selection item icon number S.
The control unit 58 sets the moving speed of the pointer when combining the pointer on the screen on which the selection item icon is not displayed by multiplying each information of the remote control signal SG2 by a preset reference coefficient N.
Based on the number of selection item icons included in the screen of the synthesized video, the control unit 58 performs control so that the moving speed of the pointer PT decreases as the number increases.
Therefore, even if the attitude of the remote control device RM is changed in the same manner, the movement speed of the pointer PT in FIG. 5B is slower than that of the pointer PT in FIG.

This is realized by multiplying the reference coefficient N by a correction coefficient M related to the number of selection item icons.
For example, M = 1 / S, or, and M = 1 / ^{S 2.}
These are examples, and M can be arbitrarily set as a function of S.
As the number of selection item icons increases, the distance between the icons tends to be closer. Therefore, as the number of icons increases, the pointer movement speed is decreased, so that the pointer icon can be easily and easily aligned by the posture operation of the remote control device.

The range for determining the selection item icon number S may be within the range (area) of a predetermined distance from the position of the pointer PT to be synthesized, not the entire screen of the synthesized video.
FIGS. 6A and 6B show the same synthesized video screens as FIGS. 5A and 5B. The range AR2 for determining the number S of selection item icons from the pointer PT is shown in FIG. This is shown as radius Rcs. This range AR2 does not have to be circular as shown in FIG. 6, but may be rectangular or other shapes.

The icons included in the range AR2 shown in FIG. 6A (including some of the icons) are only P3, and the icons included in the range AR2 shown in FIG. 6B are P8 and P9. , P11. The controller 58 sets the moving speed of the pointer PT with one or three of these as the number of icons SA.
As the pointer PT moves, the number of icons SA included in the range AR2 changes sequentially, so that the moving speed is set according to the change.

This method is preferable because the operability is remarkably improved particularly when the selection item icons are unevenly distributed in the screen.
That is, when the pointer PT is in the area where the selection item icons are dense, the moving speed of the pointer is slower even in the same posture operation of the remote control device RM than in the case where the pointer PT is in the sparse area.
Therefore, the icon alignment of the pointer PT by the posture operation of the remote control device RM can be performed easily and better.

Next, an example in which the control unit 58 refers to the selection item icon position will be described.
FIG. 7 shows the same synthesized image screen as that in FIG. 5A. However, the positions of the selection item icons P1 to P3 in the screen are detected, and the distance from the synthesized position of the pointer PT is obtained. And output as icon distance LA.
Specifically, the distances between the icons P1 to P3 and the pointer PT are obtained as L71 to L73, respectively.
The control unit 58 compares L71 to L73 that are the icon distance LA with each other, and sets the moving speed of the pointer PT based on the nearest distance Lmin (L73 in FIG. 7).
Thereby, the moving speed of the pointer PT becomes slower as there is an icon closer to the pointer PT.
That is, if there is a selection item icon near the pointer PT, there is a possibility that the pointer PT will be aligned with the icon. Therefore, the closer the distance between the two, the slower the pointer moving speed even in the same posture operation of the remote control device RM. Become.
Therefore, the icon alignment of the pointer PT by the posture operation of the remote control device PM can be more easily and easily performed.

  The pointer moving speed is set by the method based on the selection item icon number S, the method based on the icon number SA in the predetermined range AR2 from the pointer PT, or the method based on the shortest distance Lmin between the pointer PT and the icon. Either may be used. Moreover, you may set combining each freely.

  The embodiment of the present invention is not limited to the configuration and procedure described above, and it goes without saying that modifications may be made without departing from the scope of the present invention.

The above-described example is an example in which a pointer that moves to a fixed synthesized video is synthesized, but the pointer function may be replaced by image inversion and the video may be moved.
That is, according to the change in posture of the remote control device RM, the video may move in the screen at a direction and speed according to the change in posture.

FIG. 8 is an external view showing an electronic device DK2 on which a modification 51a of the pointer display device 51 is mounted.
The electronic device DK2 is equipped with a display device DP.
On the display unit of the display device DP, selection item areas P12 to P18 arranged in parallel in the vertical direction are displayed.
The selection item area moves upward and downward, and selection item areas not displayed in FIG. 8 are sequentially displayed.
The pointer display device 51 moves the selection item area in one axis direction (vertical direction in FIG. 8) by changing the posture of the remote control device RM (not shown in FIG. 8).
In addition, the selection item area at a predetermined position in the vertical direction of the screen can be recognized by reversing the luminance in the sense of a pointer.
In the example of FIG. 8, “Domestic” is recognized by the pointer and inverted.
Not limited to this example, the selection item area is displayed in a two-dimensional matrix, moved in two dimensions on the screen in accordance with the change in the attitude of the remote control device RM, and the selection item area corresponding to predetermined coordinates on the screen. The pointer may be displayed by reversing the brightness.
The car navigation device has been described as an example, but the present invention can be applied to various electronic devices such as a personal computer and a television device.
Further, a part of the configuration of the pointer display device may be configured to be included in the remote control device.
The present invention includes a program for causing a computer to realize the function of the control unit 58. These programs may be read from a recording medium and loaded into a computer, or may be transmitted via a communication network and loaded into a computer.

DESCRIPTION OF SYMBOLS 1 Button operation part, 2 Effective button, 3 Sensor part, 4 Remote control part 5 Power supply 51, 51a Pointer display device 52 Video signal input part 53 Video signal processing part 54 Video composition part 55 Video output part 56 Pointer image generation part 57 Composition Condition setting unit 58 Control unit, 58a Selection item icon number determination unit, 58b Selection item icon position determination unit AR2 Range (area)
PT pointer DK, DK2 electronic device, DKa remote control receiver DP display device J1 pointer position information, J2 pointer image information, J3 pointer image J4 pointer composition information LA icon distance N reference coefficient, M correction coefficient P1-P11 selection item icon, P12 P18 Selection item area RM Remote control device (gripping device), RMa output unit S Number of selection item icons, number of SA icons SG1 video signal, SG2 remote control signal, SG3 processed video signal SG4 composite video signal

Claims (9)

A control unit that controls the position of the pointer displayed on the screen based on the posture of the gripping device or a change in the posture,
The control unit is a pointer display device that controls a moving speed of the pointer on the screen according to the number of icons displayed in a predetermined area of the screen and selectable by the pointer. A control unit that controls the position of the pointer displayed on the screen based on the posture of the gripping device or a change in the posture,
The control unit is a pointer display device that controls the moving speed according to a distance between a position of an icon displayed in a predetermined area of the screen and selectable with the pointer, and a position where the pointer is displayed.   The pointer display device according to claim 1, wherein the predetermined area is an area that is narrower than the screen including an area of the entire screen or a position where the pointer is displayed. In the pointer display method in which the control unit controls the position of the pointer displayed on the screen based on the posture of the gripping device or the change in the posture.
Determining the number of icons displayed in a predetermined area of the screen and selectable with the pointer;
And a movement speed setting step of setting a movement speed of the pointer based on the determined number of icons. In the pointer display method in which the control unit controls the position of the pointer displayed on the screen based on the posture of the gripping device or the change in the posture.
A distance determination step for determining a distance between a position of an icon displayed in a predetermined area of the screen and selectable by the pointer, and a position at which the pointer is displayed;
And a movement speed setting step of setting a movement speed of the pointer based on the determined distance.   6. The pointer display method according to claim 4, wherein the predetermined area is an area of the entire screen or an area narrower than the screen including a position where the pointer is displayed. Based on the posture of the gripping device or the change in the posture, the computer of the display device that controls the position of the pointer displayed on the screen,
Determining the number of icons displayed in a predetermined area of the screen and selectable with the pointer;
And a moving speed setting step of setting a moving speed of the pointer based on the determined number of icons. Based on the posture of the gripping device or the change in the posture, the computer of the display device that controls the position of the pointer displayed on the screen,
A distance determination step for determining a distance between a position of an icon displayed in a predetermined area of the screen and selectable by the pointer, and a position at which the pointer is displayed;
And a movement speed setting step of setting a movement speed of the pointer based on the determined distance.   9. The pointer display program according to claim 7, wherein the predetermined area is an area of the entire screen or an area narrower than the screen including a position where the pointer is displayed.

Images