JP5186516B2 - Display icon control device, display icon control method, and display icon control program - Google Patents

Description

  The present invention relates to an information processing technique using sensor information incorporated in a remote control terminal.

  Non-Patent Document 1 discloses that the wrist holding the remote control terminal (input determination device) with the right hand toward the five directions of the horizontal direction, the vertical upward direction, the vertical downward direction, the diagonally upward direction, and the diagonally downward direction is the pronation direction ( Character input selection method for TV remote control that can select the character to be determined by combining the operation of tilting counterclockwise / rotating outward (clockwise) and the multi-tap operation of the direction key provided on the remote control terminal. Is disclosed.

  The wrist operation range is divided into five areas, different characters are assigned to the respective divided areas, respectively, and displayed, and the character determined to be input can be selected by tilting the wrist. Since the wrist motion is used, the ease of character selection by the user varies depending on the method of determining the angle to be divided into these regions.

Ryosuke Aoki, 4 others, “Proposal of character input operation method for TV remote control using attitude sensor”, IEICE, IEICE Technical Report, HSC2008-75 (2009-3), p.103-p.108

  Here, since the operating characteristics of the user tilting his / her wrist are different for each user, there is a problem that if the angle at which the selected character is switched is fixed, a user who cannot properly select the character appears. For such a problem, when selecting a target character for input determination, the user can measure (calibrate) the accuracy of the operation of tilting the wrist in advance, and select each character based on the measured data. Although it is conceivable to determine the angle region, the operation to be measured in advance increases the labor of the user.

  The present invention has been made in view of the above, and an object of the present invention is to appropriately select a target icon in accordance with an operation characteristic in which a user holding an input determination device tilts his / her wrist.

  According to the first aspect of the present invention, a plurality of icons that are selected and determined by tilting the input determination device that is held in the hand by turning the wrist inward or outward are displayed at predetermined angular intervals. Display means, receiving means for receiving, as a reference inclination angle, the inclination angle of the input determination device transmitted from the input determination device when the input determined icon is selected, and one selected from the plurality of icons Storage means for storing each angle threshold at which an icon switches to an adjacent icon, and each relative angle interval between the reference inclination angle of the input determining device and the plurality of angle thresholds; Adjusting the plurality of angle thresholds by reading the plurality of angle intervals from the means, and adding the reference inclination angle received last to the plurality of angle intervals, respectively. Characterized in that it.

  According to the present invention, by rotating the wrist inward or outward and tilting the input determination device held by the hand, a plurality of icons selected and determined for input are displayed at predetermined angular intervals, and the input is determined. Each angle threshold at which one icon selected from a plurality of icons is switched to one adjacent icon is received as an inclination angle of the input determining apparatus transmitted from the input determining apparatus when the selected icon is selected, and The reference inclination angle of the input determining device and the relative angle intervals between the plurality of angle threshold values are stored in the storage means, the plurality of angle intervals are read from the storage means, and the last received reference inclination angle Therefore, the target icon is appropriately selected according to the operating characteristics of the user who holds the input determination device tilts his / her wrist. It can be.

  The present invention according to claim 2, wherein the plurality of icons are five icons positioned respectively in a horizontal direction, a vertically upward direction, a vertically downward direction, a diagonally upward direction, and a diagonally downward direction, When the icon finally determined to be input is the icon positioned in the vertical upward direction, the angle threshold value for switching from the icon positioned in the diagonally downward direction to the icon positioned in the vertical downward direction is set in the horizontal direction. It is characterized in that it approaches an angle threshold value for switching from a positioned icon to the icon positioned obliquely downward.

  According to the third aspect of the present invention, a plurality of icons that are input and determined by tilting an input determining device that is held by a hand by turning a wrist inward or outward by a computer at predetermined angular intervals. A second step of receiving, as a reference tilt angle, a tilt angle of the input determination device transmitted from the input determination device when the input determined icon is selected; Each angle threshold at which one icon selected from the icons is switched to an adjacent icon, and relative angle intervals between the reference inclination angle of the input determining device and the plurality of angle thresholds are stored in the storage means. A third step to be stored and the plurality of angle intervals are read from the storage means, and the last received reference inclination angle is added to the plurality of angle intervals, respectively. And having a, a fourth step of adjusting the plurality of threshold angle then.

  According to a fourth aspect of the present invention, the plurality of icons are five icons located in a horizontal direction, a vertical upward direction, a vertical downward direction, a diagonally upward direction, and a diagonally downward direction, respectively, in the fourth step. The angle threshold value for switching from the icon positioned in the diagonally downward direction to the icon positioned in the vertical downward direction when the icon finally determined to be input is the icon positioned in the vertical upward direction is the horizontal threshold value. It is close to the angle threshold value for switching from the icon positioned in the direction to the icon positioned diagonally downward.

  According to a fifth aspect of the present invention, each step in the display method according to the third or fourth aspect is executed by a computer.

  According to the present invention, it is possible to appropriately select a target icon in accordance with an operation characteristic in which a user holding the input determination device tilts his / her wrist.

It is a figure which shows the functional block structure of a remote control terminal. It is a figure which shows the functional block structure of digital TV. It is a figure which shows an example of the display state of the icon etc. in digital TV. It is a figure explaining operation which inclines a remote control terminal to a roll direction. It is a figure which shows a response | compatibility with a remote control terminal and the icon selected. It is a figure which shows the characteristic of the movement amount of the wrist at the time of selecting the number separated by one. It is a figure which shows the characteristic of the movement amount of the wrist at the time of selecting the number separated by two. It is a figure which shows the characteristic of the movement amount of the wrist at the time of selecting the number separated by three. It is a figure which shows the characteristic of the movement amount of the wrist at the time of selecting the number separated into four. It is a figure which shows the positional relationship between a some icon and the angle threshold value set between each icon. It is a figure which shows the whole processing flow of digital TV. It is a figure which shows the processing flow of a signal receiver. It is a figure which shows the processing flow of an input character control apparatus. It is a figure which shows the processing flow of a selection part. It is a figure which shows the processing flow which determines an angle threshold value. It is a figure which shows the processing flow of a determination part.

  Hereinafter, an embodiment for carrying out the invention will be described with reference to the drawings.

  First, the functional block configuration of the remote control terminal will be described. FIG. 1 is a diagram showing a functional block configuration of a remote control terminal. The remote control terminal 1 includes a key state detection unit 11 that determines whether or not various keys (decision key, selection key, etc.) provided on the surface of the remote control terminal 1 are pressed, and a use that holds the remote control terminal 1 A posture detection unit 12 that detects an inclination angle (inclination of the user's wrist) of the remote control terminal 1 that occurs when a person tilts the wrist in a roll direction (described later), and signal types of various pressed keys and detected A microcomputer unit 13 that transfers detection information related to an inclination angle or the like to a subsequent transmission unit 14 and a transmission that transmits the detection information transferred by the microcomputer unit 13 to a digital TV via a wired or wireless communication network (infrared communication or the like). Part 14. As the posture detection unit 12, an acceleration sensor or a gyro sensor can be used as an example.

  Next, a functional block of the digital TV that receives the detection information transmitted from the remote control terminal 1 will be described. FIG. 2 is a diagram showing a functional block configuration of the digital TV. The digital TV includes a signal receiving device 31, a data storage device 32, an input character control device 33, and a display image control device 34. Hereinafter, each function of each device will be described in detail.

  The signal receiving device 31 receives the detection information transmitted from the remote control terminal 1, analyzes the content included in the detection information, and analyzes the analyzed content (for example, a determination signal when the determination key is pressed or the remote control terminal 1 And the like are stored in the signal storage unit 321 of the data storage device 32.

  The data storage device 32 includes a signal storage unit 321 that stores a signal related to the detection information received by the signal receiving device 31, and character information (Japanese characters, English characters, numbers, symbols selected and input by the remote control terminal 1) A character table storage unit 322 for storing a table (including a matrix of vowels and consonants) and a display image data storage for storing image data such as icons displayed on the display 323 and a character conversion dictionary unit 324 that provides a dictionary function for character conversion.

  The input character control device 33 selects a character (including information such as Japanese characters, English characters, numbers, symbols, etc.) input based on the user's remote control terminal operation stored in the signal storage unit 321. And a determination unit 332 that determines a character to be input based on the operation of the remote control terminal 1.

  The display image control device 34 selects and determines the input of the display image data by tilting the remote control terminal 1 held by the hand by turning the right wrist in the inward direction (counterclockwise) or in the outward direction (clockwise). A plurality of icons stored in the storage unit 323 are displayed at an angular interval of 45 °, for example, and the character information stored in the character table storage unit 322 is read to display each character information on each icon. A function of converting character information in accordance with the selection or determination made by the input character control device 33 according to the character selection status by the operation of the remote control terminal 1, and displaying the latest state after conversion and display on the display Have.

  Here, a display state of icons and character information displayed on the display of the digital TV 3 will be described. FIG. 3 is a diagram illustrating an example of a display state of icons and the like on the digital TV. Five circular icons are vertically upward (angle + 90 ° when viewed from the center), diagonally upward (angle + 45 ° when viewed from the center), and horizontally (position at an angle of 0 ° when viewed from the center). , Vertically downward (position at an angle of −45 ° when viewed from the center) and diagonally downward (position at an angle of −90 ° when viewed from the center), and “1” above each icon. Character information “˜5” is displayed.

  As shown in FIG. 4, when the user tilts the remote control terminal 1 in the roll direction (pronation / extraction) to select a target character, the wrist is detected by the posture detection unit 12 of the remote control terminal 1. The inclination angle of the remote control terminal 1 is transmitted to the digital TV 3 in accordance with the inclination of the input signal, and after the inclination angle is received as the reference inclination angle by the signal receiving device 31 of the digital TV 3 and temporarily accumulated by the signal accumulation unit 321, the input character control is performed. The icon corresponding to the reference inclination angle of the remote control terminal 1 is displayed by the selection unit 331 of the device 33 so as to be identifiable as being selected by the user.

  Specifically, as shown in FIG. 5, when the remote control terminal 1 is tilted by + 90 °, an icon displaying character information “1” is selected (hereinafter simply referred to as “1” icon selection). When it is tilted + 45 °, the icon “2” is selected, when it is tilted 0 °, the icon “3” is selected, and when it is tilted −45 °, the icon “4” is selected. Is selected and tilted by −90 °, the icon “5” is displayed as identifiable as being selected.

  More specifically, in the digital TV 3, one icon (for example, “2” icon) selected from the icons “1” to “5” is adjacent to one icon (for example, “3” icon). Each angle threshold value to be switched, and each relative angle interval between the reference tilt angle and each angle threshold value of the remote control terminal 1 are stored in the data storage device 32 in advance, and the reference tilt angle transmitted from the remote control terminal 1 is stored. When the value exceeds or falls below the set angle threshold, the currently selected icon is switched to the adjacent icon in an identifiable manner. For example, the angle threshold between the “2” icon and the “3” icon is set to 22.5 °, and the angle threshold between the “1” icon and the “2” icon is set to 67.5 °. When the transmitted reference tilt angle of the remote control terminal 1 is 61 °, the “2” icon is displayed in a selected state.

  Here, the characteristics of the movement distance of the angle at which the wrist is tilted when selecting the number of the next icon from the number of the icon last selected by the user will be described. The user should think that he is tilting his wrist to the ideal angle corresponding to the currently selected number. For example, when the angle threshold for selecting “3” is −18 ° to 18 ° and the width of the angle for selecting “3” is 36 °, the reference inclination angle of the remote control terminal 1 (inclination of the wrist) If the angle is within the range of the angle, “3” can be selected. However, the user selects “3” on the assumption that the actual angle of the wrist with respect to the horizontal direction is + 2 °. And that the angle of my wrist is 0 ° is the same.

  Next, as shown in FIG. 5, the numbers are arranged at 45 ° intervals, and it can be considered that the user rotates the wrist by the distance of the relative angle. In other words, the user tends to move an N × 45 ° angular distance with reference to the tilt of the wrist that last selected the number in order to select N separated numbers (FIG. 6). To FIG. 8). This is based on the fact that the average value of the amount of movement of tilting the wrist in the case of N = 1 to 3 is close to a multiple of 45 °, from the characteristics of the amount of movement of the wrist shown in FIGS. On the other hand, since there is a limit to the movable range of the wrist, when N = 4 (for example, “1” → “5” or “5” → “1” is selected), the average value is lower than 180 °. (See FIG. 9), an attempt is made to move an angular distance smaller than an N × 45 ° angular distance.

  Therefore, when the last input number is 2, 3, or 4 (in the case of an icon positioned diagonally upward, horizontally, or diagonally downward), N = 4, so N × Since the input character control device 33 tries to move the angular distance of 45 °, the input character control device 33 sets the relative angle interval between the reference inclination angle transmitted from the remote control terminal 1 and the angle threshold value for switching to the adjacent icon described above to N. X45 ° is set, and the reference inclination angle of the remote control terminal 1 transmitted from the remote control terminal 1 when the last input determined icon is selected is added to each of the set relative angle intervals. Then, a plurality of angle thresholds at which the icons are switched are adjusted.

Specifically, for example, each angle threshold value can be adjusted by calculating the angle threshold value AngleTh [I] using Expression (1). As shown in FIG. 10, the angle threshold between “1” and “2” is calculated when I = 0, and the angle between “2” and “3” when I = 1. A threshold is calculated, an angle threshold between “3” and “4” is calculated for I = 2, and an angle threshold between “4” and “5” is calculated for I = 3. Shall be.

  However, BaseAngle indicates the reference inclination angle transmitted from the remote control terminal 1 when the icon determined to be input last is selected, and mOldConsonant indicates the number (2 to 4) of the icon determined to be input last.

  On the other hand, when the last determined number is 1 or 5 (in the case of an icon positioned vertically upward or vertically downward), N = 4, which is smaller than the angular distance of N × 45 °. Since the input character control device 33 tries to move the angular distance, the input character control device 33 sets the angle threshold value for switching from “4” to “5” to “3” when the last input-determined number is “1”. To be close to the angle threshold for switching from “4” to “4”. Conversely, if the last input number is “5”, the angle threshold for switching from “2” to “1” is adjusted to be closer to the angle threshold for switching from “3” to “2”. To do.

Specifically, when the last input number is 1 (when mOldConsonant = 1), the angle threshold corresponding to I = 0, 1, 2 is calculated by the above formula (1). The angle threshold corresponding to I = 3 is calculated using equation (2).

On the other hand, when the last input number is 5 (when mOldConsonant = 5), the angle threshold corresponding to I = 1, 2, 3 is calculated by the above equation (1), but I = 0 The angle threshold corresponding to is calculated using equation (3).

  As a result, it is possible to select a target number according to the operation characteristics of the user tilting his / her wrist, and it is possible to improve the number input accuracy for various users.

  Next, the processing flow of the digital TV 3 will be described. FIG. 11 is a diagram showing an overall processing flow of the digital TV. First, the digital TV 3 performs initial setting of each device (S1), receives the detection information transmitted from the remote control terminal 1 by the signal receiving device 31 (S2), and determines the determination signal and remote control by pressing the determination key. The reference inclination angle of the terminal 1 is distinguished and stored in the signal storage unit 321 (S3). Thereafter, the input character control device 33 selects a character based on the accumulated detection information (inclination angle of the remote control terminal 1) (S4), and the display image control device 34 displays the selected character in an identifiable manner. (S5). Note that S1 is performed only when the digital TV 3 is activated, and each process of S2 to S5 is repeated each time detection information transmitted from the remote control terminal 1 is received.

  Next, the processing flow of the signal receiving device 31 will be described. FIG. 12 is a diagram illustrating a processing flow of the signal receiving apparatus. The signal receiving device 31 sequentially determines whether or not a signal related to the detection information transmitted from the remote control terminal 1 has been received (S11), and when the signal is received, analyzes the content included in the detection information. Then, the determination signal obtained by pressing the determination key, which is the analyzed content, and the reference inclination angle of the remote control terminal 1 are distinguished and stored in the signal storage unit 321 (S12).

  Next, the processing flow of the input character control device 33 will be described. FIG. 13 is a diagram showing a processing flow of the input character control apparatus. The input character control device 33 uses the selection unit 331 to acquire the detection information transmitted from the remote control terminal 1 from the signal storage unit 321 (S21), and determines whether or not a determination signal is received by pressing the determination key. (S22) When the signal is received, the determining unit 332 determines the selected character as an input character (S23).

  Next, the processing flow of the selection unit 331 of the input character control device will be described in detail. FIG. 14 is a diagram illustrating a processing flow of the selection unit. The selection unit 331 obtains an initial value of the angle threshold corresponding to I = 0 to 3 using the above-described equation (1) (S31). Since the digital TV 3 considers the horizontal direction as the home position, 0 ° is substituted for Base Angle to calculate initial values of a plurality of angle thresholds. Next, sensor information (inclination angle of the remote control terminal 1) for detecting the posture of the remote control terminal 1 is acquired from the signal storage unit 321 (S32), and the wrist inclination in the pronation or supination direction is calculated (S32). S33). Thereafter, a number corresponding to the calculated inclination is selected (S34).

  Next, the processing flow for determining the angle threshold in the selection unit 331 will be described in detail. FIG. 15 is a diagram showing a processing flow for determining the angle threshold. If the last input number is not 1 (mOldConsonant = 1) (S41) and further 5 (mOldConsonant = 5) (S42), the angle threshold value is calculated using the above-described equation (1). (S43). On the other hand, if the last input number is 1 (mOldConsonant = 1) (S41), the angle threshold corresponding to I = 0, 1, 2 is calculated by the above equation (1) (S44). , The angle threshold corresponding to I = 3 is calculated using equation (2) (S45). When the last input number is 5 (mOldConsonant = 5) (S42), the angle threshold corresponding to I = 1, 2, 3 is calculated by the above formula (1) (S46). , The angle threshold value corresponding to I = 0 is calculated using equation (3) (S47).

  Next, the processing flow of the determination unit 332 of the input character control device will be described in detail. FIG. 16 is a diagram illustrating a processing flow of the determination unit. When a decision signal is received in a state in which a number is selected, a number to be input is determined by mapping the corresponding number from the character table storage unit 322 (S51), and the input-determined number (mConsonant) is the last. The number determined to be input (mOldConsonant) is set, and the tilt angle (mCurrentAngle) of the remote control terminal 1 at that time is set to the reference tilt angle (BaseAngle) (S52).

  Each time a detection signal transmitted from the remote control terminal 1 is received, the processing flow shown in FIGS. 11 to 16 is repeatedly performed, so that the numerical input accuracy for various users can be improved each time.

  According to the present embodiment, a plurality of icons that are selected and determined by tilting the remote control terminal 1 held on the hand by turning the wrist in the pronation or supination direction are displayed at an angular interval of 45 °. When the input determined icon is selected, the tilt angle of the remote control terminal 1 transmitted from the remote control terminal 1 is received as the reference tilt angle, and one icon selected from the plurality of icons is switched to the adjacent one icon. Each angle threshold value and the relative angle interval between the reference inclination angle of the remote control terminal 1 and the plurality of angle threshold values are stored, and the last received reference inclination angle is added to each of the plurality of angle intervals. Since the plurality of angle threshold values are adjusted, the target icon can be appropriately selected according to the operation characteristics of the user holding the remote control terminal 1 tilting his / her wrist.

  Finally, the digital TV 3 described in each embodiment is configured by a computer, and each process of each functional block is executed by a program. Further, each processing operation of the input information determination device described in each embodiment is recorded as a program on a recording medium such as a compact disk or a floppy (registered trademark) disk, and this recording medium is incorporated into a computer or recorded. A program recorded on a medium can be downloaded to a computer via an arbitrary communication line, or installed from a recording medium, and the computer is operated with the program, thereby causing each processing operation described above to function as the digital TV 3. Of course you can.

1 ... Remote control terminal (input determination device)
DESCRIPTION OF SYMBOLS 11 ... Key state detection part 12 ... Attitude | position detection part 13 ... Microcomputer part 14 ... Transmission part 3 ... Digital TV (display icon control apparatus)
31 ... Signal receiving device (receiving means)
32. Data storage device (storage means)
321 ... Signal storage unit 322 ... Character table storage unit 323 ... Display image data storage unit 324 ... Character conversion dictionary unit 33 ... Input character control device (adjustment means)
331: Selection unit 332 ... Determination unit 34 ... Display image control device (display means)
S1-S5 ... Step S11-S12 ... Step S21-S23 ... Step S31-S34 ... Step S41-S47 ... Step S51-S52 ... Step

Claims (5)

Display means for displaying at a predetermined angular interval a plurality of icons selected and input determined by tilting the input determining device held by the hand by turning the wrist inward or outward;
Receiving means for receiving, as a reference inclination angle, an inclination angle of the input determination device transmitted from the input determination device when the input determined icon is selected;
Each angle threshold at which one icon selected from the plurality of icons is switched to an adjacent icon, and each relative angle interval between the reference inclination angle of the input determining device and the plurality of angle thresholds Storage means for storing;
Adjusting means for reading the plurality of angle intervals from the storage unit and adjusting the plurality of angle thresholds by adding the last received reference inclination angle to each of the plurality of angle intervals;
A display icon control device comprising: The plurality of icons are five icons located in a horizontal direction, a vertically upward direction, a vertically downward direction, a diagonally upward direction, and a diagonally downward direction,
The adjusting means includes
When the icon finally determined to be input is the icon positioned in the vertical upward direction, the angle threshold value for switching from the icon positioned in the diagonally downward direction to the icon positioned in the vertical downward direction is set in the horizontal direction. The display icon control apparatus according to claim 1, wherein the display icon control apparatus approaches an angle threshold value for switching from a positioned icon to the icon positioned obliquely downward. By computer
A first step of displaying at a predetermined angular interval a plurality of icons selected and input determined by tilting the input determination device held by the hand by turning the wrist inward or outward;
A second step of receiving, as a reference tilt angle, a tilt angle of the input determination device transmitted from the input determination device when the input determined icon is selected;
Each angle threshold at which one icon selected from the plurality of icons is switched to an adjacent icon, and each relative angle interval between the reference inclination angle of the input determining device and the plurality of angle thresholds A third step stored in the storage means;
A fourth step of reading the plurality of angle intervals from the storage means and adjusting the plurality of angle thresholds by adding the last received reference inclination angle to the plurality of angle intervals, respectively;
A display icon control method characterized by comprising: The plurality of icons are five icons located in a horizontal direction, a vertically upward direction, a vertically downward direction, a diagonally upward direction, and a diagonally downward direction,
The fourth step includes
When the icon finally determined to be input is an icon positioned in the vertically upward direction, the angle threshold for switching from the icon positioned in the diagonally downward direction to the icon positioned in the vertically downward direction is set in the horizontal direction. The display icon control method according to claim 3, wherein the display icon control method is close to an angle threshold value for switching from a positioned icon to the icon positioned obliquely downward.   5. A display icon control program that causes a computer to execute each step in the display method according to claim 3 or 4.

Images