JP2014063427A - Program for electronic device and electronic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program for an electronic device for performing the operation of the electronic device including a camera such as a mobile phone and a display part displaying a character and a graphic only by the movement of the eyeball of a user and to provide the electronic device.SOLUTION: The electronic device includes a camera 22 imaging the eyeball 20 of the user, a detection part 24 detecting the movement of the eyeball imaged by the camera 22, a display part 26 displaying the character, the graphic, etc., and an operation part 28 performing a previously set operation by the operation of the user. The operation part 28 sequentially displays the characters whose display orders are previously set on the display part 26. When the detection part 24 detects the blink of the eyeball 20 of the user, the operation part 28 performs the previously set operation on the character displayed on the display part 26.

Description

  The present invention relates to an operation of an electronic apparatus including a camera such as a mobile phone and a display unit that displays characters and graphics.

  Most of electronic devices such as mobile phones that are currently popular have a display unit, that is, a display, and a user of the electronic device operates an operation button provided separately while viewing information displayed on the display. Alternatively, an operation desired by the user is performed by operating an operation button displayed on the display.

  However, there are cases where it is difficult for a user who cannot move his / her fingertip due to an obstacle or the like to operate the operation buttons.

  Therefore, for an electronic device equipped with a camera, such as a mobile phone, for a user who is difficult to operate the operation buttons, a method and an electronic device for detecting the movement of the user's eyeball by the camera and operating the electronic device are provided. For example, a portable terminal device as in Patent Document 1 has been proposed.

JP 2007-310815 A

  However, in the case of the portable terminal device of Patent Document 1, since the operation and input of the portable terminal device are performed according to the number of movements of the eyeball, the burden on the user required for the operation and input is large and, for example, input of one character is performed. In addition, since it is necessary to move the eyeball a plurality of times, a considerable amount of time is required to input the text.

  In view of such problems, the present invention reduces the user's labor for conventional operations and inputs, and can quickly operate and input electronic devices as compared with the conventional invention. And an electronic device.

  (1) A program for an electronic device according to the present invention includes a camera that captures an eyeball of a user, a detection unit that detects movement of an eyeball captured by the camera, a display unit that displays characters, graphics, and the like, An electronic device program for controlling an electronic device comprising: an operation unit configured to perform an operation set in advance by a user's operation; and the operation unit sequentially displays characters in a predetermined order to be displayed on the display unit. A step of displaying, and the operation unit includes a step of performing a preset operation on a character displayed on the display unit when the detection unit detects blinking of a user's eyeball. To do.

  (2) The electronic device program according to the present invention is the electronic device program according to (1), wherein the character includes at least two types of character strings, a first character string and a second character string, If the detection unit detects blinking of the user's eyeball when the character of the first character string is displayed on the display unit, the operation unit continues to display the characters after the second character string on the display unit And a step of performing.

  (3) The electronic device program according to the present invention is the electronic device program according to any one of (1) and (2), wherein the detection unit detects a direction of a user's eyeball, and the operation unit Comprises scrolling characters displayed on the display unit in accordance with the direction of the eyeball detected by the detection unit.

  (4) In the electronic device program according to any one of (2) and (3), when the type of the character string displayed on the display unit is changed, The operation unit includes a step of changing a background color of the display unit.

  (5) Further, an electronic device according to the present invention includes a camera that captures an eyeball of a user, a detection unit that detects a movement of the eyeball captured by the camera, a display unit that displays characters, graphics, and the like, An operation unit that sequentially displays characters whose order of display on the display unit is determined in advance, and performs a preset operation on the characters displayed on the display unit when the detection unit detects blinking of the user's eyeball And.

  According to the electronic device program described in (1), the user can sequentially perform predetermined operations such as inputting characters and deleting characters by simply blinking the characters displayed on the display unit. it can.

  According to the electronic device program described in (2), the user can promptly display the desired character on the display unit by changing the character string to be displayed.

  According to the electronic device program described in (3), the user can promptly display a character to be displayed by scrolling according to the direction of the eyeball.

  According to the electronic device program described in (4), the user can easily recognize that the displayed character string has been changed.

  According to the electronic device described in (5), the user can perform an operation such as inputting a character displayed only by blinking the eyeball.

It is a figure which shows schematic structure of the electronic device which can apply the program for electronic devices concerning 1st Embodiment. It is a flowchart which shows the control flow of the program for electronic devices concerning 1st Embodiment. It is a figure which shows the image of the 1st character string and 2nd character string concerning 2nd Embodiment. It is a flowchart which shows the control flow of the program for electronic devices concerning 2nd Embodiment. It is a flowchart which shows the control flow of the program for electronic devices concerning 3rd Embodiment. It is a schematic diagram of direction of a user's eyeball concerning a 3rd embodiment.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. Such an embodiment is merely an example for facilitating understanding of the invention, and does not limit the present invention unless otherwise specified. In the present specification and drawings, elements having substantially the same function and configuration are denoted by the same reference numerals, and redundant description is omitted, and elements not directly related to the present invention are not illustrated. To do.

  (First embodiment)

  FIG. 1 is a schematic configuration diagram showing an electronic device 10 to which the electronic device program according to the first embodiment can be applied, and FIG. 2 is a flowchart showing a control flow of the electronic device program according to the first embodiment.

  The electronic device 10 includes a camera 22 that captures the user's eyeball 20, a detection unit 24 that detects the movement of the eyeball captured by the camera 22, a display unit 26 that displays characters, graphics, and the like, and user operations. Is provided with an operation unit 28 for performing a preset operation.

  The electronic device program applied to the electronic device 10 includes a step of sequentially displaying characters on the display unit 26 in a predetermined order to be displayed by the operation unit 28, and the operation unit 28 causes the detection unit 24 to be displayed by the user. Performing a preset operation on characters displayed on the display unit 26 when the blink of the eyeball 20 is detected.

  Specifically, when the electronic device program is started (S100), the operation unit 28 displays the first character to be displayed on the display unit 26 (S101).

  The character to be displayed first is arbitrarily determined, but for example, “a” of the Japanese syllabary or “A” of the alphabet is preferable so that the user can easily guess the characters sequentially displayed thereafter. The displayed character does not have to be a single character, and may be a character string representing a command such as “conversion”, “confirm”, or “delete one character”.

  Next, when the detection unit 24 detects a blink of the user within a predetermined time (YES in S102), the operation unit 28 performs a predetermined operation on the character displayed on the display unit 26 at that time (S103). ).

  As an example of the operation at this time, in the case of a character such as “A” or “A”, it is “input” of the character, and when a command such as “conversion” is displayed, execution of the command After this operation, this program ends (S105).

  Note that the termination (S105) here means that the processing of this program has been completed once, and in the case of actual character input, a plurality of characters are continuously input. The program is started (S100).

  If the user's blink is not detected by the detection unit 24 within a predetermined time (NO in S102), the operation unit 28 displays the next character to be displayed on the display unit 26.

  For example, when the already displayed character is “A” or “A”, the operation unit 28 displays “I” or “B” instead of the character displayed on the display unit 26.

  As an effect of the present embodiment, since characters are displayed one after another on the display unit 26 of the electronic device 10, the user can input characters, convert them, and perform a simple operation of blinking while the characters are displayed. It becomes possible to execute processing such as confirmation.

  (Second Embodiment)

  FIG. 3 is a diagram showing an image of the first character string 30 and the second character string 32 according to the second embodiment, and FIG. 4 is a flowchart showing a control flow of the electronic device program according to the second embodiment.

  The schematic configuration of an electronic device to which the electronic device program according to the second embodiment is applied is the same as that of the electronic device 10 shown in FIG. 1 described in the first embodiment.

  In the electronic device program according to the second embodiment, the characters displayed on the display unit 26 include at least two types of character strings, the first character string 30 and the second character string 32, and the display unit 26 displays the first character string. When the detection unit 24 detects blinking of the user's eyeball 20 while the character string 30 is displayed, the operation unit 28 is displayed on the display unit 26 according to the blinking of the user's eyeball 20. For the first character string, a predetermined operation (input of displayed characters or the like) is executed, or the characters of the second character string 32 are continuously displayed on the display unit 26.

  Specifically, among the 50-sound hiragana shown in FIG. 3, “Akasana Hamawara”, which is the uppermost row in the horizontal row, is set as the first character string 30 in this order, and is a vertical column that is the first character string. Each of “Iueo” to “N °” without the character is a second character string 32.

  When the electronic device program according to the second embodiment is started (S200), the operation unit 28 displays “A”, which is the first character displayed in the first character string 30, on the display unit 26 (S201).

  When the detection unit 24 detects a blink of the user while “A” is displayed on the display unit 26 for a predetermined time (YES in S202), the detection unit 24 continues to detect a blink of the user within the predetermined time. If the user blinks twice or more within a predetermined time (YES in S204), the operation unit 28 is a character displayed on the display unit 26. A predetermined operation for “a” is executed (S205), and the process ends (S209).

  On the other hand, when the detection unit 24 does not detect the user's blink while the first character string is displayed on the display unit 26 (NO in S202), the operation unit 28 displays the next character to be displayed in the first character string. Is displayed on the display unit 26 (S203).

  Even when the user's blink is detected while “a”, which is the first character displayed in the first character string, is displayed (YES in S202), the detected blink is performed twice within a predetermined time. When no more is detected (NO in S204), the operation unit 28 displays “I” which is the next character to be displayed in the second character string 32 on the display unit 26 (S206).

  If the detection unit 24 detects a blink of the user within a predetermined time (YES in S207), the operation unit 28 performs a predetermined operation on “I” that is a character displayed on the display unit 26. (S205) The process ends (S209).

  On the other hand, when the blink of the user is not detected within the predetermined time (NO in S207), the operation unit 28 displays “U” which is the next character to be displayed in the second character string 32 on the display unit 26 (S208). ).

  As an effect of the present embodiment, the user can first select the first character string 30 and then select from the second character string 32 to quickly display the target character on the display unit 26.

  In the present embodiment, the first character string and the second character string are used. However, the third character string and the subsequent character strings may be set as necessary. In this embodiment, the user performs blinking twice or more within a predetermined time in order to execute a predetermined operation without displaying the second character string on the first character string displayed on the display unit 26. For example, the bag may be closed for a predetermined time.

  As an effect of the present embodiment, the user can promptly display a target character on the display unit 26 by using the first character string and the second character string.

  (Third embodiment)

  The schematic configuration of the electronic device to which the electronic device program according to the third embodiment is applied is the same as that of the electronic device 10 shown in FIG. 1 described in the first embodiment.

  FIG. 5 is a flowchart showing a control flow of the electronic apparatus program according to the third embodiment, and FIG. 6 is a view of the direction of the user's eyeball.

  The difference from the flowchart of FIG. 2 is that S300 and S301 are added between S101 and S102. Only differences from FIG. 2 will be described below.

  After the first character to be displayed on the display unit 26 is displayed on the operation unit 28 (S101), until the user's blink is detected within a predetermined time (S102), the direction of the user's eyeball is detected. If detected at 24 (YES in S300), the operation unit 28 scrolls the characters according to the direction of the user's eyeball (S301).

  When scrolling, as shown at 34 in FIG. 6, for example, when the user's eyeball is facing the front, the scrolling is not performed. Do it. When the eyeball direction is downward as in 34b, the character is scrolled downward. When the eyeball direction is left as in 34c, the character is scrolled to the left, and when the eyeball direction is as 34d. If right, scroll character to the right.

  In this way, when the scroll according to the direction of the user's eyeball is taken in when displaying the character, the user can quickly display the character to be displayed on the display unit 26.

  (Fourth embodiment)

  The schematic configuration of an electronic device to which the electronic device program according to the fourth embodiment is applied is the same as that of the electronic device 10 shown in FIG. 1 described in the first embodiment.

  The electronic device program according to the second embodiment or the third embodiment has at least two character strings of the first character string 30 and the second character string 32.

  In the fourth embodiment, when the type of character string displayed on the display unit 26 changes, the operation unit 28 changes the background color of the display unit 26.

  For example, if the first character string 30 is “Akasata Hamayawa” and the background color when the first character string 30 is displayed is yellow, the second character string 32 is “Iueo”. The background color when the two character string 32 is displayed is green. The background color may also be changed when the displayed character string is a command such as “conversion”, “confirmation”, “delete one character”, or the like.

  Thus, the user can easily recognize that the type of the displayed character string has changed, and can perform a quick and accurate operation.

  (Fifth embodiment)

  Although the present invention has been described as a program for an electronic device from the first embodiment to the fourth embodiment, the present invention is also suitable as an electronic device.

  The schematic configuration of an electronic device to which the electronic device program according to the fifth embodiment is applied is the same as that of the electronic device 10 shown in FIG. 1 described in the first embodiment.

  That is, the electronic apparatus according to the fifth embodiment includes a camera 22 that captures the user's eyeball 20, a detection unit 24 that detects the movement of the eyeball captured by the camera 22, and a display unit that displays characters, graphics, and the like. 26 and a character whose display order is predetermined on the display unit 26 are sequentially displayed, and the character displayed on the display unit 26 when the detection unit 24 detects blinking of the user's eyeball 20 is set in advance. And an operation unit 28 for performing an operation. The character here does not need to be a single character, as in the first embodiment, and may be a character string representing a command such as “conversion”, “confirm”, “delete one character”, for example.

  The electronic device according to the present embodiment performs preset operations such as character input, conversion, confirmation, and single character deletion only by an operation in which the user blinks while the character is displayed on the display unit 26. Is possible.

  The preferred embodiments of the present invention have been described above with reference to the accompanying drawings.

  It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  The present invention can be used for operation of an electronic apparatus including a camera such as a mobile phone and a display unit that displays characters and graphics.

10: electronic device, 20: user's eyeball, 22: camera, 24: detection unit, 26 display unit, 28: operation unit, 30: first character string, 32: second character string, 34: user eyeball Direction, 34a-34d: Direction of the user's eyeball

Claims (5)

A camera that images the user's eyeball;
A detection unit for detecting the movement of the eyeball imaged by the camera;
A display unit for displaying characters and figures,
An operation unit for performing a preset operation by a user's operation;
In an electronic device program for controlling an electronic device comprising:
The operation unit sequentially displays characters on the display unit in a predetermined display order;
The operation unit performs a preset operation on characters displayed on the display unit when the detection unit detects blinking of a user's eyeball;
A program for an electronic device comprising: The character is composed of at least two character strings of a first character string and a second character string,
When the detection unit detects blinking of the user's eyeball when the character of the first character string is displayed on the display unit, the operation unit continues to display the characters after the second character string on the display unit. Steps to display;
The electronic device program according to claim 1, further comprising: The detection unit detects a direction of a user's eyeball, and the operation unit scrolls characters displayed on the display unit according to the direction of the eyeball detected by the detection unit;
The electronic device program according to claim 1, further comprising: When the type of the character string displayed on the display unit is changed, the operation unit changes a background color of the display unit;
The electronic device program according to claim 2, further comprising: A camera that images the user's eyeball;
A detection unit for detecting the movement of the eyeball imaged by the camera;
A display unit for displaying characters and figures,
An operation of sequentially displaying characters whose display order is determined in advance on the display unit, and performing a preset operation on the characters displayed on the display unit when the detection unit detects blinking of the user's eyeball And
An electronic device comprising:

Images