KR20160148567A - Electronic device set system including input-assisting deviced and electronic device for processing input using same - Google Patents

Electronic device set system including input-assisting deviced and electronic device for processing input using same Download PDF

Info

Publication number
KR20160148567A
KR20160148567A KR1020167031030A KR20167031030A KR20160148567A KR 20160148567 A KR20160148567 A KR 20160148567A KR 1020167031030 A KR1020167031030 A KR 1020167031030A KR 20167031030 A KR20167031030 A KR 20167031030A KR 20160148567 A KR20160148567 A KR 20160148567A
Authority
KR
South Korea
Prior art keywords
input
electronic device
unit
gesture
menu
Prior art date
Application number
KR1020167031030A
Other languages
Korean (ko)
Inventor
손동현
조한울참
이호찬
우수지
장수진
Original Assignee
손동현
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 손동현 filed Critical 손동현
Priority to PCT/KR2014/003624 priority Critical patent/WO2015163500A1/en
Publication of KR20160148567A publication Critical patent/KR20160148567A/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/018Input/output arrangements for oriental characters
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/0202Constructional details or processes of manufacture of the input device
    • G06F3/0219Special purpose keyboards
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233Character input methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/003Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers; Analogous equipment at exchanges
    • H04M1/72Substation extension arrangements; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selecting
    • H04M1/725Cordless telephones
    • H04M1/72519Portable communication terminals with improved user interface to control a main telephone operation mode or to indicate the communication status
    • H04M1/72522With means for supporting locally a plurality of applications to increase the functionality

Abstract

The present invention provides an electronic device including an input auxiliary device including a gesture input part for inputting a gesture and a code input part for inputting a code, and a gesture input receiving part for receiving the gesture input and a code input receiving part for receiving the code input. And an electronic device set device including the electronic device.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device set device including an input auxiliary device and an electronic device for processing input using the input auxiliary device,

The present invention relates to an electronic device set device including an input auxiliary device and an interface for processing input of the input auxiliary device. And more particularly to a smart phone including a smart phone cover and an interface for processing the input of the smartphone cover.

The display screen of the smartphone is made of glass and can easily break when falling on the floor or colliding with other objects. Thus, a smartphone cover has appeared to protect the glass of the smartphone. The smartphone cover can make various products with different color, material and shape at a lower cost than the smartphone. It is possible to easily change the expensive appearance of the smartphone which can be monotonous by using the smartphone cover. In addition, the smartphone cover can insert a business card or a card as an additional function. As the use of smartphone covers has increased in recent years, the demand for these additional functions is increasing.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an input assisting device which enables a gesture input and a code input to be performed without looking at eyes.

SUMMARY OF THE INVENTION An object of the present invention is to provide an electronic device including an interface for processing a gesture input, a motion input, or a code input.

An object of the present invention is to provide an electronic device set device including an input auxiliary device that can operate without being seen by eyes and an electronic device for processing the input.

According to an aspect of the present invention, there is provided an electronic device setting apparatus including an input auxiliary device including a gesture input part for inputting a gesture and a code input part for inputting a code, and a gesture input And an electronic device including a receiving unit and a code input receiving unit for receiving the code input.

According to an embodiment according to the inventive concept, the electronic device is a smart phone or a game machine or a remote controller or a calculator or a Tablet PC.

According to an embodiment of the present invention, the code input unit includes a braille input unit for inputting braille characters.

According to an embodiment of the present invention, the braille input unit includes a rubber material or a sponge material including a silicone material or a rubber material or a metal.

According to an embodiment of the present invention, the sign input unit includes a Hangul input unit for Hangul input, a numeral input unit for numeric input, or an English input unit for English input.

According to an embodiment of the present invention, the Hangul input unit, the numeral input unit or the English input unit include a rubber material or a sponge material including a silicone material or a rubber material or metal.

According to an embodiment of the present invention, the electronic device includes a touch display unit including the input receiving unit and a voice output unit for voicing the gesture input or the code input.

According to an embodiment of the present invention, the gesture input selects an upper menu according to a horizontal direction gesture, and selects a lower menu according to a vertical direction touch.

According to an embodiment in accordance with the inventive concept, the parent menu is a message-related menu or a weather guide menu or a current time menu or location information menu, or a current date menu or a calculator menu or a telephone-related menu.

According to an embodiment of the present invention, the submenu is a message transmission menu or a message storage menu according to the menu selection related to the upper message.

According to an embodiment according to the concept of the present invention, the electronic device includes a braille / character conversion unit for converting the Braille input into Hangul or English or Japanese, or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi.

According to an embodiment of the present invention, the braille / character conversion unit refers to a hash table and converts the hash table.

According to the embodiment of the present invention, the material of the gesture input part and the material of the code input part are the same.

According to an aspect of the present invention, there is provided an input assistance apparatus including a gesture input unit for inputting a gesture and a code input unit for inputting a code, wherein the gesture input unit and the code input unit are located at different positions .

According to an embodiment in accordance with the inventive concept, the input assistance device is a smartphone cover.

According to an embodiment of the present invention, the code input unit includes a braille input unit for inputting braille characters.

According to an embodiment of the present invention, the braille input unit includes a rubber material or a sponge material including a silicone material or rubber or metal.

According to an embodiment of the present invention, the sign input unit includes a Hangul input unit for Hangul input, a numeral input unit for numeric input, or an English input unit for English input.

According to an embodiment of the present invention, the Hangul input unit, the numeral input unit or the English input unit include a rubber material or a sponge material including a silicone material or a rubber material or metal.

According to an aspect of the present invention, a smartphone cover includes a braille input unit including at least six braille input buttons or holes at different positions for braille inputting.

According to an embodiment of the present invention, the apparatus further includes a code input unit including at least one code input button or a hole for code input.

According to an aspect of the present invention, there is provided an electronic device including a gesture input receiving unit for receiving a gesture input and a touch display unit having a code input receiving unit for receiving a code input, The code input receiving unit is located at different positions of the touch display unit.

According to an embodiment according to the inventive concept, the electronic device is a smart phone or a game machine or a remote controller or a calculator or a tablet PC.

According to an embodiment of the present invention, the electronic device further includes a voice output unit for voicing the gesture input and the code input.

According to an embodiment of the present invention, the gesture input selects an upper menu according to a horizontal direction gesture and a lower menu according to a vertical direction gesture.

According to an embodiment in accordance with the inventive concept, the parent menu is a message-related menu or a weather guide menu or a current time menu or location information menu, or a current date menu or a calculator menu or a telephone-related menu.

According to the embodiment of the present invention, according to the upper message transmission menu selection, it is a message transmission menu or a message storage menu.

According to an embodiment according to the concept of the present invention, the electronic device further comprises a braille / character conversion section for converting the Braille input into Hangul or English or Japanese, or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi characters .

According to the embodiment of the present invention, the braille / character conversion apparatus refers to the hash table and converts the hash table.

According to an aspect of the present invention, an electronic device includes a motion sensor for selecting an upper menu according to a horizontal motion and a lower menu according to a vertical motion.

According to an embodiment according to the inventive concept, the electronic device is a smart phone or a game machine or a remote controller or a calculator or a tablet PC.

According to an embodiment of the concept of the present invention, the motion sensor selects the upper menu in accordance with the vertical motion and the lower menu in the horizontal motion.

1 is an electronic device setting apparatus according to an embodiment of the present invention.
2 is an apparatus for setting an electronic device for braille input according to an embodiment of the present invention.
FIG. 3A is an electronic device setting apparatus for smartphone keyboard input according to an embodiment of the present invention.
3B is an electronic device set device for inputting a Qwerty keyboard according to an embodiment of the present invention.
4A-4F are various input aids according to an embodiment of the present invention.
5A and 5B are cross-sectional views of an input assist device for braille input according to an embodiment of the present invention.
6A and 6B are electronic devices showing a gesture input according to an embodiment of the present invention.
7 is a conceptual diagram illustrating horizontal and vertical menu selections according to an embodiment of the present invention.
8 is another conceptual diagram showing horizontal and vertical menu selection according to an embodiment of the present invention.
9 is another conceptual diagram showing horizontal and vertical menu selections according to an embodiment of the present invention.
10 is a table showing shortcut gesture inputs according to an embodiment of the present invention.
11A to 11B are electronic devices showing motion inputs according to an embodiment of the present invention.
12A is a Tablet PC showing a gesture input according to an embodiment of the present invention.
12B is a tablet PC showing a motion input according to an embodiment of the present invention.
13A to 13B are remocon showing a gesture input and a motion input according to an embodiment of the present invention.
14 is a conceptual diagram for processing a gesture input and a sign input according to an embodiment of the present invention.
15 is a hash table for Hangul conversion of Braille characters according to an embodiment of the present invention.
16 is a method of operating an electronic device for selecting horizontal and vertical menus according to an embodiment of the present invention.
17 is a method of operating an electronic device for booting according to an embodiment of the present invention.
18 is a method of operating an electronic device for braille input conversion according to an embodiment of the present invention.
19 is a method of operating an electronic device for selecting a telephone number according to an embodiment of the present invention.
20A to 20B are electronic device setting apparatuses for a game according to an embodiment of the present invention.
21 is a method of manufacturing an input auxiliary device according to an embodiment of the present invention.

The present invention relates to an electronic device set device including an input auxiliary device and an electronic device for processing input using the input auxiliary device.

Referring to FIG. 1, an electronic device set device 10 includes an input auxiliary device 100 and an electronic device 200. The input assistance device 100 may be a smart phone cover, and the electronic device 200 may be a smart phone. The input assistant device 100 includes a gesture input unit 110 and a code input unit 120. The gesture input 110 and the code input unit 120 are located in different positions in the input assistant device 100 so as not to overlap each other. The input assistant device 100 includes a home button input unit 195 for inputting a home button 295 of the smart phone 200. The groove button may be a hole. Also, it may be included in the code input unit 120. The input assistant device 100 includes a motion input sensor hole 194 for inputting a motion motion, a voice output hole 190 for transmitting an output voice, an image sensor hole 191 for photographing, An illuminance sensor hole 192 for sensing the brightness of light, and a temperature sensor hole 193 for sensing the temperature. The electronic device 200 includes a gesture input receiving unit 210 and a code input receiving unit 220. The gesture input receiving unit 210 and the code input receiving unit 220 are positioned so as not to overlap each other in the electronic device 200. The electronic device 200 includes a home button 295, a motion sensor 294, a speaker 290, an image sensor 291, an illuminance sensor 292, a temperature sensor 293, and a touch display unit 235 do. The input auxiliary device 100 and the electronic device 200 are connected by a connection unit 150. The connection unit 150 may electrically connect the electronic device 200 and the code input unit 120 of the input assistance device 100, including an electrical material or a circuit line. The gesture input unit 110 and the gesture input receiving unit 210 are located at the same position and the code input unit 120 and the sign input The receiving unit 220 is also located at the same position. The gesture input unit 110 may include a hole or a rubber material or a sponge material containing a silicone material, a rubber material, or a metallic material. The materials are materials for facilitating the input of the gesture, and may include any material capable of touch input without being limited to the materials.

Referring to FIG. 2, the code input unit 120 of the input assistant device 100 is shown in detail. The code input unit 120 includes six braille input units 124, 125, 126, 127, 128 and 129 for braille input and function input units 121, 122, 123, 130 and 131 for function input . The home button may also be included in the code input unit 120. The braille input button 124 and the function input unit 121 may include a braille character 133 to easily recognize the meaning and position of the input units. The electronic device 200 includes a sign input receiving unit 220. The code input receiving unit 220 includes six braille input receiving units 224, 225, 226, 227, 228 and 229 and functional input receiving units 221, 222, 223, 230 and 231. The braille input receiving units 221, 222, 223, 230, and 231 may be formed in a circle. The function input receiving units 221, 222, 223, 230, and 231 are provided with a character input receiving unit 221, a pair input receiving unit 222, a rewrite input receiving unit 223, An input receiving unit 230 and a confirmation input receiving unit 231, and may be formed in a rectangular shape. When the input auxiliary device 100 is positioned on the electronic device 200, the braille input units 124, 125, 126, 127, 128, and 129 and the braille input receiving units 221, 222, 223, 230, and 231 are located at the same position.

Referring to FIG. 3A, the input assistance device 101 includes a gesture input unit 110 and a code input unit 140. The code input unit 140 includes smart phone keyboard input units 141 for inputting characters, numbers, and symbols of a smartphone. The electronic device 201 includes a code input receiving unit 240 including a gesture input receiving unit 210 and smartphone keyboard input receiving units 241 and is located at different positions of the touch display unit 235. When the smartphone keyboard input units 141 of the code input unit 140 are overlaid on the electronic device 201 to input a smartphone keyboard, the smartphone keyboard input units 141 of the electronic device 201 Position. The smartphone keyboard input result is also output as a voice. The visually impaired can immediately know what type of keyboard he / she has entered. When the blind person becomes used to the input assistance device 101, only the electronic device 201 can be used without using the input assistance device 101. [

Referring to FIG. 3B, the code input unit 150 of the input assistant device 102 includes Qwerty keyboard input units 151. The code input receiving unit 250 of the electronic device 202 includes QWERTY input receiving units 251. [

4A-4F, there are various input aids according to an embodiment of the present invention. 4A shows an input auxiliary device 103 including a gesture input unit, a menu selection input unit, and a braille input unit, which are located at different positions. The gesture input unit is located above the auxiliary input device 103 and the menu selection input unit is located between the gesture input unit and the braille input unit. The menu selection input includes settings, weather, calculator, radio, music, phone and current location and internet and clock menus. The braille input unit includes six braille input units, a clock input unit, and a confirmation input unit. Referring to FIG. 4B, the braille input unit of the input assist device 104 of FIG. 4B is located between the gesture input unit and the menu selection input unit. Referring to FIG. 4C, the input auxiliary device 105 includes a first menu selection input unit, a braille input unit, and a second menu selection input unit. The braille input unit is located between the first menu selection input unit and the second menu selection input unit. Referring to FIG. 4D, the input auxiliary device 106 includes a braille input unit, a menu selection input unit, and a gesture input unit. The braille input unit of the input assistant device 100 is located at an upper position, and the braille input unit of the input assistant device 100 is located at a lower position in order of the menu selection input unit and the gesture input unit. The braille input unit includes braille input units, and each braille input unit has a display for recognizing each meaning. For example, braille can be displayed for blind people. Various displays including a square, a triangle, and a circle can be displayed on each of the menu selection input units so that each function can be recognized only by the feeling of a finger. As a result, menu selection or braille input is possible only by the feeling of the finger without looking at the eyes. Referring to FIG. 4E, the input auxiliary device 107 includes a first braille input unit, a second braille input unit, and a menu selection input unit. The first braille input unit includes three braille input units, and the second braille input unit includes three braille input units different from the first braille input unit. When a blind person inputs a braille character, the first braille input unit can be input with a finger of the right hand and the second braille input unit can be input using a finger of the left hand. The menu selection input unit is located between the first braille input unit and the second braille input unit. Referring to FIG. 4F, the input auxiliary device set 13 includes an input auxiliary device 108 and an electronic auxiliary device 108-1. The input auxiliary device 108 includes a menu selection input unit, a braille input unit, and a gesture input unit for gesture input. The electronic device auxiliary device 108-1 may include concave or convex guides 108-2. It helps to know the code input position when inputting the electronic device. For example, when an input for driving a calculator is displayed on the touch display unit of the electronic device, the finger of the user holding the electronic device is located in the concave or convex guides, You can find the input position of the calculator in the hand without the magazine.

5A to FIG. 5C, FIG. 5A is a view of FIG. 2 rotated 90 degrees to the left. Referring to FIG. 5B, there is shown a sectional view from A to B of the input assistance device 100 of FIG. The sectional view of the input assistant device 100 shows the front surface F and the back surface R and shows a cross section of the braille input units 127, 128 and 129. The braille input unit 127 includes braille characters 127-1 and 127-2 for recognizing the position and the position of the braille input button. The braille input unit 127 includes a conductive material. In addition, it may include a rubber material or a sponge material or a plastic material including a silicone material or a rubber material or a conductive material. The gesture input 110 of the input assistance device may include an empty space or a thin transparent plastic material 111. The braille input units 127, 128, and 129 may include the same materials as those included in the braille input units 127, The shoulder A of the disk 135 of the input assistant device 100 may be made to be 2 mm or less as a shoulder between the front surface F and the front surface R. [ The shoulder B is the length from the front face F of the input assistant device 100 to the longest protruding braille. The shoulder C is a length from the surface of the braille input units 127, 128, and 129 to the braille protruding the longest. The shoulder B may be larger than the shoulder A in order to identify the braille input portions 127, 128 and 129 with only the feeling of a finger. However, when the discrimination power increases, the difference between the shoulder B and the shoulder C can be made almost equal to or less than zero. 5C, another cross-sectional view of the input assistance device 100 is shown. The cross section of the input device 100 includes an input auxiliary device plate 135, a gesture input unit 110, and braille input units 127, 128, and 19. The gesture input unit 110 may include a conductive material including a metal for gesture input. In addition, it may include a rubber material or a sponge material or a plastic material including a silicone material or a rubber material or a conductive material. The shoulder A is the shoulder of the input auxiliary device disk 135. The shoulder D is a length from the rear surface R of the input assist device to the longest braille of the braille input units 127, 128, and 129. The shoulder A and the shoulder D may be the same or smaller when the braille input portion is formed into a groove shape. Instead of braille, you can make various shapes such as square, star, triangle and so on. The difference between the shoulder B and the shoulder A may be less than 1 mm. When the visually impaired users use the input assist device of less than 1 mm in height, it becomes difficult to visually distinguish from the input assist device of other general users. The materials of the gesture input unit 110 and the code input units 127a, 128a, and 129a may be made of the same material. The gesture input unit 110 and the code input units 127a, 128a, and 129a may transmit an input to an electronic device by touching and operate by a "TAP" gesture.

Referring to FIG. 6A, the electronic device 201 includes a code input receiving unit 240 including a gesture input receiving unit 210 and a smartphone key inputting unit. The gesture input receiving unit 210 may receive a horizontal direction gesture input and a vertical direction gesture input. The horizontal direction gesture input may be performed by closely contacting an object having a finger or electricity with the gesture input receiving unit in a horizontal direction, dragging the object for a predetermined time, and then stopping the close contact.

Referring to FIG. 6B, the electronic device 200 includes a code input receiving unit 240 including a gesture input receiving unit 210 and a braille input receiving unit. The touch input receiving unit 210 may receive a horizontal direction gesture input and a vertical direction gesture input.

Referring to FIG. 7, the upper and lower menus are selected through the horizontal direction gesture and the vertical direction gesture input of the electronic device 201 of FIG. 6A and the touch input unit 210 of the electronic device 200 of FIG. 6B . And one of the upper menus 1-0, 2-0, 3-0, 4-0, 5-0, 6-0 is selected by the horizontal direction gesture input. When the horizontal direction gesture is inputted from the right side to the left side in the upper menu 5-0, the upper menu 1-0 can be selected by moving to the upper menu 6-0 and again entering the horizontal direction gesture from the right side to the left side. After selecting the upper menu 2-0, the lower menus 2-1, 2-2, and 2-3 may be selected by the vertical direction gesture input. When a vertical gesture input from the top to the bottom in the top menu (2-0) is performed, the submenu 2-1 is selected. Repeat this to select Menu 2-2. If it is repeated again, it moves to the upper menu (2-0). The upper menu and the lower menu may be displayed on the gesture input receiving unit 210 on the touch display unit of the electronic device 200. When the user inputs the horizontal direction gesture from left to right after selecting the submenus 2-1 or 2-2, the user directly moves (A, B) to the upper menu 3-0, can do. 7, the upper menu can be selected by the vertical direction gesture input and the lower menu can be selected by the horizontal direction gesture input, as opposed to the present embodiment.

Referring to FIG. 8, FIG. 7 shows a specific embodiment of the present invention. The top menu includes directions, music, calculator, phone, current time and message, weather and my location, internet, calendar and app selection. The upper menu may further include a setting menu and a radio menu for setting the electronic device. The upper menu may be selected by a horizontal direction gesture input. After selecting the message menu, which is the upper menu, the user can select the message transmission, message reading, message storage, and message search menu, which are submenus, by the input of the horizontal direction gesture. If a horizontal gesture is input from right to left or from left to right after selecting one of the submenus, the user can directly go to the current time menu or the weather menu. The upper menus and the lower menus may be displayed on the gesture input receiving unit 210 of the electronic device 200 in all or a part of the area. If the horizontal direction gesture input is continued in the same direction after selecting the application selection menu which is the upper menu, the user can go to the guidance menu. Also, if you select the message save menu, which is a submenu, and enter a vertical direction gesture from top to bottom, you can go to the message search menu. The selected top menu or submenu can be executed via the Tap Gesture input. When the horizontal or vertical gesture stops for a predetermined time, the selected menus are judged to be a selected menu and output the stored voice of the menu. The menu selected by the voice can be recognized.

9, an interface method for selecting upper and lower menus by horizontal and vertical gesture input is performed by selecting one of a plurality of applications (Applications, App 1, ..., App 16) on the electronic device 200 Can be used. For example, after selecting App 6, App 5 and App 7 can be selected via the horizontal gesture. In addition, the user can select the app 2 and the app 10 through the vertical direction gesture input. The app screen may be composed of at least two apps. For example, the app 1 and the app 2 can be simultaneously displayed in the single gesture input receiving unit 210. The horizontal and vertical gesture input may also be used when selecting group apps including a plurality of apps.

Referring to FIG. 10A, a gesture input input through the gesture input receiving unit 210 of the electronic device 200 of FIGS. 6A to 6B can immediately select and execute a corresponding menu. Referring to the table of FIG. 10A, it is possible to display the current menu, the current time, the current time, the phone, the message, the weather, my location, the Internet, the calendar and the app selection and setting menu according to the shortcut gesture type of the table. You can choose. The shortcut gesture type is a type 1 (1,2,3,4,5,6,7,8,9,10,11,12) and type 2 (a, b, c, d, e, f, g, h, i) and type 3 (♡, C, A, ♪, □, ○, P, M, W, +, ☆, C, A). If the letters or shapes of the type 1, the type 2 and the type 3 are drawn using a pen with a finger or electricity as it is, the menu corresponding to the table of FIG. 10 can be moved and executed. For example, if the number "2 " is touched with the gesture input receiving unit of the electronic device and is drawn, the user can move to the guidance menu and execute it. As shown in FIG. 10B, when a character including Hangul, English, a number, and a special character is input in the same way as a character is written, it can be converted into the same character as the inputted character. The shortcut gesture is converted into voice and output almost simultaneously with its input.

Referring to FIGS. 11A and 11B, the electronic devices 200 and 201 include a smartphone keyboard input receiving unit or a braille input receiving unit and a motion sensor 194. The motion sensor 194 can sense motion in the horizontal and vertical directions of a hand gesture or object. When the motion detection mode of the electronic device is set, the upper menu is selected by the horizontal motion as in the menu selection of FIG. 8 without receiving the gesture input of the gesture input receiving unit 210, The submenu can be selected by motion. The upper or lower menu can be selected as a stop motion or "perfect" sound of the human hand. The directions of the horizontal and vertical motions and the directions of the upper and lower menu movements are the same with respect to the screen of the gesture input receiving unit 201. For example, if you move your hand up and down in a vertical motion, the submenus move from bottom to top.

Referring to FIG. 12A, the electronic device 300 is a tablet PC including a large-screen touch display 310 for receiving a gesture input. The upper menu is selected through the horizontal direction gesture input on the tablet PC, and the lower menu is selected through the vertical direction gesture input. The opposite is also possible. Referring to FIG. 12B, the electronic device 300 includes a motion sensor 394 and a large-screen touch display 310 for receiving a gesture input. The motion sensor selects an upper menu by horizontal motion and a lower menu by vertical motion. The opposite is also possible.

13A, the electronic device 400 includes a display on / off switch 410, a satellite broadcast or internet on / off switch 420, operation buttons 430, and a gesture input receiving unit 440. The gesture input receiving unit 440 selects an upper menu by a horizontal direction gesture input and a lower menu by a vertical direction gesture input. The opposite is also possible. Referring to FIG. 13B, the electronic device 400 of FIG. 13A further includes a motion sensor 494. The motion sensor 494 senses a horizontal motion and can select a higher menu of a display screen such as a TV, and can detect a vertical motion to select a lower menu. The opposite is also possible.

Referring to FIG. 14, the electronic device 200 of FIG. 2 is a system for gesture input and code input processing of the input assistant device 100. The electronic device 200 includes a gesture input receiving unit 510, a gesture input identifying unit 511, a gesture processing unit 513, an operation processing control unit 520, a memory 530, (550) and a code / Hangul transmission unit (560). The gesture input is transmitted to a gesture input receiving unit 510. The gesture input identifying unit 521 converts various gesture inputs including a horizontal or vertical direction gesture into a digital signal and notifies the operation control unit 520 of the digital signal. The operation processing control unit 520 determines whether to output a screen or a message or voice stored in the memory 530 according to the digital signal. The operation processing control unit 520 may be a CPU or an AP. The gesture processing unit 513 includes a gesture / Hangul conversion unit 524. The gesture / code conversion unit 514 refers to the memory 530 by the digital signal of the gesture input identification unit 511 and the gesture / code conversion unit 514 converts the input gesture into a character including a letter, . The converted code is converted into a voice by the voice conversion unit 540 and output by the voice output unit 550. [ On the other hand, the code converted in the gesture input is transmitted as a message by the code / Hangul transmission unit 560. The electronic device 200 includes a sign input identification unit 571 and a Braille / Hangul conversion unit 574 including a sign input reception unit 570 and a braille input identification unit 572, And a sign processing unit 573. The code input receiving unit 570 may receive input or output of Korean or English or Japanese, or German or Chinese or Spanish, or Portuguese or Russian, or Hebrew or Hindi. You can also use numbers (1,2, ...) and special characters (@, #, #, $,%, ^, & ,, *, (,), The character input identifying unit 571 may further include a character input identifying unit and a special character identifying unit for identifying the character, the number, and the special character The braille input identifying unit 572 of the code input identifying unit 571 converts the digital signal into a digital signal and transfers the result to the operation processing control unit 520 and the code processing unit 573. The code The processing unit 573 includes a Braille-Hangul conversion unit 574 and refers to the hash table 531 of the memory 530 and converts the applied braille into Hangul. The result is supplied to the speech converting unit 540 And after voice conversion, the voice is output by the voice output unit 550. The gesture input and the code input can be processed by the operation processing control unit 520 at the same time.

Referring to FIG. 15, the hash table 531 of FIG. 14 is shown. In the hash table 531, one of six braille combinations corresponds to a consonant, a neutral vowel, and a consonant consonant. There is a limitation that one-to-one correspondence can not be made due to the characteristics of Braille and Hangul. In case of inputting Korean consonants with one of 6 braille combinations, it is necessary to distinguish between the beginning and end of Hangul. In addition, when a Korean vowel is input, it is necessary to distinguish a short vowel and a pair vowel. The hash table 531 can convert braille characters to Korean characters using a hash table for distinguishing between Korean characters and neutral characters corresponding to each braille character. The hash table 531 shows horizontal addresses (1, 2, ..., 23) and vertical addresses (1,2, ..., 6). For example, when the vertical address is 1 and the horizontal address is 1, the input of the braille "a" can be recognized as "a" of the Hangul character and converted. The discrimination between the initial value of the braille input and the longitudinality can be determined as a sequence from the input of the first input of the confirmation input receiving unit 231 of FIG. 2 to the input of the next confirmation button. After inputting the Korean alphabetic characters, the Korean alphabet received by the input of the confirmation input receiving unit 231 can be confirmed by voice. The "second" of the hash table means the beginning, and the "mother" means the vowel. The configuration of the hash table can be made in other combinations. The hash table can be used to convert Braille characters to English or Japanese or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi.

Referring to FIG. 16, the operation method of the electronic device 200 of FIG. 2 is described. The electronic device 200 may include a step 610 of receiving a horizontal motion by a gesture input receiving unit or a horizontal motion by a motion sensor and a step 610 by a gesture input identifying unit to perform horizontal motion by the horizontal direction gesture or the motion sensor (630) of selecting an upper menu corresponding to the horizontal direction motion by the horizontal direction gesture or the motion sensor by an operation processing control unit (630); and a step (630) of selecting a vertical direction gesture or a vertical direction gesture by the gesture input receiving unit A step (640) of receiving a vertical motion by a motion sensor and a step (650) of recognizing the vertical motion by the vertical direction gesture or the motion sensor by the gesture input receiving unit (650) A vertical direction gesture or a submenu corresponding to the vertical motion And a system (660).

17, the electronic device 200 includes a step 710 of booting an electronic device, a step 720 of automatically executing a program for a visually impaired person by the electronic device, and a step 720 of executing a general program by the electronic device (730) of holding an active state or an active state, and selecting (740) upper and lower menus by recognizing horizontal and vertical gestures or horizontal and vertical motions by an operation processing control unit of the electronic apparatus.

Referring to FIG. 18, this is another method of operation of the electronic device 200. A step 810 of receiving the braille by the braille input receiving unit of the electronic device 200 and a step 820 of converting the braille input into Hangul or English by the code processing unit 820, A step 830 of converting English into speech and a step 840 of outputting the converted speech signal by voice.

Referring to FIG. 19, the telephone number of the electronic device 200 is selected. First, the first letter (A, B, ..., Z) of the first name (A, B, ..., H) or the English name is selected as the upper menu by the gesture or the motion 950 in the horizontal direction . The selected characters of the selected Hangul initial or English can be displayed on the gesture input receiving units 901, 902, 903, ..., 90n. Next, the names 921, 922, ..., 927 of the person to be called with the vertical gesture or motion 960 can be selected as the submenu. After selecting the submenu, you can call tap gesture. For example, " A "or" A "may first be selected by the horizontal direction gesture or motion input, and" Amy "may be selected by vertical direction gesture or motion input. For example, when the current selection is the gesture input receiving unit 902, the finger 950 is closely contacted with the gesture input receiving unit 902 in the first horizontal touch direction (950-2, right to left) And then moves to the gesture input receiving unit 903 according to the menu moving direction 950-4. The finger 950 is moved close to the gesture input receiving unit 902 in the second horizontal touch direction 950-1 and left to right to move the finger 950 by a predetermined distance and then separated. In accordance with the menu movement direction 950-3, And moves to the gesture input receiving unit 901. The first horizontal touch direction (950-2, right to left) and the second horizontal touch direction (950-1, left to right), which are the horizontal direction gestures, are the movement directions (950-4, 950- 3). When a sub menu is selected after the gesture input receiving unit 901 is selected, the finger 960 is brought into close contact with the gesture input receiving unit 901 in the first vertical touch direction 960-2 When the distance is moved and separated, the sub menu "steel number" 921 is selected. In addition, when the finger 960 is brought into close contact with the gesture input receiving section 901 in the second vertical touch direction 960-1 (upper and lower) and separated after moving a certain distance, the lower menu " Is selected. The first vertical touch of the vertical direction gesture and the second vertical touch input direction are opposite to the movement directions of the submenu 960-3 and 960-4. The vertical and horizontal touch directions and the upper and lower menu movement directions are the same as the upper or lower menu displayed on the gesture input receiving unit 902 of the electronic device 200. The relationship between the horizontal and vertical touch directions and the moving directions of the upper and lower menus can be relatively viewed according to the reference.

Referring to Figs. 20A and 20B, the electronic device set device 30 includes an input auxiliary device 105 and an electronic device 203. Fig. The input auxiliary device 105 includes a first operation input unit 150 for inputting the electronic device 203, a second operation input unit 151, a function input button unit 153 for setting, a gesture input, And a gesture input / screen display unit 155 for viewing a screen of the device 203. The electronic device 203 includes a first operation input receiving unit 250, a second operation input receiving unit 251, a function input button receiving unit 253, a gesture input receiving unit, and a screen display output unit 255. The input units 150, 151, 153, and 155 of the input assistance device 105 are located at different positions in the input assistance device 105, respectively. The input receiving units 250, 251, 253, and 255 of the electronic device 203 are located at different positions in the electronic device 203. When the input auxiliary device 105 is positioned on the electronic device 203, the respective input portions and the input receiving portions are located at the same position. For example, the position of the first operation input unit 150 is substantially the same as that of the first operation input receiving unit 250. The inputs of the input assistance device 105 may be used as an input aid for game operations. In addition, the input receivers of the electronic device 203 may be used for input processing for a game. 20A, the electronic device setting apparatus 30 of FIG. 20A includes a gesture input unit and a screen display input unit 154, a third operation input unit 152, a fourth operation input unit 158, And an input auxiliary device 105 including a plurality of input devices 157 and 157-1. The third operation input unit 150 is located directly under the spurge output unit 159 due to the larger-sized gesture input unit and the screen display input unit 156. [ 20B has a larger size gesture input unit, a screen display input receiving unit 256, a third operation input receiving unit 251, a fourth operation input receiving unit 250, a motion sensor 257 (Not shown). When the input assistance device 105 and the electronic device 203 are turned on, the positions of the input portions of the input assistance device 105 and the reception portions of the electronic device 203 are almost equal to each other. The electronic device set device 30 may further include input and reception units 152, 158, 252, and 258 of operation buttons for convenience of game operation.

Referring to FIG. 21, the method of manufacturing the input assistance device 100 is described. The method of manufacturing the input assistant device 100 may include the steps of making an electronic device cover (970) substantially identical to the size of the electronic device for input to the electronic device 100, a gesture input portion for inputting a gesture to the electronic device cover, A step 972 of deleting a code input unit for inputting the code, a step 972 of removing the gesture input unit and the code input unit from the cover 972, a gesture input unit capable of touch input with a material different from the cover material, (973), a touch input unit capable of touch input including a material different from the electronic device cover and the electronic device cover from which the gesture input unit and the code input unit are removed, and the code input unit capable of touch input (Step 974). The touch input unit capable of touch input and the code input unit capable of touch input of the input assistant device 100 are made of a rubber material or a sponge material including a silicone material, a rubber material, or a conductive material.

Claims (32)

  1. An input auxiliary device including a gesture input part for gesture input and a code input part for inputting a code; And
    And an electronic device including a gesture input receiving unit for receiving the gesture input and a code input receiving unit for receiving the code input.
  2. The electronic device set device according to claim 1, wherein the electronic device is a smart phone or a game machine or a remote controller or a calculator or a tablet PC.
  3. The electronic device setting apparatus according to claim 1, wherein the sign input unit includes a braille input unit for inputting braille characters.
  4. The electronic device setting apparatus according to claim 3, wherein the braille input unit is a rubber material or a sponge material including a silicone material, a rubber material, or a metal
  5. 2. The electronic device set-up device according to claim 1, wherein the sign input unit comprises a Hangul input unit for Hangul input, a numeral input unit for numeric input, or an English input unit for English input.
  6. 6. The electronic device setting apparatus according to claim 5, wherein the Hangul input unit, the numeral input unit, or the English input unit is a rubber material or a sponge material including a silicone material,
  7. The electronic device according to claim 1, wherein the electronic device further comprises a touch display unit including the gesture input receiving unit and the code input receiving unit, and a voice output unit for notifying the gesture input or the code input by voice. Set device
  8. The apparatus according to claim 1, wherein the gesture input selects an upper menu according to a horizontal direction gesture and selects a lower menu according to a vertical direction gesture.
  9. 9. The electronic device set-up device according to claim 8, wherein the upper menu is a message-related menu or a telephone-
  10. 10. The electronic device set device according to claim 9, wherein the submenu is a message transmission menu or a message storage menu in accordance with the upper message related menu selection.
  11. The electronic device according to claim 1, wherein the electronic device further comprises a braille / character conversion unit for converting the Braille input into Hangul or English or Japanese, or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi Device set device
  12. 12. The electronic device set-up device according to claim 11, wherein the braille / character conversion unit refers to the hash table to perform conversion
  13. 2. The electronic device setting apparatus according to claim 1, wherein the material of the gesture input unit and the material of the code input unit are the same.
  14. A gesture input unit for inputting a gesture; And
    And a code input unit for inputting a code,
    Wherein the gesture input unit and the code input unit are located at different positions.
  15. 15. The input assistance device of claim 14, wherein the input assistance device is a smartphone cover
  16. 15. The input auxiliary device according to claim 14, wherein the code input unit includes a braille input unit for inputting braille characters.
  17. 17. The input aid device according to claim 16, wherein the braille input unit is a rubber material or a sponge material including a silicone material button or a rubber material or metal.
  18. 15. The input auxiliary device according to claim 14, wherein the sign input unit comprises a Korean input unit for inputting Hangul or a numeric input unit for inputting numbers or an English input unit for inputting English.
  19. 19. The input auxiliary device according to claim 18, wherein the Hangul input unit, the numeral input unit or the English input unit is a rubber material or a sponge material including a silicone material or a rubber material or metal.
  20. And a braille input section including at least six braille input buttons or holes located at different positions for braille input.
  21. 21. The smartphone according to claim 20, further comprising a code input unit including at least one code input button or hole for code input,
  22. And a touch display unit including a gesture input receiving unit for receiving a gesture input and a code input receiving unit for receiving a code input, wherein the gesture input receiving unit and the code input receiving unit are located at different positions in the touch display unit Electronics
  23. 23. The electronic device according to claim 22, wherein the electronic device is a smart phone or a game machine or a remote control or a calculator or a Tablet PC
  24. 23. The electronic device according to claim 22, wherein the electronic device further comprises a voice output unit for voicing the gesture input and the code input.
  25. 23. The method of claim 22, wherein the gesture input selects an upper menu according to a horizontal direction gesture and selects a lower menu according to a vertical direction gesture.
  26. 26. The electronic device according to claim 25, wherein the upper menu includes a message-related menu or a telephone-related menu.
  27. 27. The electronic device according to claim 25, wherein, in accordance with the upper message related menu selection, the lower menu is a message transmission menu or a message storage menu
  28. 23. The electronic device according to claim 22, wherein the electronic device further comprises a braille / character conversion unit for converting the Braille input into Hangul or English or Japanese, or German or Chinese or Spanish or Portuguese or Russian or Hebrew or Hindi device
  29. 29. The electronic device of claim 28, wherein the braille / character conversion unit refers to the hash table
  30. And a motion sensor for selecting an upper menu according to a horizontal motion and selecting a lower menu according to a vertical motion,
  31. The electronic device according to claim 30, wherein the electronic device is a smart phone or a game machine or a remote control or a calculator or a tablet PC.
  32. 31. The electronic device according to claim 30, wherein the motion sensor selects the upper menu according to the vertical motion and selects the lower menu according to the horizontal motion.
KR1020167031030A 2014-04-24 2014-04-24 Electronic device set system including input-assisting deviced and electronic device for processing input using same KR20160148567A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2014/003624 WO2015163500A1 (en) 2014-04-24 2014-04-24 Electronic device set system including input-assisting device and electronic device for processing input using same

Publications (1)

Publication Number Publication Date
KR20160148567A true KR20160148567A (en) 2016-12-26

Family

ID=54332653

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020167031030A KR20160148567A (en) 2014-04-24 2014-04-24 Electronic device set system including input-assisting deviced and electronic device for processing input using same

Country Status (2)

Country Link
KR (1) KR20160148567A (en)
WO (1) WO2015163500A1 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2479506A1 (en) * 2002-03-20 2003-09-25 Visuaide Inc. Wireless handheld portable navigation system and method for visually impaired pedestrians
GB2477528B (en) * 2010-02-04 2014-01-15 Imagination Tech Ltd Touch sensitive screen for scrolling through sets of data
US20120081317A1 (en) * 2010-10-01 2012-04-05 Imerj LLC Method and system for performing copy-paste operations on a device via user gestures
CN105843574A (en) * 2011-02-10 2016-08-10 三星电子株式会社 Portable device comprising touch-screen display, and method for controlling same
KR101386218B1 (en) * 2012-05-24 2014-04-17 삼성디스플레이 주식회사 Dual display apparatus and driving method thereof

Also Published As

Publication number Publication date
WO2015163500A1 (en) 2015-10-29

Similar Documents

Publication Publication Date Title
US7016704B2 (en) Coordinating images displayed on devices with two or more displays
CN1245823C (en) Cellular telephone for accepting handwritten characters from back side
US9535906B2 (en) Mobile device having human language translation capability with positional feedback
JP5787375B2 (en) information processing apparatus, program, and information processing method
US7856603B2 (en) Graphical user interface
JP5635274B2 (en) Tactile sensation presentation apparatus and tactile sensation presentation method
AU780674B2 (en) Integrated keypad system
JP5204305B2 (en) User interface apparatus and method using pattern recognition in portable terminal
EP2336870B1 (en) Mobile terminal and controlling method thereof
CN102754052B (en) For the method and apparatus changing operational mode
EP2245612B1 (en) Device and method for providing tactile information
EP2718788B1 (en) Method and apparatus for providing character input interface
JP6245788B2 (en) Information input device
US7898527B1 (en) Systems, methods and devices for efficient communication utilizing a reduced number of selectable inputs
WO2009157241A1 (en) Input device
US7190351B1 (en) System and method for data input
JP5370374B2 (en) Information processing device
US20090036176A1 (en) Interface with and communication between mobile electronic devices
KR20080106265A (en) A system and method of inputting data into a computing system
US20140170611A1 (en) System and method for teaching pictographic languages
KR20120006503A (en) Improved text input
WO2002088920A1 (en) Touch-type key input apparatus
WO1998016889A1 (en) Character input apparatus and storage medium in which character input program is stored
US9448620B2 (en) Input method and apparatus of portable device for mapping segments of a hand to a plurality of keys
CN1628282A (en) Input device, mobile telephone, and mobile information device

Legal Events

Date Code Title Description
A201 Request for examination